[2025-09-02 22:23:55,583][ INFO][PID:2320483] Marking build as starting [2025-09-02 22:23:56,171][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:23:56,172][ INFO][PID:2320483] VM allocation process starts [2025-09-02 22:23:56,186][ INFO][PID:2320483] Trying to allocate VM: ResallocHost, ticket_id=4882063, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-09-02 22:24:01,188][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:24:06,190][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:24:08,282][ INFO][PID:2320483] Allocated host ResallocHost, ticket_id=4882063, hostname=140.211.168.83, name=copr_osuosl_p09_prod_06542151_20250902_143237, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-09-02 22:24:08,282][ INFO][PID:2320483] Allocating ssh connection to builder [2025-09-02 22:24:08,285][ INFO][PID:2320483] Checking that builder machine is OK [2025-09-02 22:24:10,111][ INFO][PID:2320483] Running remote command: copr-builder-ready fedora-42-ppc64le [2025-09-02 22:24:11,120][ INFO][PID:2320483] Red Hat subscription not needed for fedora-42-ppc64le Builder is ready to be used [2025-09-02 22:24:11,121][ INFO][PID:2320483] Filling build.info file with builder info [2025-09-02 22:24:11,127][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:24:11,128][ INFO][PID:2320483] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "python3-scipy-1.10.1", "project_dirname": "python3-scipy-1.10.1", "submitter": "https://src.fedoraproject.org/user/music", "ended_on": null, "started_on": 1756851851.128183, "submitted_on": null, "status": 3, "chroot": "fedora-42-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9516861-fedora-42-ppc64le", "build_id": 9516861, "package_name": "python-trimesh", "package_version": "4.8.1-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/python3-scipy-1.10.1/python-trimesh", "git_hash": "e082601b676871dcfcbb728e7b84653fcad0e738", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/python3-scipy-1.10.1--https://src.fedoraproject.org/user/music", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.10.1/fedora-42-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.10.1", "result_dir": "09516861-python-trimesh", "built_packages": "", "id": 9516861, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "python3-scipy-1.10.1", "vendor": "Fedora Project COPR (psimovec/python3-scipy-1.10.1)" } } ] } [2025-09-02 22:24:11,231][ INFO][PID:2320483] Sending fedora-messaging bus message in build.start [2025-09-02 22:24:12,025][ INFO][PID:2320483] Sending fedora-messaging bus message in chroot.start [2025-09-02 22:24:12,056][ INFO][PID:2320483] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9516861-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached [2025-09-02 22:24:13,320][ INFO][PID:2320483] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '140.211.168.83' (ED25519) to the list of known hosts. [2025-09-02 22:24:13,321][ INFO][PID:2320483] Downloading the builder-live.log file, attempt 1 [2025-09-02 22:24:13,323][ INFO][PID:2320483] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.83 copr-rpmbuild-log [2025-09-02 22:24:18,332][ INFO][PID:2320483] Periodic builder liveness probe: alive [2025-09-02 22:24:18,333][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:24:23,334][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:24:28,335][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:24:33,337][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:24:38,338][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:24:43,339][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:24:48,342][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:24:53,343][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:24:58,348][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:25:03,350][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:25:08,350][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:25:13,351][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:25:18,353][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:25:23,354][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:25:28,359][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:25:33,361][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:25:38,363][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:25:43,364][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:25:48,365][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:25:53,366][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:25:58,368][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:26:03,369][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:26:08,371][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:26:13,372][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:26:18,376][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:26:23,377][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:26:28,379][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:26:33,380][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:26:38,381][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:26:43,382][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:26:48,383][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:26:53,384][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:26:58,385][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:27:03,386][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:27:08,387][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:27:13,388][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:27:18,389][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:27:23,390][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:27:28,391][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:27:33,392][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:27:38,393][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:27:43,394][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:27:48,395][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:27:53,397][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:27:58,398][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:28:03,399][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:28:08,400][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:28:13,401][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:28:18,402][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:28:23,403][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:28:28,404][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:28:33,405][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:28:38,406][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:28:43,407][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:28:48,408][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:28:53,409][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:28:58,410][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:29:03,411][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:29:08,412][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:29:13,413][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:29:18,414][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:29:23,415][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:29:28,416][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:29:33,418][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:29:38,419][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:29:43,420][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:29:48,421][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:29:53,422][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:29:58,423][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:30:03,431][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:30:08,432][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:30:13,433][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:30:18,434][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:30:23,435][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:30:28,437][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:30:33,438][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:30:38,441][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:30:43,443][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:30:48,444][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:30:53,445][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:30:58,446][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:31:03,448][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:31:08,450][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:31:13,451][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:31:18,452][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:31:23,453][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:31:28,454][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:31:33,455][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:31:38,457][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:31:43,458][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:31:48,459][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:31:53,460][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:31:58,461][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:32:03,462][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:32:08,464][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:32:13,465][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:32:18,467][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:32:23,469][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:32:28,470][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:32:33,472][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:32:38,473][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:32:43,474][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:32:48,475][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:32:53,476][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:32:58,477][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:33:03,480][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:33:08,483][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:33:13,484][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:33:18,485][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:33:23,486][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:33:28,487][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:33:33,488][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:33:38,489][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:33:43,493][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:33:48,494][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:33:53,495][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:33:58,497][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:34:03,498][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:34:08,499][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:34:13,502][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:34:18,548][ INFO][PID:2320483] Periodic builder liveness probe: alive [2025-09-02 22:34:18,549][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:34:23,559][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:34:28,561][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:34:33,563][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:34:38,567][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:34:43,569][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:34:48,579][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:34:53,580][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:34:58,585][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:35:03,588][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:35:08,591][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:35:13,595][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:35:18,596][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:35:23,601][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:35:28,605][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:35:33,606][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:35:38,611][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:35:43,614][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:35:48,646][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:35:53,671][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:35:58,672][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:36:03,673][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:36:08,678][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:36:13,679][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:36:18,681][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:36:23,682][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:36:28,687][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:36:33,691][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:36:38,692][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:36:43,694][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:36:48,700][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:36:53,701][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:36:58,707][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:37:03,715][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:37:08,720][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:37:13,721][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:37:18,728][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:37:23,732][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:37:28,733][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:37:33,735][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:37:38,736][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:37:43,739][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:37:48,740][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:37:53,744][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:37:58,745][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:38:03,746][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:38:08,753][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:38:13,754][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:38:18,758][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:38:23,762][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:38:28,763][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:38:33,764][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:38:38,765][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:38:43,767][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:38:48,769][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:38:53,770][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:38:58,770][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:39:03,771][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:39:08,773][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:39:13,774][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:39:18,775][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:39:23,777][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:39:28,778][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:39:33,779][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:39:38,780][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:39:43,782][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:39:48,783][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:39:53,784][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:39:58,785][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:40:03,786][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:40:08,787][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:40:13,789][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:40:18,790][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:40:23,791][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:40:28,792][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:40:33,793][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:40:38,794][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:40:43,795][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:40:48,797][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:40:53,798][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:40:58,799][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:41:03,800][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:41:08,801][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:41:13,802][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:41:18,803][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:41:23,804][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:41:28,806][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:41:33,807][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:41:38,808][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:41:43,809][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:41:48,810][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:41:53,812][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:41:58,812][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:42:03,814][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:42:08,814][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:42:13,816][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:42:18,817][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:42:23,818][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:42:28,819][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:42:33,819][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:42:38,820][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:42:43,821][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:42:48,822][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:42:53,823][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:42:58,824][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:43:03,825][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:43:08,826][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:43:13,827][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:43:18,828][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:43:23,829][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:43:28,830][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:43:33,831][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:43:38,832][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:43:43,833][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:43:48,833][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:43:53,834][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:43:58,835][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:44:03,837][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:44:08,837][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:44:13,838][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:44:18,844][ INFO][PID:2320483] Periodic builder liveness probe: alive [2025-09-02 22:44:18,845][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:44:23,846][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:44:28,847][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:44:33,848][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:44:38,848][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:44:43,849][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:44:48,851][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:44:53,852][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:44:58,853][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:45:03,854][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:45:08,855][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:45:13,856][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:45:18,857][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:45:23,858][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:45:28,858][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:45:33,859][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:45:38,860][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:45:43,861][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:45:48,862][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:45:53,863][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:45:58,864][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:46:03,865][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:46:08,866][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:46:13,867][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:46:18,868][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:46:23,869][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:46:28,870][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:46:33,871][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:46:38,872][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:46:43,873][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:46:48,874][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:46:53,875][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:46:58,876][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:47:03,877][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:47:08,878][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:47:13,879][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:47:18,880][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:47:23,881][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:47:28,881][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:47:33,882][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:47:38,883][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:47:43,884][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:47:48,885][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:47:53,887][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:47:58,888][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:48:03,889][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:48:08,890][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:48:13,891][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:48:18,892][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:48:23,893][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:48:28,894][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:48:33,894][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:48:38,895][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:48:43,896][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:48:48,897][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:48:53,898][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:48:58,899][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:49:03,901][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:49:08,902][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:49:13,903][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:49:18,904][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:49:23,905][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:49:28,906][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:49:33,907][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:49:38,908][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:49:43,909][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:49:48,910][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:49:53,911][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:49:58,912][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:50:03,913][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:50:08,914][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:50:13,915][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:50:18,916][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:50:23,917][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:50:28,918][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:50:33,919][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:50:38,920][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:50:43,921][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:50:48,921][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:50:53,922][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:50:58,923][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:51:03,924][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:51:08,925][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:51:13,926][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:51:18,927][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:51:23,928][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:51:28,929][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:51:33,930][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:51:38,931][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:51:43,932][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:51:48,933][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:51:53,934][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:51:58,935][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:52:03,936][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:52:08,937][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:52:13,938][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:52:18,939][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:52:23,940][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:52:28,941][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:52:33,942][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:52:38,943][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:52:43,944][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:52:48,946][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:52:53,947][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:52:58,948][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:53:03,949][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:53:08,950][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:53:13,952][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:53:18,956][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:53:23,957][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:53:28,958][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:53:33,959][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:53:38,960][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:53:43,961][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:53:48,962][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:53:53,963][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:53:58,964][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:54:03,966][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:54:08,967][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:54:13,968][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:54:19,020][ INFO][PID:2320483] Periodic builder liveness probe: dead [2025-09-02 22:54:19,020][ INFO][PID:2320483] calling cancel callback, and waiting [2025-09-02 22:55:19,091][ ERROR][PID:2320483] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.83 port 22: Connection timed out [2025-09-02 22:55:27,139][ ERROR][PID:2320483] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-09-02 22:55:37,140][WARNING][PID:2320483] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-09-02 22:55:47,141][ INFO][PID:2320483] Downloading the builder-live.log file, attempt 2 [2025-09-02 22:55:47,144][ INFO][PID:2320483] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.83 copr-rpmbuild-log [2025-09-02 22:56:29,160][ ERROR][PID:2320483] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.83 port 22: Connection timed out [2025-09-02 22:56:47,195][ ERROR][PID:2320483] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-09-02 22:56:57,200][WARNING][PID:2320483] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-09-02 22:57:07,200][ INFO][PID:2320483] Downloading the builder-live.log file, attempt 3 [2025-09-02 22:57:07,201][ INFO][PID:2320483] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.83 copr-rpmbuild-log [2025-09-02 22:57:39,228][ ERROR][PID:2320483] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.83 port 22: Connection timed out [2025-09-02 22:58:07,263][ ERROR][PID:2320483] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-09-02 22:58:17,266][WARNING][PID:2320483] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-09-02 22:58:27,267][ INFO][PID:2320483] Downloading the builder-live.log file, attempt 4 [2025-09-02 22:58:27,268][ INFO][PID:2320483] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.83 copr-rpmbuild-log [2025-09-02 22:58:49,297][ ERROR][PID:2320483] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.83 port 22: Connection timed out [2025-09-02 22:58:59,298][ ERROR][PID:2320483] Can't ssh to cancel build. [2025-09-02 22:59:27,336][ ERROR][PID:2320483] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-09-02 22:59:37,339][ ERROR][PID:2320483] Giving up for unstable SSH, failures: 1756853737.1407075, 1756853817.200102, 1756853897.2667317, 1756853977.3391268 [2025-09-02 22:59:37,340][ ERROR][PID:2320483] Re-try request for task on 'ResallocHost, ticket_id=4882063, hostname=140.211.168.83, name=copr_osuosl_p09_prod_06542151_20250902_143237, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED [2025-09-02 22:59:37,340][ INFO][PID:2320483] Releasing VM back to pool [2025-09-02 22:59:37,349][ INFO][PID:2320483] Retry #1 (on other host) [2025-09-02 22:59:37,350][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:59:37,350][ INFO][PID:2320483] VM allocation process starts [2025-09-02 22:59:37,398][ INFO][PID:2320483] Trying to allocate VM: ResallocHost, ticket_id=4882401, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-09-02 22:59:40,442][ INFO][PID:2320483] Allocated host ResallocHost, ticket_id=4882401, hostname=2620:52:3:1:dead:beef:cafe:c254, name=copr_hv_ppc64le_02_prod_06547915_20250902_223840, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-09-02 22:59:40,442][ INFO][PID:2320483] Allocating ssh connection to builder [2025-09-02 22:59:40,443][ INFO][PID:2320483] Checking that builder machine is OK [2025-09-02 22:59:41,173][ INFO][PID:2320483] Running remote command: copr-builder-ready fedora-42-ppc64le [2025-09-02 22:59:41,539][ INFO][PID:2320483] Red Hat subscription not needed for fedora-42-ppc64le Builder is ready to be used [2025-09-02 22:59:41,540][ INFO][PID:2320483] Filling build.info file with builder info [2025-09-02 22:59:41,543][ INFO][PID:2320483] Checking for cancel request [2025-09-02 22:59:41,544][ INFO][PID:2320483] Not re-notifying FE and msg buses for the new host. [2025-09-02 22:59:41,544][ INFO][PID:2320483] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9516861-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached [2025-09-02 22:59:42,165][ INFO][PID:2320483] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c254' (ED25519) to the list of known hosts. [2025-09-02 22:59:42,168][ INFO][PID:2320483] Downloading the builder-live.log file, attempt 1 [2025-09-02 22:59:42,170][ INFO][PID:2320483] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c254 copr-rpmbuild-log [2025-09-02 22:59:47,169][ INFO][PID:2320483] calling cancel callback, and waiting [2025-09-02 22:59:50,914][ INFO][PID:2320483] Cancel request succeeded out: success err: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c254' (ED25519) to the list of known hosts. [2025-09-02 22:59:50,914][ INFO][PID:2320483] Downloading results from builder [2025-09-02 22:59:50,915][ INFO][PID:2320483] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c254]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-42-ppc64le/09516861-python-trimesh started [2025-09-02 22:59:50,916][ INFO][PID:2320483] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c254]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-42-ppc64le/09516861-python-trimesh/ &> /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-42-ppc64le/09516861-python-trimesh/build-09516861.rsync.log [2025-09-02 22:59:51,348][ INFO][PID:2320483] rsyncing finished. [2025-09-02 22:59:51,349][ INFO][PID:2320483] Releasing VM back to pool [2025-09-02 22:59:51,359][ INFO][PID:2320483] Searching for 'success' file in resultdir [2025-09-02 22:59:51,360][ ERROR][PID:2320483] Build failed: Backend process error: No success file => build failure [2025-09-02 22:59:51,360][ INFO][PID:2320483] Finished build: id=9516861 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1 chroot=fedora-42-ppc64le [2025-09-02 22:59:51,362][ ERROR][PID:2320483] Backend process error: No success file => build failure [2025-09-02 22:59:51,363][ INFO][PID:2320483] Worker failed build, took 9.81859827041626 [2025-09-02 22:59:51,363][ INFO][PID:2320483] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "python3-scipy-1.10.1", "project_dirname": "python3-scipy-1.10.1", "submitter": "https://src.fedoraproject.org/user/music", "ended_on": 1756853991.3629725, "started_on": 1756853981.5443742, "submitted_on": null, "status": 0, "chroot": "fedora-42-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9516861-fedora-42-ppc64le", "build_id": 9516861, "package_name": "python-trimesh", "package_version": "4.8.1-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/python3-scipy-1.10.1/python-trimesh", "git_hash": "e082601b676871dcfcbb728e7b84653fcad0e738", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/python3-scipy-1.10.1--https://src.fedoraproject.org/user/music", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.10.1/fedora-42-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.10.1", "result_dir": "09516861-python-trimesh", "built_packages": "", "id": 9516861, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "python3-scipy-1.10.1", "vendor": "Fedora Project COPR (psimovec/python3-scipy-1.10.1)" } } ] } [2025-09-02 22:59:51,435][ INFO][PID:2320483] Sending fedora-messaging bus message in build.end [2025-09-02 22:59:51,460][ INFO][PID:2320483] Compressing /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-42-ppc64le/09516861-python-trimesh/builder-live.log by gzip [2025-09-02 22:59:51,461][ INFO][PID:2320483] Running command 'gzip /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-42-ppc64le/09516861-python-trimesh/builder-live.log' as PID 2545077 [2025-09-02 22:59:51,463][ INFO][PID:2320483] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-42-ppc64le/09516861-python-trimesh/builder-live.log) [2025-09-02 22:59:51,463][ INFO][PID:2320483] Compressing /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-42-ppc64le/09516861-python-trimesh/backend.log by gzip [2025-09-02 22:59:51,464][ INFO][PID:2320483] Running command 'gzip /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-42-ppc64le/09516861-python-trimesh/backend.log' as PID 2545078