[2025-08-25 16:26:46,907][ INFO][PID:2759723] Marking build as starting [2025-08-25 16:26:46,955][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:26:46,956][ INFO][PID:2759723] VM allocation process starts [2025-08-25 16:26:46,974][ INFO][PID:2759723] Trying to allocate VM: ResallocHost, ticket_id=4711215, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-08-25 16:26:51,980][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:26:53,010][ INFO][PID:2759723] Allocated host ResallocHost, ticket_id=4711215, hostname=140.211.168.89, name=copr_osuosl_p09_prod_06415291_20250825_154622, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-08-25 16:26:53,010][ INFO][PID:2759723] Allocating ssh connection to builder [2025-08-25 16:26:53,012][ INFO][PID:2759723] Checking that builder machine is OK [2025-08-25 16:26:54,040][ INFO][PID:2759723] Running remote command: copr-builder-ready fedora-42-ppc64le [2025-08-25 16:26:55,089][ INFO][PID:2759723] Red Hat subscription not needed for fedora-42-ppc64le Builder is ready to be used [2025-08-25 16:26:55,089][ INFO][PID:2759723] Filling build.info file with builder info [2025-08-25 16:26:55,090][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:26:55,092][ INFO][PID:2759723] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "python3-scipy-1.11.1", "project_dirname": "python3-scipy-1.11.1", "submitter": "https://src.fedoraproject.org/user/ankursinha", "ended_on": null, "started_on": 1756139215.092074, "submitted_on": null, "status": 3, "chroot": "fedora-42-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9484508-fedora-42-ppc64le", "build_id": 9484508, "package_name": "python-wxnatpy", "package_version": "0.4.0-18", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/python3-scipy-1.11.1/python-wxnatpy", "git_hash": "547482502dab6667ae1762f2ef5ebd934259ba50", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/python3-scipy-1.11.1--https://src.fedoraproject.org/user/ankursinha", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.11.1/fedora-42-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/python3-scipy-1.11.1", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.11.1", "result_dir": "09484508-python-wxnatpy", "built_packages": "", "id": 9484508, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "python3-scipy-1.11.1", "vendor": "Fedora Project COPR (psimovec/python3-scipy-1.11.1)" } } ] } [2025-08-25 16:26:55,160][ INFO][PID:2759723] Sending fedora-messaging bus message in build.start [2025-08-25 16:26:55,966][ INFO][PID:2759723] Sending fedora-messaging bus message in chroot.start [2025-08-25 16:26:55,993][ INFO][PID:2759723] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9484508-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached [2025-08-25 16:26:57,263][ INFO][PID:2759723] Downloading the builder-live.log file, attempt 1 [2025-08-25 16:26:57,264][ INFO][PID:2759723] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.89 copr-rpmbuild-log [2025-08-25 16:27:02,273][ INFO][PID:2759723] Periodic builder liveness probe: alive [2025-08-25 16:27:02,273][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:27:07,274][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:27:12,275][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:27:17,276][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:27:22,280][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:27:27,282][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:27:32,283][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:27:37,285][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:27:42,289][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:27:47,291][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:27:52,292][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:27:57,294][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:28:02,301][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:28:07,306][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:28:12,308][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:28:17,309][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:28:22,310][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:28:27,311][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:28:32,312][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:28:37,313][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:28:42,314][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:28:47,317][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:28:52,319][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:28:57,320][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:29:02,322][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:29:07,328][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:29:12,331][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:29:17,335][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:29:22,337][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:29:27,345][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:29:32,347][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:29:37,349][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:29:42,351][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:29:47,353][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:29:52,356][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:29:57,357][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:30:02,362][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:30:07,364][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:30:12,366][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:30:17,371][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:30:22,372][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:30:27,373][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:30:32,374][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:30:37,376][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:30:42,377][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:30:47,379][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:30:52,381][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:30:57,383][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:31:02,388][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:31:07,391][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:31:12,392][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:31:17,393][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:31:22,395][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:31:27,396][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:31:32,397][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:31:37,398][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:31:42,399][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:31:47,401][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:31:52,402][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:31:57,404][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:32:02,405][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:32:07,411][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:32:12,412][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:32:17,414][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:32:22,415][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:32:27,416][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:32:32,418][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:32:37,421][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:32:42,423][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:32:47,425][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:32:52,427][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:32:57,428][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:33:02,429][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:33:07,430][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:33:12,431][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:33:17,432][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:33:22,434][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:33:27,436][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:33:32,439][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:33:37,440][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:33:42,441][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:33:47,445][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:33:52,446][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:33:57,448][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:34:02,450][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:34:07,455][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:34:12,456][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:34:17,458][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:34:22,462][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:34:27,464][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:34:32,472][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:34:37,473][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:34:42,474][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:34:47,475][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:34:52,477][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:34:57,479][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:35:02,483][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:35:07,485][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:35:12,486][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:35:17,488][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:35:22,490][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:35:27,491][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:35:32,493][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:35:37,494][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:35:42,496][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:35:47,497][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:35:52,498][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:35:57,499][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:36:02,501][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:36:07,502][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:36:12,505][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:36:17,506][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:36:22,508][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:36:27,510][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:36:32,511][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:36:37,512][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:36:42,514][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:36:47,515][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:36:52,516][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:36:57,518][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:37:02,529][ INFO][PID:2759723] Periodic builder liveness probe: alive [2025-08-25 16:37:02,530][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:37:07,532][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:37:12,533][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:37:17,534][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:37:22,536][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:37:27,537][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:37:32,539][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:37:37,540][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:37:42,541][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:37:47,542][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:37:52,543][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:37:57,545][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:38:02,546][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:38:07,547][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:38:12,549][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:38:17,551][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:38:22,552][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:38:27,553][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:38:32,555][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:38:37,558][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:38:42,565][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:38:47,566][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:38:52,568][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:38:57,569][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:39:02,570][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:39:07,571][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:39:12,572][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:39:17,573][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:39:22,574][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:39:27,576][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:39:32,577][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:39:37,578][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:39:42,579][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:39:47,580][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:39:52,581][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:39:57,582][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:40:02,584][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:40:07,587][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:40:12,588][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:40:17,593][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:40:22,595][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:40:27,597][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:40:32,601][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:40:37,602][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:40:42,604][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:40:47,605][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:40:52,609][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:40:57,611][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:41:02,612][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:41:07,614][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:41:12,615][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:41:17,616][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:41:22,617][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:41:27,618][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:41:32,619][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:41:37,620][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:41:42,622][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:41:47,623][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:41:52,624][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:41:57,625][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:42:02,626][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:42:07,627][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:42:12,628][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:42:17,629][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:42:22,630][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:42:27,632][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:42:32,636][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:42:37,638][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:42:42,639][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:42:47,640][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:42:52,641][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:42:57,642][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:43:02,643][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:43:07,644][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:43:12,646][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:43:17,647][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:43:22,648][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:43:27,649][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:43:32,650][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:43:37,651][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:43:42,652][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:43:47,654][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:43:52,655][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:43:57,656][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:44:02,657][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:44:07,658][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:44:12,659][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:44:17,660][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:44:22,661][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:44:27,663][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:44:32,663][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:44:37,665][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:44:42,666][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:44:47,667][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:44:52,668][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:44:57,669][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:45:02,670][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:45:07,671][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:45:12,673][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:45:17,674][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:45:22,675][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:45:27,676][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:45:32,677][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:45:37,678][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:45:42,679][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:45:47,680][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:45:52,681][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:45:57,682][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:46:02,684][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:46:07,685][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:46:12,686][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:46:17,688][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:46:22,689][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:46:27,690][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:46:32,691][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:46:37,692][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:46:42,693][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:46:47,695][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:46:52,696][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:46:57,697][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:47:02,708][ INFO][PID:2759723] Periodic builder liveness probe: alive [2025-08-25 16:47:02,708][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:47:07,709][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:47:12,711][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:47:17,712][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:47:22,713][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:47:27,716][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:47:32,717][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:47:37,718][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:47:42,720][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:47:47,721][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:47:52,723][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:47:57,724][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:48:02,725][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:48:07,726][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:48:12,728][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:48:17,729][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:48:22,732][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:48:27,733][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:48:32,735][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:48:37,748][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:48:42,750][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:48:47,751][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:48:52,753][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:48:57,754][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:49:02,755][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:49:07,756][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:49:12,757][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:49:17,759][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:49:22,762][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:49:27,763][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:49:32,764][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:49:37,765][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:49:42,766][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:49:47,768][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:49:52,769][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:49:57,770][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:50:02,772][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:50:07,773][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:50:12,776][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:50:17,778][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:50:22,779][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:50:27,780][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:50:32,781][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:50:37,783][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:50:42,785][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:50:47,786][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:50:52,787][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:50:57,789][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:51:02,791][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:51:07,793][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:51:12,796][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:51:17,798][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:51:22,799][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:51:27,801][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:51:32,802][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:51:37,804][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:51:42,805][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:51:47,806][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:51:52,808][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:51:57,811][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:52:02,812][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:52:07,813][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:52:12,817][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:52:17,818][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:52:22,821][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:52:27,823][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:52:32,825][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:52:37,834][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:52:42,835][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:52:47,839][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:52:52,841][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:52:57,843][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:53:02,848][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:53:07,849][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:53:12,855][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:53:17,856][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:53:22,858][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:53:27,863][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:53:28,139][ ERROR][PID:2759723] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-08-25 16:53:32,864][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:53:37,866][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:53:38,140][WARNING][PID:2759723] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-08-25 16:53:42,869][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:53:47,870][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:53:48,143][ INFO][PID:2759723] Downloading the builder-live.log file, attempt 2 [2025-08-25 16:53:48,145][ INFO][PID:2759723] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.89 copr-rpmbuild-log [2025-08-25 16:53:52,871][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:53:57,873][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:54:02,876][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:54:07,877][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:54:12,879][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:54:17,882][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:54:22,886][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:54:27,888][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:54:32,890][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:54:37,895][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:54:42,899][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:54:47,901][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:54:48,215][ ERROR][PID:2759723] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-08-25 16:54:52,903][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:54:57,905][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:54:58,218][WARNING][PID:2759723] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-08-25 16:55:02,912][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:55:07,913][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:55:08,224][ INFO][PID:2759723] Downloading the builder-live.log file, attempt 3 [2025-08-25 16:55:08,226][ INFO][PID:2759723] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.89 copr-rpmbuild-log [2025-08-25 16:55:12,917][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:55:17,921][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:55:22,923][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:55:27,924][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:55:32,927][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:55:37,929][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:55:42,930][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:55:47,931][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:55:52,933][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:55:57,935][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:56:02,936][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:56:07,939][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:56:08,295][ ERROR][PID:2759723] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-08-25 16:56:12,940][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:56:17,942][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:56:18,299][WARNING][PID:2759723] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-08-25 16:56:22,943][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:56:27,944][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:56:28,300][ INFO][PID:2759723] Downloading the builder-live.log file, attempt 4 [2025-08-25 16:56:28,301][ INFO][PID:2759723] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.89 copr-rpmbuild-log [2025-08-25 16:56:32,945][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:56:37,946][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:56:42,948][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:56:47,950][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:56:52,953][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:56:57,955][ INFO][PID:2759723] Checking for cancel request [2025-08-25 16:57:02,962][ INFO][PID:2759723] Periodic builder liveness probe: dead [2025-08-25 16:57:28,370][ ERROR][PID:2759723] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-08-25 16:57:38,377][ ERROR][PID:2759723] Giving up for unstable SSH, failures: 1756140818.1409278, 1756140898.2187014, 1756140978.2993298, 1756141058.3767712 [2025-08-25 16:58:03,033][ ERROR][PID:2759723] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.89 port 22: Connection timed out [2025-08-25 16:59:13,102][ ERROR][PID:2759723] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.89 port 22: Connection timed out [2025-08-25 17:00:23,172][ ERROR][PID:2759723] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.89 port 22: Connection timed out [2025-08-25 17:01:33,245][ ERROR][PID:2759723] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.89 port 22: Connection timed out [2025-08-25 17:01:43,246][ ERROR][PID:2759723] Can't ssh to cancel build. [2025-08-25 17:01:43,246][ ERROR][PID:2759723] Re-try request for task on 'ResallocHost, ticket_id=4711215, hostname=140.211.168.89, name=copr_osuosl_p09_prod_06415291_20250825_154622, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED [2025-08-25 17:01:43,247][ INFO][PID:2759723] Releasing VM back to pool [2025-08-25 17:01:43,261][ INFO][PID:2759723] Retry #1 (on other host) [2025-08-25 17:01:43,262][ INFO][PID:2759723] Checking for cancel request [2025-08-25 17:01:43,262][ INFO][PID:2759723] VM allocation process starts [2025-08-25 17:01:43,274][ INFO][PID:2759723] Trying to allocate VM: ResallocHost, ticket_id=4711796, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-08-25 17:01:46,289][ INFO][PID:2759723] Allocated host ResallocHost, ticket_id=4711796, hostname=2620:52:3:1:dead:beef:cafe:c20d, name=copr_hv_ppc64le_01_prod_06416710_20250825_163735, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-08-25 17:01:46,290][ INFO][PID:2759723] Allocating ssh connection to builder [2025-08-25 17:01:46,290][ INFO][PID:2759723] Checking that builder machine is OK [2025-08-25 17:01:46,988][ INFO][PID:2759723] Running remote command: copr-builder-ready fedora-42-ppc64le [2025-08-25 17:01:47,350][ INFO][PID:2759723] Red Hat subscription not needed for fedora-42-ppc64le Builder is ready to be used [2025-08-25 17:01:47,351][ INFO][PID:2759723] Filling build.info file with builder info [2025-08-25 17:01:47,358][ INFO][PID:2759723] Checking for cancel request [2025-08-25 17:01:47,359][ INFO][PID:2759723] Not re-notifying FE and msg buses for the new host. [2025-08-25 17:01:47,359][ INFO][PID:2759723] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9484508-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached [2025-08-25 17:01:47,974][ INFO][PID:2759723] Downloading the builder-live.log file, attempt 1 [2025-08-25 17:01:47,975][ INFO][PID:2759723] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c20d copr-rpmbuild-log [2025-08-25 17:01:56,848][ INFO][PID:2759723] Cancel request succeeded out: success err: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c20d' (ED25519) to the list of known hosts. [2025-08-25 17:01:56,849][ INFO][PID:2759723] Downloading results from builder [2025-08-25 17:01:56,850][ INFO][PID:2759723] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c20d]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/python3-scipy-1.11.1/fedora-42-ppc64le/09484508-python-wxnatpy started [2025-08-25 17:01:56,850][ INFO][PID:2759723] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c20d]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/python3-scipy-1.11.1/fedora-42-ppc64le/09484508-python-wxnatpy/ &> /var/lib/copr/public_html/results/psimovec/python3-scipy-1.11.1/fedora-42-ppc64le/09484508-python-wxnatpy/build-09484508.rsync.log [2025-08-25 17:01:57,268][ INFO][PID:2759723] rsyncing finished. [2025-08-25 17:01:57,268][ INFO][PID:2759723] Releasing VM back to pool [2025-08-25 17:01:57,282][ INFO][PID:2759723] Searching for 'success' file in resultdir [2025-08-25 17:01:57,282][ ERROR][PID:2759723] Build failed: Backend process error: No success file => build failure [2025-08-25 17:01:57,283][ INFO][PID:2759723] Finished build: id=9484508 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/python3-scipy-1.11.1 chroot=fedora-42-ppc64le [2025-08-25 17:01:57,285][ ERROR][PID:2759723] Backend process error: No success file => build failure [2025-08-25 17:01:57,285][ INFO][PID:2759723] Worker failed build, took 9.926508665084839 [2025-08-25 17:01:57,286][ INFO][PID:2759723] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "python3-scipy-1.11.1", "project_dirname": "python3-scipy-1.11.1", "submitter": "https://src.fedoraproject.org/user/ankursinha", "ended_on": 1756141317.2855587, "started_on": 1756141307.35905, "submitted_on": null, "status": 0, "chroot": "fedora-42-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9484508-fedora-42-ppc64le", "build_id": 9484508, "package_name": "python-wxnatpy", "package_version": "0.4.0-18", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/python3-scipy-1.11.1/python-wxnatpy", "git_hash": "547482502dab6667ae1762f2ef5ebd934259ba50", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/python3-scipy-1.11.1--https://src.fedoraproject.org/user/ankursinha", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.11.1/fedora-42-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/python3-scipy-1.11.1", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.11.1", "result_dir": "09484508-python-wxnatpy", "built_packages": "", "id": 9484508, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "python3-scipy-1.11.1", "vendor": "Fedora Project COPR (psimovec/python3-scipy-1.11.1)" } } ] } [2025-08-25 17:01:57,357][ INFO][PID:2759723] Sending fedora-messaging bus message in build.end [2025-08-25 17:01:57,383][ INFO][PID:2759723] Compressing /var/lib/copr/public_html/results/psimovec/python3-scipy-1.11.1/fedora-42-ppc64le/09484508-python-wxnatpy/builder-live.log by gzip [2025-08-25 17:01:57,385][ INFO][PID:2759723] Running command 'gzip /var/lib/copr/public_html/results/psimovec/python3-scipy-1.11.1/fedora-42-ppc64le/09484508-python-wxnatpy/builder-live.log' as PID 3026184 [2025-08-25 17:01:57,386][ INFO][PID:2759723] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/python3-scipy-1.11.1/fedora-42-ppc64le/09484508-python-wxnatpy/builder-live.log) [2025-08-25 17:01:57,387][ INFO][PID:2759723] Compressing /var/lib/copr/public_html/results/psimovec/python3-scipy-1.11.1/fedora-42-ppc64le/09484508-python-wxnatpy/backend.log by gzip [2025-08-25 17:01:57,388][ INFO][PID:2759723] Running command 'gzip /var/lib/copr/public_html/results/psimovec/python3-scipy-1.11.1/fedora-42-ppc64le/09484508-python-wxnatpy/backend.log' as PID 3026188