[2025-09-09 11:09:50,908][ INFO][PID:1687775] Marking build as starting [2025-09-09 11:09:51,007][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:09:51,008][ INFO][PID:1687775] VM allocation process starts [2025-09-09 11:09:51,123][ INFO][PID:1687775] Trying to allocate VM: ResallocHost, ticket_id=4978894, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-09-09 11:09:56,128][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:10:01,130][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:10:06,131][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:10:09,237][ INFO][PID:1687775] Allocated host ResallocHost, ticket_id=4978894, hostname=140.211.168.5, name=copr_osuosl_p09_prod_06678968_20250909_105012, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-09-09 11:10:09,238][ INFO][PID:1687775] Allocating ssh connection to builder [2025-09-09 11:10:09,238][ INFO][PID:1687775] Checking that builder machine is OK [2025-09-09 11:10:10,523][ INFO][PID:1687775] Running remote command: copr-builder-ready fedora-43-ppc64le [2025-09-09 11:10:11,571][ INFO][PID:1687775] Red Hat subscription not needed for fedora-43-ppc64le Builder is ready to be used [2025-09-09 11:10:11,572][ INFO][PID:1687775] Filling build.info file with builder info [2025-09-09 11:10:11,573][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:10:11,579][ INFO][PID:1687775] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "scipy-1.8.3", "project_dirname": "scipy-1.8.3", "submitter": "https://src.fedoraproject.org/user/ankursinha", "ended_on": null, "started_on": 1757416211.578893, "submitted_on": null, "status": 3, "chroot": "fedora-43-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9538945-fedora-43-ppc64le", "build_id": 9538945, "package_name": "python-pyedflib", "package_version": "0.1.42-4", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/scipy-1.8.3/python-pyedflib", "git_hash": "d99953102e055a0650d5ee154da363a729ce1445", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/scipy-1.8.3--https://src.fedoraproject.org/user/ankursinha", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/scipy-1.8.3/fedora-43-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/scipy-1.8.3", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/scipy-1.8.3", "result_dir": "09538945-python-pyedflib", "built_packages": "", "id": 9538945, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "scipy-1.8.3", "vendor": "Fedora Project COPR (psimovec/scipy-1.8.3)" } } ] } [2025-09-09 11:10:11,662][ INFO][PID:1687775] Sending fedora-messaging bus message in build.start [2025-09-09 11:10:13,518][ INFO][PID:1687775] Sending fedora-messaging bus message in chroot.start [2025-09-09 11:10:13,641][ INFO][PID:1687775] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9538945-fedora-43-ppc64le --chroot fedora-43-ppc64le --detached [2025-09-09 11:10:14,959][ INFO][PID:1687775] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '140.211.168.5' (ED25519) to the list of known hosts. [2025-09-09 11:10:15,027][ INFO][PID:1687775] Downloading the builder-live.log file, attempt 1 [2025-09-09 11:10:15,032][ INFO][PID:1687775] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.5 copr-rpmbuild-log [2025-09-09 11:10:20,050][ INFO][PID:1687775] Periodic builder liveness probe: alive [2025-09-09 11:10:20,094][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:10:25,115][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:10:30,178][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:10:35,216][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:10:40,361][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:10:45,655][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:10:50,739][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:10:55,843][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:11:00,985][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:11:06,004][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:11:11,040][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:11:16,073][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:11:21,083][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:11:26,099][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:11:31,104][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:11:36,106][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:11:41,224][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:11:46,302][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:11:51,307][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:11:56,379][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:12:01,492][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:12:06,653][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:12:11,949][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:12:17,001][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:12:22,025][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:12:27,105][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:12:32,120][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:12:37,140][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:12:42,148][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:12:47,167][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:12:52,185][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:12:57,344][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:13:02,460][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:13:07,515][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:13:12,643][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:13:17,754][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:13:22,812][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:13:27,898][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:13:32,935][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:13:37,982][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:13:42,996][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:13:48,193][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:13:53,284][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:13:58,363][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:14:03,415][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:14:08,438][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:14:13,446][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:14:18,562][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:14:23,588][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:14:28,607][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:14:33,641][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:14:38,663][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:14:43,763][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:14:48,820][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:14:53,831][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:14:58,912][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:15:04,152][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:15:09,286][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:15:14,457][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:15:19,539][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:15:24,551][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:15:29,639][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:15:34,724][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:15:39,900][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:15:44,934][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:15:49,997][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:15:55,015][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:16:00,025][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:16:05,037][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:16:10,052][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:16:15,200][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:16:20,231][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:16:25,296][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:16:30,318][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:16:35,422][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:16:40,553][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:16:45,656][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:16:50,677][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:16:55,758][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:17:00,844][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:17:05,963][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:17:11,123][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:17:16,416][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:17:21,536][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:17:26,552][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:17:31,570][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:17:36,639][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:17:41,747][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:17:46,838][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:17:51,912][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:17:56,933][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:18:01,935][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:18:06,940][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:18:12,040][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:18:17,086][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:18:22,205][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:18:27,437][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:18:32,475][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:18:37,482][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:18:42,502][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:18:47,538][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:18:52,552][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:18:57,591][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:19:02,645][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:19:07,701][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:19:12,852][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:19:17,988][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:19:23,046][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:19:28,107][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:19:33,132][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:19:38,208][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:19:43,237][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:19:48,240][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:19:53,271][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:19:58,274][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:20:03,340][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:20:08,414][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:20:13,522][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:20:18,586][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:20:23,685][ INFO][PID:1687775] Periodic builder liveness probe: alive [2025-09-09 11:20:23,686][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:20:28,687][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:20:33,826][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:20:38,973][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:20:44,115][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:20:49,146][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:20:54,231][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:20:59,344][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:21:04,389][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:21:09,494][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:21:14,515][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:21:19,535][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:21:24,600][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:21:29,835][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:21:34,864][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:21:39,876][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:21:44,994][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:21:50,061][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:21:55,237][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:22:00,335][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:22:05,391][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:22:10,415][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:22:15,463][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:22:20,498][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:22:25,500][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:22:30,501][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:22:35,558][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:22:40,626][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:22:45,657][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:22:50,758][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:22:55,860][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:23:00,896][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:23:05,998][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:23:11,028][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:23:16,236][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:23:21,386][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:23:26,404][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:23:31,409][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:23:36,412][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:23:41,437][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:23:46,485][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:23:51,563][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:23:56,574][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:24:01,610][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:24:06,679][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:24:11,765][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:24:16,852][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:24:21,900][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:24:26,940][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:24:32,160][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:24:37,221][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:24:42,339][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:24:47,453][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:24:52,681][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:24:57,748][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:25:02,833][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:25:07,845][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:25:12,932][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:25:18,029][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:25:23,043][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:25:28,179][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:25:33,277][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:25:38,327][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:25:43,403][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:25:48,444][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:25:53,519][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:25:58,603][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:26:03,692][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:26:09,280][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:26:14,308][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:26:19,319][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:26:24,329][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:26:29,529][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:26:34,654][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:26:39,821][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:26:44,918][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:26:49,937][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:26:55,075][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:27:00,136][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:27:05,317][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:27:10,321][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:27:15,325][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:27:20,364][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:27:25,401][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:27:30,410][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:27:35,455][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:27:40,581][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:27:45,596][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:27:50,652][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:27:55,824][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:28:00,872][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:28:05,905][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:28:11,078][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:28:16,089][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:28:21,113][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:28:26,208][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:28:31,234][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:28:36,350][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:28:41,424][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:28:46,448][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:28:51,472][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:28:56,693][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:29:01,736][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:29:06,770][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:29:11,844][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:29:17,068][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:29:22,338][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:29:27,409][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:29:32,427][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:29:37,455][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:29:42,501][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:29:47,508][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:29:52,541][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:29:57,547][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:30:02,695][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:30:07,707][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:30:12,727][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:30:17,740][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:30:22,768][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:30:27,964][ INFO][PID:1687775] Periodic builder liveness probe: alive [2025-09-09 11:30:28,042][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:30:33,051][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:30:38,112][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:30:43,142][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:30:48,290][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:30:53,536][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:30:58,590][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:31:03,644][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:31:08,682][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:31:13,716][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:31:18,744][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:31:23,777][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:31:28,904][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:31:33,917][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:31:38,961][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:31:43,966][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:31:49,014][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:31:54,072][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:31:59,076][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:32:04,178][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:32:09,371][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:32:14,756][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:32:19,955][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:32:25,161][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:32:30,255][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:32:35,419][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:32:40,651][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:32:45,817][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:32:51,065][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:32:56,330][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:33:01,669][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:33:19,111][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:33:24,112][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:33:29,113][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:33:38,171][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:33:46,698][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:33:52,452][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:34:00,977][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:34:08,119][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:34:13,408][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:34:18,481][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:34:23,550][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:34:28,571][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:34:33,644][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:34:38,701][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:34:43,725][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:34:48,733][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:34:53,945][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:34:58,964][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:35:03,983][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:35:09,054][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:35:14,167][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:35:19,292][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:35:24,558][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:35:29,622][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:35:34,654][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:35:39,957][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:35:45,102][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:35:50,173][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:35:55,422][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:36:00,481][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:36:05,582][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:36:10,672][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:36:15,674][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:36:20,676][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:36:25,684][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:36:30,780][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:36:35,900][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:36:40,941][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:36:45,957][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:36:50,970][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:36:55,984][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:37:01,046][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:37:06,179][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:37:11,247][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:37:16,280][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:37:21,306][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:37:26,519][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:37:31,534][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:37:36,631][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:37:41,654][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:37:46,837][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:37:51,887][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:37:56,989][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:38:01,994][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:38:07,137][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:38:12,234][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:38:17,264][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:38:22,290][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:38:27,375][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:38:32,410][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:38:37,424][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:38:42,501][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:38:47,562][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:38:52,573][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:38:57,723][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:39:02,813][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:39:07,887][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:39:12,954][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:39:17,997][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:39:23,006][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:39:28,024][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:39:33,109][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:39:38,136][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:39:43,142][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:39:48,174][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:39:53,230][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:39:58,236][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:40:03,248][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:40:08,262][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:40:13,288][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:40:18,401][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:40:23,489][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:40:28,619][ INFO][PID:1687775] Periodic builder liveness probe: dead [2025-09-09 11:40:28,621][ INFO][PID:1687775] calling cancel callback, and waiting [2025-09-09 11:41:28,748][ ERROR][PID:1687775] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.5 port 22: Connection timed out [2025-09-09 11:41:55,220][ ERROR][PID:1687775] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-09-09 11:42:05,221][WARNING][PID:1687775] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-09-09 11:42:15,222][ INFO][PID:1687775] Downloading the builder-live.log file, attempt 2 [2025-09-09 11:42:15,223][ INFO][PID:1687775] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.5 copr-rpmbuild-log [2025-09-09 11:42:38,818][ ERROR][PID:1687775] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.5 port 22: Connection timed out [2025-09-09 11:43:15,294][ ERROR][PID:1687775] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-09-09 11:43:25,299][WARNING][PID:1687775] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-09-09 11:43:35,303][ INFO][PID:1687775] Downloading the builder-live.log file, attempt 3 [2025-09-09 11:43:35,304][ INFO][PID:1687775] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.5 copr-rpmbuild-log [2025-09-09 11:43:48,891][ ERROR][PID:1687775] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.5 port 22: Connection timed out [2025-09-09 11:44:35,375][ ERROR][PID:1687775] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-09-09 11:44:45,382][WARNING][PID:1687775] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-09-09 11:44:55,383][ INFO][PID:1687775] Downloading the builder-live.log file, attempt 4 [2025-09-09 11:44:55,385][ INFO][PID:1687775] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.5 copr-rpmbuild-log [2025-09-09 11:44:58,964][ ERROR][PID:1687775] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.5 port 22: Connection timed out [2025-09-09 11:45:08,964][ ERROR][PID:1687775] Can't ssh to cancel build. [2025-09-09 11:45:55,454][ ERROR][PID:1687775] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-09-09 11:46:05,456][ ERROR][PID:1687775] Giving up for unstable SSH, failures: 1757418125.2212915, 1757418205.2995024, 1757418285.3822944, 1757418365.4562204 [2025-09-09 11:46:05,458][ ERROR][PID:1687775] Re-try request for task on 'ResallocHost, ticket_id=4978894, hostname=140.211.168.5, name=copr_osuosl_p09_prod_06678968_20250909_105012, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED [2025-09-09 11:46:05,459][ INFO][PID:1687775] Releasing VM back to pool [2025-09-09 11:46:05,480][ INFO][PID:1687775] Retry #1 (on other host) [2025-09-09 11:46:05,499][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:46:05,502][ INFO][PID:1687775] VM allocation process starts [2025-09-09 11:46:05,538][ INFO][PID:1687775] Trying to allocate VM: ResallocHost, ticket_id=4980140, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-09-09 11:46:10,540][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:46:11,595][ INFO][PID:1687775] Allocated host ResallocHost, ticket_id=4980140, hostname=2620:52:3:1:dead:beef:cafe:c2a1, name=copr_p09_01_prod_06679749_20250909_114003, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-09-09 11:46:11,595][ INFO][PID:1687775] Allocating ssh connection to builder [2025-09-09 11:46:11,596][ INFO][PID:1687775] Checking that builder machine is OK [2025-09-09 11:46:12,366][ INFO][PID:1687775] Running remote command: copr-builder-ready fedora-43-ppc64le [2025-09-09 11:46:12,824][ INFO][PID:1687775] Red Hat subscription not needed for fedora-43-ppc64le Builder is ready to be used [2025-09-09 11:46:12,825][ INFO][PID:1687775] Filling build.info file with builder info [2025-09-09 11:46:12,826][ INFO][PID:1687775] Checking for cancel request [2025-09-09 11:46:12,827][ INFO][PID:1687775] Not re-notifying FE and msg buses for the new host. [2025-09-09 11:46:12,827][ INFO][PID:1687775] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9538945-fedora-43-ppc64le --chroot fedora-43-ppc64le --detached [2025-09-09 11:46:13,659][ INFO][PID:1687775] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c2a1' (ED25519) to the list of known hosts. [2025-09-09 11:46:13,660][ INFO][PID:1687775] Downloading the builder-live.log file, attempt 1 [2025-09-09 11:46:13,662][ INFO][PID:1687775] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c2a1 copr-rpmbuild-log [2025-09-09 11:46:18,661][ INFO][PID:1687775] calling cancel callback, and waiting [2025-09-09 11:46:22,372][ INFO][PID:1687775] Cancel request succeeded out: success err: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c2a1' (ED25519) to the list of known hosts. [2025-09-09 11:46:22,374][ INFO][PID:1687775] Downloading results from builder [2025-09-09 11:46:22,376][ INFO][PID:1687775] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c2a1]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-43-ppc64le/09538945-python-pyedflib started [2025-09-09 11:46:22,379][ INFO][PID:1687775] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c2a1]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-43-ppc64le/09538945-python-pyedflib/ &> /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-43-ppc64le/09538945-python-pyedflib/build-09538945.rsync.log [2025-09-09 11:46:22,862][ INFO][PID:1687775] rsyncing finished. [2025-09-09 11:46:22,863][ INFO][PID:1687775] Releasing VM back to pool [2025-09-09 11:46:22,876][ INFO][PID:1687775] Searching for 'success' file in resultdir [2025-09-09 11:46:22,876][ ERROR][PID:1687775] Build failed: Backend process error: No success file => build failure [2025-09-09 11:46:22,877][ INFO][PID:1687775] Finished build: id=9538945 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/scipy-1.8.3 chroot=fedora-43-ppc64le [2025-09-09 11:46:22,879][ ERROR][PID:1687775] Backend process error: No success file => build failure [2025-09-09 11:46:22,880][ INFO][PID:1687775] Worker failed build, took 10.052608251571655 [2025-09-09 11:46:22,880][ INFO][PID:1687775] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "scipy-1.8.3", "project_dirname": "scipy-1.8.3", "submitter": "https://src.fedoraproject.org/user/ankursinha", "ended_on": 1757418382.8800793, "started_on": 1757418372.827471, "submitted_on": null, "status": 0, "chroot": "fedora-43-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9538945-fedora-43-ppc64le", "build_id": 9538945, "package_name": "python-pyedflib", "package_version": "0.1.42-4", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/scipy-1.8.3/python-pyedflib", "git_hash": "d99953102e055a0650d5ee154da363a729ce1445", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/scipy-1.8.3--https://src.fedoraproject.org/user/ankursinha", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/scipy-1.8.3/fedora-43-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/scipy-1.8.3", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/scipy-1.8.3", "result_dir": "09538945-python-pyedflib", "built_packages": "", "id": 9538945, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "scipy-1.8.3", "vendor": "Fedora Project COPR (psimovec/scipy-1.8.3)" } } ] } [2025-09-09 11:46:22,936][ INFO][PID:1687775] Sending fedora-messaging bus message in build.end [2025-09-09 11:46:22,972][ INFO][PID:1687775] Compressing /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-43-ppc64le/09538945-python-pyedflib/builder-live.log by gzip [2025-09-09 11:46:22,974][ INFO][PID:1687775] Running command 'gzip /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-43-ppc64le/09538945-python-pyedflib/builder-live.log' as PID 2021994 [2025-09-09 11:46:22,980][ INFO][PID:1687775] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-43-ppc64le/09538945-python-pyedflib/builder-live.log) [2025-09-09 11:46:22,981][ INFO][PID:1687775] Compressing /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-43-ppc64le/09538945-python-pyedflib/backend.log by gzip [2025-09-09 11:46:22,983][ INFO][PID:1687775] Running command 'gzip /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-43-ppc64le/09538945-python-pyedflib/backend.log' as PID 2021998