[2025-09-10 14:06:53,802][ INFO][PID:1905534] Marking build as starting [2025-09-10 14:06:53,884][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:06:53,885][ INFO][PID:1905534] VM allocation process starts [2025-09-10 14:06:53,954][ INFO][PID:1905534] Trying to allocate VM: ResallocHost, ticket_id=4998825, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-09-10 14:06:58,972][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:06:59,995][ INFO][PID:1905534] Allocated host ResallocHost, ticket_id=4998825, hostname=140.211.168.189, name=copr_osuosl_p09_prod_06703737_20250910_135637, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-09-10 14:06:59,996][ INFO][PID:1905534] Allocating ssh connection to builder [2025-09-10 14:06:59,997][ INFO][PID:1905534] Checking that builder machine is OK [2025-09-10 14:07:01,364][ INFO][PID:1905534] Running remote command: copr-builder-ready centos-stream-10-ppc64le [2025-09-10 14:07:02,344][ INFO][PID:1905534] Red Hat subscription not needed for centos-stream-10-ppc64le Builder is ready to be used [2025-09-10 14:07:02,344][ INFO][PID:1905534] Filling build.info file with builder info [2025-09-10 14:07:02,345][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:07:02,346][ INFO][PID:1905534] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@yggdrasil", "project_name": "latest", "project_dirname": "latest", "submitter": "packit", "ended_on": null, "started_on": 1757513222.346096, "submitted_on": null, "status": 3, "chroot": "centos-stream-10-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9543382-centos-stream-10-ppc64le", "build_id": 9543382, "package_name": "rhc", "package_version": "1:0.3.4-99.20250910gitf3db768.fc42", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@yggdrasil/latest/rhc", "git_hash": "27d7f38ab4b7853fc0f201071e8694a69169dd12", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@yggdrasil/latest--packit", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@yggdrasil/latest/centos-stream-10-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@yggdrasil/latest/centos-stream-10-ppc64le/", "id": "copr_yggdrasil_latest", "name": "Additional repo copr_yggdrasil_latest" } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@yggdrasil/latest", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@yggdrasil/latest", "result_dir": "09543382-rhc", "built_packages": "", "id": 9543382, "mockchain_macros": { "copr_username": "@yggdrasil", "copr_projectname": "latest", "vendor": "Fedora Project COPR (@yggdrasil/latest)" } } ] } [2025-09-10 14:07:02,457][ INFO][PID:1905534] Sending fedora-messaging bus message in build.start [2025-09-10 14:07:03,383][ INFO][PID:1905534] Sending fedora-messaging bus message in chroot.start [2025-09-10 14:07:03,416][ INFO][PID:1905534] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9543382-centos-stream-10-ppc64le --chroot centos-stream-10-ppc64le --detached [2025-09-10 14:07:04,635][ INFO][PID:1905534] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '140.211.168.189' (ED25519) to the list of known hosts. [2025-09-10 14:07:04,636][ INFO][PID:1905534] Downloading the builder-live.log file, attempt 1 [2025-09-10 14:07:04,638][ INFO][PID:1905534] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.189 copr-rpmbuild-log [2025-09-10 14:07:09,645][ INFO][PID:1905534] Periodic builder liveness probe: alive [2025-09-10 14:07:09,646][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:07:14,647][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:07:19,648][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:07:24,649][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:07:29,651][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:07:34,652][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:07:39,654][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:07:44,655][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:07:49,657][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:07:54,659][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:07:59,662][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:08:04,739][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:08:09,740][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:08:14,772][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:08:19,788][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:08:24,865][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:08:29,981][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:08:34,990][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:08:40,214][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:08:45,275][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:08:50,366][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:08:55,409][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:09:00,430][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:09:05,575][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:09:10,628][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:09:15,695][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:09:20,735][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:09:25,842][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:09:30,929][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:09:36,007][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:09:41,087][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:09:46,143][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:09:51,207][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:09:56,283][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:10:01,409][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:10:06,412][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:10:11,561][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:10:16,588][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:10:21,599][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:10:26,708][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:10:31,821][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:10:36,859][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:10:41,863][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:10:46,897][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:10:51,948][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:10:57,014][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:11:02,043][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:11:07,047][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:11:12,070][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:11:17,129][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:11:22,167][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:11:27,182][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:11:32,281][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:11:37,386][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:11:42,405][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:11:47,422][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:11:52,491][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:11:57,607][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:12:02,610][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:12:07,741][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:12:12,858][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:12:17,988][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:12:23,073][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:12:28,176][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:12:33,232][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:12:38,402][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:12:43,621][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:12:48,683][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:12:53,721][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:12:58,850][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:13:03,908][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:13:08,914][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:13:13,986][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:13:19,005][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:13:24,143][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:13:29,164][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:13:34,227][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:13:39,298][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:13:44,406][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:13:49,473][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:13:54,559][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:13:59,721][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:14:04,735][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:14:09,823][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:14:14,863][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:14:19,916][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:14:24,982][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:14:30,076][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:14:35,086][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:14:40,192][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:14:45,232][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:14:50,244][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:14:55,290][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:15:00,337][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:15:05,389][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:15:10,457][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:15:15,515][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:15:20,739][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:15:25,746][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:15:30,751][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:15:35,787][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:15:40,800][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:15:45,890][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:15:50,939][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:15:56,010][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:16:01,042][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:16:06,106][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:16:11,218][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:16:16,300][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:16:21,358][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:16:26,479][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:16:31,550][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:16:36,643][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:16:41,719][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:16:46,787][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:16:51,827][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:16:56,966][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:17:02,070][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:17:07,078][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:17:12,214][ INFO][PID:1905534] Periodic builder liveness probe: alive [2025-09-10 14:17:12,326][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:17:17,336][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:17:22,340][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:17:27,376][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:17:32,469][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:17:37,501][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:17:42,512][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:17:47,547][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:17:52,590][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:17:57,598][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:18:02,620][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:18:07,649][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:18:12,759][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:18:17,798][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:18:22,865][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:18:27,971][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:18:32,995][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:18:38,064][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:18:43,099][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:18:48,160][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:18:53,314][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:18:58,353][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:19:03,374][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:19:08,390][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:19:13,462][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:19:18,535][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:19:23,541][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:19:28,618][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:19:33,634][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:19:38,711][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:19:43,721][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:19:48,771][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:19:53,890][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:19:58,900][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:20:03,984][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:20:09,089][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:20:14,176][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:20:19,213][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:20:24,329][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:20:29,397][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:20:34,418][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:20:39,503][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:20:44,570][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:20:49,616][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:20:54,621][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:20:59,739][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:21:04,813][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:21:09,881][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:21:15,006][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:21:20,036][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:21:25,296][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:21:30,300][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:21:35,381][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:21:40,388][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:21:45,446][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:21:50,821][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:21:55,823][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:22:00,824][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:22:06,167][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:22:11,175][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:22:16,176][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:22:21,367][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:22:26,369][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:22:31,370][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:22:36,372][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:22:41,373][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:22:46,375][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:22:51,523][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:22:56,524][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:23:02,097][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:23:07,113][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:23:12,118][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:23:17,119][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:23:22,122][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:23:27,123][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:23:32,125][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:23:37,126][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:23:42,285][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:23:47,286][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:23:52,401][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:23:57,403][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:24:02,412][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:24:07,413][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:24:12,950][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:24:17,953][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:24:22,955][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:24:27,956][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:24:32,958][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:24:37,959][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:24:42,960][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:24:47,968][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:24:52,969][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:24:58,191][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:25:03,195][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:25:08,197][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:25:13,199][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:25:18,407][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:25:23,408][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:25:28,410][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:25:33,550][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:25:38,693][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:25:43,699][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:25:48,728][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:25:53,734][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:25:58,735][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:26:04,061][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:26:09,087][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:26:14,090][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:26:19,091][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:26:24,093][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:26:29,098][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:26:34,107][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:26:39,109][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:26:44,260][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:26:49,265][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:26:54,268][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:27:00,361][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:27:05,377][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:27:10,378][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:27:15,398][ INFO][PID:1905534] Periodic builder liveness probe: alive [2025-09-10 14:27:39,942][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:27:44,943][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:27:49,947][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:27:55,565][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:28:00,568][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:28:05,846][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:28:10,849][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:28:15,853][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:28:20,859][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:28:25,860][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:28:30,862][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:28:35,864][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:28:40,865][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:28:46,001][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:28:51,014][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:28:56,017][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:29:01,018][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:29:06,379][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:29:11,473][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:29:26,038][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:29:31,047][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:29:36,189][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:29:41,193][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:29:46,335][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:29:51,614][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:29:56,741][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:30:02,136][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:30:07,145][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:30:27,958][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:30:32,186][ ERROR][PID:1905534] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-09-10 14:30:32,960][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:30:37,961][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:30:42,187][WARNING][PID:1905534] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-09-10 14:30:42,962][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:30:47,963][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:30:52,188][ INFO][PID:1905534] Downloading the builder-live.log file, attempt 2 [2025-09-10 14:30:52,189][ INFO][PID:1905534] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.189 copr-rpmbuild-log [2025-09-10 14:30:52,964][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:30:57,965][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:31:02,966][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:31:07,968][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:31:12,969][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:31:46,464][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:31:51,466][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:31:52,905][ ERROR][PID:1905534] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-09-10 14:31:56,468][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:32:01,470][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:32:02,909][WARNING][PID:1905534] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-09-10 14:32:06,471][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:32:11,473][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:32:12,910][ INFO][PID:1905534] Downloading the builder-live.log file, attempt 3 [2025-09-10 14:32:12,912][ INFO][PID:1905534] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.189 copr-rpmbuild-log [2025-09-10 14:32:16,475][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:32:21,477][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:32:36,454][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:32:41,456][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:32:46,457][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:32:51,458][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:33:01,240][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:33:06,242][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:33:11,244][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:33:12,981][ ERROR][PID:1905534] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-09-10 14:33:16,246][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:33:21,248][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:33:22,984][WARNING][PID:1905534] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-09-10 14:33:26,251][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:33:31,252][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:33:32,984][ INFO][PID:1905534] Downloading the builder-live.log file, attempt 4 [2025-09-10 14:33:32,986][ INFO][PID:1905534] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.189 copr-rpmbuild-log [2025-09-10 14:33:36,253][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:33:41,254][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:33:46,256][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:33:51,258][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:33:56,259][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:34:01,260][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:34:06,261][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:34:11,262][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:34:16,263][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:34:21,265][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:34:26,266][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:34:33,054][ ERROR][PID:1905534] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-09-10 14:34:50,192][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:34:55,193][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:34:55,420][ ERROR][PID:1905534] Giving up for unstable SSH, failures: 1757514642.1873171, 1757514722.909345, 1757514802.9841197, 1757514895.420643 [2025-09-10 14:34:55,422][ ERROR][PID:1905534] Re-try request for task on 'ResallocHost, ticket_id=4998825, hostname=140.211.168.189, name=copr_osuosl_p09_prod_06703737_20250910_135637, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-09-10 14:34:55,422][ INFO][PID:1905534] Releasing VM back to pool [2025-09-10 14:34:55,437][ INFO][PID:1905534] Retry #1 (on other host) [2025-09-10 14:34:55,447][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:34:55,448][ INFO][PID:1905534] VM allocation process starts [2025-09-10 14:34:55,465][ INFO][PID:1905534] Trying to allocate VM: ResallocHost, ticket_id=4999266, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-09-10 14:35:00,467][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:35:01,499][ INFO][PID:1905534] Allocated host ResallocHost, ticket_id=4999266, hostname=140.211.168.171, name=copr_osuosl_p09_prod_06705094_20250910_142801, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-09-10 14:35:01,500][ INFO][PID:1905534] Allocating ssh connection to builder [2025-09-10 14:35:01,500][ INFO][PID:1905534] Checking that builder machine is OK [2025-09-10 14:35:02,972][ INFO][PID:1905534] Running remote command: copr-builder-ready centos-stream-10-ppc64le [2025-09-10 14:35:03,958][ INFO][PID:1905534] Red Hat subscription not needed for centos-stream-10-ppc64le Builder is ready to be used [2025-09-10 14:35:03,959][ INFO][PID:1905534] Filling build.info file with builder info [2025-09-10 14:35:03,994][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:35:03,995][ INFO][PID:1905534] Not re-notifying FE and msg buses for the new host. [2025-09-10 14:35:03,996][ INFO][PID:1905534] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9543382-centos-stream-10-ppc64le --chroot centos-stream-10-ppc64le --detached [2025-09-10 14:35:05,273][ INFO][PID:1905534] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '140.211.168.171' (ED25519) to the list of known hosts. [2025-09-10 14:35:05,274][ INFO][PID:1905534] Downloading the builder-live.log file, attempt 1 [2025-09-10 14:35:05,275][ INFO][PID:1905534] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.171 copr-rpmbuild-log [2025-09-10 14:35:10,274][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:35:15,275][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:35:20,277][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:35:25,278][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:35:30,279][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:35:35,281][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:35:40,282][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:35:45,283][ INFO][PID:1905534] Checking for cancel request [2025-09-10 14:35:45,285][ INFO][PID:1905534] calling cancel callback, and waiting [2025-09-10 14:35:49,443][ INFO][PID:1905534] Cancel request succeeded out: success err: Warning: Permanently added '140.211.168.171' (ED25519) to the list of known hosts. [2025-09-10 14:35:49,446][ ERROR][PID:1905534] Build was canceled [2025-09-10 14:35:49,446][ INFO][PID:1905534] Releasing VM back to pool [2025-09-10 14:35:49,462][WARNING][PID:1905534] Switching not-finished job state to 'failed' [2025-09-10 14:35:49,462][ INFO][PID:1905534] Worker failed build, took 45.46672534942627 [2025-09-10 14:35:49,464][ INFO][PID:1905534] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@yggdrasil", "project_name": "latest", "project_dirname": "latest", "submitter": "packit", "ended_on": 1757514949.462246, "started_on": 1757514903.9955206, "submitted_on": null, "status": 0, "chroot": "centos-stream-10-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9543382-centos-stream-10-ppc64le", "build_id": 9543382, "package_name": "rhc", "package_version": "1:0.3.4-99.20250910gitf3db768.fc42", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@yggdrasil/latest/rhc", "git_hash": "27d7f38ab4b7853fc0f201071e8694a69169dd12", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@yggdrasil/latest--packit", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@yggdrasil/latest/centos-stream-10-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@yggdrasil/latest/centos-stream-10-ppc64le/", "id": "copr_yggdrasil_latest", "name": "Additional repo copr_yggdrasil_latest" } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@yggdrasil/latest", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@yggdrasil/latest", "result_dir": "09543382-rhc", "built_packages": "", "id": 9543382, "mockchain_macros": { "copr_username": "@yggdrasil", "copr_projectname": "latest", "vendor": "Fedora Project COPR (@yggdrasil/latest)" } } ] } [2025-09-10 14:35:49,518][ INFO][PID:1905534] Sending fedora-messaging bus message in build.end [2025-09-10 14:35:49,546][ INFO][PID:1905534] Compressing /var/lib/copr/public_html/results/@yggdrasil/latest/centos-stream-10-ppc64le/09543382-rhc/builder-live.log by gzip [2025-09-10 14:35:49,547][ INFO][PID:1905534] Running command 'gzip /var/lib/copr/public_html/results/@yggdrasil/latest/centos-stream-10-ppc64le/09543382-rhc/builder-live.log' as PID 2093775 [2025-09-10 14:35:49,551][ INFO][PID:1905534] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@yggdrasil/latest/centos-stream-10-ppc64le/09543382-rhc/builder-live.log) [2025-09-10 14:35:49,552][ INFO][PID:1905534] Compressing /var/lib/copr/public_html/results/@yggdrasil/latest/centos-stream-10-ppc64le/09543382-rhc/backend.log by gzip [2025-09-10 14:35:49,553][ INFO][PID:1905534] Running command 'gzip /var/lib/copr/public_html/results/@yggdrasil/latest/centos-stream-10-ppc64le/09543382-rhc/backend.log' as PID 2093777