[2025-12-17 08:17:38,438][ INFO][PID:2085327] Marking build as starting [2025-12-17 08:17:38,624][ INFO][PID:2085327] Checking that /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/repodata/repomd.xml exists [2025-12-17 08:17:38,650][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:17:38,654][ INFO][PID:2085327] VM allocation process starts [2025-12-17 08:17:38,702][ INFO][PID:2085327] Trying to allocate VM: ResallocHost, ticket_id=383305, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-12-17 08:17:43,716][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:17:44,743][ INFO][PID:2085327] Allocated host ResallocHost, ticket_id=383305, hostname=2620:52:6:1161:dead:beef:cafe:c152, name=vmhost_p09_03_prod_00631500_20251217_074353, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-12-17 08:17:44,744][ INFO][PID:2085327] Allocating ssh connection to builder [2025-12-17 08:17:44,744][ INFO][PID:2085327] Checking that builder machine is OK [2025-12-17 08:18:44,813][ ERROR][PID:2085327] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c152 port 22: Connection timed out [2025-12-17 08:18:54,814][ ERROR][PID:2085327] Re-try request for task on 'ResallocHost, ticket_id=383305, hostname=2620:52:6:1161:dead:beef:cafe:c152, name=vmhost_p09_03_prod_00631500_20251217_074353, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': Unable to finish after 1 SSH attempts [2025-12-17 08:18:54,814][ INFO][PID:2085327] Releasing VM back to pool [2025-12-17 08:18:54,845][ INFO][PID:2085327] Retry #1 (on other host) [2025-12-17 08:18:54,845][ INFO][PID:2085327] Checking that /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/repodata/repomd.xml exists [2025-12-17 08:18:54,846][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:18:54,846][ INFO][PID:2085327] VM allocation process starts [2025-12-17 08:18:54,911][ INFO][PID:2085327] Trying to allocate VM: ResallocHost, ticket_id=383363, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-12-17 08:18:57,938][ INFO][PID:2085327] Allocated host ResallocHost, ticket_id=383363, hostname=2620:52:6:1161:dead:beef:cafe:c189, name=vmhost_p09_04_prod_00631581_20251217_075123, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-12-17 08:18:57,939][ INFO][PID:2085327] Allocating ssh connection to builder [2025-12-17 08:18:57,939][ INFO][PID:2085327] Checking that builder machine is OK [2025-12-17 08:18:58,913][ INFO][PID:2085327] Running remote command: copr-builder-ready fedora-eln-ppc64le [2025-12-17 08:18:59,454][ INFO][PID:2085327] Red Hat subscription not needed for fedora-eln-ppc64le Builder is ready to be used [2025-12-17 08:18:59,455][ INFO][PID:2085327] Filling build.info file with builder info [2025-12-17 08:18:59,455][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:18:59,456][ INFO][PID:2085327] Not re-notifying FE and msg buses for the new host. [2025-12-17 08:18:59,457][ INFO][PID:2085327] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9917978-fedora-eln-ppc64le --chroot fedora-eln-ppc64le --detached [2025-12-17 08:19:00,427][ INFO][PID:2085327] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c189' (ED25519) to the list of known hosts. [2025-12-17 08:19:00,428][ INFO][PID:2085327] Downloading the builder-live.log file, attempt 1 [2025-12-17 08:19:00,429][ INFO][PID:2085327] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c189 copr-rpmbuild-log [2025-12-17 08:19:05,433][ INFO][PID:2085327] Periodic builder liveness probe: alive [2025-12-17 08:19:05,434][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:19:10,435][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:19:15,436][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:19:20,437][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:19:25,438][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:19:30,439][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:19:35,440][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:19:40,443][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:19:45,444][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:19:50,446][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:19:55,447][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:20:00,448][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:20:05,450][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:20:10,458][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:20:15,459][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:20:20,460][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:20:25,462][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:20:30,463][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:20:35,464][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:20:40,465][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:20:45,466][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:20:50,467][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:20:55,468][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:21:00,469][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:21:05,484][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:21:10,485][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:21:15,487][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:21:20,489][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:21:25,490][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:21:30,491][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:21:35,492][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:21:40,493][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:21:45,494][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:21:50,495][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:21:55,496][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:22:00,497][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:22:05,499][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:22:10,503][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:22:15,507][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:22:20,509][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:22:25,510][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:22:30,554][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:22:35,566][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:22:40,567][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:22:45,568][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:22:50,571][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:22:55,575][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:23:00,576][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:23:05,578][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:23:10,603][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:23:15,607][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:23:20,612][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:23:25,639][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:23:30,650][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:23:35,653][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:23:40,654][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:23:45,700][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:23:50,702][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:23:55,768][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:24:00,816][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:24:05,824][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:24:10,855][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:24:15,863][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:24:21,112][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:24:26,255][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:24:31,269][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:24:36,276][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:24:41,277][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:24:46,743][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:24:51,748][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:24:56,754][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:25:01,761][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:25:06,822][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:25:11,824][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:25:16,825][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:25:21,875][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:25:26,951][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:25:31,966][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:25:37,078][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:25:42,093][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:25:47,173][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:25:52,262][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:25:57,263][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:26:02,338][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:26:07,343][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:26:12,352][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:26:17,354][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:26:22,497][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:26:27,579][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:26:32,688][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:26:37,937][ INFO][PID:2085327] Checking for cancel request [2025-12-17 08:26:38,115][ INFO][PID:2085327] calling cancel callback, and waiting [2025-12-17 08:26:42,169][ INFO][PID:2085327] Cancel request succeeded out: success err: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c189' (ED25519) to the list of known hosts. [2025-12-17 08:26:42,176][ ERROR][PID:2085327] Build was canceled [2025-12-17 08:26:42,178][ INFO][PID:2085327] Releasing VM back to pool [2025-12-17 08:26:42,224][WARNING][PID:2085327] Switching not-finished job state to 'failed' [2025-12-17 08:26:42,226][ INFO][PID:2085327] Worker failed build, took 462.7605233192444 [2025-12-17 08:26:42,236][ INFO][PID:2085327] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "rhcontainerbot", "project_name": "bootc", "project_dirname": "bootc", "submitter": "packit", "ended_on": 1765960002.2171733, "started_on": 1765959539.45665, "submitted_on": null, "status": 0, "chroot": "fedora-eln-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9917978-fedora-eln-ppc64le", "build_id": 9917978, "package_name": "bootc", "package_version": "202512170813.gf6b7ec8009-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rhcontainerbot/bootc/bootc", "git_hash": "001dd16c6883701e0f759d1bd1d4232187573747", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rhcontainerbot/bootc--packit", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/fedora-eln-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://kojipkgs.fedoraproject.org/repos/eln-build/latest/$basearch/", "id": "https_kojipkgs_fedoraproject_org_repos_eln_build_latest_basearch", "name": "Additional repo https_kojipkgs_fedoraproject_org_repos_eln_build_latest_basearch" } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rhcontainerbot/bootc", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc", "result_dir": "09917978-bootc", "built_packages": "", "id": 9917978, "mockchain_macros": { "copr_username": "rhcontainerbot", "copr_projectname": "bootc", "vendor": "Fedora Project COPR (rhcontainerbot/bootc)" } } ] } [2025-12-17 08:26:43,517][ INFO][PID:2085327] Sending fedora-messaging bus message in build.end [2025-12-17 08:26:53,554][ INFO][PID:2085327] Compressing /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/09917978-bootc/builder-live.log by gzip [2025-12-17 08:26:53,564][ INFO][PID:2085327] Running command 'gzip /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/09917978-bootc/builder-live.log' as PID 2141013 [2025-12-17 08:26:53,838][ INFO][PID:2085327] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/09917978-bootc/builder-live.log) [2025-12-17 08:26:53,839][ INFO][PID:2085327] Compressing /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/09917978-bootc/backend.log by gzip [2025-12-17 08:26:53,841][ INFO][PID:2085327] Running command 'gzip /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/09917978-bootc/backend.log' as PID 2141015