[2025-12-22 15:36:24,936][ INFO][PID:3780104] Marking build as starting [2025-12-22 15:36:25,018][ INFO][PID:3780104] Checking that /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-ppc64le/repodata/repomd.xml exists [2025-12-22 15:36:25,019][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:36:25,020][ INFO][PID:3780104] VM allocation process starts [2025-12-22 15:36:25,030][ INFO][PID:3780104] Trying to allocate VM: ResallocHost, ticket_id=473644, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-12-22 15:36:28,041][ INFO][PID:3780104] Allocated host ResallocHost, ticket_id=473644, hostname=2620:52:6:1161:dead:beef:cafe:c18d, name=vmhost_p09_04_prod_00731796_20251222_152550, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-12-22 15:36:28,042][ INFO][PID:3780104] Allocating ssh connection to builder [2025-12-22 15:36:28,042][ INFO][PID:3780104] Checking that builder machine is OK [2025-12-22 15:37:28,069][ ERROR][PID:3780104] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c18d port 22: Connection timed out [2025-12-22 15:37:38,070][ ERROR][PID:3780104] Re-try request for task on 'ResallocHost, ticket_id=473644, hostname=2620:52:6:1161:dead:beef:cafe:c18d, name=vmhost_p09_04_prod_00731796_20251222_152550, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': Unable to finish after 1 SSH attempts [2025-12-22 15:37:38,070][ INFO][PID:3780104] Releasing VM back to pool [2025-12-22 15:37:38,078][ INFO][PID:3780104] Retry #1 (on other host) [2025-12-22 15:37:38,079][ INFO][PID:3780104] Checking that /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-ppc64le/repodata/repomd.xml exists [2025-12-22 15:37:38,079][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:37:38,080][ INFO][PID:3780104] VM allocation process starts [2025-12-22 15:37:38,116][ INFO][PID:3780104] Trying to allocate VM: ResallocHost, ticket_id=473651, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-12-22 15:37:41,146][ INFO][PID:3780104] Allocated host ResallocHost, ticket_id=473651, hostname=2620:52:6:1161:dead:beef:cafe:c149, name=vmhost_p09_03_prod_00731804_20251222_152817, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-12-22 15:37:41,147][ INFO][PID:3780104] Allocating ssh connection to builder [2025-12-22 15:37:41,147][ INFO][PID:3780104] Checking that builder machine is OK [2025-12-22 15:37:42,128][ INFO][PID:3780104] Running remote command: copr-builder-ready centos-stream-9-ppc64le [2025-12-22 15:37:42,642][ INFO][PID:3780104] Red Hat subscription not needed for centos-stream-9-ppc64le Builder is ready to be used [2025-12-22 15:37:42,643][ INFO][PID:3780104] Filling build.info file with builder info [2025-12-22 15:37:42,643][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:37:42,644][ INFO][PID:3780104] Not re-notifying FE and msg buses for the new host. [2025-12-22 15:37:42,644][ INFO][PID:3780104] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9941258-centos-stream-9-ppc64le --chroot centos-stream-9-ppc64le --detached [2025-12-22 15:37:43,576][ INFO][PID:3780104] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c149' (ED25519) to the list of known hosts. [2025-12-22 15:37:43,577][ INFO][PID:3780104] Downloading the builder-live.log file, attempt 1 [2025-12-22 15:37:43,669][ INFO][PID:3780104] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c149 copr-rpmbuild-log [2025-12-22 15:37:48,583][ INFO][PID:3780104] Periodic builder liveness probe: alive [2025-12-22 15:37:48,583][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:37:53,584][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:37:58,585][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:38:03,586][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:38:08,587][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:38:13,588][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:38:18,589][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:38:23,590][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:38:28,590][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:38:33,591][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:38:38,592][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:38:43,593][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:38:48,594][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:38:53,595][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:38:58,596][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:39:03,597][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:39:08,598][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:39:13,599][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:39:18,600][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:39:23,601][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:39:28,602][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:39:33,603][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:39:38,603][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:39:43,604][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:39:48,606][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:39:53,606][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:39:58,607][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:40:03,608][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:40:08,609][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:40:13,610][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:40:18,611][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:40:23,612][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:40:28,613][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:40:33,614][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:40:38,615][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:40:43,616][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:40:48,617][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:40:53,618][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:40:58,619][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:41:03,619][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:41:08,620][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:41:13,621][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:41:18,622][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:41:23,623][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:41:28,624][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:41:33,625][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:41:38,626][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:41:43,661][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:41:48,662][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:41:53,663][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:41:58,664][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:42:03,665][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:42:08,666][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:42:13,667][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:42:18,668][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:42:23,668][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:42:28,670][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:42:33,671][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:42:38,671][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:42:43,672][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:42:48,673][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:42:53,674][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:42:58,675][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:43:03,676][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:43:08,677][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:43:13,678][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:43:18,679][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:43:23,680][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:43:28,681][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:43:33,682][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:43:38,683][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:43:43,684][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:43:48,685][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:43:53,686][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:43:58,687][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:44:03,688][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:44:08,689][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:44:13,690][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:44:18,692][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:44:23,693][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:44:28,693][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:44:33,694][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:44:38,695][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:44:43,696][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:44:48,698][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:44:53,715][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:44:58,716][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:45:03,717][ INFO][PID:3780104] Checking for cancel request [2025-12-22 15:45:07,632][ INFO][PID:3780104] Downloading results from builder [2025-12-22 15:45:07,632][ INFO][PID:3780104] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c149]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-ppc64le/09941258-ramalama started [2025-12-22 15:45:07,633][ INFO][PID:3780104] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c149]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-ppc64le/09941258-ramalama/ &> /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-ppc64le/09941258-ramalama/build-09941258.rsync.log [2025-12-22 15:46:07,691][ INFO][PID:3780104] rsyncing finished. [2025-12-22 15:46:07,692][ ERROR][PID:3780104] Failed to download data from builder due to rsync error, see the rsync log file for details. [2025-12-22 15:46:07,692][ ERROR][PID:3780104] SSH connection lost on #1 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details. [2025-12-22 15:46:17,693][ INFO][PID:3780104] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c149]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-ppc64le/09941258-ramalama started [2025-12-22 15:46:17,694][ INFO][PID:3780104] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c149]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-ppc64le/09941258-ramalama/ &> /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-ppc64le/09941258-ramalama/build-09941258.rsync.log [2025-12-22 15:46:18,801][ INFO][PID:3780104] rsyncing finished. [2025-12-22 15:46:18,802][ INFO][PID:3780104] Releasing VM back to pool [2025-12-22 15:46:18,832][ INFO][PID:3780104] Searching for 'success' file in resultdir [2025-12-22 15:46:18,833][ ERROR][PID:3780104] Build failed: Backend process error: No success file => build failure [2025-12-22 15:46:18,834][ INFO][PID:3780104] Finished build: id=9941258 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/rhcontainerbot/podman-next chroot=centos-stream-9-ppc64le [2025-12-22 15:46:18,835][ ERROR][PID:3780104] Backend process error: No success file => build failure [2025-12-22 15:46:18,836][ INFO][PID:3780104] Worker failed build, took 516.1920926570892 [2025-12-22 15:46:18,837][ INFO][PID:3780104] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "rhcontainerbot", "project_name": "podman-next", "project_dirname": "podman-next", "submitter": "packit", "ended_on": 1766418378.8364022, "started_on": 1766417862.6443095, "submitted_on": null, "status": 0, "chroot": "centos-stream-9-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9941258-centos-stream-9-ppc64le", "build_id": 9941258, "package_name": "ramalama", "package_version": "0.16.0-1000.1.20251222144402560912.main.20.g5f985008", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rhcontainerbot/podman-next/ramalama", "git_hash": "cd3704408653d3ed73d0ae53cabb48657710b1a3", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rhcontainerbot/podman-next--packit", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/podman-next/centos-stream-9-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://dl.fedoraproject.org/pub/epel/9/Everything/$basearch/", "id": "https_dl_fedoraproject_org_pub_epel_9_Everything_basearch", "name": "Additional repo https_dl_fedoraproject_org_pub_epel_9_Everything_basearch" } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rhcontainerbot/podman-next", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/podman-next", "result_dir": "09941258-ramalama", "built_packages": "", "id": 9941258, "mockchain_macros": { "copr_username": "rhcontainerbot", "copr_projectname": "podman-next", "vendor": "Fedora Project COPR (rhcontainerbot/podman-next)" } } ] } [2025-12-22 15:46:18,928][ INFO][PID:3780104] Sending fedora-messaging bus message in build.end [2025-12-22 15:46:19,493][ INFO][PID:3780104] Compressing /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-ppc64le/09941258-ramalama/builder-live.log by gzip [2025-12-22 15:46:19,494][ INFO][PID:3780104] Running command 'gzip /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-ppc64le/09941258-ramalama/builder-live.log' as PID 3824804 [2025-12-22 15:46:19,515][ INFO][PID:3780104] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-ppc64le/09941258-ramalama/builder-live.log) [2025-12-22 15:46:19,516][ INFO][PID:3780104] Compressing /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-ppc64le/09941258-ramalama/backend.log by gzip [2025-12-22 15:46:19,517][ INFO][PID:3780104] Running command 'gzip /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-ppc64le/09941258-ramalama/backend.log' as PID 3824806