[2025-12-16 11:39:21,274][ INFO][PID:4011592] Marking build as starting [2025-12-16 11:39:21,429][ INFO][PID:4011592] Checking that /var/lib/copr/public_html/results/dorinda/virglrenderer-sys/fedora-eln-ppc64le/repodata/repomd.xml exists [2025-12-16 11:39:21,431][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:39:21,432][ INFO][PID:4011592] VM allocation process starts [2025-12-16 11:39:21,458][ INFO][PID:4011592] Trying to allocate VM: ResallocHost, ticket_id=369086, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-12-16 11:39:26,464][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:39:27,495][ INFO][PID:4011592] Allocated host ResallocHost, ticket_id=369086, hostname=2620:52:6:1161:dead:beef:cafe:c148, name=vmhost_p09_03_prod_00596391_20251216_112621, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-12-16 11:39:27,496][ INFO][PID:4011592] Allocating ssh connection to builder [2025-12-16 11:39:27,497][ INFO][PID:4011592] Checking that builder machine is OK [2025-12-16 11:40:27,567][ ERROR][PID:4011592] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c148 port 22: Connection timed out [2025-12-16 11:40:37,568][ ERROR][PID:4011592] Re-try request for task on 'ResallocHost, ticket_id=369086, hostname=2620:52:6:1161:dead:beef:cafe:c148, name=vmhost_p09_03_prod_00596391_20251216_112621, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': Unable to finish after 1 SSH attempts [2025-12-16 11:40:37,568][ INFO][PID:4011592] Releasing VM back to pool [2025-12-16 11:40:37,577][ INFO][PID:4011592] Retry #1 (on other host) [2025-12-16 11:40:37,578][ INFO][PID:4011592] Checking that /var/lib/copr/public_html/results/dorinda/virglrenderer-sys/fedora-eln-ppc64le/repodata/repomd.xml exists [2025-12-16 11:40:37,578][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:40:37,579][ INFO][PID:4011592] VM allocation process starts [2025-12-16 11:40:37,589][ INFO][PID:4011592] Trying to allocate VM: ResallocHost, ticket_id=369128, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-12-16 11:40:40,601][ INFO][PID:4011592] Allocated host ResallocHost, ticket_id=369128, hostname=2620:52:6:1161:dead:beef:cafe:c155, name=vmhost_p09_03_prod_00596281_20251216_111803, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-12-16 11:40:40,602][ INFO][PID:4011592] Allocating ssh connection to builder [2025-12-16 11:40:40,602][ INFO][PID:4011592] Checking that builder machine is OK [2025-12-16 11:40:41,049][ INFO][PID:4011592] Running remote command: copr-builder-ready fedora-eln-ppc64le [2025-12-16 11:40:41,548][ INFO][PID:4011592] Red Hat subscription not needed for fedora-eln-ppc64le Builder is ready to be used [2025-12-16 11:40:41,549][ INFO][PID:4011592] Filling build.info file with builder info [2025-12-16 11:40:41,550][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:40:41,550][ INFO][PID:4011592] Not re-notifying FE and msg buses for the new host. [2025-12-16 11:40:41,551][ INFO][PID:4011592] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9914888-fedora-eln-ppc64le --chroot fedora-eln-ppc64le --detached [2025-12-16 11:40:42,373][ INFO][PID:4011592] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c155' (ED25519) to the list of known hosts. [2025-12-16 11:40:42,374][ INFO][PID:4011592] Downloading the builder-live.log file, attempt 1 [2025-12-16 11:40:42,376][ INFO][PID:4011592] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c155 copr-rpmbuild-log [2025-12-16 11:40:47,380][ INFO][PID:4011592] Periodic builder liveness probe: alive [2025-12-16 11:40:47,381][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:40:52,382][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:40:57,383][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:41:02,384][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:41:07,385][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:41:12,386][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:41:17,388][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:41:22,389][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:41:27,390][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:41:32,391][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:41:37,392][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:41:42,393][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:41:47,394][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:41:52,395][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:41:57,396][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:42:02,397][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:42:07,398][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:42:12,400][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:42:17,401][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:42:22,402][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:42:27,403][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:42:32,405][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:42:37,407][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:42:42,409][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:42:47,411][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:42:52,412][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:42:57,414][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:43:02,415][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:43:07,417][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:43:12,418][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:43:17,419][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:43:22,420][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:43:27,421][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:43:32,422][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:43:37,424][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:43:42,425][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:43:47,427][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:43:52,429][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:43:57,432][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:44:02,435][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:44:07,436][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:44:12,438][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:44:17,441][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:44:22,443][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:44:27,446][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:44:32,448][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:44:37,449][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:44:42,451][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:44:47,469][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:44:52,470][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:44:57,473][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:45:02,475][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:45:07,476][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:45:12,478][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:45:17,479][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:45:22,480][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:45:27,481][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:45:32,483][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:45:37,484][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:45:42,485][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:45:47,486][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:45:52,487][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:45:57,488][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:46:02,489][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:46:07,490][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:46:12,491][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:46:17,492][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:46:22,493][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:46:27,494][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:46:32,495][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:46:37,496][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:46:42,499][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:46:47,500][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:46:52,501][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:46:57,502][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:47:02,503][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:47:07,504][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:47:12,505][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:47:17,506][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:47:22,507][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:47:27,508][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:47:32,509][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:47:37,510][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:47:42,510][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:47:47,511][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:47:52,512][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:47:57,513][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:48:02,514][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:48:07,515][ INFO][PID:4011592] Checking for cancel request [2025-12-16 11:48:09,251][ INFO][PID:4011592] Downloading results from builder [2025-12-16 11:48:09,699][ INFO][PID:4011592] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c155]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/dorinda/virglrenderer-sys/fedora-eln-ppc64le/09914888-rust-virglrenderer-sys started [2025-12-16 11:48:09,699][ INFO][PID:4011592] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c155]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/dorinda/virglrenderer-sys/fedora-eln-ppc64le/09914888-rust-virglrenderer-sys/ &> /var/lib/copr/public_html/results/dorinda/virglrenderer-sys/fedora-eln-ppc64le/09914888-rust-virglrenderer-sys/build-09914888.rsync.log [2025-12-16 11:48:10,273][ INFO][PID:4011592] rsyncing finished. [2025-12-16 11:48:10,273][ INFO][PID:4011592] Releasing VM back to pool [2025-12-16 11:48:10,282][ INFO][PID:4011592] Searching for 'success' file in resultdir [2025-12-16 11:48:10,282][ ERROR][PID:4011592] Build failed: Backend process error: No success file => build failure [2025-12-16 11:48:10,283][ INFO][PID:4011592] Finished build: id=9914888 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/dorinda/virglrenderer-sys chroot=fedora-eln-ppc64le [2025-12-16 11:48:10,285][ ERROR][PID:4011592] Backend process error: No success file => build failure [2025-12-16 11:48:10,285][ INFO][PID:4011592] Worker failed build, took 448.7346272468567 [2025-12-16 11:48:10,285][ INFO][PID:4011592] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "dorinda", "project_name": "virglrenderer-sys", "project_dirname": "virglrenderer-sys", "submitter": "dorinda", "ended_on": 1765885690.2853923, "started_on": 1765885241.550765, "submitted_on": null, "status": 0, "chroot": "fedora-eln-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9914888-fedora-eln-ppc64le", "build_id": 9914888, "package_name": "rust-virglrenderer-sys", "package_version": "0.1.3-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/dorinda/virglrenderer-sys/rust-virglrenderer-sys", "git_hash": "748f3c31fdc8ec657648b1e3245bd460b76dbe3a", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "dorinda/virglrenderer-sys--dorinda", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/dorinda/virglrenderer-sys/fedora-eln-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/dorinda/virglrenderer-sys", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/dorinda/virglrenderer-sys", "result_dir": "09914888-rust-virglrenderer-sys", "built_packages": "", "id": 9914888, "mockchain_macros": { "copr_username": "dorinda", "copr_projectname": "virglrenderer-sys", "vendor": "Fedora Project COPR (dorinda/virglrenderer-sys)" } } ] } [2025-12-16 11:48:10,352][ INFO][PID:4011592] Sending fedora-messaging bus message in build.end [2025-12-16 11:48:10,890][ INFO][PID:4011592] Compressing /var/lib/copr/public_html/results/dorinda/virglrenderer-sys/fedora-eln-ppc64le/09914888-rust-virglrenderer-sys/builder-live.log by gzip [2025-12-16 11:48:10,892][ INFO][PID:4011592] Running command 'gzip /var/lib/copr/public_html/results/dorinda/virglrenderer-sys/fedora-eln-ppc64le/09914888-rust-virglrenderer-sys/builder-live.log' as PID 4074143 [2025-12-16 11:48:10,897][ INFO][PID:4011592] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/dorinda/virglrenderer-sys/fedora-eln-ppc64le/09914888-rust-virglrenderer-sys/builder-live.log) [2025-12-16 11:48:10,898][ INFO][PID:4011592] Compressing /var/lib/copr/public_html/results/dorinda/virglrenderer-sys/fedora-eln-ppc64le/09914888-rust-virglrenderer-sys/backend.log by gzip [2025-12-16 11:48:10,899][ INFO][PID:4011592] Running command 'gzip /var/lib/copr/public_html/results/dorinda/virglrenderer-sys/fedora-eln-ppc64le/09914888-rust-virglrenderer-sys/backend.log' as PID 4074144