[2026-01-20 22:07:47,915][ INFO][PID:3338008] Marking build as starting [2026-01-20 22:07:47,981][ INFO][PID:3338008] Checking that /var/lib/copr/public_html/results/@virtmaint-sig/virt-preview/fedora-42-ppc64le/repodata/repomd.xml exists [2026-01-20 22:07:47,988][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:07:47,988][ INFO][PID:3338008] VM allocation process starts [2026-01-20 22:07:47,998][ INFO][PID:3338008] Trying to allocate VM: ResallocHost, ticket_id=938108, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-20 22:07:51,014][ INFO][PID:3338008] Allocated host ResallocHost, ticket_id=938108, hostname=2620:52:6:1161:dead:beef:cafe:c154, name=vmhost_p09_03_prod_01440970_20260120_215451, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-20 22:07:51,015][ INFO][PID:3338008] Allocating ssh connection to builder [2026-01-20 22:07:51,016][ INFO][PID:3338008] Checking that builder machine is OK [2026-01-20 22:08:51,085][ ERROR][PID:3338008] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c154 port 22: Connection timed out [2026-01-20 22:09:01,087][ ERROR][PID:3338008] Re-try request for task on 'ResallocHost, ticket_id=938108, hostname=2620:52:6:1161:dead:beef:cafe:c154, name=vmhost_p09_03_prod_01440970_20260120_215451, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts [2026-01-20 22:09:01,088][ INFO][PID:3338008] Releasing VM back to pool [2026-01-20 22:09:01,106][ INFO][PID:3338008] Retry #1 (on other host) [2026-01-20 22:09:01,108][ INFO][PID:3338008] Checking that /var/lib/copr/public_html/results/@virtmaint-sig/virt-preview/fedora-42-ppc64le/repodata/repomd.xml exists [2026-01-20 22:09:01,109][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:09:01,111][ INFO][PID:3338008] VM allocation process starts [2026-01-20 22:09:01,141][ INFO][PID:3338008] Trying to allocate VM: ResallocHost, ticket_id=938126, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-20 22:09:04,198][ INFO][PID:3338008] Allocated host ResallocHost, ticket_id=938126, hostname=2620:52:6:1161:dead:beef:cafe:c114, name=vmhost_p09_02_prod_01440978_20260120_215644, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-20 22:09:04,199][ INFO][PID:3338008] Allocating ssh connection to builder [2026-01-20 22:09:04,204][ INFO][PID:3338008] Checking that builder machine is OK [2026-01-20 22:10:04,288][ ERROR][PID:3338008] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c114 port 22: Connection timed out [2026-01-20 22:10:14,295][ ERROR][PID:3338008] Re-try request for task on 'ResallocHost, ticket_id=938126, hostname=2620:52:6:1161:dead:beef:cafe:c114, name=vmhost_p09_02_prod_01440978_20260120_215644, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts [2026-01-20 22:10:14,295][ INFO][PID:3338008] Releasing VM back to pool [2026-01-20 22:10:14,333][ INFO][PID:3338008] Retry #2 (on other host) [2026-01-20 22:10:14,337][ INFO][PID:3338008] Checking that /var/lib/copr/public_html/results/@virtmaint-sig/virt-preview/fedora-42-ppc64le/repodata/repomd.xml exists [2026-01-20 22:10:14,343][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:10:14,345][ INFO][PID:3338008] VM allocation process starts [2026-01-20 22:10:14,405][ INFO][PID:3338008] Trying to allocate VM: ResallocHost, ticket_id=938140, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-20 22:10:17,450][ INFO][PID:3338008] Allocated host ResallocHost, ticket_id=938140, hostname=2620:52:6:1161:dead:beef:cafe:c156, name=vmhost_p09_03_prod_01440992_20260120_215825, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-20 22:10:17,450][ INFO][PID:3338008] Allocating ssh connection to builder [2026-01-20 22:10:17,451][ INFO][PID:3338008] Checking that builder machine is OK [2026-01-20 22:10:18,542][ INFO][PID:3338008] Running remote command: copr-builder-ready fedora-42-ppc64le [2026-01-20 22:10:19,142][ INFO][PID:3338008] Red Hat subscription not needed for fedora-42-ppc64le Builder is ready to be used [2026-01-20 22:10:19,142][ INFO][PID:3338008] Filling build.info file with builder info [2026-01-20 22:10:19,143][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:10:19,149][ INFO][PID:3338008] Not re-notifying FE and msg buses for the new host. [2026-01-20 22:10:19,154][ INFO][PID:3338008] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10039666-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached [2026-01-20 22:10:20,269][ INFO][PID:3338008] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c156' (ED25519) to the list of known hosts. [2026-01-20 22:10:20,272][ INFO][PID:3338008] Downloading the builder-live.log file, attempt 1 [2026-01-20 22:10:20,276][ INFO][PID:3338008] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c156 copr-rpmbuild-log [2026-01-20 22:10:25,290][ INFO][PID:3338008] Periodic builder liveness probe: alive [2026-01-20 22:10:25,292][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:10:30,299][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:10:35,300][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:10:40,310][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:10:45,312][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:10:50,314][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:10:55,320][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:11:00,325][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:11:05,331][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:11:10,332][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:11:15,335][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:11:20,336][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:11:25,337][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:11:30,339][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:11:35,340][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:11:40,341][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:11:45,342][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:11:50,342][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:11:55,343][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:12:00,344][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:12:05,345][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:12:10,346][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:12:15,347][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:12:20,349][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:12:25,350][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:12:30,351][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:12:35,352][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:12:40,353][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:12:45,354][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:12:50,355][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:12:55,356][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:13:00,356][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:13:05,357][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:13:10,358][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:13:15,360][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:13:20,360][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:13:25,361][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:13:30,363][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:13:35,364][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:13:40,365][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:13:45,366][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:13:50,369][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:13:55,370][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:14:00,371][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:14:05,372][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:14:10,373][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:14:15,374][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:14:20,375][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:14:25,376][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:14:30,377][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:14:35,379][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:14:40,380][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:14:45,380][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:14:50,381][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:14:55,382][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:15:00,383][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:15:05,384][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:15:10,385][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:15:15,386][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:15:20,387][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:15:25,388][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:15:30,389][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:15:35,390][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:15:40,391][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:15:45,392][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:15:50,393][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:15:55,394][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:16:00,395][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:16:05,396][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:16:10,397][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:16:15,398][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:16:20,399][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:16:25,409][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:16:30,410][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:16:35,412][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:16:40,413][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:16:45,418][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:16:50,419][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:16:55,419][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:17:00,421][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:17:05,421][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:17:10,422][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:17:15,424][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:17:20,424][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:17:25,494][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:17:30,495][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:17:35,496][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:17:40,496][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:17:45,497][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:17:50,498][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:17:55,500][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:18:00,501][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:18:05,502][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:18:10,503][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:18:15,503][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:18:20,653][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:18:25,654][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:18:30,655][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:18:35,657][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:18:40,658][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:18:45,659][ INFO][PID:3338008] Checking for cancel request [2026-01-20 22:18:48,920][ INFO][PID:3338008] Downloading results from builder [2026-01-20 22:18:48,921][ INFO][PID:3338008] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c156]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@virtmaint-sig/virt-preview/fedora-42-ppc64le/10039666-SLOF started [2026-01-20 22:18:48,922][ INFO][PID:3338008] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c156]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@virtmaint-sig/virt-preview/fedora-42-ppc64le/10039666-SLOF/ &> /var/lib/copr/public_html/results/@virtmaint-sig/virt-preview/fedora-42-ppc64le/10039666-SLOF/build-10039666.rsync.log [2026-01-20 22:18:49,596][ INFO][PID:3338008] rsyncing finished. [2026-01-20 22:18:49,596][ INFO][PID:3338008] Releasing VM back to pool [2026-01-20 22:18:49,607][ INFO][PID:3338008] Searching for 'success' file in resultdir [2026-01-20 22:18:49,607][ INFO][PID:3338008] Going to sign pkgs from source: 10039666-fedora-42-ppc64le in chroot: /var/lib/copr/public_html/results/@virtmaint-sig/virt-preview/fedora-42-ppc64le [2026-01-20 22:18:49,608][ INFO][PID:3338008] Calling '/bin/sign -u @virtmaint-sig#virt-preview@copr.fedorahosted.org -p' (attempt #1) [2026-01-20 22:18:49,878][ INFO][PID:3338008] Calling '/bin/sign -4 -h sha256 -u @virtmaint-sig#virt-preview@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@virtmaint-sig/virt-preview/fedora-42-ppc64le/10039666-SLOF/SLOF-20220719-10.git6b6c16b4.fc42.src.rpm' (attempt #1) [2026-01-20 22:18:50,580][ INFO][PID:3338008] signed rpm: /var/lib/copr/public_html/results/@virtmaint-sig/virt-preview/fedora-42-ppc64le/10039666-SLOF/SLOF-20220719-10.git6b6c16b4.fc42.src.rpm [2026-01-20 22:18:50,581][ INFO][PID:3338008] Calling '/bin/sign -4 -h sha256 -u @virtmaint-sig#virt-preview@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@virtmaint-sig/virt-preview/fedora-42-ppc64le/10039666-SLOF/SLOF-20220719-10.git6b6c16b4.fc42.noarch.rpm' (attempt #1) [2026-01-20 22:18:51,292][ INFO][PID:3338008] signed rpm: /var/lib/copr/public_html/results/@virtmaint-sig/virt-preview/fedora-42-ppc64le/10039666-SLOF/SLOF-20220719-10.git6b6c16b4.fc42.noarch.rpm [2026-01-20 22:18:51,292][ INFO][PID:3338008] Sign done [2026-01-20 22:18:51,293][ INFO][PID:3338008] Incremental createrepo run, adding 10039666-SLOF into https://download.copr.fedorainfracloud.org/results/@virtmaint-sig/virt-preview/fedora-42-ppc64le, (auto-create-repo=True) [2026-01-20 22:18:51,294][ INFO][PID:3338008] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@virtmaint-sig/virt-preview/fedora-42-ppc64le --add 10039666-SLOF --no-appstream-metadata' as PID 3392362 [2026-01-20 22:18:52,120][ INFO][PID:3338008] Finished after 0 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@virtmaint-sig/virt-preview/fedora-42-ppc64le --add 10039666-SLOF --no-appstream-metadata) [2026-01-20 22:18:52,121][ INFO][PID:3338008] Getting build details [2026-01-20 22:18:52,121][ INFO][PID:3338008] Listing built binary packages in /var/lib/copr/public_html/results/@virtmaint-sig/virt-preview/fedora-42-ppc64le/10039666-SLOF [2026-01-20 22:18:52,122][ INFO][PID:3338008] Built packages: ['SLOF 20220719'] [2026-01-20 22:18:52,122][ INFO][PID:3338008] build details: {'built_packages': 'SLOF 20220719'} [2026-01-20 22:18:52,123][ INFO][PID:3338008] Retrieving pubkey [2026-01-20 22:18:52,123][ INFO][PID:3338008] Calling '/bin/sign -u @virtmaint-sig#virt-preview@copr.fedorahosted.org -p' (attempt #1) [2026-01-20 22:18:52,408][ INFO][PID:3338008] Added pubkey for user @virtmaint-sig project virt-preview into: /var/lib/copr/public_html/results/@virtmaint-sig/virt-preview/pubkey.gpg [2026-01-20 22:18:52,409][ INFO][PID:3338008] Finished build: id=10039666 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@virtmaint-sig/virt-preview chroot=fedora-42-ppc64le [2026-01-20 22:18:52,411][ INFO][PID:3338008] Worker succeeded build, took 513.2617309093475 [2026-01-20 22:18:52,412][ INFO][PID:3338008] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "@virtmaint-sig", "project_name": "virt-preview", "project_dirname": "virt-preview", "submitter": "crobinso", "ended_on": 1768947532.4115374, "started_on": 1768947019.1498065, "submitted_on": null, "status": 1, "chroot": "fedora-42-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10039666-fedora-42-ppc64le", "build_id": 10039666, "package_name": "SLOF", "package_version": "20220719-10.git6b6c16b4", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@virtmaint-sig/virt-preview/SLOF", "git_hash": "81942e8e2957fd1290f4b2a65bf161097ac5eac3", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@virtmaint-sig/virt-preview--crobinso", "results": { "packages": [ { "name": "SLOF", "epoch": null, "version": "20220719", "release": "10.git6b6c16b4.fc42", "arch": "noarch" }, { "name": "SLOF", "epoch": null, "version": "20220719", "release": "10.git6b6c16b4.fc42", "arch": "src" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@virtmaint-sig/virt-preview/fedora-42-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "bootstrap": "off", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [ "check" ], "destdir": "/var/lib/copr/public_html/results/@virtmaint-sig/virt-preview", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@virtmaint-sig/virt-preview", "result_dir": "10039666-SLOF", "built_packages": "SLOF 20220719", "id": 10039666, "mockchain_macros": { "copr_username": "@virtmaint-sig", "copr_projectname": "virt-preview", "vendor": "Fedora Project COPR (@virtmaint-sig/virt-preview)" } } ] } [2026-01-20 22:18:52,463][ INFO][PID:3338008] Sending fedora-messaging bus message in build.end [2026-01-20 22:18:53,054][ INFO][PID:3338008] Compressing /var/lib/copr/public_html/results/@virtmaint-sig/virt-preview/fedora-42-ppc64le/10039666-SLOF/builder-live.log by gzip [2026-01-20 22:18:53,055][ INFO][PID:3338008] Running command 'gzip /var/lib/copr/public_html/results/@virtmaint-sig/virt-preview/fedora-42-ppc64le/10039666-SLOF/builder-live.log' as PID 3392476 [2026-01-20 22:18:53,078][ INFO][PID:3338008] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@virtmaint-sig/virt-preview/fedora-42-ppc64le/10039666-SLOF/builder-live.log) [2026-01-20 22:18:53,079][ INFO][PID:3338008] Compressing /var/lib/copr/public_html/results/@virtmaint-sig/virt-preview/fedora-42-ppc64le/10039666-SLOF/backend.log by gzip [2026-01-20 22:18:53,080][ INFO][PID:3338008] Running command 'gzip /var/lib/copr/public_html/results/@virtmaint-sig/virt-preview/fedora-42-ppc64le/10039666-SLOF/backend.log' as PID 3392486