[2025-12-11 18:11:02,048][  INFO][PID:351134] Marking build as starting
[2025-12-11 18:11:02,125][  INFO][PID:351134] Checking that /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-41-ppc64le/repodata/repomd.xml exists
[2025-12-11 18:11:02,129][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:11:02,130][  INFO][PID:351134] VM allocation process starts
[2025-12-11 18:11:02,176][  INFO][PID:351134] Trying to allocate VM: ResallocHost, ticket_id=287956, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-11 18:11:07,178][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:11:12,180][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:11:14,248][  INFO][PID:351134] Allocated host ResallocHost, ticket_id=287956, hostname=2620:52:6:1161:dead:beef:cafe:c14a, name=vmhost_p09_03_prod_00359719_20251211_175704, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-11 18:11:14,249][  INFO][PID:351134] Allocating ssh connection to builder
[2025-12-11 18:11:14,250][  INFO][PID:351134] Checking that builder machine is OK
[2025-12-11 18:12:14,331][ ERROR][PID:351134] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c14a port 22: Connection timed out

[2025-12-11 18:12:24,332][ ERROR][PID:351134] Re-try request for task on 'ResallocHost, ticket_id=287956, hostname=2620:52:6:1161:dead:beef:cafe:c14a, name=vmhost_p09_03_prod_00359719_20251211_175704, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts
[2025-12-11 18:12:24,332][  INFO][PID:351134] Releasing VM back to pool
[2025-12-11 18:12:24,353][  INFO][PID:351134] Retry #1 (on other host)
[2025-12-11 18:12:24,354][  INFO][PID:351134] Checking that /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-41-ppc64le/repodata/repomd.xml exists
[2025-12-11 18:12:24,355][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:12:24,356][  INFO][PID:351134] VM allocation process starts
[2025-12-11 18:12:24,379][  INFO][PID:351134] Trying to allocate VM: ResallocHost, ticket_id=287971, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-11 18:12:29,385][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:12:34,386][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:12:36,468][  INFO][PID:351134] Allocated host ResallocHost, ticket_id=287971, hostname=2620:52:6:1161:dead:beef:cafe:c108, name=vmhost_p09_02_prod_00359914_20251211_180243, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-11 18:12:36,469][  INFO][PID:351134] Allocating ssh connection to builder
[2025-12-11 18:12:36,470][  INFO][PID:351134] Checking that builder machine is OK
[2025-12-11 18:13:36,552][ ERROR][PID:351134] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c108 port 22: Connection timed out

[2025-12-11 18:13:46,553][ ERROR][PID:351134] Re-try request for task on 'ResallocHost, ticket_id=287971, hostname=2620:52:6:1161:dead:beef:cafe:c108, name=vmhost_p09_02_prod_00359914_20251211_180243, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts
[2025-12-11 18:13:46,555][  INFO][PID:351134] Releasing VM back to pool
[2025-12-11 18:13:46,573][  INFO][PID:351134] Retry #2 (on other host)
[2025-12-11 18:13:46,578][  INFO][PID:351134] Checking that /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-41-ppc64le/repodata/repomd.xml exists
[2025-12-11 18:13:46,579][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:13:46,580][  INFO][PID:351134] VM allocation process starts
[2025-12-11 18:13:46,592][  INFO][PID:351134] Trying to allocate VM: ResallocHost, ticket_id=287984, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-11 18:13:51,594][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:13:52,632][  INFO][PID:351134] Allocated host ResallocHost, ticket_id=287984, hostname=2620:52:6:1161:dead:beef:cafe:c194, name=vmhost_p09_04_prod_00360117_20251211_180750, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-11 18:13:52,633][  INFO][PID:351134] Allocating ssh connection to builder
[2025-12-11 18:13:52,634][  INFO][PID:351134] Checking that builder machine is OK
[2025-12-11 18:13:53,581][  INFO][PID:351134] Running remote command: copr-builder-ready fedora-41-ppc64le
[2025-12-11 18:13:54,111][  INFO][PID:351134] Red Hat subscription not needed for fedora-41-ppc64le
Builder is ready to be used

[2025-12-11 18:13:54,113][  INFO][PID:351134] Filling build.info file with builder info
[2025-12-11 18:13:54,115][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:13:54,118][  INFO][PID:351134] Not re-notifying FE and msg buses for the new host.
[2025-12-11 18:13:54,120][  INFO][PID:351134] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9899866-fedora-41-ppc64le --chroot fedora-41-ppc64le --detached
[2025-12-11 18:13:55,127][  INFO][PID:351134] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c194' (ED25519) to the list of known hosts.


[2025-12-11 18:13:55,129][  INFO][PID:351134] Downloading the builder-live.log file, attempt 1
[2025-12-11 18:13:55,131][  INFO][PID:351134] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c194 copr-rpmbuild-log
[2025-12-11 18:14:00,144][  INFO][PID:351134] Periodic builder liveness probe: alive
[2025-12-11 18:14:00,147][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:14:05,148][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:14:10,150][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:14:15,152][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:14:20,153][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:14:25,156][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:14:30,163][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:14:35,164][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:14:40,165][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:14:45,170][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:14:50,172][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:14:55,173][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:15:00,175][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:15:05,179][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:15:10,183][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:15:15,188][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:15:20,191][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:15:25,194][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:15:30,195][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:15:35,196][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:15:40,197][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:15:45,198][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:15:50,199][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:15:55,201][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:16:00,202][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:16:05,203][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:16:10,204][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:16:15,205][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:16:20,207][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:16:25,208][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:16:30,210][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:16:35,212][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:16:40,213][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:16:45,214][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:16:50,215][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:16:55,302][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:17:00,309][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:17:05,311][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:17:10,312][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:17:15,318][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:17:20,322][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:17:25,323][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:17:30,331][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:17:35,339][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:17:40,347][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:17:45,355][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:17:50,358][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:17:55,368][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:18:00,370][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:18:05,371][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:18:10,372][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:18:15,373][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:18:20,374][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:18:25,377][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:18:30,380][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:18:35,381][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:18:40,383][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:18:45,387][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:18:50,388][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:18:55,389][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:19:00,392][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:19:05,396][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:19:10,398][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:19:15,403][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:19:20,405][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:19:25,407][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:19:30,408][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:19:35,409][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:19:40,410][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:19:45,411][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:19:50,413][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:19:55,414][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:20:00,418][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:20:05,419][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:20:10,421][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:20:15,426][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:20:20,429][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:20:25,432][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:20:30,433][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:20:35,435][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:20:40,437][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:20:45,438][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:20:50,439][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:20:55,441][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:21:00,938][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:21:06,495][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:21:11,501][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:21:16,533][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:21:21,534][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:21:26,537][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:21:31,545][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:21:36,546][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:21:41,548][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:21:46,556][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:21:51,564][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:21:56,565][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:22:01,567][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:22:06,571][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:22:11,573][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:22:16,574][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:22:21,578][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:22:26,583][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:22:31,586][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:22:36,587][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:22:41,591][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:22:46,595][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:22:51,596][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:22:56,597][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:23:01,599][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:23:06,606][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:23:11,608][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:23:16,609][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:23:21,612][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:23:26,613][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:23:31,614][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:23:36,617][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:23:41,620][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:23:46,622][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:23:51,622][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:23:56,623][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:24:01,634][  INFO][PID:351134] Periodic builder liveness probe: alive
[2025-12-11 18:24:01,635][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:24:06,638][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:24:11,640][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:24:16,641][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:24:21,642][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:24:26,644][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:24:31,646][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:24:36,649][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:24:41,650][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:24:46,653][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:24:51,657][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:24:56,659][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:25:01,664][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:25:06,666][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:25:11,668][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:25:16,689][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:25:21,707][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:25:26,710][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:25:31,890][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:25:36,894][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:25:41,897][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:25:46,903][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:25:51,905][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:25:56,911][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:26:01,913][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:26:06,916][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:26:11,920][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:26:16,924][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:26:21,925][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:26:26,928][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:26:31,929][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:26:36,930][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:26:41,931][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:26:46,932][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:26:51,933][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:26:56,934][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:27:01,935][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:27:06,936][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:27:11,937][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:27:16,938][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:27:21,939][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:27:26,941][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:27:31,943][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:27:36,945][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:27:41,946][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:27:46,947][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:27:51,948][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:27:56,949][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:28:01,950][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:28:06,951][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:28:11,952][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:28:16,958][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:28:21,959][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:28:26,960][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:28:31,962][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:28:36,963][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:28:41,965][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:28:46,969][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:28:51,971][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:28:56,973][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:29:01,973][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:29:06,974][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:29:11,975][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:29:16,977][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:29:21,978][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:29:26,985][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:29:31,987][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:29:36,988][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:29:41,989][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:29:46,991][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:29:51,993][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:29:56,995][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:30:01,996][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:30:07,000][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:30:12,003][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:30:17,005][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:30:22,007][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:30:27,011][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:30:32,016][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:30:37,022][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:30:42,030][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:30:47,034][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:30:52,042][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:30:57,044][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:31:02,045][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:31:07,047][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:31:12,049][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:31:17,050][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:31:22,051][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:31:27,054][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:31:32,057][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:31:37,059][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:31:42,063][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:31:47,065][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:31:52,067][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:31:57,070][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:32:02,072][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:32:07,073][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:32:12,075][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:32:17,076][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:32:22,077][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:32:27,078][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:32:32,079][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:32:37,080][  INFO][PID:351134] Checking for cancel request
[2025-12-11 18:32:41,372][  INFO][PID:351134] Downloading results from builder
[2025-12-11 18:32:41,372][  INFO][PID:351134] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c194]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-41-ppc64le/09899866-osbuild-composer started
[2025-12-11 18:32:41,373][  INFO][PID:351134] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c194]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-41-ppc64le/09899866-osbuild-composer/ &> /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-41-ppc64le/09899866-osbuild-composer/build-09899866.rsync.log
[2025-12-11 18:33:41,452][  INFO][PID:351134] rsyncing finished.
[2025-12-11 18:33:41,453][ ERROR][PID:351134] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2025-12-11 18:33:41,456][ ERROR][PID:351134] SSH connection lost on #1 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2025-12-11 18:33:51,458][  INFO][PID:351134] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c194]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-41-ppc64le/09899866-osbuild-composer started
[2025-12-11 18:33:51,459][  INFO][PID:351134] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c194]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-41-ppc64le/09899866-osbuild-composer/ &> /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-41-ppc64le/09899866-osbuild-composer/build-09899866.rsync.log
[2025-12-11 18:34:51,541][  INFO][PID:351134] rsyncing finished.
[2025-12-11 18:34:51,542][ ERROR][PID:351134] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2025-12-11 18:34:51,543][ ERROR][PID:351134] SSH connection lost on #2 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2025-12-11 18:35:01,544][  INFO][PID:351134] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c194]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-41-ppc64le/09899866-osbuild-composer started
[2025-12-11 18:35:01,546][  INFO][PID:351134] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c194]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-41-ppc64le/09899866-osbuild-composer/ &> /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-41-ppc64le/09899866-osbuild-composer/build-09899866.rsync.log
[2025-12-11 18:36:01,631][  INFO][PID:351134] rsyncing finished.
[2025-12-11 18:36:01,633][ ERROR][PID:351134] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2025-12-11 18:36:01,634][ ERROR][PID:351134] SSH connection lost on #3 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2025-12-11 18:36:11,635][ ERROR][PID:351134] Re-try request for task on 'ResallocHost, ticket_id=287984, hostname=2620:52:6:1161:dead:beef:cafe:c194, name=vmhost_p09_04_prod_00360117_20251211_180750, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 3 SSH attempts
[2025-12-11 18:36:11,636][  INFO][PID:351134] Releasing VM back to pool
[2025-12-11 18:36:11,647][ ERROR][PID:351134] Backend process error: Three host tried without success: {'2620:52:6:1161:dead:beef:cafe:c108', '2620:52:6:1161:dead:beef:cafe:c14a', '2620:52:6:1161:dead:beef:cafe:c194'}
[2025-12-11 18:36:11,647][WARNING][PID:351134] Switching not-finished job state to 'failed'
[2025-12-11 18:36:11,649][  INFO][PID:351134] Worker failed build, took 1337.529503583908
[2025-12-11 18:36:11,649][  INFO][PID:351134] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@osbuild",
            "project_name": "osbuild-composer",
            "project_dirname": "osbuild-composer",
            "submitter": "packit",
            "ended_on": 1765478171.6478503,
            "started_on": 1765476834.1183467,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-41-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9899866-fedora-41-ppc64le",
            "build_id": 9899866,
            "package_name": "osbuild-composer",
            "package_version": "157-1.20251211181010716390.main.28.gd66be36b1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@osbuild/osbuild-composer/osbuild-composer",
            "git_hash": "1d1c88dfa4d840d05b4342550517c07d7c93cd83",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@osbuild/osbuild-composer--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@osbuild/osbuild-composer/fedora-41-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@osbuild/osbuild-composer",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@osbuild/osbuild-composer",
            "result_dir": "09899866-osbuild-composer",
            "built_packages": "",
            "id": 9899866,
            "mockchain_macros": {
                "copr_username": "@osbuild",
                "copr_projectname": "osbuild-composer",
                "vendor": "Fedora Project COPR (@osbuild/osbuild-composer)"
            }
        }
    ]
}
[2025-12-11 18:36:11,694][  INFO][PID:351134] Sending fedora-messaging bus message in build.end
[2025-12-11 18:36:12,355][  INFO][PID:351134] Compressing /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-41-ppc64le/09899866-osbuild-composer/builder-live.log by gzip
[2025-12-11 18:36:12,357][  INFO][PID:351134] Running command 'gzip /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-41-ppc64le/09899866-osbuild-composer/builder-live.log' as PID 566549
[2025-12-11 18:36:12,421][  INFO][PID:351134] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-41-ppc64le/09899866-osbuild-composer/builder-live.log)
[2025-12-11 18:36:12,422][  INFO][PID:351134] Compressing /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-41-ppc64le/09899866-osbuild-composer/backend.log by gzip
[2025-12-11 18:36:12,423][  INFO][PID:351134] Running command 'gzip /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-41-ppc64le/09899866-osbuild-composer/backend.log' as PID 566559