[2025-12-14 15:10:20,710][  INFO][PID:1492344] Marking build as starting
[2025-12-14 15:10:20,854][  INFO][PID:1492344] Checking that /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/repodata/repomd.xml exists
[2025-12-14 15:10:20,861][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:10:20,869][  INFO][PID:1492344] VM allocation process starts
[2025-12-14 15:10:20,923][  INFO][PID:1492344] Trying to allocate VM: ResallocHost, ticket_id=334018, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-12-14 15:10:25,927][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:10:27,009][  INFO][PID:1492344] Allocated host ResallocHost, ticket_id=334018, hostname=2620:52:6:1161:dead:beef:cafe:c14c, name=vmhost_p09_03_prod_00540815_20251214_141700, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-12-14 15:10:27,010][  INFO][PID:1492344] Allocating ssh connection to builder
[2025-12-14 15:10:27,010][  INFO][PID:1492344] Checking that builder machine is OK
[2025-12-14 15:11:27,079][ ERROR][PID:1492344] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c14c port 22: Connection timed out

[2025-12-14 15:11:37,081][ ERROR][PID:1492344] Re-try request for task on 'ResallocHost, ticket_id=334018, hostname=2620:52:6:1161:dead:beef:cafe:c14c, name=vmhost_p09_03_prod_00540815_20251214_141700, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': Unable to finish after 1 SSH attempts
[2025-12-14 15:11:37,081][  INFO][PID:1492344] Releasing VM back to pool
[2025-12-14 15:11:37,093][  INFO][PID:1492344] Retry #1 (on other host)
[2025-12-14 15:11:37,094][  INFO][PID:1492344] Checking that /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/repodata/repomd.xml exists
[2025-12-14 15:11:37,095][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:11:37,096][  INFO][PID:1492344] VM allocation process starts
[2025-12-14 15:11:37,116][  INFO][PID:1492344] Trying to allocate VM: ResallocHost, ticket_id=334047, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-12-14 15:11:42,118][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:11:43,148][  INFO][PID:1492344] Allocated host ResallocHost, ticket_id=334047, hostname=2620:52:6:1161:dead:beef:cafe:c10c, name=vmhost_p09_02_prod_00541135_20251214_145052, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-12-14 15:11:43,148][  INFO][PID:1492344] Allocating ssh connection to builder
[2025-12-14 15:11:43,149][  INFO][PID:1492344] Checking that builder machine is OK
[2025-12-14 15:11:44,102][  INFO][PID:1492344] Running remote command: copr-builder-ready fedora-eln-ppc64le
[2025-12-14 15:11:44,609][  INFO][PID:1492344] Red Hat subscription not needed for fedora-eln-ppc64le
Builder is ready to be used

[2025-12-14 15:11:44,610][  INFO][PID:1492344] Filling build.info file with builder info
[2025-12-14 15:11:44,611][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:11:44,612][  INFO][PID:1492344] Not re-notifying FE and msg buses for the new host.
[2025-12-14 15:11:44,612][  INFO][PID:1492344] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9908397-fedora-eln-ppc64le --chroot fedora-eln-ppc64le --detached
[2025-12-14 15:11:45,539][  INFO][PID:1492344] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c10c' (ED25519) to the list of known hosts.


[2025-12-14 15:11:45,541][  INFO][PID:1492344] Downloading the builder-live.log file, attempt 1
[2025-12-14 15:11:45,543][  INFO][PID:1492344] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c10c copr-rpmbuild-log
[2025-12-14 15:11:50,552][  INFO][PID:1492344] Periodic builder liveness probe: alive
[2025-12-14 15:11:50,553][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:11:55,554][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:12:00,555][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:12:05,556][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:12:10,557][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:12:15,558][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:12:20,559][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:12:25,560][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:12:30,561][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:12:35,562][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:12:40,563][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:12:45,564][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:12:50,565][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:12:55,566][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:13:00,567][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:13:05,568][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:13:10,569][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:13:15,570][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:13:20,571][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:13:25,572][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:13:30,573][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:13:35,574][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:13:40,575][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:13:45,576][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:13:50,577][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:13:55,578][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:14:00,775][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:14:05,776][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:14:10,777][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:14:15,778][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:14:20,779][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:14:25,780][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:14:30,781][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:14:35,782][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:14:40,783][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:14:45,784][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:14:50,785][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:14:55,786][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:15:00,787][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:15:05,788][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:15:10,790][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:15:15,791][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:15:20,792][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:15:25,793][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:15:30,794][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:15:35,794][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:15:40,795][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:15:45,816][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:15:50,817][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:15:55,880][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:16:00,881][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:16:05,882][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:16:10,883][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:16:15,910][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:16:20,911][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:16:25,911][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:16:31,115][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:16:36,116][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:16:41,118][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:16:46,119][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:16:51,120][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:16:56,121][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:17:01,189][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:17:06,191][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:17:11,193][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:17:16,194][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:17:21,195][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:17:26,210][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:17:31,212][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:17:36,213][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:17:41,235][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:17:46,238][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:17:51,240][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:17:56,241][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:18:01,242][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:18:06,243][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:18:11,675][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:18:16,677][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:18:21,678][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:18:26,679][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:18:31,679][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:18:36,681][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:18:41,682][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:18:46,684][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:18:51,685][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:18:56,686][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:19:01,687][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:19:06,688][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:19:11,689][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:19:16,743][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:19:21,744][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:19:26,745][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:19:31,746][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:19:36,749][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:19:41,750][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:19:46,751][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:19:51,752][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:19:56,753][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:20:01,754][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:20:06,755][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:20:11,756][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:20:16,757][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:20:21,758][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:20:26,759][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:20:31,760][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:20:36,761][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:20:41,800][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:20:46,801][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:20:51,877][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:20:56,880][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:21:01,881][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:21:06,882][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:21:11,884][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:21:16,887][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:21:21,888][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:21:26,890][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:21:31,891][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:21:36,892][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:21:41,893][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:21:46,894][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:21:51,995][  INFO][PID:1492344] Periodic builder liveness probe: alive
[2025-12-14 15:21:51,995][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:21:56,996][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:22:02,044][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:22:07,046][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:22:12,048][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:22:17,049][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:22:22,050][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:22:27,051][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:22:32,098][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:22:37,099][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:22:42,189][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:22:47,351][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:22:52,352][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:22:57,355][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:23:02,356][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:23:07,357][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:23:12,358][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:23:17,360][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:23:22,361][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:23:27,362][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:23:32,364][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:23:37,365][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:23:42,367][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:23:47,368][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:23:52,369][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:23:57,370][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:24:02,374][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:24:07,375][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:24:12,378][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:24:17,379][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:24:22,380][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:24:27,381][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:24:32,382][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:24:37,383][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:24:42,422][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:24:47,580][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:24:52,581][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:24:57,603][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:25:02,604][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:25:07,606][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:25:12,607][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:25:17,609][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:25:22,610][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:25:27,611][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:25:32,612][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:25:37,613][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:25:42,614][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:25:47,615][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:25:52,616][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:25:57,617][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:26:02,618][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:26:07,619][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:26:12,620][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:26:17,622][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:26:22,623][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:26:27,624][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:26:32,625][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:26:37,628][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:26:42,629][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:26:47,632][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:26:52,634][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:26:57,635][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:27:02,636][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:27:07,638][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:27:12,639][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:27:17,640][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:27:22,641][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:27:27,643][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:27:32,644][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:27:37,645][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:27:42,647][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:27:47,648][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:27:52,650][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:27:57,650][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:28:02,652][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:28:07,653][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:28:12,654][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:28:17,654][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:28:22,655][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:28:27,656][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:28:32,657][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:28:37,658][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:28:42,659][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:28:47,660][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:28:52,661][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:28:57,661][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:29:02,662][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:29:07,663][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:29:12,664][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:29:17,665][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:29:22,666][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:29:27,668][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:29:32,669][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:29:37,670][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:29:42,671][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:29:47,672][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:29:52,673][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:29:57,674][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:30:02,676][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:30:07,677][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:30:12,678][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:30:17,679][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:30:22,680][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:30:27,681][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:30:32,682][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:30:37,684][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:30:42,685][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:30:47,685][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:30:52,686][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:30:57,687][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:31:02,688][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:31:07,689][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:31:12,690][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:31:17,691][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:31:22,692][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:31:27,693][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:31:32,694][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:31:37,695][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:31:42,696][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:31:47,697][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:31:52,705][  INFO][PID:1492344] Periodic builder liveness probe: alive
[2025-12-14 15:31:52,705][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:31:57,706][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:32:02,707][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:32:07,708][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:32:12,709][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:32:17,710][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:32:22,711][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:32:27,712][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:32:32,713][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:32:37,714][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:32:42,715][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:32:47,716][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:32:52,717][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:32:57,718][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:33:02,719][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:33:07,720][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:33:12,721][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:33:17,722][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:33:22,723][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:33:27,724][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:33:32,725][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:33:37,726][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:33:42,727][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:33:47,728][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:33:52,729][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:33:57,729][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:34:02,730][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:34:07,731][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:34:12,732][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:34:17,733][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:34:22,734][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:34:27,735][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:34:32,736][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:34:37,737][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:34:42,738][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:34:47,739][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:34:52,740][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:34:57,741][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:35:02,742][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:35:07,743][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:35:12,744][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:35:17,745][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:35:22,746][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:35:27,747][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:35:32,748][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:35:37,749][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:35:42,750][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:35:47,751][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:35:52,752][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:35:57,753][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:36:02,754][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:36:07,755][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:36:12,756][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:36:17,757][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:36:22,758][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:36:27,759][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:36:32,760][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:36:37,761][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:36:42,762][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:36:47,763][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:36:52,764][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:36:57,765][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:37:02,766][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:37:07,767][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:37:12,768][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:37:17,769][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:37:22,770][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:37:27,771][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:37:32,772][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:37:37,773][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:37:42,774][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:37:47,775][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:37:52,776][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:37:57,778][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:38:02,779][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:38:07,780][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:38:12,780][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:38:17,781][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:38:22,782][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:38:27,783][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:38:32,784][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:38:37,785][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:38:42,786][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:38:47,787][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:38:52,788][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:38:57,789][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:39:02,790][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:39:07,791][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:39:12,791][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:39:17,792][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:39:22,793][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:39:27,794][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:39:32,795][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:39:37,796][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:39:42,797][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:39:47,798][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:39:52,799][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:39:57,801][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:40:02,801][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:40:07,802][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:40:08,344][  INFO][PID:1492344] Downloading results from builder
[2025-12-14 15:40:08,344][  INFO][PID:1492344] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c10c]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/09908397-bootc started
[2025-12-14 15:40:08,345][  INFO][PID:1492344] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c10c]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/09908397-bootc/ &> /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/09908397-bootc/build-09908397.rsync.log
[2025-12-14 15:41:08,418][  INFO][PID:1492344] rsyncing finished.
[2025-12-14 15:41:08,419][ ERROR][PID:1492344] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2025-12-14 15:41:08,419][ ERROR][PID:1492344] SSH connection lost on #1 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2025-12-14 15:41:18,420][  INFO][PID:1492344] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c10c]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/09908397-bootc started
[2025-12-14 15:41:18,421][  INFO][PID:1492344] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c10c]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/09908397-bootc/ &> /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/09908397-bootc/build-09908397.rsync.log
[2025-12-14 15:42:18,516][  INFO][PID:1492344] rsyncing finished.
[2025-12-14 15:42:18,517][ ERROR][PID:1492344] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2025-12-14 15:42:18,519][ ERROR][PID:1492344] SSH connection lost on #2 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2025-12-14 15:42:28,520][  INFO][PID:1492344] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c10c]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/09908397-bootc started
[2025-12-14 15:42:28,521][  INFO][PID:1492344] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c10c]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/09908397-bootc/ &> /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/09908397-bootc/build-09908397.rsync.log
[2025-12-14 15:43:28,593][  INFO][PID:1492344] rsyncing finished.
[2025-12-14 15:43:28,594][ ERROR][PID:1492344] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2025-12-14 15:43:28,594][ ERROR][PID:1492344] SSH connection lost on #3 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2025-12-14 15:43:38,595][ ERROR][PID:1492344] Re-try request for task on 'ResallocHost, ticket_id=334047, hostname=2620:52:6:1161:dead:beef:cafe:c10c, name=vmhost_p09_02_prod_00541135_20251214_145052, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': Unable to finish after 3 SSH attempts
[2025-12-14 15:43:38,595][  INFO][PID:1492344] Releasing VM back to pool
[2025-12-14 15:43:38,604][  INFO][PID:1492344] Retry #2 (on other host)
[2025-12-14 15:43:38,604][  INFO][PID:1492344] Checking that /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/repodata/repomd.xml exists
[2025-12-14 15:43:38,604][  INFO][PID:1492344] Checking for cancel request
[2025-12-14 15:43:38,605][  INFO][PID:1492344] VM allocation process starts
[2025-12-14 15:43:38,646][  INFO][PID:1492344] Trying to allocate VM: ResallocHost, ticket_id=334279, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-12-14 15:43:41,726][  INFO][PID:1492344] Allocated host ResallocHost, ticket_id=334279, hostname=2620:52:6:1161:dead:beef:cafe:c10e, name=vmhost_p09_02_prod_00541527_20251214_152134, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-12-14 15:43:41,727][  INFO][PID:1492344] Allocating ssh connection to builder
[2025-12-14 15:43:41,727][  INFO][PID:1492344] Checking that builder machine is OK
[2025-12-14 15:44:41,796][ ERROR][PID:1492344] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c10e port 22: Connection timed out

[2025-12-14 15:44:51,797][ ERROR][PID:1492344] Re-try request for task on 'ResallocHost, ticket_id=334279, hostname=2620:52:6:1161:dead:beef:cafe:c10e, name=vmhost_p09_02_prod_00541527_20251214_152134, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': Unable to finish after 1 SSH attempts
[2025-12-14 15:44:51,797][  INFO][PID:1492344] Releasing VM back to pool
[2025-12-14 15:44:51,806][ ERROR][PID:1492344] Backend process error: Three host tried without success: {'2620:52:6:1161:dead:beef:cafe:c10e', '2620:52:6:1161:dead:beef:cafe:c10c', '2620:52:6:1161:dead:beef:cafe:c14c'}
[2025-12-14 15:44:51,807][WARNING][PID:1492344] Switching not-finished job state to 'failed'
[2025-12-14 15:44:51,808][  INFO][PID:1492344] Worker failed build, took 1987.195508480072
[2025-12-14 15:44:51,808][  INFO][PID:1492344] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "rhcontainerbot",
            "project_name": "bootc",
            "project_dirname": "bootc",
            "submitter": "packit",
            "ended_on": 1765727091.807509,
            "started_on": 1765725104.6120005,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-eln-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9908397-fedora-eln-ppc64le",
            "build_id": 9908397,
            "package_name": "bootc",
            "package_version": "202512141506.g3efcbddeb3-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rhcontainerbot/bootc/bootc",
            "git_hash": "020ba0c55782c2b32300f0c6e7efb10e69b4ee35",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rhcontainerbot/bootc--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/fedora-eln-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://kojipkgs.fedoraproject.org/repos/eln-build/latest/$basearch/",
                    "id": "https_kojipkgs_fedoraproject_org_repos_eln_build_latest_basearch",
                    "name": "Additional repo https_kojipkgs_fedoraproject_org_repos_eln_build_latest_basearch"
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rhcontainerbot/bootc",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc",
            "result_dir": "09908397-bootc",
            "built_packages": "",
            "id": 9908397,
            "mockchain_macros": {
                "copr_username": "rhcontainerbot",
                "copr_projectname": "bootc",
                "vendor": "Fedora Project COPR (rhcontainerbot/bootc)"
            }
        }
    ]
}
[2025-12-14 15:44:51,872][  INFO][PID:1492344] Sending fedora-messaging bus message in build.end
[2025-12-14 15:44:52,431][  INFO][PID:1492344] Compressing /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/09908397-bootc/builder-live.log by gzip
[2025-12-14 15:44:52,433][  INFO][PID:1492344] Running command 'gzip /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/09908397-bootc/builder-live.log' as PID 1635128
[2025-12-14 15:44:52,664][  INFO][PID:1492344] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/09908397-bootc/builder-live.log)
[2025-12-14 15:44:52,665][  INFO][PID:1492344] Compressing /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/09908397-bootc/backend.log by gzip
[2025-12-14 15:44:52,666][  INFO][PID:1492344] Running command 'gzip /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/09908397-bootc/backend.log' as PID 1635138