[2025-12-19 02:43:38,418][  INFO][PID:574008] Marking build as starting
[2025-12-19 02:43:38,542][  INFO][PID:574008] Checking that /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-43-ppc64le/repodata/repomd.xml exists
[2025-12-19 02:43:38,643][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:43:38,644][  INFO][PID:574008] VM allocation process starts
[2025-12-19 02:43:38,655][  INFO][PID:574008] Trying to allocate VM: ResallocHost, ticket_id=433244, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-19 02:43:41,671][  INFO][PID:574008] Allocated host ResallocHost, ticket_id=433244, hostname=2620:52:6:1161:dead:beef:cafe:c14f, name=vmhost_p09_03_prod_00695511_20251219_023731, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-19 02:43:41,671][  INFO][PID:574008] Allocating ssh connection to builder
[2025-12-19 02:43:41,672][  INFO][PID:574008] Checking that builder machine is OK
[2025-12-19 02:44:41,741][ ERROR][PID:574008] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c14f port 22: Connection timed out

[2025-12-19 02:44:51,741][ ERROR][PID:574008] Re-try request for task on 'ResallocHost, ticket_id=433244, hostname=2620:52:6:1161:dead:beef:cafe:c14f, name=vmhost_p09_03_prod_00695511_20251219_023731, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts
[2025-12-19 02:44:51,742][  INFO][PID:574008] Releasing VM back to pool
[2025-12-19 02:44:51,771][  INFO][PID:574008] Retry #1 (on other host)
[2025-12-19 02:44:51,772][  INFO][PID:574008] Checking that /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-43-ppc64le/repodata/repomd.xml exists
[2025-12-19 02:44:51,772][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:44:51,773][  INFO][PID:574008] VM allocation process starts
[2025-12-19 02:44:51,832][  INFO][PID:574008] Trying to allocate VM: ResallocHost, ticket_id=433257, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-19 02:44:54,844][  INFO][PID:574008] Allocated host ResallocHost, ticket_id=433257, hostname=2620:52:6:1161:dead:beef:cafe:c188, name=vmhost_p09_04_prod_00695436_20251219_022928, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-19 02:44:54,844][  INFO][PID:574008] Allocating ssh connection to builder
[2025-12-19 02:44:54,845][  INFO][PID:574008] Checking that builder machine is OK
[2025-12-19 02:44:55,919][  INFO][PID:574008] Running remote command: copr-builder-ready fedora-43-ppc64le
[2025-12-19 02:44:56,395][  INFO][PID:574008] Red Hat subscription not needed for fedora-43-ppc64le
Builder is ready to be used

[2025-12-19 02:44:56,396][  INFO][PID:574008] Filling build.info file with builder info
[2025-12-19 02:44:56,396][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:44:56,397][  INFO][PID:574008] Not re-notifying FE and msg buses for the new host.
[2025-12-19 02:44:56,397][  INFO][PID:574008] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9932552-fedora-43-ppc64le --chroot fedora-43-ppc64le --detached
[2025-12-19 02:44:57,369][  INFO][PID:574008] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c188' (ED25519) to the list of known hosts.


[2025-12-19 02:44:57,371][  INFO][PID:574008] Downloading the builder-live.log file, attempt 1
[2025-12-19 02:44:57,373][  INFO][PID:574008] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c188 copr-rpmbuild-log
[2025-12-19 02:45:02,380][  INFO][PID:574008] Periodic builder liveness probe: alive
[2025-12-19 02:45:02,380][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:45:07,381][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:45:12,382][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:45:17,383][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:45:22,384][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:45:27,385][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:45:32,386][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:45:37,387][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:45:42,388][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:45:47,389][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:45:52,391][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:45:57,392][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:46:02,393][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:46:07,394][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:46:12,396][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:46:17,397][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:46:22,398][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:46:27,400][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:46:32,402][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:46:37,404][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:46:42,405][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:46:47,406][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:46:52,407][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:46:57,408][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:47:02,409][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:47:07,410][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:47:12,411][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:47:17,412][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:47:22,413][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:47:27,415][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:47:32,416][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:47:37,417][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:47:42,435][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:47:47,470][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:47:52,471][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:47:57,473][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:48:02,474][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:48:07,475][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:48:12,476][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:48:17,477][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:48:22,513][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:48:27,515][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:48:32,516][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:48:37,517][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:48:42,518][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:48:47,519][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:48:52,520][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:48:57,521][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:49:02,521][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:49:07,523][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:49:12,523][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:49:17,524][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:49:22,525][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:49:27,526][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:49:32,528][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:49:37,529][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:49:42,530][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:49:47,530][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:49:52,532][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:49:57,533][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:50:02,534][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:50:07,535][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:50:12,536][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:50:17,537][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:50:22,538][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:50:27,540][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:50:32,541][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:50:37,542][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:50:42,543][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:50:47,544][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:50:52,545][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:50:57,546][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:51:02,548][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:51:07,549][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:51:12,550][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:51:17,551][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:51:22,552][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:51:27,553][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:51:32,554][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:51:37,555][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:51:42,556][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:51:47,557][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:51:52,558][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:51:57,559][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:52:02,560][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:52:07,561][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:52:12,562][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:52:17,563][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:52:22,564][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:52:27,565][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:52:32,576][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:52:37,578][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:52:42,579][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:52:47,580][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:52:52,581][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:52:57,588][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:53:02,589][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:53:07,590][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:53:12,591][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:53:17,592][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:53:22,593][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:53:27,594][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:53:32,595][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:53:37,596][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:53:42,598][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:53:47,599][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:53:52,600][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:53:57,601][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:54:02,602][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:54:07,603][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:54:12,604][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:54:17,606][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:54:22,607][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:54:27,608][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:54:32,609][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:54:37,611][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:54:42,612][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:54:47,613][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:54:52,616][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:54:57,618][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:55:02,626][  INFO][PID:574008] Periodic builder liveness probe: alive
[2025-12-19 02:55:02,627][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:55:07,631][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:55:12,633][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:55:17,634][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:55:22,635][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:55:27,995][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:55:32,997][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:55:38,001][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:55:43,002][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:55:48,004][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:55:53,005][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:55:58,006][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:56:03,007][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:56:08,008][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:56:13,009][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:56:18,010][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:56:23,013][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:56:28,013][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:56:33,014][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:56:38,016][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:56:43,017][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:56:48,018][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:56:53,019][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:56:58,020][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:57:03,021][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:57:08,022][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:57:13,023][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:57:18,024][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:57:23,025][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:57:28,026][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:57:33,027][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:57:38,028][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:57:43,029][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:57:48,030][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:57:53,031][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:57:58,032][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:58:03,033][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:58:08,118][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:58:13,119][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:58:18,121][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:58:23,122][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:58:28,123][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:58:33,379][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:58:38,659][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:58:43,660][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:58:48,661][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:58:53,662][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:58:58,663][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:59:03,664][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:59:08,665][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:59:13,666][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:59:18,667][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:59:23,668][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:59:28,669][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:59:33,670][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:59:38,671][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:59:43,672][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:59:48,673][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:59:53,674][  INFO][PID:574008] Checking for cancel request
[2025-12-19 02:59:58,675][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:00:03,676][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:00:08,677][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:00:13,678][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:00:18,679][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:00:23,680][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:00:28,681][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:00:33,682][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:00:38,683][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:00:43,684][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:00:48,685][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:00:53,686][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:00:58,687][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:01:03,688][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:01:08,689][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:01:13,690][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:01:18,691][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:01:23,692][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:01:28,693][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:01:33,697][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:01:38,698][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:01:43,699][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:01:48,701][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:01:53,756][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:01:58,757][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:02:03,758][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:02:08,759][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:02:13,760][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:02:18,761][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:02:23,762][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:02:28,763][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:02:33,764][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:02:38,765][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:02:43,766][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:02:48,767][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:02:53,768][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:02:58,769][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:03:03,770][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:03:08,771][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:03:13,771][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:03:18,772][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:03:23,773][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:03:28,774][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:03:33,775][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:03:38,776][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:03:43,777][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:03:48,778][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:03:53,818][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:03:58,818][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:04:03,819][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:04:08,821][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:04:13,823][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:04:18,824][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:04:23,825][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:04:28,825][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:04:33,826][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:04:38,828][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:04:43,829][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:04:48,830][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:04:53,831][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:04:58,831][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:05:03,837][  INFO][PID:574008] Periodic builder liveness probe: alive
[2025-12-19 03:05:03,838][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:05:08,838][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:05:13,839][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:05:18,840][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:05:23,841][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:05:28,842][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:05:33,843][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:05:38,844][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:05:43,845][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:05:48,846][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:05:53,847][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:05:58,848][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:06:03,849][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:06:08,850][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:06:13,851][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:06:18,852][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:06:23,853][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:06:28,854][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:06:33,855][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:06:38,856][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:06:43,857][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:06:48,858][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:06:53,859][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:06:58,860][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:07:03,861][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:07:08,862][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:07:13,863][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:07:18,864][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:07:23,865][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:07:28,866][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:07:33,867][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:07:38,868][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:07:43,869][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:07:48,870][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:07:53,871][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:07:58,872][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:08:03,872][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:08:08,873][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:08:13,874][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:08:18,875][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:08:23,877][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:08:28,878][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:08:33,879][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:08:38,880][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:08:43,881][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:08:48,882][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:08:53,883][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:08:58,884][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:09:03,885][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:09:08,886][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:09:13,887][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:09:18,887][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:09:23,888][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:09:28,889][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:09:33,891][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:09:38,892][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:09:43,893][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:09:48,894][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:09:53,895][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:09:58,896][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:10:03,897][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:10:08,898][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:10:13,899][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:10:18,900][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:10:23,902][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:10:28,902][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:10:33,903][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:10:38,904][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:10:43,905][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:10:48,906][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:10:53,907][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:10:58,908][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:11:03,909][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:11:08,303][ ERROR][PID:574008] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-19 03:11:08,910][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:11:13,912][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:11:18,304][WARNING][PID:574008] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-12-19 03:11:18,913][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:11:23,914][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:11:28,305][  INFO][PID:574008] Downloading the builder-live.log file, attempt 2
[2025-12-19 03:11:28,479][  INFO][PID:574008] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c188 copr-rpmbuild-log
[2025-12-19 03:11:28,915][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:11:33,918][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:11:38,920][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:11:43,921][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:11:48,922][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:11:53,924][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:11:58,925][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:12:03,926][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:12:08,947][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:12:13,948][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:12:18,949][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:12:23,950][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:12:28,951][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:12:33,952][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:12:38,953][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:12:43,954][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:12:48,955][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:12:53,957][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:12:58,958][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:13:03,959][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:13:08,960][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:13:13,964][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:13:18,967][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:13:23,968][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:13:28,970][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:13:29,850][ ERROR][PID:574008] Re-try request for task on 'ResallocHost, ticket_id=433257, hostname=2620:52:6:1161:dead:beef:cafe:c188, name=vmhost_p09_04_prod_00695436_20251219_022928, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: copr-rpmbuild-log shouldn't exit != 0
[2025-12-19 03:13:29,851][  INFO][PID:574008] Releasing VM back to pool
[2025-12-19 03:13:29,862][  INFO][PID:574008] Retry #2 (on other host)
[2025-12-19 03:13:29,863][  INFO][PID:574008] Checking that /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-43-ppc64le/repodata/repomd.xml exists
[2025-12-19 03:13:29,889][  INFO][PID:574008] Checking for cancel request
[2025-12-19 03:13:29,891][  INFO][PID:574008] VM allocation process starts
[2025-12-19 03:13:29,903][  INFO][PID:574008] Trying to allocate VM: ResallocHost, ticket_id=433582, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-19 03:13:32,917][  INFO][PID:574008] Allocated host ResallocHost, ticket_id=433582, hostname=2620:52:6:1161:dead:beef:cafe:c194, name=vmhost_p09_04_prod_00695678_20251219_024943, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-19 03:13:32,918][  INFO][PID:574008] Allocating ssh connection to builder
[2025-12-19 03:13:32,920][  INFO][PID:574008] Checking that builder machine is OK
[2025-12-19 03:14:32,963][ ERROR][PID:574008] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c194 port 22: Connection timed out

[2025-12-19 03:14:42,964][ ERROR][PID:574008] Re-try request for task on 'ResallocHost, ticket_id=433582, hostname=2620:52:6:1161:dead:beef:cafe:c194, name=vmhost_p09_04_prod_00695678_20251219_024943, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts
[2025-12-19 03:14:42,965][  INFO][PID:574008] Releasing VM back to pool
[2025-12-19 03:14:42,976][ ERROR][PID:574008] Backend process error: Three host tried without success: {'2620:52:6:1161:dead:beef:cafe:c194', '2620:52:6:1161:dead:beef:cafe:c14f', '2620:52:6:1161:dead:beef:cafe:c188'}
[2025-12-19 03:14:42,977][WARNING][PID:574008] Switching not-finished job state to 'failed'
[2025-12-19 03:14:42,977][  INFO][PID:574008] Worker failed build, took 1786.580078125
[2025-12-19 03:14:42,978][  INFO][PID:574008] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "rhcontainerbot",
            "project_name": "bootc",
            "project_dirname": "bootc",
            "submitter": "packit",
            "ended_on": 1766114082.977438,
            "started_on": 1766112296.3973598,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-43-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9932552-fedora-43-ppc64le",
            "build_id": 9932552,
            "package_name": "bootc",
            "package_version": "202512190045.g72f1f2720d-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rhcontainerbot/bootc/bootc",
            "git_hash": "3520332825aee3ba198c34e52895be9c3dda74b5",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rhcontainerbot/bootc--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/fedora-43-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rhcontainerbot/bootc",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc",
            "result_dir": "09932552-bootc",
            "built_packages": "",
            "id": 9932552,
            "mockchain_macros": {
                "copr_username": "rhcontainerbot",
                "copr_projectname": "bootc",
                "vendor": "Fedora Project COPR (rhcontainerbot/bootc)"
            }
        }
    ]
}
[2025-12-19 03:14:43,071][  INFO][PID:574008] Sending fedora-messaging bus message in build.end
[2025-12-19 03:14:43,648][  INFO][PID:574008] Compressing /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-43-ppc64le/09932552-bootc/builder-live.log by gzip
[2025-12-19 03:14:43,650][  INFO][PID:574008] Running command 'gzip /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-43-ppc64le/09932552-bootc/builder-live.log' as PID 711992
[2025-12-19 03:14:43,668][  INFO][PID:574008] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-43-ppc64le/09932552-bootc/builder-live.log)
[2025-12-19 03:14:43,669][  INFO][PID:574008] Compressing /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-43-ppc64le/09932552-bootc/backend.log by gzip
[2025-12-19 03:14:43,670][  INFO][PID:574008] Running command 'gzip /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-43-ppc64le/09932552-bootc/backend.log' as PID 711993