[2025-12-14 00:42:15,844][  INFO][PID:1857777] Marking build as starting
[2025-12-14 00:42:16,160][  INFO][PID:1857777] Checking that /var/lib/copr/public_html/results/topazus/test-review/fedora-43-ppc64le/repodata/repomd.xml exists
[2025-12-14 00:42:16,169][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:42:16,174][  INFO][PID:1857777] VM allocation process starts
[2025-12-14 00:42:16,194][  INFO][PID:1857777] Trying to allocate VM: ResallocHost, ticket_id=326270, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-14 00:42:21,196][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:42:22,224][  INFO][PID:1857777] Allocated host ResallocHost, ticket_id=326270, hostname=2620:52:6:1161:dead:beef:cafe:c18b, name=vmhost_p09_04_prod_00529959_20251214_000825, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-14 00:42:22,225][  INFO][PID:1857777] Allocating ssh connection to builder
[2025-12-14 00:42:22,225][  INFO][PID:1857777] Checking that builder machine is OK
[2025-12-14 00:42:23,192][  INFO][PID:1857777] Running remote command: copr-builder-ready fedora-43-ppc64le
[2025-12-14 00:42:23,264][ ERROR][PID:1857777] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c18b port 22: Permission denied

[2025-12-14 00:42:33,266][ ERROR][PID:1857777] Re-try request for task on 'ResallocHost, ticket_id=326270, hostname=2620:52:6:1161:dead:beef:cafe:c18b, name=vmhost_p09_04_prod_00529959_20251214_000825, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts
[2025-12-14 00:42:33,268][  INFO][PID:1857777] Releasing VM back to pool
[2025-12-14 00:42:33,285][  INFO][PID:1857777] Retry #1 (on other host)
[2025-12-14 00:42:33,287][  INFO][PID:1857777] Checking that /var/lib/copr/public_html/results/topazus/test-review/fedora-43-ppc64le/repodata/repomd.xml exists
[2025-12-14 00:42:33,287][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:42:33,288][  INFO][PID:1857777] VM allocation process starts
[2025-12-14 00:42:33,307][  INFO][PID:1857777] Trying to allocate VM: ResallocHost, ticket_id=326280, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-14 00:42:38,316][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:42:43,319][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:42:45,365][  INFO][PID:1857777] Allocated host ResallocHost, ticket_id=326280, hostname=2620:52:6:1161:dead:beef:cafe:c10e, name=vmhost_p09_02_prod_00530059_20251214_001855, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-14 00:42:45,366][  INFO][PID:1857777] Allocating ssh connection to builder
[2025-12-14 00:42:45,366][  INFO][PID:1857777] Checking that builder machine is OK
[2025-12-14 00:42:46,325][  INFO][PID:1857777] Running remote command: copr-builder-ready fedora-43-ppc64le
[2025-12-14 00:42:46,897][  INFO][PID:1857777] Red Hat subscription not needed for fedora-43-ppc64le
Builder is ready to be used

[2025-12-14 00:42:46,898][  INFO][PID:1857777] Filling build.info file with builder info
[2025-12-14 00:42:46,899][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:42:46,899][  INFO][PID:1857777] Not re-notifying FE and msg buses for the new host.
[2025-12-14 00:42:46,900][  INFO][PID:1857777] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9907025-fedora-43-ppc64le --chroot fedora-43-ppc64le --detached
[2025-12-14 00:42:47,824][  INFO][PID:1857777] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c10e' (ED25519) to the list of known hosts.


[2025-12-14 00:42:47,825][  INFO][PID:1857777] Downloading the builder-live.log file, attempt 1
[2025-12-14 00:42:47,827][  INFO][PID:1857777] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c10e copr-rpmbuild-log
[2025-12-14 00:42:52,838][  INFO][PID:1857777] Periodic builder liveness probe: alive
[2025-12-14 00:42:52,839][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:42:57,840][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:43:02,841][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:43:07,842][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:43:12,843][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:43:17,845][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:43:22,847][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:43:27,848][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:43:32,850][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:43:37,851][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:43:42,852][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:43:47,853][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:43:52,854][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:43:57,855][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:44:02,857][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:44:07,858][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:44:12,859][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:44:17,860][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:44:22,861][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:44:27,862][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:44:32,863][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:44:37,864][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:44:42,865][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:44:47,866][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:44:52,867][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:44:57,868][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:45:02,869][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:45:07,870][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:45:12,871][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:45:17,873][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:45:22,873][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:45:27,874][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:45:32,875][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:45:37,876][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:45:42,877][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:45:47,878][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:45:52,879][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:45:57,880][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:46:02,881][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:46:07,882][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:46:12,883][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:46:18,010][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:46:23,011][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:46:28,013][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:46:33,014][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:46:38,021][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:46:43,022][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:46:48,023][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:46:53,025][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:46:58,026][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:47:03,027][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:47:08,125][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:47:13,126][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:47:18,128][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:47:23,129][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:47:28,130][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:47:33,174][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:47:38,424][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:47:43,425][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:47:48,426][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:47:53,427][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:47:58,716][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:48:03,717][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:48:08,718][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:48:13,719][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:48:18,720][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:48:23,721][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:48:28,722][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:48:33,723][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:48:38,928][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:48:43,929][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:48:48,930][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:48:53,931][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:48:58,932][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:49:03,933][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:49:08,957][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:49:13,958][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:49:18,970][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:49:24,096][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:49:29,097][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:49:34,098][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:49:39,099][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:49:44,100][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:49:49,101][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:49:54,281][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:49:59,282][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:50:04,283][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:50:09,284][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:50:14,285][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:50:19,442][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:50:24,443][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:50:29,444][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:50:34,445][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:50:39,446][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:50:44,447][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:50:49,448][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:50:54,495][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:50:59,496][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:51:04,497][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:51:09,498][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:51:14,499][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:51:19,589][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:51:24,640][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:51:29,641][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:51:34,641][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:51:39,642][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:51:44,658][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:51:49,660][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:51:54,940][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:51:59,942][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:52:04,942][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:52:09,981][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:52:14,983][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:52:19,983][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:52:24,984][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:52:29,985][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:52:34,986][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:52:40,356][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:52:45,357][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:52:50,358][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:52:55,423][  INFO][PID:1857777] Periodic builder liveness probe: alive
[2025-12-14 00:52:55,423][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:53:00,424][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:53:05,425][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:53:10,426][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:53:15,427][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:53:20,428][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:53:25,430][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:53:30,626][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:53:35,629][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:53:40,631][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:53:45,632][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:53:50,633][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:53:55,635][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:54:00,673][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:54:05,677][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:54:10,680][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:54:15,682][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:54:20,814][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:54:25,961][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:54:30,962][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:54:35,963][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:54:41,145][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:54:46,146][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:54:51,147][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:54:56,148][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:55:01,149][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:55:06,293][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:55:11,297][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:55:16,299][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:55:21,300][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:55:26,484][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:55:31,594][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:55:36,595][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:55:41,597][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:55:46,598][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:55:51,717][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:55:56,779][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:56:01,780][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:56:06,781][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:56:11,782][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:56:16,935][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:56:21,952][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:56:27,272][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:56:32,275][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:56:37,276][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:56:42,277][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:56:47,567][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:56:52,567][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:56:57,568][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:57:02,569][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:57:07,570][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:57:12,571][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:57:17,572][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:57:22,573][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:57:27,574][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:57:32,575][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:57:37,576][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:57:42,577][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:57:47,578][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:57:52,579][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:57:57,633][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:58:02,635][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:58:07,638][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:58:12,645][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:58:17,647][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:58:22,660][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:58:27,665][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:58:32,669][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:58:37,673][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:58:42,674][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:58:47,713][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:58:52,715][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:58:57,716][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:59:02,717][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:59:07,718][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:59:12,719][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:59:17,755][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:59:22,758][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:59:27,835][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:59:32,876][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:59:38,374][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:59:43,375][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:59:48,377][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:59:53,379][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 00:59:58,381][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:00:03,383][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:00:08,384][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:00:13,385][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:00:18,386][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:00:23,386][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:00:28,388][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:00:33,388][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:00:38,757][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:00:43,758][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:00:48,759][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:00:53,760][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:00:58,761][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:01:03,762][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:01:08,763][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:01:13,764][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:01:18,766][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:01:23,767][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:01:28,768][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:01:33,777][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:01:38,876][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:01:43,954][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:01:49,080][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:01:54,081][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:01:59,264][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:02:04,268][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:02:09,269][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:02:14,270][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:02:19,272][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:02:24,282][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:02:29,285][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:02:34,286][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:02:39,287][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:02:44,451][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:02:49,453][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:02:54,455][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:02:59,463][  INFO][PID:1857777] Periodic builder liveness probe: dead
[2025-12-14 01:02:59,464][  INFO][PID:1857777] calling cancel callback, and waiting
[2025-12-14 01:03:44,141][ ERROR][PID:1857777] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-14 01:03:54,142][WARNING][PID:1857777] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-12-14 01:03:59,533][ ERROR][PID:1857777] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c10e port 22: Connection timed out

[2025-12-14 01:04:04,142][  INFO][PID:1857777] Downloading the builder-live.log file, attempt 2
[2025-12-14 01:04:04,144][  INFO][PID:1857777] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c10e copr-rpmbuild-log
[2025-12-14 01:04:10,291][WARNING][PID:1857777] Can't cancel build
out:

err:
Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c10e' (ED25519) to the list of known hosts.
Traceback (most recent call last):
  File "/usr/bin/copr-rpmbuild-cancel", line 85, in <module>
    _main()
    ~~~~~^^
  File "/usr/bin/copr-rpmbuild-cancel", line 69, in _main
    with open(pidfile, "r") as pidfd:
         ~~~~^^^^^^^^^^^^^^
FileNotFoundError: [Errno 2] No such file or directory: '/var/lib/copr-rpmbuild/pid'

[2025-12-14 01:06:05,385][ ERROR][PID:1857777] Re-try request for task on 'ResallocHost, ticket_id=326280, hostname=2620:52:6:1161:dead:beef:cafe:c10e, name=vmhost_p09_02_prod_00530059_20251214_001855, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED
[2025-12-14 01:06:05,385][  INFO][PID:1857777] Releasing VM back to pool
[2025-12-14 01:06:05,395][  INFO][PID:1857777] Retry #2 (on other host)
[2025-12-14 01:06:05,395][  INFO][PID:1857777] Checking that /var/lib/copr/public_html/results/topazus/test-review/fedora-43-ppc64le/repodata/repomd.xml exists
[2025-12-14 01:06:05,396][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:06:05,396][  INFO][PID:1857777] VM allocation process starts
[2025-12-14 01:06:05,409][  INFO][PID:1857777] Trying to allocate VM: ResallocHost, ticket_id=326379, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-14 01:06:10,410][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:06:11,429][  INFO][PID:1857777] Allocated host ResallocHost, ticket_id=326379, hostname=2620:52:6:1161:dead:beef:cafe:c18e, name=vmhost_p09_04_prod_00530195_20251214_003331, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-14 01:06:11,430][  INFO][PID:1857777] Allocating ssh connection to builder
[2025-12-14 01:06:11,430][  INFO][PID:1857777] Checking that builder machine is OK
[2025-12-14 01:06:12,461][  INFO][PID:1857777] Running remote command: copr-builder-ready fedora-43-ppc64le
[2025-12-14 01:06:12,959][  INFO][PID:1857777] Red Hat subscription not needed for fedora-43-ppc64le
Builder is ready to be used

[2025-12-14 01:06:12,959][  INFO][PID:1857777] Filling build.info file with builder info
[2025-12-14 01:06:12,983][  INFO][PID:1857777] Checking for cancel request
[2025-12-14 01:06:12,984][  INFO][PID:1857777] Not re-notifying FE and msg buses for the new host.
[2025-12-14 01:06:12,984][  INFO][PID:1857777] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9907025-fedora-43-ppc64le --chroot fedora-43-ppc64le --detached
[2025-12-14 01:07:13,050][ ERROR][PID:1857777] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c18e port 22: Connection timed out

[2025-12-14 01:07:23,051][ ERROR][PID:1857777] Re-try request for task on 'ResallocHost, ticket_id=326379, hostname=2620:52:6:1161:dead:beef:cafe:c18e, name=vmhost_p09_04_prod_00530195_20251214_003331, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts
[2025-12-14 01:07:23,051][  INFO][PID:1857777] Releasing VM back to pool
[2025-12-14 01:07:23,061][ ERROR][PID:1857777] Backend process error: Three host tried without success: {'2620:52:6:1161:dead:beef:cafe:c18e', '2620:52:6:1161:dead:beef:cafe:c10e', '2620:52:6:1161:dead:beef:cafe:c18b'}
[2025-12-14 01:07:23,062][WARNING][PID:1857777] Switching not-finished job state to 'failed'
[2025-12-14 01:07:23,062][  INFO][PID:1857777] Worker failed build, took 70.07786893844604
[2025-12-14 01:07:23,063][  INFO][PID:1857777] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "topazus",
            "project_name": "test-review",
            "project_dirname": "test-review",
            "submitter": "topazus",
            "ended_on": 1765674443.0620484,
            "started_on": 1765674372.9841795,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-43-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9907025-fedora-43-ppc64le",
            "build_id": 9907025,
            "package_name": "deepin-manual",
            "package_version": "6.5.41-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/topazus/test-review/deepin-manual",
            "git_hash": "111cdc7eeb0893228792bde34c2ad661c6170459",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "topazus/test-review--topazus",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/topazus/test-review/fedora-43-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/topazus/test-review/fedora-43-ppc64le/",
                    "id": "copr_topazus_test_review",
                    "name": "Additional repo copr_topazus_test_review"
                }
            ],
            "background": false,
            "fedora_review": true,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/topazus/test-review",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/topazus/test-review",
            "result_dir": "09907025-deepin-manual",
            "built_packages": "",
            "id": 9907025,
            "mockchain_macros": {
                "copr_username": "topazus",
                "copr_projectname": "test-review",
                "vendor": "Fedora Project COPR (topazus/test-review)"
            }
        }
    ]
}
[2025-12-14 01:07:23,118][  INFO][PID:1857777] Sending fedora-messaging bus message in build.end
[2025-12-14 01:07:23,630][  INFO][PID:1857777] Compressing /var/lib/copr/public_html/results/topazus/test-review/fedora-43-ppc64le/09907025-deepin-manual/builder-live.log by gzip
[2025-12-14 01:07:23,631][  INFO][PID:1857777] Running command 'gzip /var/lib/copr/public_html/results/topazus/test-review/fedora-43-ppc64le/09907025-deepin-manual/builder-live.log' as PID 1953071
[2025-12-14 01:07:23,632][  INFO][PID:1857777] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/topazus/test-review/fedora-43-ppc64le/09907025-deepin-manual/builder-live.log)
[2025-12-14 01:07:23,633][  INFO][PID:1857777] Compressing /var/lib/copr/public_html/results/topazus/test-review/fedora-43-ppc64le/09907025-deepin-manual/backend.log by gzip
[2025-12-14 01:07:23,633][  INFO][PID:1857777] Running command 'gzip /var/lib/copr/public_html/results/topazus/test-review/fedora-43-ppc64le/09907025-deepin-manual/backend.log' as PID 1953072