[2026-02-08 02:37:21,063][  INFO][PID:3158551] Marking build as starting
[2026-02-08 02:37:21,139][  INFO][PID:3158551] Checking that /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-44-ppc64le/repodata/repomd.xml exists
[2026-02-08 02:37:21,140][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:37:21,141][  INFO][PID:3158551] VM allocation process starts
[2026-02-08 02:37:21,151][  INFO][PID:3158551] Trying to allocate VM: ResallocHost, ticket_id=1216400, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-02-08 02:37:24,200][  INFO][PID:3158551] Allocated host ResallocHost, ticket_id=1216400, hostname=2620:52:6:1161:dead:beef:cafe:c14d, name=vmhost_p09_03_prod_01996884_20260208_011335, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-02-08 02:37:24,201][  INFO][PID:3158551] Allocating ssh connection to builder
[2026-02-08 02:37:24,201][  INFO][PID:3158551] Checking that builder machine is OK
[2026-02-08 02:38:24,270][ ERROR][PID:3158551] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c14d port 22: Connection timed out

[2026-02-08 02:38:34,289][ ERROR][PID:3158551] Re-try request for task on 'ResallocHost, ticket_id=1216400, hostname=2620:52:6:1161:dead:beef:cafe:c14d, name=vmhost_p09_03_prod_01996884_20260208_011335, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts
[2026-02-08 02:38:34,290][  INFO][PID:3158551] Releasing VM back to pool
[2026-02-08 02:38:34,298][  INFO][PID:3158551] Retry #1 (on other host)
[2026-02-08 02:38:34,299][  INFO][PID:3158551] Checking that /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-44-ppc64le/repodata/repomd.xml exists
[2026-02-08 02:38:34,299][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:38:34,300][  INFO][PID:3158551] VM allocation process starts
[2026-02-08 02:38:34,332][  INFO][PID:3158551] Trying to allocate VM: ResallocHost, ticket_id=1216406, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-02-08 02:38:37,366][  INFO][PID:3158551] Allocated host ResallocHost, ticket_id=1216406, hostname=2620:52:6:1161:dead:beef:cafe:c190, name=vmhost_p09_04_prod_01996943_20260208_013246, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-02-08 02:38:37,366][  INFO][PID:3158551] Allocating ssh connection to builder
[2026-02-08 02:38:37,367][  INFO][PID:3158551] Checking that builder machine is OK
[2026-02-08 02:38:38,342][  INFO][PID:3158551] Running remote command: copr-builder-ready fedora-44-ppc64le
[2026-02-08 02:38:38,849][  INFO][PID:3158551] Red Hat subscription not needed for fedora-44-ppc64le
Builder is ready to be used

[2026-02-08 02:38:38,850][  INFO][PID:3158551] Filling build.info file with builder info
[2026-02-08 02:38:38,850][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:38:38,851][  INFO][PID:3158551] Not re-notifying FE and msg buses for the new host.
[2026-02-08 02:38:38,851][  INFO][PID:3158551] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10103028-fedora-44-ppc64le --chroot fedora-44-ppc64le --detached
[2026-02-08 02:38:39,825][  INFO][PID:3158551] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c190' (ED25519) to the list of known hosts.


[2026-02-08 02:38:39,826][  INFO][PID:3158551] Downloading the builder-live.log file, attempt 1
[2026-02-08 02:38:39,827][  INFO][PID:3158551] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c190 copr-rpmbuild-log
[2026-02-08 02:38:44,831][  INFO][PID:3158551] Periodic builder liveness probe: alive
[2026-02-08 02:38:44,832][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:38:49,833][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:38:54,834][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:38:59,835][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:39:04,835][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:39:09,836][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:39:14,837][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:39:19,838][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:39:24,839][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:39:29,840][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:39:34,841][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:39:39,842][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:39:39,892][ ERROR][PID:3158551] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-02-08 02:39:44,843][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:39:49,844][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:39:49,893][WARNING][PID:3158551] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-02-08 02:39:54,848][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:39:59,849][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:39:59,894][  INFO][PID:3158551] Downloading the builder-live.log file, attempt 2
[2026-02-08 02:39:59,895][  INFO][PID:3158551] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c190 copr-rpmbuild-log
[2026-02-08 02:40:04,850][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:40:09,851][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:40:14,852][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:40:19,853][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:40:24,854][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:40:29,855][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:40:34,856][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:40:39,857][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:40:44,858][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:40:49,859][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:40:54,860][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:40:59,861][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:40:59,963][ ERROR][PID:3158551] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-02-08 02:41:04,862][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:41:09,863][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:41:10,001][WARNING][PID:3158551] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-02-08 02:41:14,864][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:41:19,865][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:41:20,002][  INFO][PID:3158551] Downloading the builder-live.log file, attempt 3
[2026-02-08 02:41:20,003][  INFO][PID:3158551] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c190 copr-rpmbuild-log
[2026-02-08 02:41:24,866][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:41:29,867][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:41:34,867][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:41:39,868][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:41:44,869][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:41:49,870][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:41:54,871][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:41:59,872][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:42:04,873][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:42:09,874][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:42:14,875][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:42:19,876][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:42:20,066][ ERROR][PID:3158551] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-02-08 02:42:24,877][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:42:29,878][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:42:30,071][WARNING][PID:3158551] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-02-08 02:42:34,879][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:42:39,879][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:42:40,072][  INFO][PID:3158551] Downloading the builder-live.log file, attempt 4
[2026-02-08 02:42:40,073][  INFO][PID:3158551] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c190 copr-rpmbuild-log
[2026-02-08 02:42:44,880][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:42:49,881][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:42:54,882][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:42:59,883][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:43:04,884][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:43:09,885][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:43:14,886][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:43:19,887][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:43:24,888][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:43:29,889][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:43:34,890][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:43:39,891][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:43:40,104][ ERROR][PID:3158551] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-02-08 02:43:44,892][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:43:49,893][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:43:50,114][ ERROR][PID:3158551] Giving up for unstable SSH, failures: 1770518389.893503, 1770518470.001717, 1770518550.0713675, 1770518630.1139228
[2026-02-08 02:43:50,114][ ERROR][PID:3158551] Re-try request for task on 'ResallocHost, ticket_id=1216406, hostname=2620:52:6:1161:dead:beef:cafe:c190, name=vmhost_p09_04_prod_01996943_20260208_013246, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2026-02-08 02:43:50,115][  INFO][PID:3158551] Releasing VM back to pool
[2026-02-08 02:43:50,123][  INFO][PID:3158551] Retry #2 (on other host)
[2026-02-08 02:43:50,123][  INFO][PID:3158551] Checking that /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-44-ppc64le/repodata/repomd.xml exists
[2026-02-08 02:43:50,124][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:43:50,124][  INFO][PID:3158551] VM allocation process starts
[2026-02-08 02:43:50,165][  INFO][PID:3158551] Trying to allocate VM: ResallocHost, ticket_id=1216435, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-02-08 02:43:53,207][  INFO][PID:3158551] Allocated host ResallocHost, ticket_id=1216435, hostname=2620:52:6:1161:dead:beef:cafe:c149, name=vmhost_p09_03_prod_01996921_20260208_013027, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-02-08 02:43:53,207][  INFO][PID:3158551] Allocating ssh connection to builder
[2026-02-08 02:43:53,208][  INFO][PID:3158551] Checking that builder machine is OK
[2026-02-08 02:43:55,756][  INFO][PID:3158551] Running remote command: copr-builder-ready fedora-44-ppc64le
[2026-02-08 02:43:57,579][  INFO][PID:3158551] Red Hat subscription not needed for fedora-44-ppc64le
Builder is ready to be used

[2026-02-08 02:43:57,580][  INFO][PID:3158551] Filling build.info file with builder info
[2026-02-08 02:43:57,595][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:43:57,596][  INFO][PID:3158551] Not re-notifying FE and msg buses for the new host.
[2026-02-08 02:43:57,596][  INFO][PID:3158551] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10103028-fedora-44-ppc64le --chroot fedora-44-ppc64le --detached
[2026-02-08 02:43:59,845][  INFO][PID:3158551] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c149' (ED25519) to the list of known hosts.


[2026-02-08 02:43:59,846][  INFO][PID:3158551] Downloading the builder-live.log file, attempt 1
[2026-02-08 02:43:59,847][  INFO][PID:3158551] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c149 copr-rpmbuild-log
[2026-02-08 02:44:04,846][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:44:09,847][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:44:14,848][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:44:19,849][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:44:24,850][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:44:29,851][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:44:34,852][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:44:39,853][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:44:44,853][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:44:49,854][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:44:54,855][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:44:59,856][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:45:04,857][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:45:09,858][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:45:14,859][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:45:19,860][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:45:24,861][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:45:29,862][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:45:34,863][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:45:39,864][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:45:44,865][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:45:49,866][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:45:54,867][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:45:59,868][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:46:04,881][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:46:09,882][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:46:14,883][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:46:19,884][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:46:24,885][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:46:29,886][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:46:34,887][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:46:39,888][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:46:44,889][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:46:49,890][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:46:54,891][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:46:59,892][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:47:04,893][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:47:09,894][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:47:14,895][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:47:19,896][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:47:24,897][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:47:29,898][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:47:34,899][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:47:39,900][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:47:44,901][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:47:49,902][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:47:54,903][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:47:59,904][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:48:04,905][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:48:09,906][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:48:14,907][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:48:19,908][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:48:24,909][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:48:29,910][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:48:34,910][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:48:39,911][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:48:44,917][  INFO][PID:3158551] Periodic builder liveness probe: alive
[2026-02-08 02:48:44,917][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:48:49,918][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:48:54,919][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:48:59,920][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:49:04,921][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:49:09,922][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:49:14,923][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:49:19,923][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:49:24,925][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:49:29,926][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:49:34,927][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:49:39,928][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:49:44,929][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:49:49,930][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:49:54,931][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:49:59,932][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:50:04,933][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:50:09,934][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:50:14,935][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:50:19,935][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:50:24,936][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:50:29,937][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:50:34,938][  INFO][PID:3158551] Checking for cancel request
[2026-02-08 02:50:36,692][  INFO][PID:3158551] Downloading results from builder
[2026-02-08 02:50:36,692][  INFO][PID:3158551] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c149]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-44-ppc64le/10103028-libmodulemd started
[2026-02-08 02:50:36,693][  INFO][PID:3158551] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c149]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-44-ppc64le/10103028-libmodulemd/ &> /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-44-ppc64le/10103028-libmodulemd/build-10103028.rsync.log
[2026-02-08 02:50:37,407][  INFO][PID:3158551] rsyncing finished.
[2026-02-08 02:50:37,407][  INFO][PID:3158551] Releasing VM back to pool
[2026-02-08 02:50:37,416][  INFO][PID:3158551] Searching for 'success' file in resultdir
[2026-02-08 02:50:37,416][ ERROR][PID:3158551] Build failed: Backend process error: No success file => build failure
[2026-02-08 02:50:37,417][  INFO][PID:3158551] Finished build: id=10103028 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly chroot=fedora-44-ppc64le 
[2026-02-08 02:50:37,418][ ERROR][PID:3158551] Backend process error: No success file => build failure
[2026-02-08 02:50:37,419][  INFO][PID:3158551] Worker failed build, took 399.8229594230652
[2026-02-08 02:50:37,419][  INFO][PID:3158551] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "rpmsoftwaremanagement",
            "project_name": "dnf-nightly",
            "project_dirname": "dnf-nightly",
            "submitter": "rpmsoftwaremanagement",
            "ended_on": 1770519037.4192343,
            "started_on": 1770518637.5962749,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-44-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "10103028-fedora-44-ppc64le",
            "build_id": 10103028,
            "package_name": "libmodulemd",
            "package_version": "2.15.3-0.20260208020745897310.main.3.gf3039d8",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rpmsoftwaremanagement/dnf-nightly/libmodulemd",
            "git_hash": "74eec36fa22d22d3910978e4a7fc470ffbc6210b",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rpmsoftwaremanagement/dnf-nightly--rpmsoftwaremanagement",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly/fedora-44-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "bootstrap": "off",
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly",
            "result_dir": "10103028-libmodulemd",
            "built_packages": "",
            "id": 10103028,
            "mockchain_macros": {
                "copr_username": "rpmsoftwaremanagement",
                "copr_projectname": "dnf-nightly",
                "vendor": "Fedora Project COPR (rpmsoftwaremanagement/dnf-nightly)"
            }
        }
    ]
}
[2026-02-08 02:50:37,511][  INFO][PID:3158551] Sending fedora-messaging bus message in build.end
[2026-02-08 02:50:38,029][  INFO][PID:3158551] Compressing /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-44-ppc64le/10103028-libmodulemd/builder-live.log by gzip
[2026-02-08 02:50:38,030][  INFO][PID:3158551] Running command 'gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-44-ppc64le/10103028-libmodulemd/builder-live.log' as PID 3195554
[2026-02-08 02:50:38,096][  INFO][PID:3158551] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-44-ppc64le/10103028-libmodulemd/builder-live.log)
[2026-02-08 02:50:38,097][  INFO][PID:3158551] Compressing /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-44-ppc64le/10103028-libmodulemd/backend.log by gzip
[2026-02-08 02:50:38,098][  INFO][PID:3158551] Running command 'gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-44-ppc64le/10103028-libmodulemd/backend.log' as PID 3195555