[2025-11-12 18:01:34,814][ INFO][PID:2751109] Marking build as starting [2025-11-12 18:01:34,927][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:01:34,928][ INFO][PID:2751109] VM allocation process starts [2025-11-12 18:01:34,940][ INFO][PID:2751109] Trying to allocate VM: ResallocHost, ticket_id=6149187, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-11-12 18:01:37,954][ INFO][PID:2751109] Allocated host ResallocHost, ticket_id=6149187, hostname=2620:52:6:1161:dead:beef:cafe:c195, name=vmhost_p09_04_prod_07961414_20251112_173803, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-11-12 18:01:37,955][ INFO][PID:2751109] Allocating ssh connection to builder [2025-11-12 18:01:37,956][ INFO][PID:2751109] Checking that builder machine is OK [2025-11-12 18:02:38,025][ ERROR][PID:2751109] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c195 port 22: Connection timed out [2025-11-12 18:02:48,026][ ERROR][PID:2751109] Re-try request for task on 'ResallocHost, ticket_id=6149187, hostname=2620:52:6:1161:dead:beef:cafe:c195, name=vmhost_p09_04_prod_07961414_20251112_173803, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts [2025-11-12 18:02:48,026][ INFO][PID:2751109] Releasing VM back to pool [2025-11-12 18:02:48,037][ INFO][PID:2751109] Retry #1 (on other host) [2025-11-12 18:02:48,038][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:02:48,038][ INFO][PID:2751109] VM allocation process starts [2025-11-12 18:02:48,050][ INFO][PID:2751109] Trying to allocate VM: ResallocHost, ticket_id=6149202, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-11-12 18:02:51,089][ INFO][PID:2751109] Allocated host ResallocHost, ticket_id=6149202, hostname=2620:52:6:1161:dead:beef:cafe:c194, name=vmhost_p09_04_prod_07961436_20251112_173959, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-11-12 18:02:51,090][ INFO][PID:2751109] Allocating ssh connection to builder [2025-11-12 18:02:51,090][ INFO][PID:2751109] Checking that builder machine is OK [2025-11-12 18:02:52,133][ INFO][PID:2751109] Running remote command: copr-builder-ready fedora-rawhide-ppc64le [2025-11-12 18:02:52,650][ INFO][PID:2751109] Red Hat subscription not needed for fedora-rawhide-ppc64le Builder is ready to be used [2025-11-12 18:02:52,651][ INFO][PID:2751109] Filling build.info file with builder info [2025-11-12 18:02:52,651][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:02:52,652][ INFO][PID:2751109] Not re-notifying FE and msg buses for the new host. [2025-11-12 18:02:52,655][ INFO][PID:2751109] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9791965-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached [2025-11-12 18:02:53,656][ INFO][PID:2751109] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c194' (ED25519) to the list of known hosts. [2025-11-12 18:02:53,657][ INFO][PID:2751109] Downloading the builder-live.log file, attempt 1 [2025-11-12 18:02:53,660][ INFO][PID:2751109] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c194 copr-rpmbuild-log [2025-11-12 18:02:58,663][ INFO][PID:2751109] Periodic builder liveness probe: alive [2025-11-12 18:02:58,664][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:03:03,666][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:03:08,668][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:03:13,669][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:03:18,670][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:03:23,671][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:03:28,673][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:03:33,674][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:03:38,675][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:03:43,676][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:03:48,681][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:03:53,682][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:03:58,683][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:04:03,685][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:04:08,686][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:04:13,688][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:04:18,689][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:04:23,691][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:04:28,692][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:04:33,693][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:04:38,694][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:04:43,696][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:04:48,697][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:04:53,698][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:04:58,699][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:05:03,700][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:05:08,701][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:05:13,702][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:05:18,704][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:05:23,705][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:05:28,706][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:05:33,707][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:05:38,708][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:05:43,709][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:05:48,711][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:05:53,712][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:05:58,713][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:06:03,714][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:06:08,716][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:06:13,718][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:06:18,719][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:06:23,720][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:06:28,722][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:06:33,723][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:06:38,724][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:06:43,725][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:06:48,726][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:06:53,728][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:06:58,729][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:07:03,730][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:07:08,732][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:07:13,734][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:07:18,735][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:07:23,736][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:07:28,737][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:07:33,738][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:07:38,739][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:07:43,741][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:07:48,742][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:07:53,745][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:07:58,746][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:08:03,747][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:08:08,749][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:08:13,750][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:08:18,751][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:08:23,752][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:08:28,753][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:08:33,754][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:08:38,755][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:08:43,757][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:08:48,758][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:08:53,759][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:08:58,761][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:09:03,762][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:09:08,763][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:09:13,766][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:09:18,769][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:09:23,770][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:09:28,771][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:09:33,772][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:09:38,773][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:09:42,614][ INFO][PID:2751109] Downloading results from builder [2025-11-12 18:09:42,615][ INFO][PID:2751109] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c194]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml started [2025-11-12 18:09:42,616][ INFO][PID:2751109] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c194]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/ &> /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/build-09791965.rsync.log [2025-11-12 18:10:42,697][ INFO][PID:2751109] rsyncing finished. [2025-11-12 18:10:42,699][ ERROR][PID:2751109] Failed to download data from builder due to rsync error, see the rsync log file for details. [2025-11-12 18:10:42,699][ ERROR][PID:2751109] SSH connection lost on #1 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details. [2025-11-12 18:10:52,700][ INFO][PID:2751109] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c194]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml started [2025-11-12 18:10:52,701][ INFO][PID:2751109] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c194]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/ &> /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/build-09791965.rsync.log [2025-11-12 18:11:52,797][ INFO][PID:2751109] rsyncing finished. [2025-11-12 18:11:52,798][ ERROR][PID:2751109] Failed to download data from builder due to rsync error, see the rsync log file for details. [2025-11-12 18:11:52,798][ ERROR][PID:2751109] SSH connection lost on #2 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details. [2025-11-12 18:12:02,799][ INFO][PID:2751109] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c194]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml started [2025-11-12 18:12:02,802][ INFO][PID:2751109] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c194]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/ &> /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/build-09791965.rsync.log [2025-11-12 18:13:02,933][ INFO][PID:2751109] rsyncing finished. [2025-11-12 18:13:02,934][ ERROR][PID:2751109] Failed to download data from builder due to rsync error, see the rsync log file for details. [2025-11-12 18:13:02,936][ ERROR][PID:2751109] SSH connection lost on #3 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details. [2025-11-12 18:13:12,937][ ERROR][PID:2751109] Re-try request for task on 'ResallocHost, ticket_id=6149202, hostname=2620:52:6:1161:dead:beef:cafe:c194, name=vmhost_p09_04_prod_07961436_20251112_173959, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 3 SSH attempts [2025-11-12 18:13:12,939][ INFO][PID:2751109] Releasing VM back to pool [2025-11-12 18:13:12,970][ INFO][PID:2751109] Retry #2 (on other host) [2025-11-12 18:13:12,971][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:13:12,972][ INFO][PID:2751109] VM allocation process starts [2025-11-12 18:13:13,025][ INFO][PID:2751109] Trying to allocate VM: ResallocHost, ticket_id=6149444, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-11-12 18:13:18,029][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:13:19,148][ INFO][PID:2751109] Allocated host ResallocHost, ticket_id=6149444, hostname=2620:52:6:1161:dead:beef:cafe:c154, name=vmhost_p09_03_prod_07961434_20251112_173948, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-11-12 18:13:19,148][ INFO][PID:2751109] Allocating ssh connection to builder [2025-11-12 18:13:19,149][ INFO][PID:2751109] Checking that builder machine is OK [2025-11-12 18:13:20,160][ INFO][PID:2751109] Running remote command: copr-builder-ready fedora-rawhide-ppc64le [2025-11-12 18:13:20,722][ INFO][PID:2751109] Red Hat subscription not needed for fedora-rawhide-ppc64le Builder is ready to be used [2025-11-12 18:13:20,723][ INFO][PID:2751109] Filling build.info file with builder info [2025-11-12 18:13:20,735][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:13:20,737][ INFO][PID:2751109] Not re-notifying FE and msg buses for the new host. [2025-11-12 18:13:20,738][ INFO][PID:2751109] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9791965-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached [2025-11-12 18:13:21,602][ INFO][PID:2751109] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c154' (ED25519) to the list of known hosts. [2025-11-12 18:13:21,608][ INFO][PID:2751109] Downloading the builder-live.log file, attempt 1 [2025-11-12 18:13:21,625][ INFO][PID:2751109] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c154 copr-rpmbuild-log [2025-11-12 18:13:26,629][ INFO][PID:2751109] Periodic builder liveness probe: alive [2025-11-12 18:13:26,630][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:13:31,634][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:13:36,635][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:13:41,637][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:13:46,643][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:13:51,647][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:13:56,648][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:14:01,653][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:14:06,658][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:14:11,659][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:14:16,662][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:14:21,664][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:14:26,665][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:14:31,667][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:14:36,669][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:14:41,670][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:14:46,671][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:14:51,677][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:14:56,678][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:15:01,679][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:15:06,681][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:15:11,685][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:15:16,687][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:15:21,692][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:15:26,694][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:15:31,700][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:15:36,705][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:15:41,707][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:15:46,709][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:15:51,712][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:15:56,716][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:16:01,717][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:16:06,718][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:16:11,722][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:16:16,725][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:16:21,726][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:16:26,728][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:16:31,729][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:16:36,733][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:16:41,734][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:16:46,735][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:16:51,736][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:16:56,739][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:17:01,878][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:17:07,204][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:17:12,218][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:17:17,220][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:17:22,687][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:17:27,749][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:17:32,805][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:17:37,888][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:17:43,106][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:17:48,140][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:17:53,264][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:17:58,325][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:18:03,332][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:18:08,335][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:18:13,347][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:18:18,444][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:18:23,447][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:18:28,449][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:18:33,712][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:18:38,993][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:18:44,016][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:18:49,026][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:18:54,029][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:18:59,040][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:19:04,086][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:19:09,259][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:19:14,296][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:19:19,298][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:19:24,300][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:19:29,301][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:19:34,306][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:19:39,316][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:19:44,320][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:19:49,321][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:19:54,334][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:19:59,425][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:20:04,439][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:20:09,443][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:20:14,447][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:20:19,612][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:20:24,630][ INFO][PID:2751109] Checking for cancel request [2025-11-12 18:20:25,643][ INFO][PID:2751109] Downloading results from builder [2025-11-12 18:20:25,644][ INFO][PID:2751109] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c154]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml started [2025-11-12 18:20:25,645][ INFO][PID:2751109] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c154]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/ &> /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/build-09791965.rsync.log [2025-11-12 18:20:26,432][ INFO][PID:2751109] rsyncing finished. [2025-11-12 18:20:26,435][ INFO][PID:2751109] Releasing VM back to pool [2025-11-12 18:20:26,450][ INFO][PID:2751109] Searching for 'success' file in resultdir [2025-11-12 18:20:26,450][ INFO][PID:2751109] Going to sign pkgs from source: 9791965-fedora-rawhide-ppc64le in chroot: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le [2025-11-12 18:20:26,451][ INFO][PID:2751109] Calling '/bin/sign -u psimovec#openblas-0.3.23@copr.fedorahosted.org -p' (attempt #1) [2025-11-12 18:20:26,816][ INFO][PID:2751109] Calling '/bin/sign -4 -h sha256 -u psimovec#openblas-0.3.23@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/libkolabxml-debuginfo-1.2.0-36.fc44.ppc64le.rpm' (attempt #1) [2025-11-12 18:20:27,735][ INFO][PID:2751109] signed rpm: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/libkolabxml-debuginfo-1.2.0-36.fc44.ppc64le.rpm [2025-11-12 18:20:27,736][ INFO][PID:2751109] Calling '/bin/sign -4 -h sha256 -u psimovec#openblas-0.3.23@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/libkolabxml-debugsource-1.2.0-36.fc44.ppc64le.rpm' (attempt #1) [2025-11-12 18:20:28,634][ INFO][PID:2751109] signed rpm: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/libkolabxml-debugsource-1.2.0-36.fc44.ppc64le.rpm [2025-11-12 18:20:28,636][ INFO][PID:2751109] Calling '/bin/sign -4 -h sha256 -u psimovec#openblas-0.3.23@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/libkolabxml-devel-1.2.0-36.fc44.ppc64le.rpm' (attempt #1) [2025-11-12 18:20:29,314][ INFO][PID:2751109] signed rpm: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/libkolabxml-devel-1.2.0-36.fc44.ppc64le.rpm [2025-11-12 18:20:29,315][ INFO][PID:2751109] Calling '/bin/sign -4 -h sha256 -u psimovec#openblas-0.3.23@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/python3-kolabformat-1.2.0-36.fc44.ppc64le.rpm' (attempt #1) [2025-11-12 18:20:30,032][ INFO][PID:2751109] signed rpm: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/python3-kolabformat-1.2.0-36.fc44.ppc64le.rpm [2025-11-12 18:20:30,033][ INFO][PID:2751109] Calling '/bin/sign -4 -h sha256 -u psimovec#openblas-0.3.23@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/php-kolabformat-1.2.0-36.fc44.ppc64le.rpm' (attempt #1) [2025-11-12 18:20:30,571][ INFO][PID:2751109] signed rpm: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/php-kolabformat-1.2.0-36.fc44.ppc64le.rpm [2025-11-12 18:20:30,572][ INFO][PID:2751109] Calling '/bin/sign -4 -h sha256 -u psimovec#openblas-0.3.23@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/libkolabxml-1.2.0-36.fc44.ppc64le.rpm' (attempt #1) [2025-11-12 18:20:31,249][ INFO][PID:2751109] signed rpm: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/libkolabxml-1.2.0-36.fc44.ppc64le.rpm [2025-11-12 18:20:31,251][ INFO][PID:2751109] Calling '/bin/sign -4 -h sha256 -u psimovec#openblas-0.3.23@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/php-kolabformat-debuginfo-1.2.0-36.fc44.ppc64le.rpm' (attempt #1) [2025-11-12 18:20:31,782][ INFO][PID:2751109] signed rpm: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/php-kolabformat-debuginfo-1.2.0-36.fc44.ppc64le.rpm [2025-11-12 18:20:31,783][ INFO][PID:2751109] Calling '/bin/sign -4 -h sha256 -u psimovec#openblas-0.3.23@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/libkolabxml-1.2.0-36.fc44.src.rpm' (attempt #1) [2025-11-12 18:20:32,297][ INFO][PID:2751109] signed rpm: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/libkolabxml-1.2.0-36.fc44.src.rpm [2025-11-12 18:20:32,298][ INFO][PID:2751109] Calling '/bin/sign -4 -h sha256 -u psimovec#openblas-0.3.23@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/python3-kolabformat-debuginfo-1.2.0-36.fc44.ppc64le.rpm' (attempt #1) [2025-11-12 18:20:33,210][ INFO][PID:2751109] signed rpm: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/python3-kolabformat-debuginfo-1.2.0-36.fc44.ppc64le.rpm [2025-11-12 18:20:33,217][ INFO][PID:2751109] Calling '/bin/sign -4 -h sha256 -u psimovec#openblas-0.3.23@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/java-kolabformat-1.2.0-36.fc44.ppc64le.rpm' (attempt #1) [2025-11-12 18:20:33,970][ INFO][PID:2751109] signed rpm: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/java-kolabformat-1.2.0-36.fc44.ppc64le.rpm [2025-11-12 18:20:33,971][ INFO][PID:2751109] Sign done [2025-11-12 18:20:33,974][ INFO][PID:2751109] Incremental createrepo run, adding 09791965-libkolabxml into https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le, (auto-create-repo=True) [2025-11-12 18:20:33,994][ INFO][PID:2751109] Running command 'copr-repo --batched /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le --add 09791965-libkolabxml --no-appstream-metadata' as PID 2890423 [2025-11-12 18:20:37,749][ INFO][PID:2751109] Finished after 3 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le --add 09791965-libkolabxml --no-appstream-metadata) [2025-11-12 18:20:37,755][ INFO][PID:2751109] Getting build details [2025-11-12 18:20:37,757][ INFO][PID:2751109] Listing built binary packages in /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml [2025-11-12 18:20:37,758][ INFO][PID:2751109] Built packages: ['libkolabxml-debuginfo 1.2.0', 'python3-kolabformat 1.2.0', 'libkolabxml 1.2.0', 'php-kolabformat 1.2.0', 'libkolabxml-debugsource 1.2.0', 'python3-kolabformat-debuginfo 1.2.0', 'php-kolabformat-debuginfo 1.2.0', 'libkolabxml-devel 1.2.0', 'java-kolabformat 1.2.0'] [2025-11-12 18:20:37,761][ INFO][PID:2751109] build details: {'built_packages': 'libkolabxml-debuginfo 1.2.0\npython3-kolabformat 1.2.0\nlibkolabxml 1.2.0\nphp-kolabformat 1.2.0\nlibkolabxml-debugsource 1.2.0\npython3-kolabformat-debuginfo 1.2.0\nphp-kolabformat-debuginfo 1.2.0\nlibkolabxml-devel 1.2.0\njava-kolabformat 1.2.0'} [2025-11-12 18:20:37,763][ INFO][PID:2751109] Retrieving pubkey [2025-11-12 18:20:37,768][ INFO][PID:2751109] Calling '/bin/sign -u psimovec#openblas-0.3.23@copr.fedorahosted.org -p' (attempt #1) [2025-11-12 18:20:38,184][ INFO][PID:2751109] Added pubkey for user psimovec project openblas-0.3.23 into: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/pubkey.gpg [2025-11-12 18:20:38,186][ INFO][PID:2751109] Finished build: id=9791965 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1 chroot=fedora-rawhide-ppc64le [2025-11-12 18:20:38,213][ INFO][PID:2751109] Worker succeeded build, took 437.47532081604004 [2025-11-12 18:20:38,216][ INFO][PID:2751109] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "openblas-0.3.23", "project_dirname": "openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1", "submitter": "https://src.fedoraproject.org/user/lecris", "ended_on": 1762971638.2130203, "started_on": 1762971200.7376995, "submitted_on": null, "status": 1, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9791965-fedora-rawhide-ppc64le", "build_id": 9791965, "package_name": "libkolabxml", "package_version": "1.2.0-36", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/libkolabxml", "git_hash": "236e02d25b0260138628eadf1037b804364934a3", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/lecris", "results": { "packages": [ { "name": "libkolabxml", "epoch": null, "version": "1.2.0", "release": "36.fc44", "arch": "src" }, { "name": "libkolabxml-debuginfo", "epoch": null, "version": "1.2.0", "release": "36.fc44", "arch": "ppc64le" }, { "name": "python3-kolabformat", "epoch": null, "version": "1.2.0", "release": "36.fc44", "arch": "ppc64le" }, { "name": "libkolabxml", "epoch": null, "version": "1.2.0", "release": "36.fc44", "arch": "ppc64le" }, { "name": "php-kolabformat", "epoch": null, "version": "1.2.0", "release": "36.fc44", "arch": "ppc64le" }, { "name": "libkolabxml-debugsource", "epoch": null, "version": "1.2.0", "release": "36.fc44", "arch": "ppc64le" }, { "name": "python3-kolabformat-debuginfo", "epoch": null, "version": "1.2.0", "release": "36.fc44", "arch": "ppc64le" }, { "name": "php-kolabformat-debuginfo", "epoch": null, "version": "1.2.0", "release": "36.fc44", "arch": "ppc64le" }, { "name": "libkolabxml-devel", "epoch": null, "version": "1.2.0", "release": "36.fc44", "arch": "ppc64le" }, { "name": "java-kolabformat", "epoch": null, "version": "1.2.0", "release": "36.fc44", "arch": "ppc64le" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/", "id": "copr_coprdir", "name": "Coprdir repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1", "result_dir": "09791965-libkolabxml", "built_packages": "libkolabxml-debuginfo 1.2.0\npython3-kolabformat 1.2.0\nlibkolabxml 1.2.0\nphp-kolabformat 1.2.0\nlibkolabxml-debugsource 1.2.0\npython3-kolabformat-debuginfo 1.2.0\nphp-kolabformat-debuginfo 1.2.0\nlibkolabxml-devel 1.2.0\njava-kolabformat 1.2.0", "id": 9791965, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "openblas-0.3.23", "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)" } } ] } [2025-11-12 18:20:38,332][ INFO][PID:2751109] Sending fedora-messaging bus message in build.end [2025-11-12 18:20:39,788][ INFO][PID:2751109] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/builder-live.log by gzip [2025-11-12 18:20:39,798][ INFO][PID:2751109] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/builder-live.log' as PID 2890996 [2025-11-12 18:20:39,923][ INFO][PID:2751109] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/builder-live.log) [2025-11-12 18:20:39,926][ INFO][PID:2751109] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/backend.log by gzip [2025-11-12 18:20:39,928][ INFO][PID:2751109] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-libkolabxml-1/fedora-rawhide-ppc64le/09791965-libkolabxml/backend.log' as PID 2891009