[2026-02-10 17:41:29,531][ INFO][PID:2288195] Marking build as starting [2026-02-10 17:41:29,653][ INFO][PID:2288195] Checking that /var/lib/copr/public_html/results/pemensik/unbound/fedora-44-x86_64/repodata/repomd.xml exists [2026-02-10 17:41:29,691][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:41:29,692][ INFO][PID:2288195] VM allocation process starts [2026-02-10 17:41:29,704][ INFO][PID:2288195] Trying to allocate VM: ResallocHost, ticket_id=1260849, requested_tags=['copr_builder', 'arch_x86_64'] [2026-02-10 17:41:32,723][ INFO][PID:2288195] Allocated host ResallocHost, ticket_id=1260849, hostname=52.207.232.44, name=aws_x86_64_spot_prod_02147180_20260210_173731, requested_tags=['copr_builder', 'arch_x86_64'] [2026-02-10 17:41:32,724][ INFO][PID:2288195] Allocating ssh connection to builder [2026-02-10 17:41:32,725][ INFO][PID:2288195] Checking that builder machine is OK [2026-02-10 17:42:32,795][ ERROR][PID:2288195] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 52.207.232.44 port 22: Connection timed out [2026-02-10 17:42:42,796][ ERROR][PID:2288195] Re-try request for task on 'ResallocHost, ticket_id=1260849, hostname=52.207.232.44, name=aws_x86_64_spot_prod_02147180_20260210_173731, requested_tags=['copr_builder', 'arch_x86_64']': Unable to finish after 1 SSH attempts [2026-02-10 17:42:42,797][ INFO][PID:2288195] Releasing VM back to pool [2026-02-10 17:42:42,810][ INFO][PID:2288195] Retry #1 (on other host) [2026-02-10 17:42:42,811][ INFO][PID:2288195] Checking that /var/lib/copr/public_html/results/pemensik/unbound/fedora-44-x86_64/repodata/repomd.xml exists [2026-02-10 17:42:42,811][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:42:42,812][ INFO][PID:2288195] VM allocation process starts [2026-02-10 17:42:42,830][ INFO][PID:2288195] Trying to allocate VM: ResallocHost, ticket_id=1260856, requested_tags=['copr_builder', 'arch_x86_64'] [2026-02-10 17:42:45,844][ INFO][PID:2288195] Allocated host ResallocHost, ticket_id=1260856, hostname=52.90.133.173, name=aws_x86_64_spot_prod_02147447_20260210_174013, requested_tags=['copr_builder', 'arch_x86_64'] [2026-02-10 17:42:45,845][ INFO][PID:2288195] Allocating ssh connection to builder [2026-02-10 17:42:45,845][ INFO][PID:2288195] Checking that builder machine is OK [2026-02-10 17:42:46,196][ INFO][PID:2288195] Running remote command: copr-builder-ready fedora-44-x86_64 [2026-02-10 17:42:46,419][ INFO][PID:2288195] Red Hat subscription not needed for fedora-44-x86_64 Builder is ready to be used [2026-02-10 17:42:46,419][ INFO][PID:2288195] Filling build.info file with builder info [2026-02-10 17:42:46,420][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:42:46,421][ INFO][PID:2288195] Not re-notifying FE and msg buses for the new host. [2026-02-10 17:42:46,421][ INFO][PID:2288195] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10113661-fedora-44-x86_64 --chroot fedora-44-x86_64 --detached [2026-02-10 17:42:46,760][ INFO][PID:2288195] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '52.90.133.173' (ED25519) to the list of known hosts. [2026-02-10 17:42:46,761][ INFO][PID:2288195] Downloading the builder-live.log file, attempt 1 [2026-02-10 17:42:46,762][ INFO][PID:2288195] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@52.90.133.173 copr-rpmbuild-log [2026-02-10 17:42:51,775][ INFO][PID:2288195] Periodic builder liveness probe: alive [2026-02-10 17:42:51,776][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:42:56,777][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:43:01,778][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:43:06,779][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:43:11,780][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:43:16,781][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:43:21,783][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:43:26,784][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:43:31,785][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:43:36,786][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:43:41,787][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:43:46,788][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:43:51,789][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:43:56,791][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:44:01,792][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:44:06,793][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:44:11,795][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:44:16,796][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:44:21,797][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:44:26,798][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:44:31,799][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:44:36,801][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:44:41,808][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:44:46,809][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:44:51,810][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:44:56,812][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:45:01,813][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:45:06,815][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:45:11,815][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:45:16,817][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:45:21,818][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:45:26,819][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:45:31,820][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:45:36,821][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:45:41,822][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:45:46,823][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:45:51,825][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:45:56,826][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:46:01,827][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:46:06,828][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:46:11,829][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:46:16,830][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:46:21,831][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:46:26,832][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:46:31,833][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:46:36,834][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:46:41,835][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:46:46,836][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:46:51,836][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:46:56,838][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:47:01,839][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:47:06,840][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:47:11,840][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:47:16,841][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:47:21,842][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:47:26,843][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:47:31,844][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:47:36,845][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:47:41,846][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:47:46,847][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:47:51,848][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:47:56,849][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:48:01,850][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:48:06,851][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:48:11,852][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:48:16,853][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:48:21,854][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:48:26,855][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:48:31,856][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:48:36,857][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:48:41,858][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:48:46,859][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:48:51,860][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:48:56,860][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:49:01,862][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:49:06,862][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:49:11,863][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:49:16,987][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:49:22,102][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:49:22,374][ ERROR][PID:2288195] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-02-10 17:49:27,104][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:49:32,106][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:49:32,375][WARNING][PID:2288195] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-02-10 17:49:37,107][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:49:42,114][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:49:42,375][ INFO][PID:2288195] Downloading the builder-live.log file, attempt 2 [2026-02-10 17:49:42,377][ INFO][PID:2288195] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@52.90.133.173 copr-rpmbuild-log [2026-02-10 17:49:47,115][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:49:52,117][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:49:57,173][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:50:02,175][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:50:07,176][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:50:12,177][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:50:17,178][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:50:22,179][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:50:27,208][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:50:32,209][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:50:37,209][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:50:42,277][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:50:42,444][ ERROR][PID:2288195] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-02-10 17:50:47,278][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:50:52,279][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:50:52,455][WARNING][PID:2288195] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-02-10 17:50:57,289][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:51:02,291][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:51:02,456][ INFO][PID:2288195] Downloading the builder-live.log file, attempt 3 [2026-02-10 17:51:02,458][ INFO][PID:2288195] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@52.90.133.173 copr-rpmbuild-log [2026-02-10 17:51:07,293][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:51:12,294][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:51:17,733][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:51:22,734][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:51:27,966][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:51:32,967][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:51:37,968][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:51:42,969][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:51:47,970][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:51:52,971][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:51:57,971][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:52:02,519][ ERROR][PID:2288195] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-02-10 17:52:02,972][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:52:07,973][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:52:12,974][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:52:13,354][WARNING][PID:2288195] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-02-10 17:52:17,975][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:52:22,976][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:52:23,355][ INFO][PID:2288195] Downloading the builder-live.log file, attempt 4 [2026-02-10 17:52:23,356][ INFO][PID:2288195] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@52.90.133.173 copr-rpmbuild-log [2026-02-10 17:52:27,977][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:52:32,978][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:52:37,979][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:52:42,980][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:52:47,982][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:52:52,988][ INFO][PID:2288195] Periodic builder liveness probe: alive [2026-02-10 17:52:52,988][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:52:57,989][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:53:02,990][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:53:07,991][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:53:12,994][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:53:17,995][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:53:22,996][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:53:23,385][ ERROR][PID:2288195] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-02-10 17:53:27,998][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:53:32,999][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:53:33,401][ ERROR][PID:2288195] Giving up for unstable SSH, failures: 1770745772.3752153, 1770745852.4554052, 1770745933.3547041, 1770746013.4010868 [2026-02-10 17:53:33,402][ ERROR][PID:2288195] Re-try request for task on 'ResallocHost, ticket_id=1260856, hostname=52.90.133.173, name=aws_x86_64_spot_prod_02147447_20260210_174013, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-02-10 17:53:33,402][ INFO][PID:2288195] Releasing VM back to pool [2026-02-10 17:53:33,412][ INFO][PID:2288195] Retry #2 (on other host) [2026-02-10 17:53:33,413][ INFO][PID:2288195] Checking that /var/lib/copr/public_html/results/pemensik/unbound/fedora-44-x86_64/repodata/repomd.xml exists [2026-02-10 17:53:33,413][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:53:33,414][ INFO][PID:2288195] VM allocation process starts [2026-02-10 17:53:33,424][ INFO][PID:2288195] Trying to allocate VM: ResallocHost, ticket_id=1260949, requested_tags=['copr_builder', 'arch_x86_64'] [2026-02-10 17:53:36,436][ INFO][PID:2288195] Allocated host ResallocHost, ticket_id=1260949, hostname=54.234.148.112, name=aws_x86_64_spot_prod_02147838_20260210_174538, requested_tags=['copr_builder', 'arch_x86_64'] [2026-02-10 17:53:36,437][ INFO][PID:2288195] Allocating ssh connection to builder [2026-02-10 17:53:36,437][ INFO][PID:2288195] Checking that builder machine is OK [2026-02-10 17:53:36,772][ INFO][PID:2288195] Running remote command: copr-builder-ready fedora-44-x86_64 [2026-02-10 17:53:37,006][ INFO][PID:2288195] Red Hat subscription not needed for fedora-44-x86_64 Builder is ready to be used [2026-02-10 17:53:37,006][ INFO][PID:2288195] Filling build.info file with builder info [2026-02-10 17:53:37,013][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:53:37,014][ INFO][PID:2288195] Not re-notifying FE and msg buses for the new host. [2026-02-10 17:53:37,014][ INFO][PID:2288195] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10113661-fedora-44-x86_64 --chroot fedora-44-x86_64 --detached [2026-02-10 17:53:37,332][ INFO][PID:2288195] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '54.234.148.112' (ED25519) to the list of known hosts. [2026-02-10 17:53:37,333][ INFO][PID:2288195] Downloading the builder-live.log file, attempt 1 [2026-02-10 17:53:37,334][ INFO][PID:2288195] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.234.148.112 copr-rpmbuild-log [2026-02-10 17:53:42,333][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:53:47,335][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:53:52,347][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:53:57,379][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:54:02,380][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:54:07,381][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:54:12,382][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:54:17,383][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:54:22,384][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:54:27,385][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:54:32,386][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:54:37,387][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:54:42,388][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:54:47,389][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:54:52,391][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:54:57,392][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:55:02,393][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:55:07,394][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:55:12,395][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:55:17,396][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:55:22,397][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:55:25,983][ ERROR][PID:2288195] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-02-10 17:55:27,398][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:55:32,399][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:55:35,984][WARNING][PID:2288195] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-02-10 17:55:37,400][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:55:42,401][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:55:45,985][ INFO][PID:2288195] Downloading the builder-live.log file, attempt 2 [2026-02-10 17:55:45,987][ INFO][PID:2288195] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.234.148.112 copr-rpmbuild-log [2026-02-10 17:55:47,402][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:55:52,403][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:55:57,404][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:56:02,405][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:56:07,406][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:56:12,408][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:56:17,410][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:56:22,411][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:56:27,412][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:56:32,413][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:56:37,414][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:56:42,415][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:56:46,050][ ERROR][PID:2288195] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-02-10 17:56:47,416][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:56:52,417][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:56:56,063][WARNING][PID:2288195] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-02-10 17:56:57,418][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:57:02,419][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:57:06,064][ INFO][PID:2288195] Downloading the builder-live.log file, attempt 3 [2026-02-10 17:57:06,065][ INFO][PID:2288195] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.234.148.112 copr-rpmbuild-log [2026-02-10 17:57:07,420][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:57:12,421][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:57:17,422][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:57:22,423][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:57:27,424][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:57:32,425][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:57:37,426][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:57:42,427][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:57:47,428][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:57:52,429][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:57:57,430][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:58:02,431][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:58:06,101][ ERROR][PID:2288195] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-02-10 17:58:07,432][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:58:12,433][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:58:16,117][WARNING][PID:2288195] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-02-10 17:58:17,434][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:58:22,435][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:58:26,118][ INFO][PID:2288195] Downloading the builder-live.log file, attempt 4 [2026-02-10 17:58:26,119][ INFO][PID:2288195] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.234.148.112 copr-rpmbuild-log [2026-02-10 17:58:27,436][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:58:32,437][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:58:37,438][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:58:42,439][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:58:47,440][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:58:52,441][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:58:57,442][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:59:02,443][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:59:07,444][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:59:12,445][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:59:17,460][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:59:22,461][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:59:26,187][ ERROR][PID:2288195] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-02-10 17:59:27,474][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:59:32,879][ INFO][PID:2288195] Checking for cancel request [2026-02-10 17:59:36,195][ ERROR][PID:2288195] Giving up for unstable SSH, failures: 1770746135.9848094, 1770746216.0634694, 1770746296.117271, 1770746376.1952393 [2026-02-10 17:59:36,196][ ERROR][PID:2288195] Re-try request for task on 'ResallocHost, ticket_id=1260949, hostname=54.234.148.112, name=aws_x86_64_spot_prod_02147838_20260210_174538, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-02-10 17:59:36,196][ INFO][PID:2288195] Releasing VM back to pool [2026-02-10 17:59:36,206][ ERROR][PID:2288195] Backend process error: Three host tried without success: {'52.207.232.44', '54.234.148.112', '52.90.133.173'} [2026-02-10 17:59:36,207][WARNING][PID:2288195] Switching not-finished job state to 'failed' [2026-02-10 17:59:36,207][ INFO][PID:2288195] Worker failed build, took 359.19286251068115 [2026-02-10 17:59:36,208][ INFO][PID:2288195] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "pemensik", "project_name": "unbound", "project_dirname": "unbound", "submitter": "https://src.fedoraproject.org/user/asosedkin", "ended_on": 1770746376.2071257, "started_on": 1770746017.0142632, "submitted_on": null, "status": 0, "chroot": "fedora-44-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10113661-fedora-44-x86_64", "build_id": 10113661, "package_name": "gnutls", "package_version": "3.8.11-3", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/pemensik/unbound/gnutls", "git_hash": "b38035f4c1eea88552f2ae65de00a4171a2399b6", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "pemensik/unbound--https://src.fedoraproject.org/user/asosedkin", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/pemensik/unbound/fedora-44-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "bootstrap": "off", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/pemensik/unbound", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/pemensik/unbound", "result_dir": "10113661-gnutls", "built_packages": "", "id": 10113661, "mockchain_macros": { "copr_username": "pemensik", "copr_projectname": "unbound", "vendor": "Fedora Project COPR (pemensik/unbound)" } } ] } [2026-02-10 17:59:36,266][ INFO][PID:2288195] Sending fedora-messaging bus message in build.end [2026-02-10 17:59:36,842][ INFO][PID:2288195] Compressing /var/lib/copr/public_html/results/pemensik/unbound/fedora-44-x86_64/10113661-gnutls/builder-live.log by gzip [2026-02-10 17:59:36,844][ INFO][PID:2288195] Running command 'gzip /var/lib/copr/public_html/results/pemensik/unbound/fedora-44-x86_64/10113661-gnutls/builder-live.log' as PID 2375840 [2026-02-10 17:59:37,119][ INFO][PID:2288195] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/pemensik/unbound/fedora-44-x86_64/10113661-gnutls/builder-live.log) [2026-02-10 17:59:37,120][ INFO][PID:2288195] Compressing /var/lib/copr/public_html/results/pemensik/unbound/fedora-44-x86_64/10113661-gnutls/backend.log by gzip [2026-02-10 17:59:37,121][ INFO][PID:2288195] Running command 'gzip /var/lib/copr/public_html/results/pemensik/unbound/fedora-44-x86_64/10113661-gnutls/backend.log' as PID 2375859