[2022-07-08 17:05:56,219][ INFO][PID:4009094] Marking build as starting [2022-07-08 17:05:56,446][ INFO][PID:4009094] Trying to allocate VM [2022-07-08 17:05:59,480][ INFO][PID:4009094] Allocated host ResallocHost, ticket_id=3421125, hostname=2620:52:3:1:dead:beef:cafe:c20e [2022-07-08 17:05:59,480][ INFO][PID:4009094] Allocating ssh connection to builder [2022-07-08 17:05:59,481][ INFO][PID:4009094] Checking that builder machine is OK [2022-07-08 17:06:00,396][ INFO][PID:4009094] Filling build.info file with builder info [2022-07-08 17:06:00,396][ INFO][PID:4009094] Marking build as running on frontend [2022-07-08 17:06:00,455][ INFO][PID:4009094] Sending fedora-messaging bus message in build.start [2022-07-08 17:06:00,893][ INFO][PID:4009094] Sending fedora-messaging bus message in chroot.start [2022-07-08 17:06:00,904][ INFO][PID:4009094] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --build-id 4618104 --chroot fedora-rawhide-ppc64le --detached [2022-07-08 17:06:01,601][ INFO][PID:4009094] Downloading the builder-live.log file, attempt 1 [2022-07-08 17:13:23,402][WARNING][PID:4009094] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2022-07-08 17:13:33,412][ INFO][PID:4009094] Downloading the builder-live.log file, attempt 2 [2022-07-08 17:14:43,487][WARNING][PID:4009094] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2022-07-08 17:14:53,497][ INFO][PID:4009094] Downloading the builder-live.log file, attempt 3 [2022-07-08 17:16:03,572][WARNING][PID:4009094] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2022-07-08 17:16:13,582][ INFO][PID:4009094] Downloading the builder-live.log file, attempt 4 [2022-07-08 17:17:23,661][ ERROR][PID:4009094] Giving up for unstable SSH, failures: 1657300403.4019701, 1657300483.487014, 1657300563.5722578, 1657300643.661018 [2022-07-08 17:17:23,662][ ERROR][PID:4009094] Re-try request for task on 'ResallocHost, ticket_id=3421125, hostname=2620:52:3:1:dead:beef:cafe:c20e': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2022-07-08 17:17:23,663][ INFO][PID:4009094] Releasing VM back to pool [2022-07-08 17:17:23,682][ INFO][PID:4009094] Retry #1 (on other host) [2022-07-08 17:17:23,683][ INFO][PID:4009094] Trying to allocate VM [2022-07-08 17:17:26,721][ INFO][PID:4009094] Allocated host ResallocHost, ticket_id=3421344, hostname=140.211.168.116 [2022-07-08 17:17:26,721][ INFO][PID:4009094] Allocating ssh connection to builder [2022-07-08 17:17:26,722][ INFO][PID:4009094] Checking that builder machine is OK [2022-07-08 17:17:29,500][ INFO][PID:4009094] Filling build.info file with builder info [2022-07-08 17:17:29,501][ INFO][PID:4009094] Not re-notifying FE and msg buses for the new host. [2022-07-08 17:17:29,501][ INFO][PID:4009094] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --build-id 4618104 --chroot fedora-rawhide-ppc64le --detached [2022-07-08 17:17:31,380][ INFO][PID:4009094] Downloading the builder-live.log file, attempt 1 [2022-07-08 20:41:55,228][WARNING][PID:4009094] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2022-07-08 20:42:05,248][ INFO][PID:4009094] Downloading the builder-live.log file, attempt 2 [2022-07-08 20:43:15,329][WARNING][PID:4009094] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2022-07-08 20:43:25,338][ INFO][PID:4009094] Downloading the builder-live.log file, attempt 3 [2022-07-08 20:44:35,413][WARNING][PID:4009094] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2022-07-08 20:44:45,423][ INFO][PID:4009094] Downloading the builder-live.log file, attempt 4 [2022-07-08 20:45:55,499][ ERROR][PID:4009094] Giving up for unstable SSH, failures: 1657312915.2279787, 1657312995.3291247, 1657313075.4136724, 1657313155.4991748 [2022-07-08 20:45:55,499][ ERROR][PID:4009094] Re-try request for task on 'ResallocHost, ticket_id=3421344, hostname=140.211.168.116': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2022-07-08 20:45:55,500][ INFO][PID:4009094] Releasing VM back to pool [2022-07-08 20:45:55,510][ INFO][PID:4009094] Retry #2 (on other host) [2022-07-08 20:45:55,511][ INFO][PID:4009094] Trying to allocate VM [2022-07-08 20:45:58,562][ INFO][PID:4009094] Allocated host ResallocHost, ticket_id=3423918, hostname=140.211.168.135 [2022-07-08 20:45:58,563][ INFO][PID:4009094] Allocating ssh connection to builder [2022-07-08 20:45:58,563][ INFO][PID:4009094] Checking that builder machine is OK [2022-07-08 20:46:00,931][ INFO][PID:4009094] Filling build.info file with builder info [2022-07-08 20:46:00,932][ INFO][PID:4009094] Not re-notifying FE and msg buses for the new host. [2022-07-08 20:46:00,933][ INFO][PID:4009094] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --build-id 4618104 --chroot fedora-rawhide-ppc64le --detached [2022-07-08 20:46:02,718][ INFO][PID:4009094] Downloading the builder-live.log file, attempt 1 [2022-07-09 00:59:37,529][ INFO][PID:4009094] Downloading results from builder [2022-07-09 00:59:54,749][ INFO][PID:4009094] Releasing VM back to pool [2022-07-09 01:02:03,743][ ERROR][PID:4009094] Unexpected exception (in /usr/lib64/python3.10/socket.py:848) [2022-07-09 01:02:03,744][ INFO][PID:4009094] Releasing VM back to pool [2022-07-09 01:04:14,815][ ERROR][PID:4009094] unexpected failure [Errno 110] Connection timed out (in /usr/lib64/python3.10/socket.py:848)