[2026-01-16 18:45:24,296][ INFO][PID:4117319] Marking build as starting [2026-01-16 18:45:24,586][ INFO][PID:4117319] Checking that /var/lib/copr/public_html/results/trawets/libeatmydata/fedora-42-i386/repodata/repomd.xml exists [2026-01-16 18:45:24,671][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:45:24,672][ INFO][PID:4117319] VM allocation process starts [2026-01-16 18:45:24,684][ INFO][PID:4117319] Trying to allocate VM: ResallocHost, ticket_id=865158, requested_tags=['copr_builder', 'arch_i386'] [2026-01-16 18:45:27,709][ INFO][PID:4117319] Allocated host ResallocHost, ticket_id=865158, hostname=3.238.227.103, name=aws_x86_64_spot_prod_01314783_20260116_184258, requested_tags=['copr_builder', 'arch_i386'] [2026-01-16 18:45:27,710][ INFO][PID:4117319] Allocating ssh connection to builder [2026-01-16 18:45:27,712][ INFO][PID:4117319] Checking that builder machine is OK [2026-01-16 18:45:28,054][ INFO][PID:4117319] Running remote command: copr-builder-ready fedora-42-i386 [2026-01-16 18:45:28,275][ INFO][PID:4117319] Red Hat subscription not needed for fedora-42-i386 Builder is ready to be used [2026-01-16 18:45:28,276][ INFO][PID:4117319] Filling build.info file with builder info [2026-01-16 18:45:28,277][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:45:28,279][ INFO][PID:4117319] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "trawets", "project_name": "libeatmydata", "project_dirname": "libeatmydata", "submitter": "https://src.fedoraproject.org/user/releng", "ended_on": null, "started_on": 1768589128.279267, "submitted_on": null, "status": 3, "chroot": "fedora-42-i386", "arch": "i386", "buildroot_pkgs": [], "task_id": "10023567-fedora-42-i386", "build_id": 10023567, "package_name": "libeatmydata", "package_version": "131-3", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/trawets/libeatmydata/libeatmydata", "git_hash": "96412210b4cd3a6aff3775d6b3b18ee364057eae", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "trawets/libeatmydata--https://src.fedoraproject.org/user/releng", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/trawets/libeatmydata/fedora-42-i386/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": true, "isolation": "default", "repo_priority": null, "tags": [ "arch_i386" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/trawets/libeatmydata", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/trawets/libeatmydata", "result_dir": "10023567-libeatmydata", "built_packages": "", "id": 10023567, "mockchain_macros": { "copr_username": "trawets", "copr_projectname": "libeatmydata", "vendor": "Fedora Project COPR (trawets/libeatmydata)" } } ] } [2026-01-16 18:45:28,401][ INFO][PID:4117319] Sending fedora-messaging bus message in build.start [2026-01-16 18:45:29,867][ INFO][PID:4117319] Sending fedora-messaging bus message in chroot.start [2026-01-16 18:45:29,991][ INFO][PID:4117319] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10023567-fedora-42-i386 --chroot fedora-42-i386 --detached [2026-01-16 18:45:30,335][ INFO][PID:4117319] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '3.238.227.103' (ED25519) to the list of known hosts. [2026-01-16 18:45:30,336][ INFO][PID:4117319] Downloading the builder-live.log file, attempt 1 [2026-01-16 18:45:30,338][ INFO][PID:4117319] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.238.227.103 copr-rpmbuild-log [2026-01-16 18:45:35,345][ INFO][PID:4117319] Periodic builder liveness probe: alive [2026-01-16 18:45:35,345][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:45:40,346][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:45:45,347][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:45:50,348][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:45:55,350][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:46:00,352][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:46:05,357][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:46:10,365][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:46:15,367][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:46:20,369][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:46:25,370][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:46:27,533][ ERROR][PID:4117319] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-16 18:46:30,372][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:46:35,373][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:46:37,534][WARNING][PID:4117319] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-16 18:46:40,374][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:46:45,377][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:46:47,890][ INFO][PID:4117319] Downloading the builder-live.log file, attempt 2 [2026-01-16 18:46:47,897][ INFO][PID:4117319] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.238.227.103 copr-rpmbuild-log [2026-01-16 18:46:50,380][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:46:55,383][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:47:00,385][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:47:05,389][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:47:10,391][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:47:15,393][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:47:20,395][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:47:25,396][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:47:30,398][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:47:35,410][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:47:40,419][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:47:45,424][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:47:47,992][ ERROR][PID:4117319] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-16 18:47:50,426][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:47:55,430][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:47:58,015][WARNING][PID:4117319] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-16 18:48:00,435][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:48:05,438][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:48:08,016][ INFO][PID:4117319] Downloading the builder-live.log file, attempt 3 [2026-01-16 18:48:08,019][ INFO][PID:4117319] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.238.227.103 copr-rpmbuild-log [2026-01-16 18:48:10,440][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:48:15,442][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:48:20,447][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:48:25,449][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:48:30,452][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:48:35,453][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:48:40,454][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:48:45,458][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:48:50,459][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:48:55,461][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:49:00,466][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:49:05,467][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:49:08,091][ ERROR][PID:4117319] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-16 18:49:10,474][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:49:15,480][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:49:18,097][WARNING][PID:4117319] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-16 18:49:20,482][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:49:25,484][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:49:28,101][ INFO][PID:4117319] Downloading the builder-live.log file, attempt 4 [2026-01-16 18:49:28,103][ INFO][PID:4117319] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.238.227.103 copr-rpmbuild-log [2026-01-16 18:49:30,491][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:49:35,493][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:49:40,498][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:49:45,500][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:49:50,508][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:49:55,519][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:50:00,523][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:50:05,524][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:50:10,535][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:50:15,538][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:50:20,540][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:50:25,549][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:50:28,237][ ERROR][PID:4117319] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-16 18:50:30,552][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:50:35,559][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:50:38,265][ ERROR][PID:4117319] Giving up for unstable SSH, failures: 1768589197.5348072, 1768589278.01575, 1768589358.0975723, 1768589438.2657516 [2026-01-16 18:50:38,270][ ERROR][PID:4117319] Re-try request for task on 'ResallocHost, ticket_id=865158, hostname=3.238.227.103, name=aws_x86_64_spot_prod_01314783_20260116_184258, requested_tags=['copr_builder', 'arch_i386']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-01-16 18:50:38,271][ INFO][PID:4117319] Releasing VM back to pool [2026-01-16 18:50:38,318][ INFO][PID:4117319] Retry #1 (on other host) [2026-01-16 18:50:38,320][ INFO][PID:4117319] Checking that /var/lib/copr/public_html/results/trawets/libeatmydata/fedora-42-i386/repodata/repomd.xml exists [2026-01-16 18:50:38,325][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:50:38,328][ INFO][PID:4117319] VM allocation process starts [2026-01-16 18:50:38,381][ INFO][PID:4117319] Trying to allocate VM: ResallocHost, ticket_id=865392, requested_tags=['copr_builder', 'arch_i386'] [2026-01-16 18:50:43,405][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:50:48,407][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:50:53,412][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:50:58,420][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:51:03,428][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:51:08,430][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:51:13,432][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:51:18,435][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:51:23,439][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:51:26,682][ INFO][PID:4117319] Allocated host ResallocHost, ticket_id=865392, hostname=54.210.226.186, name=aws_x86_64_spot_prod_01314782_20260116_184257, requested_tags=['copr_builder', 'arch_i386'] [2026-01-16 18:51:26,683][ INFO][PID:4117319] Allocating ssh connection to builder [2026-01-16 18:51:26,689][ INFO][PID:4117319] Checking that builder machine is OK [2026-01-16 18:51:27,168][ INFO][PID:4117319] Running remote command: copr-builder-ready fedora-42-i386 [2026-01-16 18:51:27,461][ INFO][PID:4117319] Red Hat subscription not needed for fedora-42-i386 Builder is ready to be used [2026-01-16 18:51:27,463][ INFO][PID:4117319] Filling build.info file with builder info [2026-01-16 18:51:27,499][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:51:27,506][ INFO][PID:4117319] Not re-notifying FE and msg buses for the new host. [2026-01-16 18:51:27,507][ INFO][PID:4117319] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10023567-fedora-42-i386 --chroot fedora-42-i386 --detached [2026-01-16 18:51:27,945][ INFO][PID:4117319] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '54.210.226.186' (ED25519) to the list of known hosts. [2026-01-16 18:51:27,947][ INFO][PID:4117319] Downloading the builder-live.log file, attempt 1 [2026-01-16 18:51:27,958][ INFO][PID:4117319] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.210.226.186 copr-rpmbuild-log [2026-01-16 18:51:32,957][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:51:37,958][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:51:42,959][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:51:47,962][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:51:52,966][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:51:57,968][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:52:02,969][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:52:07,970][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:52:12,972][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:52:17,981][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:52:22,985][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:52:27,987][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:52:32,990][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:52:37,992][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:52:42,995][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:52:48,000][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:52:53,003][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:52:58,004][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:53:03,006][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:53:08,008][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:53:13,009][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:53:18,011][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:53:23,015][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:53:24,561][ ERROR][PID:4117319] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-16 18:53:28,018][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:53:33,027][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:53:34,563][WARNING][PID:4117319] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-16 18:53:38,028][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:53:43,031][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:53:44,569][ INFO][PID:4117319] Downloading the builder-live.log file, attempt 2 [2026-01-16 18:53:44,572][ INFO][PID:4117319] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.210.226.186 copr-rpmbuild-log [2026-01-16 18:53:48,037][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:53:53,038][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:53:58,040][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:54:03,041][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:54:08,043][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:54:13,044][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:54:18,046][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:54:23,047][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:54:28,049][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:54:33,050][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:54:38,051][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:54:43,053][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:54:44,661][ ERROR][PID:4117319] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-16 18:54:48,054][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:54:53,058][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:54:54,683][WARNING][PID:4117319] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-16 18:54:58,085][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:55:03,086][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:55:04,685][ INFO][PID:4117319] Downloading the builder-live.log file, attempt 3 [2026-01-16 18:55:04,686][ INFO][PID:4117319] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.210.226.186 copr-rpmbuild-log [2026-01-16 18:55:08,087][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:55:13,089][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:55:18,090][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:55:23,094][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:55:28,096][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:55:33,100][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:55:38,116][ INFO][PID:4117319] Periodic builder liveness probe: alive [2026-01-16 18:55:38,117][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:55:43,119][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:55:48,121][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:55:53,122][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:55:58,126][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:56:03,128][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:56:04,755][ ERROR][PID:4117319] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-16 18:56:08,129][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:56:13,130][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:56:14,757][WARNING][PID:4117319] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-16 18:56:18,132][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:56:23,133][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:56:24,758][ INFO][PID:4117319] Downloading the builder-live.log file, attempt 4 [2026-01-16 18:56:24,760][ INFO][PID:4117319] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.210.226.186 copr-rpmbuild-log [2026-01-16 18:56:28,136][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:56:33,138][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:56:38,139][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:56:43,141][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:56:48,142][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:56:53,143][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:56:58,144][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:57:03,145][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:57:08,146][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:57:13,148][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:57:18,149][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:57:23,150][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:57:24,829][ ERROR][PID:4117319] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-16 18:57:28,152][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:57:33,154][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:57:34,843][ ERROR][PID:4117319] Giving up for unstable SSH, failures: 1768589614.5631597, 1768589694.6838238, 1768589774.7571068, 1768589854.8433466 [2026-01-16 18:57:34,844][ ERROR][PID:4117319] Re-try request for task on 'ResallocHost, ticket_id=865392, hostname=54.210.226.186, name=aws_x86_64_spot_prod_01314782_20260116_184257, requested_tags=['copr_builder', 'arch_i386']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-01-16 18:57:34,844][ INFO][PID:4117319] Releasing VM back to pool [2026-01-16 18:57:34,858][ INFO][PID:4117319] Retry #2 (on other host) [2026-01-16 18:57:34,859][ INFO][PID:4117319] Checking that /var/lib/copr/public_html/results/trawets/libeatmydata/fedora-42-i386/repodata/repomd.xml exists [2026-01-16 18:57:34,859][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:57:34,860][ INFO][PID:4117319] VM allocation process starts [2026-01-16 18:57:34,873][ INFO][PID:4117319] Trying to allocate VM: ResallocHost, ticket_id=865531, requested_tags=['copr_builder', 'arch_i386'] [2026-01-16 18:57:37,895][ INFO][PID:4117319] Allocated host ResallocHost, ticket_id=865531, hostname=50.16.147.226, name=aws_x86_64_spot_prod_01315281_20260116_185515, requested_tags=['copr_builder', 'arch_i386'] [2026-01-16 18:57:37,895][ INFO][PID:4117319] Allocating ssh connection to builder [2026-01-16 18:57:37,896][ INFO][PID:4117319] Checking that builder machine is OK [2026-01-16 18:57:38,220][ INFO][PID:4117319] Running remote command: copr-builder-ready fedora-42-i386 [2026-01-16 18:57:38,416][ INFO][PID:4117319] Red Hat subscription not needed for fedora-42-i386 Builder is ready to be used [2026-01-16 18:57:38,416][ INFO][PID:4117319] Filling build.info file with builder info [2026-01-16 18:57:38,513][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:57:38,514][ INFO][PID:4117319] Not re-notifying FE and msg buses for the new host. [2026-01-16 18:57:38,515][ INFO][PID:4117319] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10023567-fedora-42-i386 --chroot fedora-42-i386 --detached [2026-01-16 18:57:38,832][ INFO][PID:4117319] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '50.16.147.226' (ED25519) to the list of known hosts. [2026-01-16 18:57:38,833][ INFO][PID:4117319] Downloading the builder-live.log file, attempt 1 [2026-01-16 18:57:38,834][ INFO][PID:4117319] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@50.16.147.226 copr-rpmbuild-log [2026-01-16 18:57:43,833][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:57:48,835][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:57:53,836][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:57:58,837][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:58:03,842][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:58:08,847][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:58:13,849][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:58:18,850][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:58:23,854][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:58:28,855][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:58:33,856][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:58:38,857][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:58:43,858][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:58:48,859][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:58:53,861][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:58:58,861][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:59:03,862][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:59:08,864][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:59:13,867][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:59:18,871][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:59:23,873][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:59:28,874][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:59:33,875][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:59:38,876][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:59:43,877][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:59:48,878][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:59:53,879][ INFO][PID:4117319] Checking for cancel request [2026-01-16 18:59:58,887][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:00:03,888][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:00:08,890][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:00:13,894][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:00:18,895][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:00:23,897][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:00:28,898][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:00:33,899][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:00:38,900][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:00:43,901][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:00:48,903][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:00:53,904][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:00:58,906][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:01:03,908][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:01:08,909][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:01:13,910][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:01:18,911][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:01:23,912][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:01:28,913][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:01:33,915][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:01:38,916][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:01:43,917][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:01:48,918][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:01:53,920][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:01:58,921][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:02:03,925][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:02:08,926][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:02:13,927][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:02:18,928][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:02:23,930][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:02:28,930][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:02:33,932][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:02:38,933][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:02:43,934][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:02:48,936][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:02:53,939][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:02:58,941][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:03:03,942][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:03:08,943][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:03:13,944][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:03:18,945][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:03:23,947][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:03:28,948][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:03:33,949][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:03:38,950][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:03:43,951][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:03:48,952][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:03:53,953][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:03:58,954][ INFO][PID:4117319] Checking for cancel request [2026-01-16 19:04:02,084][ INFO][PID:4117319] Downloading results from builder [2026-01-16 19:04:02,085][ INFO][PID:4117319] rsyncing of mockbuilder@50.16.147.226:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/trawets/libeatmydata/fedora-42-i386/10023567-libeatmydata started [2026-01-16 19:04:02,086][ INFO][PID:4117319] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@50.16.147.226:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/trawets/libeatmydata/fedora-42-i386/10023567-libeatmydata/ &> /var/lib/copr/public_html/results/trawets/libeatmydata/fedora-42-i386/10023567-libeatmydata/build-10023567.rsync.log [2026-01-16 19:04:02,320][ INFO][PID:4117319] rsyncing finished. [2026-01-16 19:04:02,320][ INFO][PID:4117319] Releasing VM back to pool [2026-01-16 19:04:02,331][ INFO][PID:4117319] Searching for 'success' file in resultdir [2026-01-16 19:04:02,331][ INFO][PID:4117319] Going to sign pkgs from source: 10023567-fedora-42-i386 in chroot: /var/lib/copr/public_html/results/trawets/libeatmydata/fedora-42-i386 [2026-01-16 19:04:02,332][ INFO][PID:4117319] Calling '/bin/sign -u trawets#libeatmydata@copr.fedorahosted.org -p' (attempt #1) [2026-01-16 19:04:02,604][ INFO][PID:4117319] Calling '/bin/sign -4 -h sha256 -u trawets#libeatmydata@copr.fedorahosted.org -r /var/lib/copr/public_html/results/trawets/libeatmydata/fedora-42-i386/10023567-libeatmydata/libeatmydata-131-3.fc42.i686.rpm' (attempt #1) [2026-01-16 19:04:03,245][ INFO][PID:4117319] signed rpm: /var/lib/copr/public_html/results/trawets/libeatmydata/fedora-42-i386/10023567-libeatmydata/libeatmydata-131-3.fc42.i686.rpm [2026-01-16 19:04:03,246][ INFO][PID:4117319] Calling '/bin/sign -4 -h sha256 -u trawets#libeatmydata@copr.fedorahosted.org -r /var/lib/copr/public_html/results/trawets/libeatmydata/fedora-42-i386/10023567-libeatmydata/libeatmydata-debuginfo-131-3.fc42.i686.rpm' (attempt #1) [2026-01-16 19:04:03,973][ INFO][PID:4117319] signed rpm: /var/lib/copr/public_html/results/trawets/libeatmydata/fedora-42-i386/10023567-libeatmydata/libeatmydata-debuginfo-131-3.fc42.i686.rpm [2026-01-16 19:04:03,973][ INFO][PID:4117319] Calling '/bin/sign -4 -h sha256 -u trawets#libeatmydata@copr.fedorahosted.org -r /var/lib/copr/public_html/results/trawets/libeatmydata/fedora-42-i386/10023567-libeatmydata/libeatmydata-131-3.fc42.src.rpm' (attempt #1) [2026-01-16 19:04:04,998][ INFO][PID:4117319] signed rpm: /var/lib/copr/public_html/results/trawets/libeatmydata/fedora-42-i386/10023567-libeatmydata/libeatmydata-131-3.fc42.src.rpm [2026-01-16 19:04:04,998][ INFO][PID:4117319] Calling '/bin/sign -4 -h sha256 -u trawets#libeatmydata@copr.fedorahosted.org -r /var/lib/copr/public_html/results/trawets/libeatmydata/fedora-42-i386/10023567-libeatmydata/libeatmydata-debugsource-131-3.fc42.i686.rpm' (attempt #1) [2026-01-16 19:04:05,815][ INFO][PID:4117319] signed rpm: /var/lib/copr/public_html/results/trawets/libeatmydata/fedora-42-i386/10023567-libeatmydata/libeatmydata-debugsource-131-3.fc42.i686.rpm [2026-01-16 19:04:05,816][ INFO][PID:4117319] Calling '/bin/sign -4 -h sha256 -u trawets#libeatmydata@copr.fedorahosted.org -r /var/lib/copr/public_html/results/trawets/libeatmydata/fedora-42-i386/10023567-libeatmydata/eatmydata-131-3.fc42.i686.rpm' (attempt #1) [2026-01-16 19:04:06,440][ INFO][PID:4117319] signed rpm: /var/lib/copr/public_html/results/trawets/libeatmydata/fedora-42-i386/10023567-libeatmydata/eatmydata-131-3.fc42.i686.rpm [2026-01-16 19:04:06,441][ INFO][PID:4117319] Sign done [2026-01-16 19:04:06,441][ INFO][PID:4117319] Incremental createrepo run, adding 10023567-libeatmydata into https://download.copr.fedorainfracloud.org/results/trawets/libeatmydata/fedora-42-i386, (auto-create-repo=True) [2026-01-16 19:04:06,442][ INFO][PID:4117319] Running command 'copr-repo --batched /var/lib/copr/public_html/results/trawets/libeatmydata/fedora-42-i386 --add 10023567-libeatmydata --no-appstream-metadata' as PID 98410 [2026-01-16 19:04:07,384][ INFO][PID:4117319] Finished after 0 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/trawets/libeatmydata/fedora-42-i386 --add 10023567-libeatmydata --no-appstream-metadata) [2026-01-16 19:04:07,385][ INFO][PID:4117319] Getting build details [2026-01-16 19:04:07,385][ INFO][PID:4117319] Listing built binary packages in /var/lib/copr/public_html/results/trawets/libeatmydata/fedora-42-i386/10023567-libeatmydata [2026-01-16 19:04:07,385][ INFO][PID:4117319] Built packages: ['libeatmydata 131', 'libeatmydata-debuginfo 131', 'eatmydata 131', 'libeatmydata-debugsource 131'] [2026-01-16 19:04:07,386][ INFO][PID:4117319] build details: {'built_packages': 'libeatmydata 131\nlibeatmydata-debuginfo 131\neatmydata 131\nlibeatmydata-debugsource 131'} [2026-01-16 19:04:07,386][ INFO][PID:4117319] Retrieving pubkey [2026-01-16 19:04:07,387][ INFO][PID:4117319] Calling '/bin/sign -u trawets#libeatmydata@copr.fedorahosted.org -p' (attempt #1) [2026-01-16 19:04:07,685][ INFO][PID:4117319] Added pubkey for user trawets project libeatmydata into: /var/lib/copr/public_html/results/trawets/libeatmydata/pubkey.gpg [2026-01-16 19:04:07,686][ INFO][PID:4117319] Finished build: id=10023567 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/trawets/libeatmydata chroot=fedora-42-i386 [2026-01-16 19:04:07,687][ INFO][PID:4117319] Worker succeeded build, took 389.1732439994812 [2026-01-16 19:04:07,688][ INFO][PID:4117319] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "trawets", "project_name": "libeatmydata", "project_dirname": "libeatmydata", "submitter": "https://src.fedoraproject.org/user/releng", "ended_on": 1768590247.6878917, "started_on": 1768589858.5146477, "submitted_on": null, "status": 1, "chroot": "fedora-42-i386", "arch": "i386", "buildroot_pkgs": [], "task_id": "10023567-fedora-42-i386", "build_id": 10023567, "package_name": "libeatmydata", "package_version": "131-3", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/trawets/libeatmydata/libeatmydata", "git_hash": "96412210b4cd3a6aff3775d6b3b18ee364057eae", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "trawets/libeatmydata--https://src.fedoraproject.org/user/releng", "results": { "packages": [ { "name": "libeatmydata", "epoch": null, "version": "131", "release": "3.fc42", "arch": "i686" }, { "name": "libeatmydata-debuginfo", "epoch": null, "version": "131", "release": "3.fc42", "arch": "i686" }, { "name": "eatmydata", "epoch": null, "version": "131", "release": "3.fc42", "arch": "i686" }, { "name": "libeatmydata-debugsource", "epoch": null, "version": "131", "release": "3.fc42", "arch": "i686" }, { "name": "libeatmydata", "epoch": null, "version": "131", "release": "3.fc42", "arch": "src" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/trawets/libeatmydata/fedora-42-i386/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": true, "isolation": "default", "repo_priority": null, "tags": [ "arch_i386" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/trawets/libeatmydata", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/trawets/libeatmydata", "result_dir": "10023567-libeatmydata", "built_packages": "libeatmydata 131\nlibeatmydata-debuginfo 131\neatmydata 131\nlibeatmydata-debugsource 131", "id": 10023567, "mockchain_macros": { "copr_username": "trawets", "copr_projectname": "libeatmydata", "vendor": "Fedora Project COPR (trawets/libeatmydata)" } } ] } [2026-01-16 19:04:07,820][ INFO][PID:4117319] Sending fedora-messaging bus message in build.end [2026-01-16 19:04:07,910][ INFO][PID:4117319] Compressing /var/lib/copr/public_html/results/trawets/libeatmydata/fedora-42-i386/10023567-libeatmydata/builder-live.log by gzip [2026-01-16 19:04:07,911][ INFO][PID:4117319] Running command 'gzip /var/lib/copr/public_html/results/trawets/libeatmydata/fedora-42-i386/10023567-libeatmydata/builder-live.log' as PID 98535 [2026-01-16 19:04:07,988][ INFO][PID:4117319] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/trawets/libeatmydata/fedora-42-i386/10023567-libeatmydata/builder-live.log) [2026-01-16 19:04:07,989][ INFO][PID:4117319] Compressing /var/lib/copr/public_html/results/trawets/libeatmydata/fedora-42-i386/10023567-libeatmydata/backend.log by gzip [2026-01-16 19:04:07,990][ INFO][PID:4117319] Running command 'gzip /var/lib/copr/public_html/results/trawets/libeatmydata/fedora-42-i386/10023567-libeatmydata/backend.log' as PID 98540