[2026-04-07 18:11:48,442][ INFO][PID:2260220] Marking build as starting [2026-04-07 18:11:48,490][ INFO][PID:2260220] Checking that https://download.copr.fedorainfracloud.org/results/cubewhy/jetbrains/fedora-43-x86_64//repodata/repomd.xml exists [2026-04-07 18:11:48,865][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:11:48,866][ INFO][PID:2260220] VM allocation process starts [2026-04-07 18:11:48,877][ INFO][PID:2260220] Trying to allocate VM: ResallocHost, ticket_id=2209508, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-07 18:11:51,890][ INFO][PID:2260220] Allocated host ResallocHost, ticket_id=2209508, hostname=3.84.155.24, name=aws_x86_64_spot_prod_05907606_20260407_180607, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-07 18:11:51,891][ INFO][PID:2260220] Allocating ssh connection to builder [2026-04-07 18:11:51,891][ INFO][PID:2260220] Checking that builder machine is OK [2026-04-07 18:11:52,227][ INFO][PID:2260220] Running remote command: copr-builder-ready fedora-43-x86_64 [2026-04-07 18:11:52,434][ INFO][PID:2260220] Red Hat subscription not needed for fedora-43-x86_64 Builder is ready to be used [2026-04-07 18:11:52,435][ INFO][PID:2260220] Filling build.info file with builder info [2026-04-07 18:11:52,435][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:11:52,436][ INFO][PID:2260220] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "cubewhy", "project_name": "jetbrains", "project_dirname": "jetbrains", "submitter": "cubewhy", "ended_on": null, "started_on": 1775585512.4365807, "submitted_on": null, "status": 3, "chroot": "fedora-43-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10298359-fedora-43-x86_64", "build_id": 10298359, "package_name": "jetbrains-rustrover-eap", "package_version": "2026.1-1.261.22158.214", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/cubewhy/jetbrains/jetbrains-rustrover-eap", "git_hash": "b42c2b2297787f2fa22c1c410069e2ec7c08ad54", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "cubewhy/jetbrains--cubewhy", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/cubewhy/jetbrains/fedora-43-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/cubewhy/jetbrains", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/cubewhy/jetbrains", "result_dir": "10298359-jetbrains-rustrover-eap", "built_packages": "", "id": 10298359, "mockchain_macros": { "copr_username": "cubewhy", "copr_projectname": "jetbrains", "vendor": "Fedora Project COPR (cubewhy/jetbrains)" } } ] } [2026-04-07 18:11:52,477][ INFO][PID:2260220] Sending fedora-messaging bus message in build.start [2026-04-07 18:11:53,038][ INFO][PID:2260220] Sending fedora-messaging bus message in chroot.start [2026-04-07 18:11:53,255][ INFO][PID:2260220] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10298359-fedora-43-x86_64 --chroot fedora-43-x86_64 --detached [2026-04-07 18:11:53,590][ INFO][PID:2260220] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '3.84.155.24' (ED25519) to the list of known hosts. [2026-04-07 18:11:53,591][ INFO][PID:2260220] Downloading the builder-live.log file, attempt 1 [2026-04-07 18:11:53,643][ INFO][PID:2260220] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.84.155.24 copr-rpmbuild-log [2026-04-07 18:11:58,596][ INFO][PID:2260220] Periodic builder liveness probe: alive [2026-04-07 18:11:58,597][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:12:03,598][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:12:08,602][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:12:13,603][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:12:18,604][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:12:23,605][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:12:28,606][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:12:33,608][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:12:38,609][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:12:43,610][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:12:48,933][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:12:53,938][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:12:58,943][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:13:03,946][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:13:08,948][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:13:13,949][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:13:18,950][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:13:23,952][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:13:28,953][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:13:33,955][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:13:38,957][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:13:43,958][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:13:48,961][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:13:53,962][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:13:58,975][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:14:03,978][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:14:08,980][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:14:13,981][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:14:18,982][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:14:23,984][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:14:28,985][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:14:33,986][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:14:36,222][ ERROR][PID:2260220] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-07 18:14:38,987][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:14:43,988][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:14:46,223][WARNING][PID:2260220] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-07 18:14:49,380][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:14:54,381][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:14:56,224][ INFO][PID:2260220] Downloading the builder-live.log file, attempt 2 [2026-04-07 18:14:56,225][ INFO][PID:2260220] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.84.155.24 copr-rpmbuild-log [2026-04-07 18:14:59,383][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:15:04,385][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:15:09,386][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:15:14,388][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:15:19,389][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:15:24,391][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:15:29,393][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:15:34,395][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:15:39,396][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:15:44,397][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:15:49,399][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:15:54,401][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:15:56,292][ ERROR][PID:2260220] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-07 18:15:59,402][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:16:04,403][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:16:06,300][WARNING][PID:2260220] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-07 18:16:09,405][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:16:14,405][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:16:16,301][ INFO][PID:2260220] Downloading the builder-live.log file, attempt 3 [2026-04-07 18:16:16,302][ INFO][PID:2260220] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.84.155.24 copr-rpmbuild-log [2026-04-07 18:16:19,406][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:16:24,556][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:16:29,560][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:16:34,562][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:16:39,563][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:16:44,564][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:16:49,565][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:16:54,566][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:16:59,567][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:17:04,568][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:17:09,569][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:17:14,570][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:17:16,370][ ERROR][PID:2260220] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-07 18:17:19,571][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:17:24,572][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:17:26,380][WARNING][PID:2260220] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-07 18:17:29,946][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:17:34,952][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:17:36,381][ INFO][PID:2260220] Downloading the builder-live.log file, attempt 4 [2026-04-07 18:17:36,382][ INFO][PID:2260220] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.84.155.24 copr-rpmbuild-log [2026-04-07 18:17:39,955][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:17:44,956][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:17:49,957][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:17:54,958][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:17:59,960][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:18:04,961][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:18:09,962][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:18:14,964][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:18:19,972][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:18:24,981][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:18:29,991][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:18:34,992][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:18:36,449][ ERROR][PID:2260220] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-07 18:18:39,993][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:18:44,995][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:18:46,477][ ERROR][PID:2260220] Giving up for unstable SSH, failures: 1775585686.2236607, 1775585766.300712, 1775585846.3807974, 1775585926.4775813 [2026-04-07 18:18:46,478][ ERROR][PID:2260220] Re-try request for task on 'ResallocHost, ticket_id=2209508, hostname=3.84.155.24, name=aws_x86_64_spot_prod_05907606_20260407_180607, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-04-07 18:18:46,479][ INFO][PID:2260220] Releasing VM back to pool [2026-04-07 18:18:46,488][ INFO][PID:2260220] Retry #1 (on other host) [2026-04-07 18:18:46,488][ INFO][PID:2260220] Checking that https://download.copr.fedorainfracloud.org/results/cubewhy/jetbrains/fedora-43-x86_64//repodata/repomd.xml exists [2026-04-07 18:18:46,647][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:18:46,648][ INFO][PID:2260220] VM allocation process starts [2026-04-07 18:18:46,684][ INFO][PID:2260220] Trying to allocate VM: ResallocHost, ticket_id=2209619, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-07 18:18:49,739][ INFO][PID:2260220] Allocated host ResallocHost, ticket_id=2209619, hostname=34.239.175.237, name=aws_x86_64_spot_prod_05907791_20260407_181259, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-07 18:18:49,812][ INFO][PID:2260220] Allocating ssh connection to builder [2026-04-07 18:18:49,813][ INFO][PID:2260220] Checking that builder machine is OK [2026-04-07 18:18:50,158][ INFO][PID:2260220] Running remote command: copr-builder-ready fedora-43-x86_64 [2026-04-07 18:18:50,361][ INFO][PID:2260220] Red Hat subscription not needed for fedora-43-x86_64 Builder is ready to be used [2026-04-07 18:18:50,361][ INFO][PID:2260220] Filling build.info file with builder info [2026-04-07 18:18:50,366][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:18:50,366][ INFO][PID:2260220] Not re-notifying FE and msg buses for the new host. [2026-04-07 18:18:50,367][ INFO][PID:2260220] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10298359-fedora-43-x86_64 --chroot fedora-43-x86_64 --detached [2026-04-07 18:18:50,698][ INFO][PID:2260220] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '34.239.175.237' (ED25519) to the list of known hosts. [2026-04-07 18:18:50,701][ INFO][PID:2260220] Downloading the builder-live.log file, attempt 1 [2026-04-07 18:18:50,704][ INFO][PID:2260220] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@34.239.175.237 copr-rpmbuild-log [2026-04-07 18:18:55,701][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:19:00,702][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:19:05,703][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:19:10,704][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:19:15,705][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:19:20,712][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:19:25,713][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:19:30,715][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:19:35,717][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:19:40,718][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:19:45,719][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:19:50,720][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:19:55,721][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:20:00,722][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:20:05,723][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:20:10,724][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:20:15,726][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:20:20,727][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:20:25,728][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:20:30,730][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:20:35,731][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:20:40,736][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:20:45,738][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:20:50,740][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:20:55,742][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:21:00,743][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:21:05,744][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:21:10,745][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:21:15,747][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:21:20,748][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:21:25,749][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:21:30,750][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:21:35,751][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:21:40,752][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:21:45,757][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:21:50,764][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:21:55,767][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:22:00,774][ INFO][PID:2260220] Periodic builder liveness probe: alive [2026-04-07 18:22:00,775][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:22:05,779][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:22:10,781][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:22:15,783][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:22:20,785][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:22:25,787][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:22:30,789][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:22:35,793][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:22:40,795][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:22:45,796][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:22:51,230][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:22:56,234][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:23:01,236][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:23:06,240][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:23:11,243][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:23:16,246][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:23:21,248][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:23:26,249][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:23:31,255][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:23:36,257][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:23:41,258][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:23:46,258][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:23:51,259][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:23:56,261][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:24:01,262][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:24:06,264][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:24:11,266][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:24:16,267][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:24:21,473][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:24:26,474][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:24:31,477][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:24:36,479][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:24:41,480][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:24:46,481][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:24:51,483][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:24:56,484][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:25:01,485][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:25:06,486][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:25:11,487][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:25:16,547][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:25:21,552][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:25:26,553][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:25:31,555][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:25:36,557][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:25:41,898][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:25:46,898][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:25:51,899][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:25:57,009][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:26:02,011][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:26:07,013][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:26:12,015][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:26:17,023][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:26:22,024][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:26:27,025][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:26:32,029][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:26:37,033][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:26:42,034][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:26:47,035][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:26:52,036][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:26:57,037][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:27:02,038][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:27:07,039][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:27:12,058][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:27:17,061][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:27:22,065][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:27:27,066][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:27:32,378][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:27:37,380][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:27:42,382][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:27:47,386][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:27:52,387][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:27:57,388][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:28:02,389][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:28:07,391][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:28:12,393][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:28:17,396][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:28:22,397][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:28:27,399][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:28:32,727][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:28:37,730][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:28:42,731][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:28:47,734][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:28:52,735][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:28:57,736][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:29:02,738][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:29:07,739][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:29:12,741][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:29:17,743][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:29:22,746][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:29:27,759][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:29:32,764][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:29:37,766][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:29:42,769][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:29:47,771][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:29:52,772][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:29:57,773][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:30:02,785][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:30:07,788][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:30:12,796][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:30:17,807][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:30:22,825][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:30:27,836][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:30:32,841][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:30:37,843][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:30:42,887][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:30:47,897][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:30:52,902][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:30:57,912][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:31:02,919][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:31:07,927][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:31:12,930][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:31:17,936][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:31:22,947][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:31:27,959][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:31:32,965][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:31:37,971][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:31:42,976][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:31:48,003][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:31:53,008][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:31:58,018][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:32:03,067][ INFO][PID:2260220] Periodic builder liveness probe: alive [2026-04-07 18:32:03,068][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:32:08,074][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:32:13,078][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:32:18,081][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:32:23,083][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:32:28,085][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:32:33,086][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:32:38,090][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:32:43,092][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:32:48,094][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:32:53,095][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:32:58,099][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:33:03,100][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:33:08,104][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:33:13,105][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:33:18,109][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:33:23,111][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:33:28,116][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:33:33,117][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:33:38,118][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:33:43,119][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:33:48,123][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:33:53,125][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:33:58,127][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:34:03,128][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:34:08,130][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:34:13,131][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:34:18,132][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:34:23,133][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:34:28,138][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:34:33,151][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:34:38,156][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:34:43,164][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:34:48,165][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:34:53,166][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:34:58,167][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:35:03,172][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:35:08,174][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:35:13,179][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:35:18,186][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:35:23,201][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:35:28,206][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:35:33,209][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:35:38,213][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:35:43,214][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:35:48,224][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:35:53,226][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:35:58,230][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:35:58,780][ ERROR][PID:2260220] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-07 18:36:03,233][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:36:08,235][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:36:08,782][WARNING][PID:2260220] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-07 18:36:13,239][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:36:18,243][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:36:18,783][ INFO][PID:2260220] Downloading the builder-live.log file, attempt 2 [2026-04-07 18:36:18,786][ INFO][PID:2260220] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@34.239.175.237 copr-rpmbuild-log [2026-04-07 18:36:18,799][ ERROR][PID:2260220] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-07 18:36:23,244][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:36:28,246][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:36:28,801][WARNING][PID:2260220] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-07 18:36:33,250][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:36:38,281][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:36:38,806][ INFO][PID:2260220] Downloading the builder-live.log file, attempt 3 [2026-04-07 18:36:38,808][ INFO][PID:2260220] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@34.239.175.237 copr-rpmbuild-log [2026-04-07 18:36:38,883][ ERROR][PID:2260220] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-07 18:36:43,300][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:36:48,305][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:36:48,886][WARNING][PID:2260220] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-07 18:36:53,310][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:36:58,317][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:36:58,888][ INFO][PID:2260220] Downloading the builder-live.log file, attempt 4 [2026-04-07 18:36:58,893][ INFO][PID:2260220] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@34.239.175.237 copr-rpmbuild-log [2026-04-07 18:37:03,319][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:37:08,321][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:37:13,322][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:37:18,339][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:37:23,382][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:37:28,410][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:37:33,419][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:37:38,452][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:37:43,456][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:37:48,465][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:37:53,476][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:37:58,478][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:37:58,964][ ERROR][PID:2260220] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-07 18:38:03,483][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:38:08,486][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:38:08,991][ ERROR][PID:2260220] Giving up for unstable SSH, failures: 1775586968.782871, 1775586988.8018043, 1775587008.8861954, 1775587088.9911063 [2026-04-07 18:38:08,992][ ERROR][PID:2260220] Re-try request for task on 'ResallocHost, ticket_id=2209619, hostname=34.239.175.237, name=aws_x86_64_spot_prod_05907791_20260407_181259, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-04-07 18:38:08,992][ INFO][PID:2260220] Releasing VM back to pool [2026-04-07 18:38:09,031][ INFO][PID:2260220] Retry #2 (on other host) [2026-04-07 18:38:09,032][ INFO][PID:2260220] Checking that https://download.copr.fedorainfracloud.org/results/cubewhy/jetbrains/fedora-43-x86_64//repodata/repomd.xml exists [2026-04-07 18:38:09,404][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:38:09,406][ INFO][PID:2260220] VM allocation process starts [2026-04-07 18:38:09,430][ INFO][PID:2260220] Trying to allocate VM: ResallocHost, ticket_id=2209979, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-07 18:38:12,493][ INFO][PID:2260220] Allocated host ResallocHost, ticket_id=2209979, hostname=3.238.172.201, name=aws_x86_64_spot_prod_05908853_20260407_183600, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-07 18:38:12,494][ INFO][PID:2260220] Allocating ssh connection to builder [2026-04-07 18:38:12,494][ INFO][PID:2260220] Checking that builder machine is OK [2026-04-07 18:38:12,825][ INFO][PID:2260220] Running remote command: copr-builder-ready fedora-43-x86_64 [2026-04-07 18:38:13,089][ INFO][PID:2260220] Red Hat subscription not needed for fedora-43-x86_64 Builder is ready to be used [2026-04-07 18:38:13,090][ INFO][PID:2260220] Filling build.info file with builder info [2026-04-07 18:38:13,099][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:38:13,101][ INFO][PID:2260220] Not re-notifying FE and msg buses for the new host. [2026-04-07 18:38:13,102][ INFO][PID:2260220] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10298359-fedora-43-x86_64 --chroot fedora-43-x86_64 --detached [2026-04-07 18:38:13,552][ INFO][PID:2260220] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '3.238.172.201' (ED25519) to the list of known hosts. [2026-04-07 18:38:13,556][ INFO][PID:2260220] Downloading the builder-live.log file, attempt 1 [2026-04-07 18:38:13,564][ INFO][PID:2260220] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.238.172.201 copr-rpmbuild-log [2026-04-07 18:38:18,558][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:38:23,560][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:38:28,563][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:38:33,564][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:38:38,568][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:38:43,578][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:38:48,583][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:38:53,584][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:38:58,586][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:39:03,588][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:39:08,593][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:39:13,595][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:39:18,597][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:39:23,599][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:39:28,600][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:39:33,602][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:39:38,619][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:39:43,620][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:39:48,623][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:39:53,675][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:39:53,965][ ERROR][PID:2260220] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-07 18:39:58,677][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:40:03,678][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:40:03,966][WARNING][PID:2260220] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-07 18:40:08,679][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:40:13,680][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:40:13,970][ INFO][PID:2260220] Downloading the builder-live.log file, attempt 2 [2026-04-07 18:40:13,974][ INFO][PID:2260220] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.238.172.201 copr-rpmbuild-log [2026-04-07 18:40:18,681][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:40:23,683][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:40:28,683][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:40:33,686][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:40:38,688][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:40:43,691][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:40:48,692][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:40:53,695][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:40:58,696][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:41:03,698][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:41:08,701][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:41:13,703][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:41:14,029][ ERROR][PID:2260220] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-07 18:41:18,705][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:41:23,706][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:41:24,031][WARNING][PID:2260220] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-07 18:41:28,712][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:41:33,714][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:41:34,032][ INFO][PID:2260220] Downloading the builder-live.log file, attempt 3 [2026-04-07 18:41:34,036][ INFO][PID:2260220] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.238.172.201 copr-rpmbuild-log [2026-04-07 18:41:38,715][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:41:43,717][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:41:48,718][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:41:53,719][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:41:58,721][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:42:03,729][ INFO][PID:2260220] Periodic builder liveness probe: alive [2026-04-07 18:42:03,730][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:42:08,730][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:42:13,731][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:42:18,732][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:42:23,733][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:42:28,734][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:42:33,736][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:42:34,105][ ERROR][PID:2260220] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-07 18:42:38,740][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:42:43,742][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:42:44,106][WARNING][PID:2260220] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-07 18:42:48,743][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:42:53,744][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:42:54,107][ INFO][PID:2260220] Downloading the builder-live.log file, attempt 4 [2026-04-07 18:42:54,110][ INFO][PID:2260220] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.238.172.201 copr-rpmbuild-log [2026-04-07 18:42:58,745][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:43:03,747][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:43:08,748][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:43:13,751][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:43:18,788][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:43:23,864][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:43:28,865][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:43:33,896][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:43:38,899][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:43:43,907][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:43:48,912][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:43:53,915][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:43:54,194][ ERROR][PID:2260220] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-07 18:43:58,916][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:44:03,921][ INFO][PID:2260220] Checking for cancel request [2026-04-07 18:44:04,198][ ERROR][PID:2260220] Giving up for unstable SSH, failures: 1775587203.9667137, 1775587284.0316389, 1775587364.1065273, 1775587444.1979806 [2026-04-07 18:44:04,199][ ERROR][PID:2260220] Re-try request for task on 'ResallocHost, ticket_id=2209979, hostname=3.238.172.201, name=aws_x86_64_spot_prod_05908853_20260407_183600, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-04-07 18:44:04,200][ INFO][PID:2260220] Releasing VM back to pool [2026-04-07 18:44:04,211][ ERROR][PID:2260220] Backend process error: Three host tried without success: {'3.238.172.201', '34.239.175.237', '3.84.155.24'} [2026-04-07 18:44:04,212][WARNING][PID:2260220] Switching not-finished job state to 'failed' [2026-04-07 18:44:04,212][ INFO][PID:2260220] Worker failed build, took 351.1105868816376 [2026-04-07 18:44:04,213][ INFO][PID:2260220] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "cubewhy", "project_name": "jetbrains", "project_dirname": "jetbrains", "submitter": "cubewhy", "ended_on": 1775587444.212386, "started_on": 1775587093.101799, "submitted_on": null, "status": 0, "chroot": "fedora-43-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10298359-fedora-43-x86_64", "build_id": 10298359, "package_name": "jetbrains-rustrover-eap", "package_version": "2026.1-1.261.22158.214", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/cubewhy/jetbrains/jetbrains-rustrover-eap", "git_hash": "b42c2b2297787f2fa22c1c410069e2ec7c08ad54", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "cubewhy/jetbrains--cubewhy", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/cubewhy/jetbrains/fedora-43-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/cubewhy/jetbrains", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/cubewhy/jetbrains", "result_dir": "10298359-jetbrains-rustrover-eap", "built_packages": "", "id": 10298359, "mockchain_macros": { "copr_username": "cubewhy", "copr_projectname": "jetbrains", "vendor": "Fedora Project COPR (cubewhy/jetbrains)" } } ] } [2026-04-07 18:44:04,261][ INFO][PID:2260220] Sending fedora-messaging bus message in build.end [2026-04-07 18:44:04,299][ INFO][PID:2260220] Compressing /var/lib/copr/public_html/results/cubewhy/jetbrains/fedora-43-x86_64/10298359-jetbrains-rustrover-eap/builder-live.log by gzip [2026-04-07 18:44:04,306][ INFO][PID:2260220] Running command 'gzip /var/lib/copr/public_html/results/cubewhy/jetbrains/fedora-43-x86_64/10298359-jetbrains-rustrover-eap/builder-live.log' as PID 2477400 [2026-04-07 18:44:04,307][ INFO][PID:2260220] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/cubewhy/jetbrains/fedora-43-x86_64/10298359-jetbrains-rustrover-eap/builder-live.log) [2026-04-07 18:44:04,308][ INFO][PID:2260220] Compressing /var/lib/copr/public_html/results/cubewhy/jetbrains/fedora-43-x86_64/10298359-jetbrains-rustrover-eap/backend.log by gzip [2026-04-07 18:44:04,312][ INFO][PID:2260220] Running command 'gzip /var/lib/copr/public_html/results/cubewhy/jetbrains/fedora-43-x86_64/10298359-jetbrains-rustrover-eap/backend.log' as PID 2477402