[2026-07-08 14:20:46,152][ INFO][PID:2856443] Marking build as starting [2026-07-08 14:20:46,217][ INFO][PID:2856443] Checking that https://download.copr.fedorainfracloud.org/results/abbra/synta/fedora-44-x86_64//repodata/repomd.xml exists [2026-07-08 14:20:46,606][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:20:46,639][WARNING][PID:2856443] rpmeta: cannot connect to https://rpmeta.fedoraproject.org, skipping [2026-07-08 14:20:46,640][ INFO][PID:2856443] VM allocation process starts [2026-07-08 14:20:46,667][ INFO][PID:2856443] Trying to allocate VM: ResallocHost, ticket_id=3813871, requested_tags=['arch_x86_64', 'copr_builder'] [2026-07-08 14:20:51,670][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:20:52,702][ INFO][PID:2856443] Allocated host ResallocHost, ticket_id=3813871, hostname=3.236.82.137, name=aws_x86_64_spot_prod_12966271_20260708_141512, requested_tags=['arch_x86_64', 'copr_builder'] [2026-07-08 14:20:52,703][ INFO][PID:2856443] Allocating ssh connection to builder [2026-07-08 14:20:52,704][ INFO][PID:2856443] Checking that builder machine is OK [2026-07-08 14:20:53,059][ INFO][PID:2856443] Installed copr-rpmbuild version: 1.8 [2026-07-08 14:20:53,060][ INFO][PID:2856443] Running remote command: copr-builder-ready fedora-44-x86_64 [2026-07-08 14:20:53,245][ INFO][PID:2856443] Red Hat subscription not needed for fedora-44-x86_64 Builder is ready to be used [2026-07-08 14:20:53,245][ INFO][PID:2856443] Filling build.info file with builder info [2026-07-08 14:20:53,246][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:20:53,247][ INFO][PID:2856443] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "abbra", "project_name": "synta", "project_dirname": "synta", "submitter": "abbra", "ended_on": null, "started_on": 1783520453.2476676, "submitted_on": null, "status": 3, "chroot": "fedora-44-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10698479-fedora-44-x86_64", "build_id": 10698479, "package_name": "rust-ldap-acis", "package_version": "0.1.1-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/abbra/synta/rust-ldap-acis", "git_hash": "3b8ed6e0f47d566814b249421f8a51fbfbb50311", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "abbra/synta--abbra", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/abbra/synta/fedora-44-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/abbra/synta", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/abbra/synta", "result_dir": "10698479-rust-ldap-acis", "built_packages": "", "rpmeta_prediction": null, "id": 10698479, "mockchain_macros": { "copr_username": "abbra", "copr_projectname": "synta", "vendor": "Fedora Project COPR (abbra/synta)" } } ] } [2026-07-08 14:20:53,304][ INFO][PID:2856443] Sending fedora-messaging bus message in build.start [2026-07-08 14:20:53,832][ INFO][PID:2856443] Sending fedora-messaging bus message in chroot.start [2026-07-08 14:20:53,864][ INFO][PID:2856443] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10698479-fedora-44-x86_64 --chroot fedora-44-x86_64 --detached [2026-07-08 14:20:54,594][ INFO][PID:2856443] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '3.236.82.137' (ED25519) to the list of known hosts. [2026-07-08 14:20:54,595][ INFO][PID:2856443] Downloading the builder-live.log file, attempt 1 [2026-07-08 14:20:54,598][ INFO][PID:2856443] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.236.82.137 copr-rpmbuild-log [2026-07-08 14:20:59,603][ INFO][PID:2856443] Periodic builder liveness probe: alive [2026-07-08 14:20:59,603][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:21:04,605][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:21:09,607][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:21:14,611][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:21:19,613][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:21:24,615][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:21:29,617][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:21:34,618][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:21:36,961][ ERROR][PID:2856443] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-07-08 14:21:39,620][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:21:44,621][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:21:46,970][WARNING][PID:2856443] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-07-08 14:21:49,623][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:21:54,624][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:21:56,971][ INFO][PID:2856443] Downloading the builder-live.log file, attempt 2 [2026-07-08 14:21:56,973][ INFO][PID:2856443] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.236.82.137 copr-rpmbuild-log [2026-07-08 14:21:59,626][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:22:04,635][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:22:09,636][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:22:14,638][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:22:19,640][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:22:24,642][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:22:29,644][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:22:34,647][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:22:39,649][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:22:44,652][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:22:49,656][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:22:54,658][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:22:57,041][ ERROR][PID:2856443] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-07-08 14:22:59,660][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:23:04,661][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:23:07,055][WARNING][PID:2856443] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-07-08 14:23:09,664][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:23:14,674][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:23:17,057][ INFO][PID:2856443] Downloading the builder-live.log file, attempt 3 [2026-07-08 14:23:17,059][ INFO][PID:2856443] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.236.82.137 copr-rpmbuild-log [2026-07-08 14:23:19,675][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:23:24,678][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:23:29,681][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:23:34,684][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:23:39,686][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:23:44,688][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:23:49,697][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:23:54,699][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:23:59,701][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:24:04,702][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:24:09,704][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:24:14,707][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:24:17,130][ ERROR][PID:2856443] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-07-08 14:24:19,712][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:24:24,726][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:24:27,444][WARNING][PID:2856443] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-07-08 14:24:29,737][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:24:34,739][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:24:37,448][ INFO][PID:2856443] Downloading the builder-live.log file, attempt 4 [2026-07-08 14:24:37,451][ INFO][PID:2856443] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.236.82.137 copr-rpmbuild-log [2026-07-08 14:24:39,741][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:24:44,747][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:24:49,757][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:24:54,760][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:24:59,765][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:25:04,767][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:25:09,770][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:25:14,774][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:25:19,778][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:25:24,785][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:25:29,788][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:25:34,790][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:25:37,520][ ERROR][PID:2856443] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-07-08 14:25:39,791][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:25:44,805][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:25:47,639][ ERROR][PID:2856443] Giving up for unstable SSH, failures: 1783520506.9706373, 1783520587.0555696, 1783520667.4439993, 1783520747.565067 [2026-07-08 14:25:47,737][ ERROR][PID:2856443] Re-try request for task on 'ResallocHost, ticket_id=3813871, hostname=3.236.82.137, name=aws_x86_64_spot_prod_12966271_20260708_141512, requested_tags=['arch_x86_64', 'copr_builder']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-07-08 14:25:47,784][ INFO][PID:2856443] VM Release request [2026-07-08 14:25:47,964][ INFO][PID:2856443] Retry #1 (on other host) [2026-07-08 14:25:47,979][ INFO][PID:2856443] Checking that https://download.copr.fedorainfracloud.org/results/abbra/synta/fedora-44-x86_64//repodata/repomd.xml exists [2026-07-08 14:25:51,333][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:25:51,429][WARNING][PID:2856443] rpmeta: cannot connect to https://rpmeta.fedoraproject.org, skipping [2026-07-08 14:25:51,435][ INFO][PID:2856443] VM allocation process starts [2026-07-08 14:25:51,480][ INFO][PID:2856443] Trying to allocate VM: ResallocHost, ticket_id=3813956, requested_tags=['arch_x86_64', 'copr_builder'] [2026-07-08 14:25:56,530][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:25:57,657][ INFO][PID:2856443] Allocated host ResallocHost, ticket_id=3813956, hostname=44.202.159.220, name=aws_x86_64_reserved_prod_12966624_20260708_142436, requested_tags=['arch_x86_64', 'copr_builder'] [2026-07-08 14:25:57,659][ INFO][PID:2856443] Allocating ssh connection to builder [2026-07-08 14:25:57,672][ INFO][PID:2856443] Checking that builder machine is OK [2026-07-08 14:25:58,076][ INFO][PID:2856443] Installed copr-rpmbuild version: 1.8 [2026-07-08 14:25:58,087][ INFO][PID:2856443] Running remote command: copr-builder-ready fedora-44-x86_64 [2026-07-08 14:25:58,316][ INFO][PID:2856443] Red Hat subscription not needed for fedora-44-x86_64 Builder is ready to be used [2026-07-08 14:25:58,318][ INFO][PID:2856443] Filling build.info file with builder info [2026-07-08 14:25:58,321][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:25:58,327][ INFO][PID:2856443] Not re-notifying FE and msg buses for the new host. [2026-07-08 14:25:58,330][ INFO][PID:2856443] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10698479-fedora-44-x86_64 --chroot fedora-44-x86_64 --detached [2026-07-08 14:25:58,858][ INFO][PID:2856443] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '44.202.159.220' (ED25519) to the list of known hosts. [2026-07-08 14:25:58,861][ INFO][PID:2856443] Downloading the builder-live.log file, attempt 1 [2026-07-08 14:25:58,863][ INFO][PID:2856443] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.202.159.220 copr-rpmbuild-log [2026-07-08 14:26:03,862][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:26:08,864][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:26:13,865][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:26:18,867][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:26:23,871][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:26:28,872][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:26:33,874][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:26:38,875][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:26:43,877][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:26:48,878][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:26:53,886][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:26:58,891][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:27:03,894][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:27:08,900][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:27:13,902][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:27:18,904][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:27:23,906][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:27:28,908][ INFO][PID:2856443] Checking for cancel request [2026-07-08 14:27:30,891][ INFO][PID:2856443] Downloading results from builder [2026-07-08 14:27:30,916][ INFO][PID:2856443] rsyncing of mockbuilder@44.202.159.220:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/abbra/synta/fedora-44-x86_64/10698479-rust-ldap-acis started [2026-07-08 14:27:30,933][ INFO][PID:2856443] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@44.202.159.220:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/abbra/synta/fedora-44-x86_64/10698479-rust-ldap-acis/ &> /var/lib/copr/public_html/results/abbra/synta/fedora-44-x86_64/10698479-rust-ldap-acis/build-10698479.rsync.log [2026-07-08 14:27:31,122][ INFO][PID:2856443] rsyncing finished. [2026-07-08 14:27:31,125][ INFO][PID:2856443] VM Release request [2026-07-08 14:27:31,143][ INFO][PID:2856443] Searching for 'success' file in resultdir [2026-07-08 14:27:31,146][ ERROR][PID:2856443] Build failed: Backend process error: No success file => build failure [2026-07-08 14:27:31,655][ INFO][PID:2856443] Finished build: id=10698479 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/abbra/synta chroot=fedora-44-x86_64 [2026-07-08 14:27:31,963][ ERROR][PID:2856443] Backend process error: No success file => build failure [2026-07-08 14:27:32,009][ INFO][PID:2856443] Worker failed build, took 93.68645596504211 [2026-07-08 14:27:32,028][ INFO][PID:2856443] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "abbra", "project_name": "synta", "project_dirname": "synta", "submitter": "abbra", "ended_on": 1783520852.009836, "started_on": 1783520758.32338, "submitted_on": null, "status": 0, "chroot": "fedora-44-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10698479-fedora-44-x86_64", "build_id": 10698479, "package_name": "rust-ldap-acis", "package_version": "0.1.1-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/abbra/synta/rust-ldap-acis", "git_hash": "3b8ed6e0f47d566814b249421f8a51fbfbb50311", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "abbra/synta--abbra", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/abbra/synta/fedora-44-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/abbra/synta", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/abbra/synta", "result_dir": "10698479-rust-ldap-acis", "built_packages": "", "rpmeta_prediction": null, "id": 10698479, "mockchain_macros": { "copr_username": "abbra", "copr_projectname": "synta", "vendor": "Fedora Project COPR (abbra/synta)" } } ] } [2026-07-08 14:27:32,134][ INFO][PID:2856443] Sending fedora-messaging bus message in build.end [2026-07-08 14:27:32,890][ INFO][PID:2856443] Compressing /var/lib/copr/public_html/results/abbra/synta/fedora-44-x86_64/10698479-rust-ldap-acis/builder-live.log by gzip [2026-07-08 14:27:32,905][ INFO][PID:2856443] Running command 'gzip /var/lib/copr/public_html/results/abbra/synta/fedora-44-x86_64/10698479-rust-ldap-acis/builder-live.log' as PID 2911570 [2026-07-08 14:27:32,943][ INFO][PID:2856443] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/abbra/synta/fedora-44-x86_64/10698479-rust-ldap-acis/builder-live.log) [2026-07-08 14:27:32,948][ INFO][PID:2856443] Compressing /var/lib/copr/public_html/results/abbra/synta/fedora-44-x86_64/10698479-rust-ldap-acis/backend.log by gzip [2026-07-08 14:27:32,950][ INFO][PID:2856443] Running command 'gzip /var/lib/copr/public_html/results/abbra/synta/fedora-44-x86_64/10698479-rust-ldap-acis/backend.log' as PID 2911575