[2026-06-08 03:40:28,801][ INFO][PID:355840] Marking build as starting [2026-06-08 03:40:28,900][ INFO][PID:355840] Checking that /var/lib/copr/public_html/results/clarlok/tools/fedora-43-x86_64/repodata/repomd.xml exists [2026-06-08 03:40:28,902][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:40:28,953][ INFO][PID:355840] rpmeta: predicted 10 min for wezterm on fedora-43-x86_64 -> normal builder sufficient [2026-06-08 03:40:28,956][ INFO][PID:355840] VM allocation process starts [2026-06-08 03:40:28,970][ INFO][PID:355840] Trying to allocate VM: ResallocHost, ticket_id=3330076, requested_tags=['arch_x86_64', 'copr_builder'] [2026-06-08 03:40:33,973][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:40:38,976][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:40:43,981][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:40:47,017][ INFO][PID:355840] Allocated host ResallocHost, ticket_id=3330076, hostname=54.174.112.221, name=aws_x86_64_spot_prod_11380898_20260608_033735, requested_tags=['arch_x86_64', 'copr_builder'] [2026-06-08 03:40:47,018][ INFO][PID:355840] Allocating ssh connection to builder [2026-06-08 03:40:47,020][ INFO][PID:355840] Checking that builder machine is OK [2026-06-08 03:40:47,407][ INFO][PID:355840] Installed copr-rpmbuild version: 1.8 [2026-06-08 03:40:47,408][ INFO][PID:355840] Running remote command: copr-builder-ready fedora-43-x86_64 [2026-06-08 03:40:47,643][ INFO][PID:355840] Red Hat subscription not needed for fedora-43-x86_64 Builder is ready to be used [2026-06-08 03:40:47,644][ INFO][PID:355840] Filling build.info file with builder info [2026-06-08 03:40:47,648][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:40:47,650][ INFO][PID:355840] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "clarlok", "project_name": "tools", "project_dirname": "tools", "submitter": "clarlok", "ended_on": null, "started_on": 1780890047.6498628, "submitted_on": null, "status": 3, "chroot": "fedora-43-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10577169-fedora-43-x86_64", "build_id": 10577169, "package_name": "wezterm", "package_version": "20260607_082427_8afe0ad3-0", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/clarlok/tools/wezterm", "git_hash": "072279682e7258c2fd053976fe82c0959976f1a4", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "clarlok/tools--clarlok", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/clarlok/tools/fedora-43-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/clarlok/tools", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/clarlok/tools", "result_dir": "10577169-wezterm", "built_packages": "", "rpmeta_prediction": 10, "id": 10577169, "mockchain_macros": { "copr_username": "clarlok", "copr_projectname": "tools", "vendor": "Fedora Project COPR (clarlok/tools)" } } ] } [2026-06-08 03:40:47,794][ INFO][PID:355840] Sending fedora-messaging bus message in build.start [2026-06-08 03:40:48,529][ INFO][PID:355840] Sending fedora-messaging bus message in chroot.start [2026-06-08 03:40:48,590][ INFO][PID:355840] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10577169-fedora-43-x86_64 --chroot fedora-43-x86_64 --detached [2026-06-08 03:40:49,099][ INFO][PID:355840] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '54.174.112.221' (ED25519) to the list of known hosts. [2026-06-08 03:40:49,100][ INFO][PID:355840] Downloading the builder-live.log file, attempt 1 [2026-06-08 03:40:49,102][ INFO][PID:355840] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.174.112.221 copr-rpmbuild-log [2026-06-08 03:40:54,130][ INFO][PID:355840] Periodic builder liveness probe: alive [2026-06-08 03:40:54,135][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:40:59,138][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:41:04,142][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:41:09,144][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:41:14,149][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:41:19,151][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:41:24,159][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:41:29,165][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:41:34,193][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:41:39,220][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:41:44,231][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:41:49,255][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:41:54,261][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:41:59,266][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:42:04,277][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:42:09,294][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:42:14,301][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:42:19,316][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:42:24,319][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:42:29,329][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:42:34,332][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:42:39,341][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:42:44,361][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:42:49,363][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:42:54,376][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:42:59,394][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:43:04,411][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:43:09,433][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:43:14,442][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:43:19,449][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:43:24,467][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:43:29,489][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:43:34,504][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:43:39,510][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:43:44,513][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:43:49,519][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:43:54,528][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:43:59,531][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:44:04,536][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:44:09,539][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:44:14,546][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:44:19,557][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:44:24,571][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:44:29,575][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:44:34,585][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:44:39,599][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:44:44,601][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:44:49,608][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:44:54,613][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:44:59,617][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:45:04,620][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:45:09,634][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:45:14,645][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:45:19,666][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:45:24,670][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:45:29,677][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:45:34,685][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:45:39,704][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:45:44,707][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:45:49,711][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:45:54,717][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:46:00,083][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:46:05,889][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:46:11,289][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:46:16,389][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:46:21,440][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:46:26,828][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:46:31,884][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:46:36,988][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:46:42,008][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:46:47,016][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:46:52,041][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:46:57,144][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:47:02,186][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:47:07,215][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:47:12,236][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:47:17,254][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:47:22,281][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:47:27,292][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:47:32,890][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:47:37,927][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:47:42,966][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:47:48,012][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:47:53,081][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:47:58,148][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:48:03,214][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:48:08,244][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:48:13,350][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:48:18,362][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:48:23,372][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:48:28,384][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:48:33,390][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:48:38,395][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:48:43,948][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:48:49,105][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:48:54,135][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:48:59,357][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:49:04,398][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:49:09,512][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:49:14,573][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:49:19,593][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:49:24,620][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:49:29,648][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:49:33,431][ ERROR][PID:355840] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-06-08 03:49:34,650][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:49:39,661][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:49:43,808][WARNING][PID:355840] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-06-08 03:49:44,662][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:49:49,664][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:49:53,833][ INFO][PID:355840] Downloading the builder-live.log file, attempt 2 [2026-06-08 03:49:53,965][ INFO][PID:355840] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.174.112.221 copr-rpmbuild-log [2026-06-08 03:49:53,969][ ERROR][PID:355840] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-06-08 03:49:54,714][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:49:59,722][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:50:04,070][WARNING][PID:355840] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-06-08 03:50:04,724][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:50:09,726][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:50:14,071][ INFO][PID:355840] Downloading the builder-live.log file, attempt 3 [2026-06-08 03:50:14,073][ INFO][PID:355840] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.174.112.221 copr-rpmbuild-log [2026-06-08 03:50:14,728][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:50:19,729][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:50:24,731][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:50:29,732][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:50:34,735][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:50:39,738][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:50:44,740][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:50:49,742][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:50:55,419][ INFO][PID:355840] Periodic builder liveness probe: alive [2026-06-08 03:50:55,559][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:51:00,567][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:51:05,571][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:51:10,573][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:51:14,140][ ERROR][PID:355840] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-06-08 03:51:15,575][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:51:20,576][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:51:24,160][WARNING][PID:355840] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-06-08 03:51:25,577][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:51:30,579][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:51:34,162][ INFO][PID:355840] Downloading the builder-live.log file, attempt 4 [2026-06-08 03:51:34,164][ INFO][PID:355840] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.174.112.221 copr-rpmbuild-log [2026-06-08 03:51:35,581][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:51:40,585][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:51:45,610][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:51:50,612][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:51:55,613][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:52:00,615][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:52:05,616][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:52:10,618][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:52:15,622][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:52:20,623][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:52:25,626][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:52:30,627][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:52:34,233][ ERROR][PID:355840] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-06-08 03:52:35,628][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:52:40,630][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:52:44,266][ ERROR][PID:355840] Giving up for unstable SSH, failures: 1780890583.8059359, 1780890604.0703416, 1780890684.1600354, 1780890764.251686 [2026-06-08 03:52:44,293][ ERROR][PID:355840] Re-try request for task on 'ResallocHost, ticket_id=3330076, hostname=54.174.112.221, name=aws_x86_64_spot_prod_11380898_20260608_033735, requested_tags=['arch_x86_64', 'copr_builder']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-06-08 03:52:44,320][ INFO][PID:355840] VM Release request [2026-06-08 03:52:44,338][ INFO][PID:355840] Retry #1 (on other host) [2026-06-08 03:52:44,347][ INFO][PID:355840] Checking that /var/lib/copr/public_html/results/clarlok/tools/fedora-43-x86_64/repodata/repomd.xml exists [2026-06-08 03:52:44,351][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:52:44,726][ INFO][PID:355840] rpmeta: predicted 10 min for wezterm on fedora-43-x86_64 -> normal builder sufficient [2026-06-08 03:52:44,734][ INFO][PID:355840] VM allocation process starts [2026-06-08 03:52:44,763][ INFO][PID:355840] Trying to allocate VM: ResallocHost, ticket_id=3330223, requested_tags=['arch_x86_64', 'copr_builder'] [2026-06-08 03:52:49,769][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:52:54,770][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:52:56,873][ INFO][PID:355840] Allocated host ResallocHost, ticket_id=3330223, hostname=13.219.247.204, name=aws_x86_64_spot_prod_11381039_20260608_033830, requested_tags=['arch_x86_64', 'copr_builder'] [2026-06-08 03:52:56,880][ INFO][PID:355840] Allocating ssh connection to builder [2026-06-08 03:52:56,882][ INFO][PID:355840] Checking that builder machine is OK [2026-06-08 03:52:57,302][ INFO][PID:355840] Installed copr-rpmbuild version: 1.8 [2026-06-08 03:52:57,315][ INFO][PID:355840] Running remote command: copr-builder-ready fedora-43-x86_64 [2026-06-08 03:52:57,546][ INFO][PID:355840] Red Hat subscription not needed for fedora-43-x86_64 Builder is ready to be used [2026-06-08 03:52:57,547][ INFO][PID:355840] Filling build.info file with builder info [2026-06-08 03:52:57,575][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:52:57,580][ INFO][PID:355840] Not re-notifying FE and msg buses for the new host. [2026-06-08 03:52:57,585][ INFO][PID:355840] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10577169-fedora-43-x86_64 --chroot fedora-43-x86_64 --detached [2026-06-08 03:52:58,091][ INFO][PID:355840] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '13.219.247.204' (ED25519) to the list of known hosts. [2026-06-08 03:52:58,092][ INFO][PID:355840] Downloading the builder-live.log file, attempt 1 [2026-06-08 03:52:58,095][ INFO][PID:355840] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.219.247.204 copr-rpmbuild-log [2026-06-08 03:53:03,093][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:53:08,094][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:53:13,096][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:53:18,097][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:53:23,099][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:53:28,100][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:53:33,102][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:53:38,103][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:53:43,105][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:53:48,106][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:53:53,108][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:53:58,109][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:54:03,111][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:54:08,117][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:54:13,119][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:54:18,126][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:54:23,127][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:54:28,142][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:54:33,146][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:54:38,147][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:54:43,157][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:54:48,159][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:54:53,167][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:54:58,169][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:55:03,171][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:55:08,179][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:55:13,181][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:55:18,188][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:55:23,191][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:55:28,198][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:55:33,199][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:55:38,201][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:55:43,206][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:55:48,207][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:55:53,209][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:55:58,210][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:56:03,211][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:56:08,213][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:56:13,214][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:56:18,221][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:56:23,222][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:56:28,224][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:56:33,225][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:56:38,227][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:56:43,229][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:56:48,230][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:56:53,232][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:56:58,233][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:57:03,234][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:57:08,236][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:57:13,238][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:57:18,239][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:57:23,240][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:57:28,246][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:57:33,247][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:57:38,250][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:57:43,256][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:57:48,258][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:57:53,259][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:57:58,269][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:58:03,290][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:58:08,291][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:58:13,293][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:58:18,294][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:58:23,295][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:58:28,297][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:58:33,300][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:58:38,301][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:58:43,303][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:58:48,304][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:58:53,306][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:58:58,307][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:59:03,309][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:59:08,310][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:59:13,312][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:59:18,313][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:59:23,315][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:59:28,316][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:59:33,348][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:59:38,350][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:59:43,351][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:59:48,352][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:59:53,353][ INFO][PID:355840] Checking for cancel request [2026-06-08 03:59:58,354][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:00:03,356][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:00:08,359][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:00:13,360][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:00:18,362][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:00:23,366][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:00:28,369][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:00:33,379][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:00:38,388][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:00:43,391][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:00:48,392][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:00:53,394][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:00:58,410][ INFO][PID:355840] Periodic builder liveness probe: alive [2026-06-08 04:00:58,413][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:01:03,415][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:01:08,423][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:01:13,425][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:01:18,433][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:01:23,435][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:01:28,458][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:01:33,487][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:01:38,503][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:01:43,511][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:01:48,515][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:01:53,517][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:01:58,521][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:02:03,523][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:02:08,538][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:02:13,554][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:02:18,560][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:02:23,572][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:02:28,575][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:02:33,610][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:02:38,630][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:02:43,634][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:02:48,637][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:02:53,654][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:02:58,665][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:03:03,673][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:03:08,681][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:03:13,691][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:03:18,696][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:03:23,700][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:03:28,713][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:03:33,717][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:03:38,718][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:03:43,721][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:03:48,828][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:03:53,834][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:03:58,846][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:04:03,860][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:04:08,865][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:04:13,867][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:04:18,878][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:04:23,888][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:04:28,891][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:04:33,919][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:04:39,142][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:04:44,162][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:04:49,204][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:04:54,207][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:04:59,244][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:05:04,260][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:05:09,289][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:05:14,326][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:05:19,607][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:05:24,618][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:05:29,648][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:05:34,679][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:05:39,811][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:05:44,861][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:05:49,880][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:05:54,887][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:05:59,889][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:06:04,892][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:06:09,899][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:06:14,902][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:06:19,904][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:06:24,906][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:06:29,911][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:06:34,913][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:06:39,918][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:06:44,927][ INFO][PID:355840] Checking for cancel request [2026-06-08 04:06:48,840][ INFO][PID:355840] Downloading results from builder [2026-06-08 04:06:48,873][ INFO][PID:355840] rsyncing of mockbuilder@13.219.247.204:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/clarlok/tools/fedora-43-x86_64/10577169-wezterm started [2026-06-08 04:06:48,957][ INFO][PID:355840] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@13.219.247.204:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/clarlok/tools/fedora-43-x86_64/10577169-wezterm/ &> /var/lib/copr/public_html/results/clarlok/tools/fedora-43-x86_64/10577169-wezterm/build-10577169.rsync.log [2026-06-08 04:06:50,470][ INFO][PID:355840] rsyncing finished. [2026-06-08 04:06:50,475][ INFO][PID:355840] VM Release request [2026-06-08 04:06:50,528][ INFO][PID:355840] Searching for 'success' file in resultdir [2026-06-08 04:06:50,548][ INFO][PID:355840] Going to sign pkgs from source: 10577169-fedora-43-x86_64 in chroot: /var/lib/copr/public_html/results/clarlok/tools/fedora-43-x86_64 [2026-06-08 04:06:50,572][ INFO][PID:355840] Calling '/bin/sign -u clarlok#tools@copr.fedorahosted.org -p' (attempt #1) [2026-06-08 04:06:50,939][ INFO][PID:355840] Calling '/bin/sign -4 -h sha256 -u clarlok#tools@copr.fedorahosted.org -r /var/lib/copr/public_html/results/clarlok/tools/fedora-43-x86_64/10577169-wezterm/wezterm-gui-20260607_082427_8afe0ad3-0.x86_64.rpm' (attempt #1) [2026-06-08 04:06:52,854][ INFO][PID:355840] signed rpm: /var/lib/copr/public_html/results/clarlok/tools/fedora-43-x86_64/10577169-wezterm/wezterm-gui-20260607_082427_8afe0ad3-0.x86_64.rpm [2026-06-08 04:06:52,858][ INFO][PID:355840] Calling '/bin/sign -4 -h sha256 -u clarlok#tools@copr.fedorahosted.org -r /var/lib/copr/public_html/results/clarlok/tools/fedora-43-x86_64/10577169-wezterm/wezterm-mux-server-20260607_082427_8afe0ad3-0.x86_64.rpm' (attempt #1) [2026-06-08 04:06:54,178][ INFO][PID:355840] signed rpm: /var/lib/copr/public_html/results/clarlok/tools/fedora-43-x86_64/10577169-wezterm/wezterm-mux-server-20260607_082427_8afe0ad3-0.x86_64.rpm [2026-06-08 04:06:54,181][ INFO][PID:355840] Calling '/bin/sign -4 -h sha256 -u clarlok#tools@copr.fedorahosted.org -r /var/lib/copr/public_html/results/clarlok/tools/fedora-43-x86_64/10577169-wezterm/wezterm-common-20260607_082427_8afe0ad3-0.x86_64.rpm' (attempt #1) [2026-06-08 04:06:55,298][ INFO][PID:355840] signed rpm: /var/lib/copr/public_html/results/clarlok/tools/fedora-43-x86_64/10577169-wezterm/wezterm-common-20260607_082427_8afe0ad3-0.x86_64.rpm [2026-06-08 04:06:55,300][ INFO][PID:355840] Calling '/bin/sign -4 -h sha256 -u clarlok#tools@copr.fedorahosted.org -r /var/lib/copr/public_html/results/clarlok/tools/fedora-43-x86_64/10577169-wezterm/wezterm-20260607_082427_8afe0ad3-0.x86_64.rpm' (attempt #1) [2026-06-08 04:06:56,038][ INFO][PID:355840] signed rpm: /var/lib/copr/public_html/results/clarlok/tools/fedora-43-x86_64/10577169-wezterm/wezterm-20260607_082427_8afe0ad3-0.x86_64.rpm [2026-06-08 04:06:56,043][ INFO][PID:355840] Calling '/bin/sign -4 -h sha256 -u clarlok#tools@copr.fedorahosted.org -r /var/lib/copr/public_html/results/clarlok/tools/fedora-43-x86_64/10577169-wezterm/wezterm-20260607_082427_8afe0ad3-0.src.rpm' (attempt #1) [2026-06-08 04:06:58,055][ INFO][PID:355840] signed rpm: /var/lib/copr/public_html/results/clarlok/tools/fedora-43-x86_64/10577169-wezterm/wezterm-20260607_082427_8afe0ad3-0.src.rpm [2026-06-08 04:06:58,057][ INFO][PID:355840] Sign done [2026-06-08 04:06:58,073][ INFO][PID:355840] Incremental createrepo run, adding 10577169-wezterm into https://download.copr.fedorainfracloud.org/results/clarlok/tools/fedora-43-x86_64, (auto-create-repo=True) [2026-06-08 04:06:58,108][ INFO][PID:355840] Running command 'copr-repo --batched /var/lib/copr/public_html/results/clarlok/tools/fedora-43-x86_64 --add 10577169-wezterm --no-appstream-metadata' as PID 618874 [2026-06-08 04:06:59,316][ INFO][PID:355840] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/clarlok/tools/fedora-43-x86_64 --add 10577169-wezterm --no-appstream-metadata) [2026-06-08 04:06:59,341][ INFO][PID:355840] Getting build details [2026-06-08 04:06:59,345][ INFO][PID:355840] Listing built binary packages in /var/lib/copr/public_html/results/clarlok/tools/fedora-43-x86_64/10577169-wezterm [2026-06-08 04:06:59,347][ INFO][PID:355840] Built packages: ['wezterm 20260607_082427_8afe0ad3', 'wezterm-common 20260607_082427_8afe0ad3', 'wezterm-mux-server 20260607_082427_8afe0ad3', 'wezterm-gui 20260607_082427_8afe0ad3'] [2026-06-08 04:06:59,349][ INFO][PID:355840] build details: {'built_packages': 'wezterm 20260607_082427_8afe0ad3\nwezterm-common 20260607_082427_8afe0ad3\nwezterm-mux-server 20260607_082427_8afe0ad3\nwezterm-gui 20260607_082427_8afe0ad3'} [2026-06-08 04:06:59,352][ INFO][PID:355840] Retrieving pubkey [2026-06-08 04:06:59,354][ INFO][PID:355840] Calling '/bin/sign -u clarlok#tools@copr.fedorahosted.org -p' (attempt #1) [2026-06-08 04:06:59,666][ INFO][PID:355840] Added pubkey for user clarlok project tools into: /var/lib/copr/public_html/results/clarlok/tools/pubkey.gpg [2026-06-08 04:06:59,672][ INFO][PID:355840] Finished build: id=10577169 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/clarlok/tools chroot=fedora-43-x86_64 [2026-06-08 04:06:59,760][ INFO][PID:355840] Worker succeeded build, took 842.181450843811 [2026-06-08 04:06:59,773][ INFO][PID:355840] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "clarlok", "project_name": "tools", "project_dirname": "tools", "submitter": "clarlok", "ended_on": 1780891619.7593749, "started_on": 1780890777.577924, "submitted_on": null, "status": 1, "chroot": "fedora-43-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10577169-fedora-43-x86_64", "build_id": 10577169, "package_name": "wezterm", "package_version": "20260607_082427_8afe0ad3-0", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/clarlok/tools/wezterm", "git_hash": "072279682e7258c2fd053976fe82c0959976f1a4", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "clarlok/tools--clarlok", "results": { "packages": [ { "name": "wezterm", "epoch": null, "version": "20260607_082427_8afe0ad3", "release": "0", "arch": "x86_64" }, { "name": "wezterm-common", "epoch": null, "version": "20260607_082427_8afe0ad3", "release": "0", "arch": "x86_64" }, { "name": "wezterm", "epoch": null, "version": "20260607_082427_8afe0ad3", "release": "0", "arch": "src" }, { "name": "wezterm-mux-server", "epoch": null, "version": "20260607_082427_8afe0ad3", "release": "0", "arch": "x86_64" }, { "name": "wezterm-gui", "epoch": null, "version": "20260607_082427_8afe0ad3", "release": "0", "arch": "x86_64" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/clarlok/tools/fedora-43-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/clarlok/tools", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/clarlok/tools", "result_dir": "10577169-wezterm", "built_packages": "wezterm 20260607_082427_8afe0ad3\nwezterm-common 20260607_082427_8afe0ad3\nwezterm-mux-server 20260607_082427_8afe0ad3\nwezterm-gui 20260607_082427_8afe0ad3", "rpmeta_prediction": 10, "id": 10577169, "mockchain_macros": { "copr_username": "clarlok", "copr_projectname": "tools", "vendor": "Fedora Project COPR (clarlok/tools)" } } ] } [2026-06-08 04:07:00,720][ INFO][PID:355840] Sending fedora-messaging bus message in build.end [2026-06-08 04:07:01,240][ INFO][PID:355840] Compressing /var/lib/copr/public_html/results/clarlok/tools/fedora-43-x86_64/10577169-wezterm/builder-live.log by gzip [2026-06-08 04:07:01,243][ INFO][PID:355840] Running command 'gzip /var/lib/copr/public_html/results/clarlok/tools/fedora-43-x86_64/10577169-wezterm/builder-live.log' as PID 619414 [2026-06-08 04:07:01,272][ INFO][PID:355840] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/clarlok/tools/fedora-43-x86_64/10577169-wezterm/builder-live.log) [2026-06-08 04:07:01,272][ INFO][PID:355840] Compressing /var/lib/copr/public_html/results/clarlok/tools/fedora-43-x86_64/10577169-wezterm/backend.log by gzip [2026-06-08 04:07:01,275][ INFO][PID:355840] Running command 'gzip /var/lib/copr/public_html/results/clarlok/tools/fedora-43-x86_64/10577169-wezterm/backend.log' as PID 619425