[2026-07-14 16:09:26,005][ INFO][PID:329936] Marking build as starting [2026-07-14 16:09:26,062][ INFO][PID:329936] Checking that /var/lib/copr/public_html/results/androniychuk/xpu-manager/fedora-rawhide-x86_64/repodata/repomd.xml exists [2026-07-14 16:09:26,108][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:09:26,139][WARNING][PID:329936] rpmeta: cannot connect to https://rpmeta.fedoraproject.org, skipping [2026-07-14 16:09:26,140][ INFO][PID:329936] VM allocation process starts [2026-07-14 16:09:26,166][ INFO][PID:329936] Trying to allocate VM: ResallocHost, ticket_id=3899359, requested_tags=['arch_x86_64', 'copr_builder'] [2026-07-14 16:09:31,178][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:09:36,184][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:09:41,188][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:09:46,191][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:09:51,193][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:09:56,195][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:10:01,197][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:10:04,241][ INFO][PID:329936] Allocated host ResallocHost, ticket_id=3899359, hostname=3.89.110.128, name=aws_x86_64_spot_prod_13076076_20260714_160842, requested_tags=['arch_x86_64', 'copr_builder'] [2026-07-14 16:10:04,243][ INFO][PID:329936] Allocating ssh connection to builder [2026-07-14 16:10:04,244][ INFO][PID:329936] Checking that builder machine is OK [2026-07-14 16:10:04,548][ INFO][PID:329936] Installed copr-rpmbuild version: 1.8 [2026-07-14 16:10:04,549][ INFO][PID:329936] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2026-07-14 16:10:04,734][ INFO][PID:329936] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2026-07-14 16:10:04,735][ INFO][PID:329936] Filling build.info file with builder info [2026-07-14 16:10:04,737][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:10:04,739][ INFO][PID:329936] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "androniychuk", "project_name": "xpu-manager", "project_dirname": "xpu-manager", "submitter": "androniychuk", "ended_on": null, "started_on": 1784045404.7395177, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10718065-fedora-rawhide-x86_64", "build_id": 10718065, "package_name": "xpu-smi", "package_version": "2.0.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/androniychuk/xpu-manager/xpu-smi", "git_hash": "a30e2b5884c2a1edf14cc2c2e474abd67c502a41", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "androniychuk/xpu-manager--androniychuk", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/androniychuk/xpu-manager/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": true, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/androniychuk/xpu-manager", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/androniychuk/xpu-manager", "result_dir": "10718065-xpu-smi", "built_packages": "", "rpmeta_prediction": null, "id": 10718065, "mockchain_macros": { "copr_username": "androniychuk", "copr_projectname": "xpu-manager", "vendor": "Fedora Project COPR (androniychuk/xpu-manager)" } } ] } [2026-07-14 16:10:04,799][ INFO][PID:329936] Sending fedora-messaging bus message in build.start [2026-07-14 16:10:05,531][ INFO][PID:329936] Sending fedora-messaging bus message in chroot.start [2026-07-14 16:10:05,569][ INFO][PID:329936] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10718065-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2026-07-14 16:10:06,069][ INFO][PID:329936] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '3.89.110.128' (ED25519) to the list of known hosts. [2026-07-14 16:10:06,070][ INFO][PID:329936] Downloading the builder-live.log file, attempt 1 [2026-07-14 16:10:06,072][ INFO][PID:329936] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.89.110.128 copr-rpmbuild-log [2026-07-14 16:10:11,080][ INFO][PID:329936] Periodic builder liveness probe: alive [2026-07-14 16:10:11,081][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:10:16,083][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:10:21,084][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:10:26,086][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:10:31,088][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:10:36,089][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:10:41,091][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:10:46,093][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:10:51,095][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:10:56,097][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:11:01,100][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:11:06,101][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:11:11,104][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:11:16,106][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:11:21,108][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:11:26,109][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:11:31,111][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:11:36,112][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:11:41,114][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:11:46,115][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:11:51,116][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:11:56,118][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:12:01,119][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:12:06,121][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:12:11,122][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:12:16,124][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:12:21,125][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:12:26,126][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:12:31,128][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:12:36,130][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:12:41,132][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:12:46,134][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:12:51,136][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:12:56,141][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:13:01,142][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:13:06,144][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:13:11,146][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:13:16,151][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:13:21,152][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:13:26,153][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:13:31,155][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:13:36,157][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:13:41,159][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:13:46,160][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:13:51,162][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:13:56,164][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:14:01,166][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:14:06,168][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:14:11,170][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:14:16,172][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:14:21,173][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:14:26,175][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:14:31,177][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:14:36,179][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:14:41,182][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:14:46,184][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:14:49,490][ ERROR][PID:329936] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-07-14 16:14:51,185][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:14:56,187][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:14:59,502][WARNING][PID:329936] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-07-14 16:15:01,189][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:15:06,190][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:15:09,565][ INFO][PID:329936] Downloading the builder-live.log file, attempt 2 [2026-07-14 16:15:09,567][ INFO][PID:329936] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.89.110.128 copr-rpmbuild-log [2026-07-14 16:15:11,192][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:15:16,194][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:15:21,195][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:15:26,197][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:15:31,199][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:15:36,202][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:15:41,204][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:15:46,206][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:15:51,208][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:15:56,213][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:16:01,216][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:16:06,217][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:16:09,639][ ERROR][PID:329936] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-07-14 16:16:11,220][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:16:16,221][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:16:19,675][WARNING][PID:329936] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-07-14 16:16:21,223][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:16:26,224][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:16:29,676][ INFO][PID:329936] Downloading the builder-live.log file, attempt 3 [2026-07-14 16:16:29,677][ INFO][PID:329936] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.89.110.128 copr-rpmbuild-log [2026-07-14 16:16:31,225][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:16:36,226][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:16:41,228][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:16:46,229][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:16:51,230][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:16:56,232][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:17:01,258][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:17:06,278][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:17:11,287][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:17:16,308][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:17:21,330][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:17:26,332][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:17:29,745][ ERROR][PID:329936] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-07-14 16:17:31,334][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:17:36,338][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:17:39,764][WARNING][PID:329936] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-07-14 16:17:41,471][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:17:46,475][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:17:49,770][ INFO][PID:329936] Downloading the builder-live.log file, attempt 4 [2026-07-14 16:17:49,826][ INFO][PID:329936] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.89.110.128 copr-rpmbuild-log [2026-07-14 16:17:51,477][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:17:56,479][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:18:01,481][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:18:06,489][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:18:11,491][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:18:16,500][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:18:21,502][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:18:26,503][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:18:31,506][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:18:36,507][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:18:41,514][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:18:46,520][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:18:50,032][ ERROR][PID:329936] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-07-14 16:18:51,534][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:18:56,536][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:19:00,085][ ERROR][PID:329936] Giving up for unstable SSH, failures: 1784045699.5019724, 1784045779.6752279, 1784045859.7636971, 1784045940.0515044 [2026-07-14 16:19:00,200][ ERROR][PID:329936] Re-try request for task on 'ResallocHost, ticket_id=3899359, hostname=3.89.110.128, name=aws_x86_64_spot_prod_13076076_20260714_160842, requested_tags=['arch_x86_64', 'copr_builder']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-07-14 16:19:00,243][ INFO][PID:329936] VM Release request [2026-07-14 16:19:00,379][ INFO][PID:329936] Retry #1 (on other host) [2026-07-14 16:19:00,400][ INFO][PID:329936] Checking that /var/lib/copr/public_html/results/androniychuk/xpu-manager/fedora-rawhide-x86_64/repodata/repomd.xml exists [2026-07-14 16:19:00,405][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:19:01,057][WARNING][PID:329936] rpmeta: cannot connect to https://rpmeta.fedoraproject.org, skipping [2026-07-14 16:19:01,059][ INFO][PID:329936] VM allocation process starts [2026-07-14 16:19:01,090][ INFO][PID:329936] Trying to allocate VM: ResallocHost, ticket_id=3899546, requested_tags=['arch_x86_64', 'copr_builder'] [2026-07-14 16:19:06,125][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:19:11,153][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:19:13,599][ INFO][PID:329936] Allocated host ResallocHost, ticket_id=3899546, hostname=100.49.43.180, name=aws_x86_64_spot_prod_13076251_20260714_161735, requested_tags=['arch_x86_64', 'copr_builder'] [2026-07-14 16:19:13,601][ INFO][PID:329936] Allocating ssh connection to builder [2026-07-14 16:19:13,618][ INFO][PID:329936] Checking that builder machine is OK [2026-07-14 16:19:14,026][ INFO][PID:329936] Installed copr-rpmbuild version: 1.8 [2026-07-14 16:19:14,105][ INFO][PID:329936] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2026-07-14 16:19:14,310][ INFO][PID:329936] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2026-07-14 16:19:14,319][ INFO][PID:329936] Filling build.info file with builder info [2026-07-14 16:19:14,339][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:19:14,365][ INFO][PID:329936] Not re-notifying FE and msg buses for the new host. [2026-07-14 16:19:14,392][ INFO][PID:329936] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10718065-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2026-07-14 16:19:14,916][ INFO][PID:329936] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '100.49.43.180' (ED25519) to the list of known hosts. [2026-07-14 16:19:14,917][ INFO][PID:329936] Downloading the builder-live.log file, attempt 1 [2026-07-14 16:19:14,930][ INFO][PID:329936] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.49.43.180 copr-rpmbuild-log [2026-07-14 16:19:19,918][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:19:24,920][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:19:29,922][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:19:34,924][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:19:39,925][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:19:44,927][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:19:49,929][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:19:54,932][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:19:59,933][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:20:04,934][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:20:09,937][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:20:14,957][ INFO][PID:329936] Periodic builder liveness probe: alive [2026-07-14 16:20:14,962][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:20:19,965][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:20:24,967][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:20:29,977][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:20:34,979][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:20:39,981][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:20:44,991][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:20:49,994][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:20:54,997][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:20:59,998][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:21:05,000][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:21:10,001][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:21:15,004][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:21:20,006][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:21:25,008][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:21:30,009][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:21:35,015][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:21:40,018][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:21:45,021][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:21:50,023][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:21:55,027][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:22:00,031][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:22:05,033][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:22:10,034][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:22:15,037][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:22:20,042][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:22:25,045][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:22:30,049][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:22:35,051][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:22:40,052][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:22:45,054][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:22:50,055][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:22:55,057][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:23:00,059][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:23:05,060][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:23:10,062][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:23:15,063][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:23:20,065][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:23:25,069][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:23:30,070][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:23:35,072][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:23:40,074][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:23:45,079][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:23:50,086][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:23:55,089][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:24:00,091][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:24:05,096][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:24:10,098][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:24:15,101][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:24:20,104][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:24:25,106][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:24:30,107][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:24:35,111][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:24:40,113][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:24:45,114][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:24:50,116][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:24:55,122][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:25:00,124][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:25:05,126][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:25:10,128][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:25:15,130][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:25:20,131][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:25:25,133][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:25:30,134][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:25:35,137][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:25:40,139][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:25:45,140][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:25:50,142][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:25:55,145][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:26:00,146][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:26:05,148][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:26:10,149][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:26:15,151][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:26:20,152][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:26:25,154][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:26:30,158][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:26:35,160][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:26:40,163][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:26:45,164][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:26:50,170][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:26:55,173][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:27:00,176][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:27:05,177][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:27:10,179][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:27:15,183][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:27:20,197][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:27:25,199][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:27:30,201][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:27:35,203][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:27:40,204][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:27:45,206][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:27:50,208][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:27:55,213][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:28:00,215][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:28:05,216][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:28:10,219][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:28:15,221][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:28:20,222][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:28:25,224][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:28:30,225][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:28:35,227][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:28:40,228][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:28:45,230][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:28:50,233][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:28:55,235][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:29:00,238][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:29:05,242][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:29:10,243][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:29:15,245][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:29:20,246][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:29:25,248][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:29:26,082][ ERROR][PID:329936] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-07-14 16:29:30,249][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:29:35,251][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:29:36,100][WARNING][PID:329936] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-07-14 16:29:40,252][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:29:45,255][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:29:46,101][ INFO][PID:329936] Downloading the builder-live.log file, attempt 2 [2026-07-14 16:29:46,105][ INFO][PID:329936] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.49.43.180 copr-rpmbuild-log [2026-07-14 16:29:50,257][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:29:55,258][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:30:00,260][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:30:05,261][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:30:10,262][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:30:15,284][ INFO][PID:329936] Periodic builder liveness probe: alive [2026-07-14 16:30:15,285][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:30:20,290][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:30:25,293][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:30:30,295][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:30:35,297][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:30:40,301][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:30:45,303][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:30:46,173][ ERROR][PID:329936] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-07-14 16:30:50,304][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:30:55,307][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:30:56,208][WARNING][PID:329936] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-07-14 16:31:00,312][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:31:05,314][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:31:06,209][ INFO][PID:329936] Downloading the builder-live.log file, attempt 3 [2026-07-14 16:31:06,211][ INFO][PID:329936] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.49.43.180 copr-rpmbuild-log [2026-07-14 16:31:10,315][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:31:15,319][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:31:20,322][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:31:25,325][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:31:30,326][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:31:35,328][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:31:40,331][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:31:45,332][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:31:50,334][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:31:55,336][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:32:00,337][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:32:05,338][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:32:06,278][ ERROR][PID:329936] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-07-14 16:32:10,340][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:32:15,342][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:32:16,340][WARNING][PID:329936] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-07-14 16:32:20,343][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:32:25,345][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:32:26,341][ INFO][PID:329936] Downloading the builder-live.log file, attempt 4 [2026-07-14 16:32:26,343][ INFO][PID:329936] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.49.43.180 copr-rpmbuild-log [2026-07-14 16:32:30,347][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:32:35,350][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:32:40,352][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:32:45,354][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:32:50,355][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:32:55,357][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:33:00,358][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:33:05,360][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:33:10,361][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:33:15,362][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:33:20,365][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:33:25,366][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:33:26,411][ ERROR][PID:329936] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-07-14 16:33:30,370][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:33:35,371][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:33:36,451][ ERROR][PID:329936] Giving up for unstable SSH, failures: 1784046576.100332, 1784046656.2086105, 1784046736.3406916, 1784046816.449504 [2026-07-14 16:33:36,499][ ERROR][PID:329936] Re-try request for task on 'ResallocHost, ticket_id=3899546, hostname=100.49.43.180, name=aws_x86_64_spot_prod_13076251_20260714_161735, requested_tags=['arch_x86_64', 'copr_builder']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-07-14 16:33:36,535][ INFO][PID:329936] VM Release request [2026-07-14 16:33:36,555][ INFO][PID:329936] Retry #2 (on other host) [2026-07-14 16:33:36,556][ INFO][PID:329936] Checking that /var/lib/copr/public_html/results/androniychuk/xpu-manager/fedora-rawhide-x86_64/repodata/repomd.xml exists [2026-07-14 16:33:36,565][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:33:36,601][WARNING][PID:329936] rpmeta: cannot connect to https://rpmeta.fedoraproject.org, skipping [2026-07-14 16:33:36,602][ INFO][PID:329936] VM allocation process starts [2026-07-14 16:33:36,664][ INFO][PID:329936] Trying to allocate VM: ResallocHost, ticket_id=3899776, requested_tags=['arch_x86_64', 'copr_builder'] [2026-07-14 16:33:39,743][ INFO][PID:329936] Allocated host ResallocHost, ticket_id=3899776, hostname=54.167.67.31, name=aws_x86_64_reserved_prod_13076274_20260714_161808, requested_tags=['arch_x86_64', 'copr_builder'] [2026-07-14 16:33:39,744][ INFO][PID:329936] Allocating ssh connection to builder [2026-07-14 16:33:39,745][ INFO][PID:329936] Checking that builder machine is OK [2026-07-14 16:33:40,090][ INFO][PID:329936] Installed copr-rpmbuild version: 1.8 [2026-07-14 16:33:40,091][ INFO][PID:329936] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2026-07-14 16:33:40,279][ INFO][PID:329936] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2026-07-14 16:33:40,280][ INFO][PID:329936] Filling build.info file with builder info [2026-07-14 16:33:40,315][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:33:40,316][ INFO][PID:329936] Not re-notifying FE and msg buses for the new host. [2026-07-14 16:33:40,317][ INFO][PID:329936] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10718065-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2026-07-14 16:33:40,795][ INFO][PID:329936] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '54.167.67.31' (ED25519) to the list of known hosts. [2026-07-14 16:33:40,796][ INFO][PID:329936] Downloading the builder-live.log file, attempt 1 [2026-07-14 16:33:40,798][ INFO][PID:329936] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.167.67.31 copr-rpmbuild-log [2026-07-14 16:33:45,796][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:33:50,797][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:33:55,799][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:34:00,801][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:34:05,803][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:34:10,805][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:34:15,806][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:34:20,808][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:34:25,810][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:34:30,811][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:34:35,812][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:34:40,814][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:34:45,815][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:34:50,816][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:34:55,817][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:35:00,819][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:35:05,820][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:35:10,822][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:35:15,836][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:35:20,837][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:35:25,839][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:35:30,841][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:35:35,843][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:35:40,844][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:35:45,845][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:35:50,846][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:35:55,848][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:36:00,849][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:36:05,850][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:36:10,852][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:36:15,855][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:36:20,857][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:36:25,858][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:36:30,859][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:36:35,861][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:36:40,862][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:36:45,863][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:36:50,865][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:36:55,867][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:37:00,869][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:37:05,870][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:37:10,871][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:37:15,873][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:37:20,874][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:37:25,875][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:37:30,877][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:37:35,878][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:37:40,879][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:37:45,881][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:37:50,882][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:37:55,883][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:38:00,884][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:38:05,886][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:38:10,887][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:38:15,889][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:38:20,890][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:38:25,891][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:38:30,893][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:38:35,894][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:38:40,895][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:38:45,896][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:38:50,898][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:38:55,899][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:39:00,900][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:39:05,901][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:39:10,903][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:39:15,904][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:39:20,906][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:39:25,907][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:39:30,909][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:39:35,913][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:39:40,914][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:39:45,916][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:39:50,918][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:39:55,919][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:40:00,920][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:40:05,921][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:40:10,923][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:40:15,937][ INFO][PID:329936] Periodic builder liveness probe: alive [2026-07-14 16:40:15,938][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:40:20,939][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:40:25,941][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:40:30,942][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:40:35,943][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:40:40,944][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:40:45,946][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:40:50,948][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:40:55,949][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:41:00,950][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:41:05,951][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:41:10,953][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:41:15,954][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:41:20,956][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:41:25,962][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:41:30,963][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:41:35,964][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:41:40,966][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:41:45,967][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:41:50,969][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:41:55,970][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:42:00,972][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:42:05,973][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:42:10,975][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:42:15,976][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:42:20,977][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:42:25,979][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:42:30,980][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:42:35,982][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:42:40,983][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:42:45,984][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:42:50,986][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:42:55,987][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:43:00,989][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:43:05,990][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:43:10,991][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:43:15,993][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:43:20,994][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:43:25,995][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:43:30,997][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:43:35,998][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:43:40,999][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:43:46,002][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:43:51,003][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:43:56,004][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:44:01,005][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:44:06,007][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:44:11,009][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:44:16,011][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:44:21,012][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:44:26,013][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:44:31,015][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:44:36,016][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:44:41,017][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:44:46,019][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:44:51,020][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:44:56,022][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:45:01,202][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:45:06,205][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:45:11,207][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:45:16,208][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:45:21,210][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:45:26,211][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:45:31,213][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:45:36,214][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:45:41,215][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:45:46,217][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:45:51,224][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:45:56,225][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:46:01,227][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:46:06,228][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:46:11,230][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:46:16,231][ INFO][PID:329936] Checking for cancel request [2026-07-14 16:46:19,054][ INFO][PID:329936] Downloading results from builder [2026-07-14 16:46:19,060][ INFO][PID:329936] rsyncing of mockbuilder@54.167.67.31:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/androniychuk/xpu-manager/fedora-rawhide-x86_64/10718065-xpu-smi started [2026-07-14 16:46:19,066][ INFO][PID:329936] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@54.167.67.31:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/androniychuk/xpu-manager/fedora-rawhide-x86_64/10718065-xpu-smi/ &> /var/lib/copr/public_html/results/androniychuk/xpu-manager/fedora-rawhide-x86_64/10718065-xpu-smi/build-10718065.rsync.log [2026-07-14 16:46:19,868][ INFO][PID:329936] rsyncing finished. [2026-07-14 16:46:19,869][ INFO][PID:329936] VM Release request [2026-07-14 16:46:19,882][ INFO][PID:329936] Searching for 'success' file in resultdir [2026-07-14 16:46:19,885][ INFO][PID:329936] Going to sign pkgs from source: 10718065-fedora-rawhide-x86_64 in chroot: /var/lib/copr/public_html/results/androniychuk/xpu-manager/fedora-rawhide-x86_64 [2026-07-14 16:46:19,898][ INFO][PID:329936] Calling '/bin/sign -u androniychuk#xpu-manager@copr.fedorahosted.org -p' (attempt #1) [2026-07-14 16:46:20,199][ INFO][PID:329936] Calling '/bin/sign -4 -h sha256 -u androniychuk#xpu-manager@copr.fedorahosted.org -r /var/lib/copr/public_html/results/androniychuk/xpu-manager/fedora-rawhide-x86_64/10718065-xpu-smi/xpu-smi-debugsource-2.0.0-1.fc45.x86_64.rpm' (attempt #1) [2026-07-14 16:46:21,206][ INFO][PID:329936] signed rpm: /var/lib/copr/public_html/results/androniychuk/xpu-manager/fedora-rawhide-x86_64/10718065-xpu-smi/xpu-smi-debugsource-2.0.0-1.fc45.x86_64.rpm [2026-07-14 16:46:21,206][ INFO][PID:329936] Calling '/bin/sign -4 -h sha256 -u androniychuk#xpu-manager@copr.fedorahosted.org -r /var/lib/copr/public_html/results/androniychuk/xpu-manager/fedora-rawhide-x86_64/10718065-xpu-smi/xpu-smi-2.0.0-1.fc45.src.rpm' (attempt #1) [2026-07-14 16:46:22,304][ INFO][PID:329936] signed rpm: /var/lib/copr/public_html/results/androniychuk/xpu-manager/fedora-rawhide-x86_64/10718065-xpu-smi/xpu-smi-2.0.0-1.fc45.src.rpm [2026-07-14 16:46:22,305][ INFO][PID:329936] Calling '/bin/sign -4 -h sha256 -u androniychuk#xpu-manager@copr.fedorahosted.org -r /var/lib/copr/public_html/results/androniychuk/xpu-manager/fedora-rawhide-x86_64/10718065-xpu-smi/xpu-smi-2.0.0-1.fc45.x86_64.rpm' (attempt #1) [2026-07-14 16:46:23,237][ INFO][PID:329936] signed rpm: /var/lib/copr/public_html/results/androniychuk/xpu-manager/fedora-rawhide-x86_64/10718065-xpu-smi/xpu-smi-2.0.0-1.fc45.x86_64.rpm [2026-07-14 16:46:23,239][ INFO][PID:329936] Calling '/bin/sign -4 -h sha256 -u androniychuk#xpu-manager@copr.fedorahosted.org -r /var/lib/copr/public_html/results/androniychuk/xpu-manager/fedora-rawhide-x86_64/10718065-xpu-smi/xpu-smi-debuginfo-2.0.0-1.fc45.x86_64.rpm' (attempt #1) [2026-07-14 16:46:24,319][ INFO][PID:329936] signed rpm: /var/lib/copr/public_html/results/androniychuk/xpu-manager/fedora-rawhide-x86_64/10718065-xpu-smi/xpu-smi-debuginfo-2.0.0-1.fc45.x86_64.rpm [2026-07-14 16:46:24,320][ INFO][PID:329936] Sign done [2026-07-14 16:46:24,334][ INFO][PID:329936] Incremental createrepo run, adding 10718065-xpu-smi into https://download.copr.fedorainfracloud.org/results/androniychuk/xpu-manager/fedora-rawhide-x86_64, (auto-create-repo=True) [2026-07-14 16:46:24,346][ INFO][PID:329936] Running command 'copr-repo --batched /var/lib/copr/public_html/results/androniychuk/xpu-manager/fedora-rawhide-x86_64 --add 10718065-xpu-smi --no-appstream-metadata' as PID 571050 [2026-07-14 16:46:25,346][ INFO][PID:329936] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/androniychuk/xpu-manager/fedora-rawhide-x86_64 --add 10718065-xpu-smi --no-appstream-metadata) [2026-07-14 16:46:25,352][ INFO][PID:329936] Getting build details [2026-07-14 16:46:25,354][ INFO][PID:329936] Listing built binary packages in /var/lib/copr/public_html/results/androniychuk/xpu-manager/fedora-rawhide-x86_64/10718065-xpu-smi [2026-07-14 16:46:25,354][ INFO][PID:329936] Built packages: ['xpu-smi 2.0.0', 'xpu-smi-debugsource 2.0.0', 'xpu-smi-debuginfo 2.0.0'] [2026-07-14 16:46:25,355][ INFO][PID:329936] build details: {'built_packages': 'xpu-smi 2.0.0\nxpu-smi-debugsource 2.0.0\nxpu-smi-debuginfo 2.0.0'} [2026-07-14 16:46:25,359][ INFO][PID:329936] Retrieving pubkey [2026-07-14 16:46:25,360][ INFO][PID:329936] Calling '/bin/sign -u androniychuk#xpu-manager@copr.fedorahosted.org -p' (attempt #1) [2026-07-14 16:46:25,665][ INFO][PID:329936] Added pubkey for user androniychuk project xpu-manager into: /var/lib/copr/public_html/results/androniychuk/xpu-manager/pubkey.gpg [2026-07-14 16:46:25,666][ INFO][PID:329936] Finished build: id=10718065 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/androniychuk/xpu-manager chroot=fedora-rawhide-x86_64 [2026-07-14 16:46:25,744][ INFO][PID:329936] Worker succeeded build, took 765.4268922805786 [2026-07-14 16:46:25,751][ INFO][PID:329936] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "androniychuk", "project_name": "xpu-manager", "project_dirname": "xpu-manager", "submitter": "androniychuk", "ended_on": 1784047585.7437632, "started_on": 1784046820.316871, "submitted_on": null, "status": 1, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10718065-fedora-rawhide-x86_64", "build_id": 10718065, "package_name": "xpu-smi", "package_version": "2.0.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/androniychuk/xpu-manager/xpu-smi", "git_hash": "a30e2b5884c2a1edf14cc2c2e474abd67c502a41", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "androniychuk/xpu-manager--androniychuk", "results": { "packages": [ { "name": "xpu-smi", "epoch": null, "version": "2.0.0", "release": "1.fc45", "arch": "x86_64" }, { "name": "xpu-smi", "epoch": null, "version": "2.0.0", "release": "1.fc45", "arch": "src" }, { "name": "xpu-smi-debugsource", "epoch": null, "version": "2.0.0", "release": "1.fc45", "arch": "x86_64" }, { "name": "xpu-smi-debuginfo", "epoch": null, "version": "2.0.0", "release": "1.fc45", "arch": "x86_64" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/androniychuk/xpu-manager/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": true, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/androniychuk/xpu-manager", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/androniychuk/xpu-manager", "result_dir": "10718065-xpu-smi", "built_packages": "xpu-smi 2.0.0\nxpu-smi-debugsource 2.0.0\nxpu-smi-debuginfo 2.0.0", "rpmeta_prediction": null, "id": 10718065, "mockchain_macros": { "copr_username": "androniychuk", "copr_projectname": "xpu-manager", "vendor": "Fedora Project COPR (androniychuk/xpu-manager)" } } ] } [2026-07-14 16:46:25,840][ INFO][PID:329936] Sending fedora-messaging bus message in build.end [2026-07-14 16:46:26,238][ INFO][PID:329936] Compressing /var/lib/copr/public_html/results/androniychuk/xpu-manager/fedora-rawhide-x86_64/10718065-xpu-smi/builder-live.log by gzip [2026-07-14 16:46:26,241][ INFO][PID:329936] Running command 'gzip /var/lib/copr/public_html/results/androniychuk/xpu-manager/fedora-rawhide-x86_64/10718065-xpu-smi/builder-live.log' as PID 571205 [2026-07-14 16:46:26,295][ INFO][PID:329936] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/androniychuk/xpu-manager/fedora-rawhide-x86_64/10718065-xpu-smi/builder-live.log) [2026-07-14 16:46:26,296][ INFO][PID:329936] Compressing /var/lib/copr/public_html/results/androniychuk/xpu-manager/fedora-rawhide-x86_64/10718065-xpu-smi/backend.log by gzip [2026-07-14 16:46:26,297][ INFO][PID:329936] Running command 'gzip /var/lib/copr/public_html/results/androniychuk/xpu-manager/fedora-rawhide-x86_64/10718065-xpu-smi/backend.log' as PID 571210