[2026-01-30 17:20:02,764][ INFO][PID:2027619] Marking build as starting [2026-01-30 17:20:02,847][ INFO][PID:2027619] Checking that /var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test/fedora-rawhide-x86_64/repodata/repomd.xml exists [2026-01-30 17:20:02,849][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:20:02,850][ INFO][PID:2027619] VM allocation process starts [2026-01-30 17:20:02,865][ INFO][PID:2027619] Trying to allocate VM: ResallocHost, ticket_id=1106603, requested_tags=['copr_builder', 'arch_x86_64'] [2026-01-30 17:20:05,886][ INFO][PID:2027619] Allocated host ResallocHost, ticket_id=1106603, hostname=3.92.146.1, name=aws_x86_64_spot_prod_01783730_20260130_171744, requested_tags=['copr_builder', 'arch_x86_64'] [2026-01-30 17:20:05,886][ INFO][PID:2027619] Allocating ssh connection to builder [2026-01-30 17:20:05,887][ INFO][PID:2027619] Checking that builder machine is OK [2026-01-30 17:20:06,224][ INFO][PID:2027619] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2026-01-30 17:20:06,526][ INFO][PID:2027619] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2026-01-30 17:20:06,527][ INFO][PID:2027619] Filling build.info file with builder info [2026-01-30 17:20:06,529][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:20:06,532][ INFO][PID:2027619] Sending build state back to frontend: { "builds": [ { "timeout": 180000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "@rocm-packagers-sig", "project_name": "rocm-test", "project_dirname": "rocm-test", "submitter": "tflink", "ended_on": null, "started_on": 1769793606.531848, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10080497-fedora-rawhide-x86_64", "build_id": 10080497, "package_name": "rocalution", "package_version": "7.1.0-4", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@rocm-packagers-sig/rocm-test/rocalution", "git_hash": "d1829d0252b2a6713c51f25173a31349a0fbb1e6", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@rocm-packagers-sig/rocm-test--tflink", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@rocm-packagers-sig/rocm-test/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [ "test" ], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@rocm-packagers-sig/rocm-test", "result_dir": "10080497-rocalution", "built_packages": "", "id": 10080497, "mockchain_macros": { "copr_username": "@rocm-packagers-sig", "copr_projectname": "rocm-test", "vendor": "Fedora Project COPR (@rocm-packagers-sig/rocm-test)" } } ] } [2026-01-30 17:20:06,606][ INFO][PID:2027619] Sending fedora-messaging bus message in build.start [2026-01-30 17:20:07,383][ INFO][PID:2027619] Sending fedora-messaging bus message in chroot.start [2026-01-30 17:20:07,409][ INFO][PID:2027619] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10080497-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2026-01-30 17:20:07,743][ INFO][PID:2027619] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '3.92.146.1' (ED25519) to the list of known hosts. [2026-01-30 17:20:07,743][ INFO][PID:2027619] Downloading the builder-live.log file, attempt 1 [2026-01-30 17:20:07,745][ INFO][PID:2027619] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.92.146.1 copr-rpmbuild-log [2026-01-30 17:20:12,751][ INFO][PID:2027619] Periodic builder liveness probe: alive [2026-01-30 17:20:12,751][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:20:17,752][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:20:22,755][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:20:27,756][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:20:32,758][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:20:37,760][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:20:42,761][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:20:47,762][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:20:52,763][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:20:57,764][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:21:02,765][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:21:07,772][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:21:12,776][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:21:17,777][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:21:22,778][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:21:27,779][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:21:32,780][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:21:37,781][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:21:42,783][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:21:47,785][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:21:52,791][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:21:57,792][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:22:02,793][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:22:07,794][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:22:12,801][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:22:17,806][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:22:22,808][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:22:27,809][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:22:32,810][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:22:37,813][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:22:42,815][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:22:47,816][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:22:52,820][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:22:57,825][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:23:02,826][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:23:07,828][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:23:12,829][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:23:17,830][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:23:22,832][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:23:27,833][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:23:32,834][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:23:37,835][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:23:42,836][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:23:47,837][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:23:52,838][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:23:57,840][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:24:02,842][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:24:07,844][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:24:12,845][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:24:17,846][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:24:22,848][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:24:27,875][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:24:32,877][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:24:37,877][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:24:42,878][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:24:47,879][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:24:52,881][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:24:57,882][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:25:02,883][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:25:07,884][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:25:12,885][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:25:17,886][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:25:22,887][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:25:27,888][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:25:32,892][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:25:37,894][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:25:42,895][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:25:47,896][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:25:52,897][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:25:57,898][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:26:02,899][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:26:07,900][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:26:12,902][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:26:17,903][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:26:22,904][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:26:27,905][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:26:32,906][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:26:37,907][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:26:42,908][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:26:47,909][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:26:52,910][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:26:57,911][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:27:02,912][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:27:07,913][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:27:12,914][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:27:17,915][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:27:22,916][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:27:27,917][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:27:32,918][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:27:37,919][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:27:42,920][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:27:47,921][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:27:52,922][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:27:57,923][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:28:02,924][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:28:07,925][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:28:12,925][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:28:17,927][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:28:22,928][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:28:27,929][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:28:32,930][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:28:37,931][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:28:42,931][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:28:47,932][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:28:52,933][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:28:57,944][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:29:02,945][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:29:07,946][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:29:12,948][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:29:14,459][ ERROR][PID:2027619] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-30 17:29:17,949][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:29:22,950][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:29:24,460][WARNING][PID:2027619] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-30 17:29:27,951][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:29:32,955][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:29:34,461][ INFO][PID:2027619] Downloading the builder-live.log file, attempt 2 [2026-01-30 17:29:34,465][ INFO][PID:2027619] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.92.146.1 copr-rpmbuild-log [2026-01-30 17:29:37,957][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:29:42,958][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:29:47,958][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:29:52,959][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:29:57,960][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:30:02,961][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:30:07,962][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:30:12,968][ INFO][PID:2027619] Periodic builder liveness probe: alive [2026-01-30 17:30:12,969][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:30:17,970][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:30:22,971][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:30:27,972][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:30:32,973][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:30:34,532][ ERROR][PID:2027619] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-30 17:30:37,977][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:30:42,978][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:30:44,550][WARNING][PID:2027619] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-30 17:30:47,979][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:30:52,980][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:30:54,552][ INFO][PID:2027619] Downloading the builder-live.log file, attempt 3 [2026-01-30 17:30:54,556][ INFO][PID:2027619] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.92.146.1 copr-rpmbuild-log [2026-01-30 17:30:57,981][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:31:02,982][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:31:07,983][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:31:12,983][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:31:17,984][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:31:22,985][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:31:27,986][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:31:32,988][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:31:37,991][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:31:42,996][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:31:47,997][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:31:52,998][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:31:54,625][ ERROR][PID:2027619] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-30 17:31:57,999][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:32:03,001][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:32:04,626][WARNING][PID:2027619] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-30 17:32:08,017][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:32:13,018][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:32:14,627][ INFO][PID:2027619] Downloading the builder-live.log file, attempt 4 [2026-01-30 17:32:14,628][ INFO][PID:2027619] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.92.146.1 copr-rpmbuild-log [2026-01-30 17:32:18,019][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:32:23,020][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:32:28,021][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:32:33,023][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:32:38,025][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:32:43,027][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:32:48,028][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:32:53,029][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:32:58,030][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:33:03,031][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:33:08,032][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:33:13,033][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:33:14,687][ ERROR][PID:2027619] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-30 17:33:18,034][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:33:23,035][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:33:24,701][ ERROR][PID:2027619] Giving up for unstable SSH, failures: 1769794164.4607108, 1769794244.550266, 1769794324.626553, 1769794404.7013905 [2026-01-30 17:33:24,702][ ERROR][PID:2027619] Re-try request for task on 'ResallocHost, ticket_id=1106603, hostname=3.92.146.1, name=aws_x86_64_spot_prod_01783730_20260130_171744, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-01-30 17:33:24,703][ INFO][PID:2027619] Releasing VM back to pool [2026-01-30 17:33:24,712][ INFO][PID:2027619] Retry #1 (on other host) [2026-01-30 17:33:24,713][ INFO][PID:2027619] Checking that /var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test/fedora-rawhide-x86_64/repodata/repomd.xml exists [2026-01-30 17:33:24,713][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:33:24,714][ INFO][PID:2027619] VM allocation process starts [2026-01-30 17:33:24,770][ INFO][PID:2027619] Trying to allocate VM: ResallocHost, ticket_id=1107059, requested_tags=['copr_builder', 'arch_x86_64'] [2026-01-30 17:33:27,812][ INFO][PID:2027619] Allocated host ResallocHost, ticket_id=1107059, hostname=54.226.58.35, name=aws_x86_64_spot_prod_01784319_20260130_172707, requested_tags=['copr_builder', 'arch_x86_64'] [2026-01-30 17:33:27,813][ INFO][PID:2027619] Allocating ssh connection to builder [2026-01-30 17:33:27,813][ INFO][PID:2027619] Checking that builder machine is OK [2026-01-30 17:33:28,169][ INFO][PID:2027619] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2026-01-30 17:33:28,413][ INFO][PID:2027619] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2026-01-30 17:33:28,414][ INFO][PID:2027619] Filling build.info file with builder info [2026-01-30 17:33:28,585][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:33:28,585][ INFO][PID:2027619] Not re-notifying FE and msg buses for the new host. [2026-01-30 17:33:28,586][ INFO][PID:2027619] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10080497-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2026-01-30 17:33:28,944][ INFO][PID:2027619] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '54.226.58.35' (ED25519) to the list of known hosts. [2026-01-30 17:33:28,945][ INFO][PID:2027619] Downloading the builder-live.log file, attempt 1 [2026-01-30 17:33:28,946][ INFO][PID:2027619] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.226.58.35 copr-rpmbuild-log [2026-01-30 17:33:33,945][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:33:38,946][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:33:43,947][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:33:48,948][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:33:53,949][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:33:58,950][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:34:03,951][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:34:08,952][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:34:13,953][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:34:18,954][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:34:23,966][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:34:28,967][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:34:33,968][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:34:38,969][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:34:43,971][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:34:48,972][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:34:50,644][ ERROR][PID:2027619] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-30 17:34:53,974][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:34:58,974][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:35:00,645][WARNING][PID:2027619] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-30 17:35:03,975][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:35:08,976][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:35:10,646][ INFO][PID:2027619] Downloading the builder-live.log file, attempt 2 [2026-01-30 17:35:10,647][ INFO][PID:2027619] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.226.58.35 copr-rpmbuild-log [2026-01-30 17:35:13,978][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:35:18,979][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:35:23,985][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:35:28,986][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:35:33,989][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:35:38,990][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:35:43,992][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:35:48,993][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:35:53,994][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:35:58,995][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:36:03,996][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:36:08,997][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:36:10,696][ ERROR][PID:2027619] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-30 17:36:13,998][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:36:18,999][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:36:20,707][WARNING][PID:2027619] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-30 17:36:24,015][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:36:29,016][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:36:30,708][ INFO][PID:2027619] Downloading the builder-live.log file, attempt 3 [2026-01-30 17:36:30,710][ INFO][PID:2027619] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.226.58.35 copr-rpmbuild-log [2026-01-30 17:36:34,017][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:36:39,018][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:36:44,019][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:36:49,021][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:36:54,022][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:36:59,023][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:37:04,024][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:37:09,025][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:37:14,026][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:37:19,027][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:37:24,028][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:37:29,029][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:37:30,775][ ERROR][PID:2027619] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-30 17:37:34,030][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:37:39,033][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:37:40,783][WARNING][PID:2027619] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-30 17:37:44,034][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:37:49,035][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:37:50,784][ INFO][PID:2027619] Downloading the builder-live.log file, attempt 4 [2026-01-30 17:37:50,786][ INFO][PID:2027619] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.226.58.35 copr-rpmbuild-log [2026-01-30 17:37:54,036][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:37:59,037][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:38:04,043][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:38:09,044][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:38:14,045][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:38:19,046][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:38:24,047][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:38:29,048][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:38:34,049][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:38:39,050][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:38:44,056][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:38:49,057][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:38:50,850][ ERROR][PID:2027619] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-30 17:38:54,058][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:38:59,059][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:39:00,864][ ERROR][PID:2027619] Giving up for unstable SSH, failures: 1769794500.6452985, 1769794580.7073739, 1769794660.7832525, 1769794740.864165 [2026-01-30 17:39:00,866][ ERROR][PID:2027619] Re-try request for task on 'ResallocHost, ticket_id=1107059, hostname=54.226.58.35, name=aws_x86_64_spot_prod_01784319_20260130_172707, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-01-30 17:39:00,868][ INFO][PID:2027619] Releasing VM back to pool [2026-01-30 17:39:00,899][ INFO][PID:2027619] Retry #2 (on other host) [2026-01-30 17:39:00,903][ INFO][PID:2027619] Checking that /var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test/fedora-rawhide-x86_64/repodata/repomd.xml exists [2026-01-30 17:39:00,906][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:39:00,907][ INFO][PID:2027619] VM allocation process starts [2026-01-30 17:39:00,934][ INFO][PID:2027619] Trying to allocate VM: ResallocHost, ticket_id=1107109, requested_tags=['copr_builder', 'arch_x86_64'] [2026-01-30 17:39:03,973][ INFO][PID:2027619] Allocated host ResallocHost, ticket_id=1107109, hostname=44.192.21.238, name=aws_x86_64_normal_prod_01782750_20260130_165440, requested_tags=['copr_builder', 'arch_x86_64'] [2026-01-30 17:39:03,974][ INFO][PID:2027619] Allocating ssh connection to builder [2026-01-30 17:39:03,974][ INFO][PID:2027619] Checking that builder machine is OK [2026-01-30 17:39:04,340][ INFO][PID:2027619] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2026-01-30 17:39:04,557][ INFO][PID:2027619] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2026-01-30 17:39:04,557][ INFO][PID:2027619] Filling build.info file with builder info [2026-01-30 17:39:04,602][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:39:04,603][ INFO][PID:2027619] Not re-notifying FE and msg buses for the new host. [2026-01-30 17:39:04,604][ INFO][PID:2027619] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10080497-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2026-01-30 17:39:04,960][ INFO][PID:2027619] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '44.192.21.238' (ED25519) to the list of known hosts. [2026-01-30 17:39:04,960][ INFO][PID:2027619] Downloading the builder-live.log file, attempt 1 [2026-01-30 17:39:04,962][ INFO][PID:2027619] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.192.21.238 copr-rpmbuild-log [2026-01-30 17:39:09,961][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:39:14,962][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:39:19,963][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:39:24,964][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:39:29,965][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:39:34,966][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:39:39,967][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:39:44,968][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:39:49,974][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:39:54,975][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:39:59,976][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:40:04,977][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:40:09,978][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:40:14,988][ INFO][PID:2027619] Periodic builder liveness probe: alive [2026-01-30 17:40:14,990][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:40:19,992][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:40:24,993][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:40:29,994][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:40:34,995][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:40:39,996][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:40:44,997][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:40:49,998][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:40:55,000][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:41:00,002][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:41:05,003][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:41:10,008][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:41:15,009][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:41:20,010][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:41:25,012][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:41:30,013][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:41:35,014][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:41:40,015][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:41:45,016][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:41:50,018][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:41:55,019][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:42:00,023][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:42:05,026][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:42:10,027][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:42:15,028][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:42:20,030][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:42:25,033][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:42:30,034][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:42:35,035][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:42:40,037][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:42:45,039][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:42:50,040][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:42:55,041][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:43:00,043][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:43:05,046][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:43:10,047][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:43:15,048][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:43:20,049][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:43:25,050][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:43:30,051][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:43:35,052][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:43:40,053][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:43:45,054][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:43:50,055][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:43:55,056][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:44:00,057][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:44:05,059][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:44:10,060][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:44:15,061][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:44:20,062][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:44:25,063][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:44:30,065][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:44:35,065][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:44:40,066][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:44:45,067][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:44:50,068][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:44:55,069][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:45:00,070][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:45:05,071][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:45:10,072][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:45:15,074][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:45:20,075][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:45:25,076][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:45:30,077][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:45:35,078][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:45:40,079][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:45:45,080][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:45:50,081][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:45:55,082][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:46:00,083][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:46:05,084][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:46:10,085][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:46:15,086][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:46:20,087][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:46:25,088][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:46:30,089][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:46:35,090][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:46:40,091][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:46:45,092][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:46:50,093][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:46:55,094][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:47:00,095][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:47:05,096][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:47:10,097][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:47:15,098][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:47:20,099][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:47:25,100][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:47:30,101][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:47:35,102][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:47:40,103][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:47:45,104][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:47:50,105][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:47:55,106][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:48:00,107][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:48:05,108][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:48:10,109][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:48:15,110][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:48:20,111][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:48:25,112][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:48:30,113][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:48:35,114][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:48:40,115][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:48:45,116][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:48:50,117][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:48:55,118][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:49:00,119][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:49:05,120][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:49:10,164][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:49:15,166][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:49:20,167][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:49:25,168][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:49:30,735][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:49:35,736][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:49:40,737][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:49:45,738][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:49:50,740][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:49:55,741][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:50:00,742][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:50:05,743][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:50:10,744][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:50:15,751][ INFO][PID:2027619] Periodic builder liveness probe: alive [2026-01-30 17:50:15,751][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:50:20,752][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:50:25,753][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:50:30,754][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:50:35,755][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:50:40,756][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:50:45,757][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:50:50,758][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:50:55,760][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:51:00,761][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:51:05,762][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:51:10,765][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:51:15,829][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:51:20,830][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:51:25,831][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:51:30,832][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:51:35,833][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:51:40,834][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:51:45,835][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:51:50,837][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:51:55,838][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:52:00,839][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:52:06,303][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:52:11,304][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:52:16,306][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:52:21,307][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:52:26,308][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:52:31,309][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:52:36,310][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:52:41,313][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:52:46,314][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:52:51,315][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:52:56,316][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:53:01,318][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:53:06,319][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:53:11,320][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:53:16,453][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:53:21,454][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:53:26,455][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:53:31,456][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:53:36,457][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:53:41,458][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:53:46,466][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:53:51,467][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:53:56,626][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:54:01,629][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:54:06,647][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:54:11,704][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:54:16,708][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:54:21,709][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:54:26,786][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:54:31,860][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:54:36,861][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:54:41,862][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:54:46,907][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:54:52,020][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:54:57,022][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:55:02,199][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:55:07,200][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:55:12,203][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:55:17,205][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:55:22,254][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:55:27,535][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:55:32,536][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:55:37,537][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:55:42,538][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:55:47,539][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:55:52,541][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:55:57,542][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:56:02,543][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:56:07,544][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:56:12,545][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:56:17,547][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:56:22,550][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:56:27,551][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:56:32,552][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:56:37,553][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:56:42,555][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:56:47,556][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:56:52,557][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:56:57,558][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:57:02,559][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:57:07,560][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:57:12,562][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:57:17,630][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:57:22,644][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:57:27,647][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:57:32,649][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:57:37,650][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:57:42,652][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:57:47,654][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:57:52,655][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:57:57,656][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:58:02,754][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:58:07,755][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:58:12,756][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:58:17,757][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:58:22,759][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:58:27,762][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:58:32,764][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:58:37,765][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:58:42,821][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:58:47,823][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:58:52,824][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:58:57,826][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:59:02,827][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:59:07,829][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:59:12,833][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:59:17,835][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:59:22,837][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:59:27,840][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:59:32,843][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:59:37,845][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:59:42,846][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:59:47,847][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:59:52,851][ INFO][PID:2027619] Checking for cancel request [2026-01-30 17:59:57,853][ INFO][PID:2027619] Checking for cancel request [2026-01-30 18:00:02,854][ INFO][PID:2027619] Checking for cancel request [2026-01-30 18:00:07,855][ INFO][PID:2027619] Checking for cancel request [2026-01-30 18:00:12,857][ INFO][PID:2027619] Checking for cancel request [2026-01-30 18:00:17,864][ INFO][PID:2027619] Periodic builder liveness probe: alive [2026-01-30 18:00:17,864][ INFO][PID:2027619] Checking for cancel request [2026-01-30 18:00:22,865][ INFO][PID:2027619] Checking for cancel request [2026-01-30 18:00:27,866][ INFO][PID:2027619] Checking for cancel request [2026-01-30 18:00:32,867][ INFO][PID:2027619] Checking for cancel request [2026-01-30 18:00:37,868][ INFO][PID:2027619] Checking for cancel request [2026-01-30 18:00:42,870][ INFO][PID:2027619] Checking for cancel request [2026-01-30 18:00:47,871][ INFO][PID:2027619] Checking for cancel request [2026-01-30 18:00:52,872][ INFO][PID:2027619] Checking for cancel request [2026-01-30 18:00:57,873][ INFO][PID:2027619] Checking for cancel request [2026-01-30 18:01:02,874][ INFO][PID:2027619] Checking for cancel request [2026-01-30 18:01:07,975][ INFO][PID:2027619] Checking for cancel request [2026-01-30 18:01:12,977][ INFO][PID:2027619] Checking for cancel request [2026-01-30 18:01:17,983][ INFO][PID:2027619] Checking for cancel request [2026-01-30 18:01:22,984][ INFO][PID:2027619] Checking for cancel request [2026-01-30 18:01:27,987][ INFO][PID:2027619] Checking for cancel request [2026-01-30 18:01:32,988][ INFO][PID:2027619] Checking for cancel request [2026-01-30 18:01:37,989][ INFO][PID:2027619] Checking for cancel request [2026-01-30 18:01:38,957][ INFO][PID:2027619] Downloading results from builder [2026-01-30 18:01:38,959][ INFO][PID:2027619] rsyncing of mockbuilder@44.192.21.238:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test/fedora-rawhide-x86_64/10080497-rocalution started [2026-01-30 18:01:38,960][ INFO][PID:2027619] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@44.192.21.238:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test/fedora-rawhide-x86_64/10080497-rocalution/ &> /var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test/fedora-rawhide-x86_64/10080497-rocalution/build-10080497.rsync.log [2026-01-30 18:01:39,851][ INFO][PID:2027619] rsyncing finished. [2026-01-30 18:01:39,852][ INFO][PID:2027619] Releasing VM back to pool [2026-01-30 18:01:39,864][ INFO][PID:2027619] Searching for 'success' file in resultdir [2026-01-30 18:01:39,867][ INFO][PID:2027619] Going to sign pkgs from source: 10080497-fedora-rawhide-x86_64 in chroot: /var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test/fedora-rawhide-x86_64 [2026-01-30 18:01:39,869][ INFO][PID:2027619] Calling '/bin/sign -u @rocm-packagers-sig#rocm-test@copr.fedorahosted.org -p' (attempt #1) [2026-01-30 18:01:40,148][ INFO][PID:2027619] Calling '/bin/sign -4 -h sha256 -u @rocm-packagers-sig#rocm-test@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test/fedora-rawhide-x86_64/10080497-rocalution/rocalution-7.1.0-4.fc44.x86_64.rpm' (attempt #1) [2026-01-30 18:01:40,863][ INFO][PID:2027619] signed rpm: /var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test/fedora-rawhide-x86_64/10080497-rocalution/rocalution-7.1.0-4.fc44.x86_64.rpm [2026-01-30 18:01:40,863][ INFO][PID:2027619] Calling '/bin/sign -4 -h sha256 -u @rocm-packagers-sig#rocm-test@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test/fedora-rawhide-x86_64/10080497-rocalution/rocalution-debuginfo-7.1.0-4.fc44.x86_64.rpm' (attempt #1) [2026-01-30 18:01:41,730][ INFO][PID:2027619] signed rpm: /var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test/fedora-rawhide-x86_64/10080497-rocalution/rocalution-debuginfo-7.1.0-4.fc44.x86_64.rpm [2026-01-30 18:01:41,730][ INFO][PID:2027619] Calling '/bin/sign -4 -h sha256 -u @rocm-packagers-sig#rocm-test@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test/fedora-rawhide-x86_64/10080497-rocalution/rocalution-devel-7.1.0-4.fc44.x86_64.rpm' (attempt #1) [2026-01-30 18:01:42,415][ INFO][PID:2027619] signed rpm: /var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test/fedora-rawhide-x86_64/10080497-rocalution/rocalution-devel-7.1.0-4.fc44.x86_64.rpm [2026-01-30 18:01:42,415][ INFO][PID:2027619] Calling '/bin/sign -4 -h sha256 -u @rocm-packagers-sig#rocm-test@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test/fedora-rawhide-x86_64/10080497-rocalution/rocalution-test-debuginfo-7.1.0-4.fc44.x86_64.rpm' (attempt #1) [2026-01-30 18:01:43,507][ INFO][PID:2027619] signed rpm: /var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test/fedora-rawhide-x86_64/10080497-rocalution/rocalution-test-debuginfo-7.1.0-4.fc44.x86_64.rpm [2026-01-30 18:01:43,507][ INFO][PID:2027619] Calling '/bin/sign -4 -h sha256 -u @rocm-packagers-sig#rocm-test@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test/fedora-rawhide-x86_64/10080497-rocalution/rocalution-7.1.0-4.fc44.src.rpm' (attempt #1) [2026-01-30 18:01:44,405][ INFO][PID:2027619] signed rpm: /var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test/fedora-rawhide-x86_64/10080497-rocalution/rocalution-7.1.0-4.fc44.src.rpm [2026-01-30 18:01:44,406][ INFO][PID:2027619] Calling '/bin/sign -4 -h sha256 -u @rocm-packagers-sig#rocm-test@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test/fedora-rawhide-x86_64/10080497-rocalution/rocalution-test-7.1.0-4.fc44.x86_64.rpm' (attempt #1) [2026-01-30 18:01:45,159][ INFO][PID:2027619] signed rpm: /var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test/fedora-rawhide-x86_64/10080497-rocalution/rocalution-test-7.1.0-4.fc44.x86_64.rpm [2026-01-30 18:01:45,159][ INFO][PID:2027619] Calling '/bin/sign -4 -h sha256 -u @rocm-packagers-sig#rocm-test@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test/fedora-rawhide-x86_64/10080497-rocalution/rocalution-debugsource-7.1.0-4.fc44.x86_64.rpm' (attempt #1) [2026-01-30 18:01:45,944][ INFO][PID:2027619] signed rpm: /var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test/fedora-rawhide-x86_64/10080497-rocalution/rocalution-debugsource-7.1.0-4.fc44.x86_64.rpm [2026-01-30 18:01:45,945][ INFO][PID:2027619] Sign done [2026-01-30 18:01:45,945][ INFO][PID:2027619] Incremental createrepo run, adding 10080497-rocalution into https://download.copr.fedorainfracloud.org/results/@rocm-packagers-sig/rocm-test/fedora-rawhide-x86_64, (auto-create-repo=True) [2026-01-30 18:01:45,946][ INFO][PID:2027619] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test/fedora-rawhide-x86_64 --add 10080497-rocalution --no-appstream-metadata' as PID 2270300 [2026-01-30 18:01:47,135][ INFO][PID:2027619] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test/fedora-rawhide-x86_64 --add 10080497-rocalution --no-appstream-metadata) [2026-01-30 18:01:47,136][ INFO][PID:2027619] Getting build details [2026-01-30 18:01:47,137][ INFO][PID:2027619] Listing built binary packages in /var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test/fedora-rawhide-x86_64/10080497-rocalution [2026-01-30 18:01:47,137][ INFO][PID:2027619] Built packages: ['rocalution-debuginfo 7.1.0', 'rocalution-test 7.1.0', 'rocalution-devel 7.1.0', 'rocalution 7.1.0', 'rocalution-test-debuginfo 7.1.0', 'rocalution-debugsource 7.1.0'] [2026-01-30 18:01:47,138][ INFO][PID:2027619] build details: {'built_packages': 'rocalution-debuginfo 7.1.0\nrocalution-test 7.1.0\nrocalution-devel 7.1.0\nrocalution 7.1.0\nrocalution-test-debuginfo 7.1.0\nrocalution-debugsource 7.1.0'} [2026-01-30 18:01:47,138][ INFO][PID:2027619] Retrieving pubkey [2026-01-30 18:01:47,139][ INFO][PID:2027619] Calling '/bin/sign -u @rocm-packagers-sig#rocm-test@copr.fedorahosted.org -p' (attempt #1) [2026-01-30 18:01:47,418][ INFO][PID:2027619] Added pubkey for user @rocm-packagers-sig project rocm-test into: /var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test/pubkey.gpg [2026-01-30 18:01:47,423][ INFO][PID:2027619] Finished build: id=10080497 failed=False timeout=180000 destdir=/var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test chroot=fedora-rawhide-x86_64 [2026-01-30 18:01:47,426][ INFO][PID:2027619] Worker succeeded build, took 1362.8224430084229 [2026-01-30 18:01:47,427][ INFO][PID:2027619] Sending build state back to frontend: { "builds": [ { "timeout": 180000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "@rocm-packagers-sig", "project_name": "rocm-test", "project_dirname": "rocm-test", "submitter": "tflink", "ended_on": 1769796107.4262705, "started_on": 1769794744.6038275, "submitted_on": null, "status": 1, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10080497-fedora-rawhide-x86_64", "build_id": 10080497, "package_name": "rocalution", "package_version": "7.1.0-4", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@rocm-packagers-sig/rocm-test/rocalution", "git_hash": "d1829d0252b2a6713c51f25173a31349a0fbb1e6", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@rocm-packagers-sig/rocm-test--tflink", "results": { "packages": [ { "name": "rocalution", "epoch": null, "version": "7.1.0", "release": "4.fc44", "arch": "src" }, { "name": "rocalution-debuginfo", "epoch": null, "version": "7.1.0", "release": "4.fc44", "arch": "x86_64" }, { "name": "rocalution-test", "epoch": null, "version": "7.1.0", "release": "4.fc44", "arch": "x86_64" }, { "name": "rocalution-devel", "epoch": null, "version": "7.1.0", "release": "4.fc44", "arch": "x86_64" }, { "name": "rocalution", "epoch": null, "version": "7.1.0", "release": "4.fc44", "arch": "x86_64" }, { "name": "rocalution-test-debuginfo", "epoch": null, "version": "7.1.0", "release": "4.fc44", "arch": "x86_64" }, { "name": "rocalution-debugsource", "epoch": null, "version": "7.1.0", "release": "4.fc44", "arch": "x86_64" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@rocm-packagers-sig/rocm-test/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [ "test" ], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@rocm-packagers-sig/rocm-test", "result_dir": "10080497-rocalution", "built_packages": "rocalution-debuginfo 7.1.0\nrocalution-test 7.1.0\nrocalution-devel 7.1.0\nrocalution 7.1.0\nrocalution-test-debuginfo 7.1.0\nrocalution-debugsource 7.1.0", "id": 10080497, "mockchain_macros": { "copr_username": "@rocm-packagers-sig", "copr_projectname": "rocm-test", "vendor": "Fedora Project COPR (@rocm-packagers-sig/rocm-test)" } } ] } [2026-01-30 18:01:47,480][ INFO][PID:2027619] Sending fedora-messaging bus message in build.end [2026-01-30 18:01:47,509][ INFO][PID:2027619] Compressing /var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test/fedora-rawhide-x86_64/10080497-rocalution/builder-live.log by gzip [2026-01-30 18:01:47,510][ INFO][PID:2027619] Running command 'gzip /var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test/fedora-rawhide-x86_64/10080497-rocalution/builder-live.log' as PID 2270470 [2026-01-30 18:01:47,705][ INFO][PID:2027619] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test/fedora-rawhide-x86_64/10080497-rocalution/builder-live.log) [2026-01-30 18:01:47,705][ INFO][PID:2027619] Compressing /var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test/fedora-rawhide-x86_64/10080497-rocalution/backend.log by gzip [2026-01-30 18:01:47,706][ INFO][PID:2027619] Running command 'gzip /var/lib/copr/public_html/results/@rocm-packagers-sig/rocm-test/fedora-rawhide-x86_64/10080497-rocalution/backend.log' as PID 2270595