[2026-06-10 15:17:41,458][ INFO][PID:2370583] Marking build as starting [2026-06-10 15:17:41,643][ INFO][PID:2370583] Checking that /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/repodata/repomd.xml exists [2026-06-10 15:17:41,678][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:17:41,969][ INFO][PID:2370583] rpmeta: predicted 2 min for koji on rhel-8-x86_64 -> normal builder sufficient [2026-06-10 15:17:41,987][ INFO][PID:2370583] VM allocation process starts [2026-06-10 15:17:42,031][ INFO][PID:2370583] Trying to allocate VM: ResallocHost, ticket_id=3372668, requested_tags=['arch_x86_64', 'copr_builder'] [2026-06-10 15:17:47,037][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:17:52,051][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:17:57,058][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:18:02,065][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:18:07,074][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:18:10,360][ INFO][PID:2370583] Allocated host ResallocHost, ticket_id=3372668, hostname=2620:52:6:1161:dead:beef:cafe:c102, name=vmhost_x86_01_prod_11814612_20260610_151557, requested_tags=['arch_x86_64', 'copr_builder'] [2026-06-10 15:18:10,362][ INFO][PID:2370583] Allocating ssh connection to builder [2026-06-10 15:18:10,373][ INFO][PID:2370583] Checking that builder machine is OK [2026-06-10 15:18:11,067][ INFO][PID:2370583] Installed copr-rpmbuild version: 1.8 [2026-06-10 15:18:11,068][ INFO][PID:2370583] Running remote command: copr-builder-ready rhel-8-x86_64 [2026-06-10 15:18:11,444][ INFO][PID:2370583] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2026-06-10 15:18:11,446][ INFO][PID:2370583] Filling build.info file with builder info [2026-06-10 15:18:11,448][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:18:11,451][ INFO][PID:2370583] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "tkopecek", "project_name": "koji", "project_dirname": "koji", "submitter": "tkopecek", "ended_on": null, "started_on": 1781104691.451561, "submitted_on": null, "status": 3, "chroot": "rhel-8-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10587007-rhel-8-x86_64", "build_id": 10587007, "package_name": "koji", "package_version": "1.36.0-20260610.67.g6e24be121", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/tkopecek/koji/koji", "git_hash": "6b9f3f4438e36085346d1603f3d327fcde787648", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "tkopecek/koji--tkopecek", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/tkopecek/koji/rhel-8-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "bootstrap": "on", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/tkopecek/koji", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/tkopecek/koji", "result_dir": "10587007-koji", "built_packages": "", "rpmeta_prediction": 2, "id": 10587007, "mockchain_macros": { "copr_username": "tkopecek", "copr_projectname": "koji", "vendor": "Fedora Project COPR (tkopecek/koji)" } } ] } [2026-06-10 15:18:11,521][ INFO][PID:2370583] Sending fedora-messaging bus message in build.start [2026-06-10 15:18:12,259][ INFO][PID:2370583] Sending fedora-messaging bus message in chroot.start [2026-06-10 15:18:12,319][ INFO][PID:2370583] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10587007-rhel-8-x86_64 --chroot rhel-8-x86_64 --detached [2026-06-10 15:18:12,977][ INFO][PID:2370583] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c102' (ED25519) to the list of known hosts. [2026-06-10 15:18:12,981][ INFO][PID:2370583] Downloading the builder-live.log file, attempt 1 [2026-06-10 15:18:12,993][ INFO][PID:2370583] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c102 copr-rpmbuild-log [2026-06-10 15:18:18,023][ INFO][PID:2370583] Periodic builder liveness probe: alive [2026-06-10 15:18:18,046][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:18:23,056][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:18:28,062][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:18:33,068][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:18:38,075][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:18:43,082][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:18:48,090][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:18:53,092][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:18:58,095][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:19:03,100][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:19:08,111][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:19:13,115][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:19:18,127][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:19:23,132][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:19:28,137][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:19:33,147][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:19:38,158][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:19:43,164][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:19:48,245][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:19:53,254][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:19:58,265][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:20:03,269][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:20:08,280][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:20:13,286][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:20:18,291][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:20:23,351][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:20:28,367][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:20:33,372][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:20:38,376][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:20:43,387][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:20:48,460][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:20:53,466][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:20:58,474][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:21:03,485][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:21:08,719][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:21:13,734][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:21:18,756][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:21:23,758][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:21:28,776][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:21:33,848][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:21:39,009][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:21:44,023][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:21:49,026][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:21:54,159][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:21:59,170][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:22:04,194][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:22:09,199][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:22:14,213][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:22:19,223][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:22:24,227][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:22:29,236][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:22:31,371][ ERROR][PID:2370583] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-06-10 15:22:34,256][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:22:39,262][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:22:41,446][WARNING][PID:2370583] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-06-10 15:22:44,288][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:22:49,291][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:22:51,447][ INFO][PID:2370583] Downloading the builder-live.log file, attempt 2 [2026-06-10 15:22:51,453][ INFO][PID:2370583] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c102 copr-rpmbuild-log [2026-06-10 15:22:54,306][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:22:59,311][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:23:04,326][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:23:09,370][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:23:14,376][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:23:19,388][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:23:24,396][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:23:29,404][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:23:34,410][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:23:39,415][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:23:44,427][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:23:49,432][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:23:51,555][ ERROR][PID:2370583] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-06-10 15:23:54,434][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:23:59,437][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:24:01,681][WARNING][PID:2370583] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-06-10 15:24:04,455][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:24:09,462][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:24:11,795][ INFO][PID:2370583] Downloading the builder-live.log file, attempt 3 [2026-06-10 15:24:11,798][ INFO][PID:2370583] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c102 copr-rpmbuild-log [2026-06-10 15:24:14,477][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:24:19,480][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:24:24,588][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:24:29,600][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:24:34,605][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:24:39,614][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:24:44,624][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:24:49,627][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:24:54,636][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:24:59,647][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:25:04,663][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:25:09,668][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:25:11,868][ ERROR][PID:2370583] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-06-10 15:25:14,906][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:25:19,912][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:25:21,891][WARNING][PID:2370583] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-06-10 15:25:24,950][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:25:29,958][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:25:31,896][ INFO][PID:2370583] Downloading the builder-live.log file, attempt 4 [2026-06-10 15:25:31,900][ INFO][PID:2370583] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c102 copr-rpmbuild-log [2026-06-10 15:25:34,969][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:25:39,973][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:25:44,987][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:25:50,023][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:25:55,034][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:26:00,043][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:26:05,046][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:26:10,207][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:26:15,218][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:26:20,243][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:26:25,250][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:26:31,348][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:26:31,972][ ERROR][PID:2370583] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-06-10 15:26:36,424][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:26:41,444][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:26:42,008][ ERROR][PID:2370583] Giving up for unstable SSH, failures: 1781104961.4466133, 1781105041.68194, 1781105121.8914738, 1781105201.9865441 [2026-06-10 15:26:42,153][ ERROR][PID:2370583] Re-try request for task on 'ResallocHost, ticket_id=3372668, hostname=2620:52:6:1161:dead:beef:cafe:c102, name=vmhost_x86_01_prod_11814612_20260610_151557, requested_tags=['arch_x86_64', 'copr_builder']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-06-10 15:26:42,398][ INFO][PID:2370583] VM Release request [2026-06-10 15:26:42,564][ INFO][PID:2370583] Retry #1 (on other host) [2026-06-10 15:26:42,582][ INFO][PID:2370583] Checking that /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/repodata/repomd.xml exists [2026-06-10 15:26:42,589][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:26:43,222][ INFO][PID:2370583] rpmeta: predicted 2 min for koji on rhel-8-x86_64 -> normal builder sufficient [2026-06-10 15:26:43,235][ INFO][PID:2370583] VM allocation process starts [2026-06-10 15:26:43,363][ INFO][PID:2370583] Trying to allocate VM: ResallocHost, ticket_id=3372924, requested_tags=['arch_x86_64', 'copr_builder'] [2026-06-10 15:26:48,387][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:26:53,390][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:26:58,403][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:27:03,404][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:27:08,417][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:27:13,426][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:27:18,431][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:27:23,444][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:27:28,445][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:27:33,448][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:27:38,450][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:27:43,453][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:27:48,462][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:27:53,467][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:27:58,488][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:28:03,492][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:28:08,495][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:28:13,497][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:28:18,501][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:28:23,513][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:28:28,544][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:28:33,558][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:28:38,604][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:28:43,612][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:28:48,619][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:28:53,625][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:28:58,647][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:29:03,657][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:29:08,666][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:29:13,678][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:29:18,695][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:29:23,707][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:29:28,712][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:29:33,718][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:29:38,726][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:29:43,736][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:29:48,739][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:29:53,742][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:29:58,787][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:30:03,820][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:30:08,844][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:30:13,851][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:30:18,856][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:30:23,865][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:30:28,866][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:30:33,868][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:30:38,872][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:30:43,879][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:30:48,881][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:30:53,882][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:30:58,988][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:31:01,965][ INFO][PID:2370583] Allocated host ResallocHost, ticket_id=3372924, hostname=2620:52:6:1161:dead:beef:cafe:c101, name=vmhost_x86_01_prod_11815227_20260610_152814, requested_tags=['arch_x86_64', 'copr_builder'] [2026-06-10 15:31:01,966][ INFO][PID:2370583] Allocating ssh connection to builder [2026-06-10 15:31:01,974][ INFO][PID:2370583] Checking that builder machine is OK [2026-06-10 15:31:02,569][ INFO][PID:2370583] Installed copr-rpmbuild version: 1.8 [2026-06-10 15:31:02,588][ INFO][PID:2370583] Running remote command: copr-builder-ready rhel-8-x86_64 [2026-06-10 15:31:03,016][ INFO][PID:2370583] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2026-06-10 15:31:03,021][ INFO][PID:2370583] Filling build.info file with builder info [2026-06-10 15:31:03,023][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:31:03,031][ INFO][PID:2370583] Not re-notifying FE and msg buses for the new host. [2026-06-10 15:31:03,039][ INFO][PID:2370583] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10587007-rhel-8-x86_64 --chroot rhel-8-x86_64 --detached [2026-06-10 15:31:03,701][ INFO][PID:2370583] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c101' (ED25519) to the list of known hosts. [2026-06-10 15:31:03,705][ INFO][PID:2370583] Downloading the builder-live.log file, attempt 1 [2026-06-10 15:31:03,709][ INFO][PID:2370583] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c101 copr-rpmbuild-log [2026-06-10 15:31:08,729][ INFO][PID:2370583] Periodic builder liveness probe: alive [2026-06-10 15:31:08,734][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:31:13,738][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:31:18,739][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:31:23,766][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:31:28,772][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:31:33,781][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:31:38,796][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:31:43,809][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:31:48,824][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:31:53,834][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:32:00,330][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:32:05,401][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:32:10,445][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:32:15,496][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:32:20,532][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:32:25,566][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:32:30,588][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:32:35,604][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:32:40,953][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:32:46,002][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:32:51,018][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:32:56,030][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:33:01,031][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:33:06,033][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:33:11,039][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:33:16,042][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:33:21,044][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:33:26,047][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:33:31,049][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:33:36,050][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:33:41,063][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:33:46,155][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:33:51,167][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:33:56,178][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:34:01,183][ INFO][PID:2370583] Checking for cancel request [2026-06-10 15:34:01,409][ INFO][PID:2370583] Downloading results from builder [2026-06-10 15:34:01,455][ INFO][PID:2370583] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c101]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji started [2026-06-10 15:34:01,467][ INFO][PID:2370583] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c101]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/ &> /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/build-10587007.rsync.log [2026-06-10 15:34:03,230][ INFO][PID:2370583] rsyncing finished. [2026-06-10 15:34:03,254][ INFO][PID:2370583] VM Release request [2026-06-10 15:34:03,353][ INFO][PID:2370583] Searching for 'success' file in resultdir [2026-06-10 15:34:03,415][ INFO][PID:2370583] Going to sign pkgs from source: 10587007-rhel-8-x86_64 in chroot: /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64 [2026-06-10 15:34:03,590][ INFO][PID:2370583] Calling '/bin/sign -u tkopecek#koji@copr.fedorahosted.org -p' (attempt #1) [2026-06-10 15:34:03,985][ INFO][PID:2370583] Calling '/bin/sign -4 -h sha256 -u tkopecek#koji@copr.fedorahosted.org -r /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/koji-hub-plugins-1.36.0-20260610.67.g6e24be121.el8.noarch.rpm' (attempt #1) [2026-06-10 15:34:04,801][ INFO][PID:2370583] signed rpm: /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/koji-hub-plugins-1.36.0-20260610.67.g6e24be121.el8.noarch.rpm [2026-06-10 15:34:04,804][ INFO][PID:2370583] Calling '/bin/sign -4 -h sha256 -u tkopecek#koji@copr.fedorahosted.org -r /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/koji-1.36.0-20260610.67.g6e24be121.el8.noarch.rpm' (attempt #1) [2026-06-10 15:34:05,838][ INFO][PID:2370583] signed rpm: /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/koji-1.36.0-20260610.67.g6e24be121.el8.noarch.rpm [2026-06-10 15:34:05,848][ INFO][PID:2370583] Calling '/bin/sign -4 -h sha256 -u tkopecek#koji@copr.fedorahosted.org -r /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/koji-builder-1.36.0-20260610.67.g6e24be121.el8.noarch.rpm' (attempt #1) [2026-06-10 15:34:06,698][ INFO][PID:2370583] signed rpm: /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/koji-builder-1.36.0-20260610.67.g6e24be121.el8.noarch.rpm [2026-06-10 15:34:06,699][ INFO][PID:2370583] Calling '/bin/sign -4 -h sha256 -u tkopecek#koji@copr.fedorahosted.org -r /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/python3-koji-cli-plugins-1.36.0-20260610.67.g6e24be121.el8.noarch.rpm' (attempt #1) [2026-06-10 15:34:07,443][ INFO][PID:2370583] signed rpm: /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/python3-koji-cli-plugins-1.36.0-20260610.67.g6e24be121.el8.noarch.rpm [2026-06-10 15:34:07,452][ INFO][PID:2370583] Calling '/bin/sign -4 -h sha256 -u tkopecek#koji@copr.fedorahosted.org -r /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/koji-builder-plugins-1.36.0-20260610.67.g6e24be121.el8.noarch.rpm' (attempt #1) [2026-06-10 15:34:08,281][ INFO][PID:2370583] signed rpm: /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/koji-builder-plugins-1.36.0-20260610.67.g6e24be121.el8.noarch.rpm [2026-06-10 15:34:08,285][ INFO][PID:2370583] Calling '/bin/sign -4 -h sha256 -u tkopecek#koji@copr.fedorahosted.org -r /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/python3-koji-1.36.0-20260610.67.g6e24be121.el8.noarch.rpm' (attempt #1) [2026-06-10 15:34:09,018][ INFO][PID:2370583] signed rpm: /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/python3-koji-1.36.0-20260610.67.g6e24be121.el8.noarch.rpm [2026-06-10 15:34:09,019][ INFO][PID:2370583] Calling '/bin/sign -4 -h sha256 -u tkopecek#koji@copr.fedorahosted.org -r /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/koji-vm-1.36.0-20260610.67.g6e24be121.el8.noarch.rpm' (attempt #1) [2026-06-10 15:34:09,897][ INFO][PID:2370583] signed rpm: /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/koji-vm-1.36.0-20260610.67.g6e24be121.el8.noarch.rpm [2026-06-10 15:34:09,899][ INFO][PID:2370583] Calling '/bin/sign -4 -h sha256 -u tkopecek#koji@copr.fedorahosted.org -r /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/koji-hub-1.36.0-20260610.67.g6e24be121.el8.noarch.rpm' (attempt #1) [2026-06-10 15:34:10,685][ INFO][PID:2370583] signed rpm: /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/koji-hub-1.36.0-20260610.67.g6e24be121.el8.noarch.rpm [2026-06-10 15:34:10,691][ INFO][PID:2370583] Calling '/bin/sign -4 -h sha256 -u tkopecek#koji@copr.fedorahosted.org -r /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/koji-1.36.0-20260610.67.g6e24be121.el8.src.rpm' (attempt #1) [2026-06-10 15:34:13,223][ INFO][PID:2370583] signed rpm: /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/koji-1.36.0-20260610.67.g6e24be121.el8.src.rpm [2026-06-10 15:34:13,230][ INFO][PID:2370583] Calling '/bin/sign -4 -h sha256 -u tkopecek#koji@copr.fedorahosted.org -r /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/koji-utils-1.36.0-20260610.67.g6e24be121.el8.noarch.rpm' (attempt #1) [2026-06-10 15:34:13,952][ INFO][PID:2370583] signed rpm: /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/koji-utils-1.36.0-20260610.67.g6e24be121.el8.noarch.rpm [2026-06-10 15:34:13,959][ INFO][PID:2370583] Calling '/bin/sign -4 -h sha256 -u tkopecek#koji@copr.fedorahosted.org -r /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/python3-koji-hub-1.36.0-20260610.67.g6e24be121.el8.noarch.rpm' (attempt #1) [2026-06-10 15:34:14,704][ INFO][PID:2370583] signed rpm: /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/python3-koji-hub-1.36.0-20260610.67.g6e24be121.el8.noarch.rpm [2026-06-10 15:34:14,719][ INFO][PID:2370583] Calling '/bin/sign -4 -h sha256 -u tkopecek#koji@copr.fedorahosted.org -r /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/python3-koji-hub-plugins-1.36.0-20260610.67.g6e24be121.el8.noarch.rpm' (attempt #1) [2026-06-10 15:34:15,501][ INFO][PID:2370583] signed rpm: /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/python3-koji-hub-plugins-1.36.0-20260610.67.g6e24be121.el8.noarch.rpm [2026-06-10 15:34:15,503][ INFO][PID:2370583] Calling '/bin/sign -4 -h sha256 -u tkopecek#koji@copr.fedorahosted.org -r /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/python3-koji-web-1.36.0-20260610.67.g6e24be121.el8.noarch.rpm' (attempt #1) [2026-06-10 15:34:16,245][ INFO][PID:2370583] signed rpm: /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/python3-koji-web-1.36.0-20260610.67.g6e24be121.el8.noarch.rpm [2026-06-10 15:34:16,256][ INFO][PID:2370583] Calling '/bin/sign -4 -h sha256 -u tkopecek#koji@copr.fedorahosted.org -r /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/koji-web-1.36.0-20260610.67.g6e24be121.el8.noarch.rpm' (attempt #1) [2026-06-10 15:34:16,940][ INFO][PID:2370583] signed rpm: /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/koji-web-1.36.0-20260610.67.g6e24be121.el8.noarch.rpm [2026-06-10 15:34:16,941][ INFO][PID:2370583] Sign done [2026-06-10 15:34:17,025][ INFO][PID:2370583] Incremental createrepo run, adding 10587007-koji into https://download.copr.fedorainfracloud.org/results/tkopecek/koji/rhel-8-x86_64, (auto-create-repo=True) [2026-06-10 15:34:17,068][ INFO][PID:2370583] Running command 'copr-repo --batched /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64 --add 10587007-koji --no-appstream-metadata' as PID 2577197 [2026-06-10 15:34:22,111][ INFO][PID:2370583] Finished after 5 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64 --add 10587007-koji --no-appstream-metadata) [2026-06-10 15:34:22,189][ INFO][PID:2370583] Getting build details [2026-06-10 15:34:22,200][ INFO][PID:2370583] Listing built binary packages in /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji [2026-06-10 15:34:22,202][ INFO][PID:2370583] Built packages: ['koji-utils 1.36.0', 'koji-web 1.36.0', 'python3-koji 1.36.0', 'python3-koji-web 1.36.0', 'koji 1.36.0', 'koji-hub 1.36.0', 'koji-hub-plugins 1.36.0', 'python3-koji-hub 1.36.0', 'python3-koji-cli-plugins 1.36.0', 'koji-builder-plugins 1.36.0', 'koji-builder 1.36.0', 'python3-koji-hub-plugins 1.36.0', 'koji-vm 1.36.0'] [2026-06-10 15:34:22,202][ INFO][PID:2370583] build details: {'built_packages': 'koji-utils 1.36.0\nkoji-web 1.36.0\npython3-koji 1.36.0\npython3-koji-web 1.36.0\nkoji 1.36.0\nkoji-hub 1.36.0\nkoji-hub-plugins 1.36.0\npython3-koji-hub 1.36.0\npython3-koji-cli-plugins 1.36.0\nkoji-builder-plugins 1.36.0\nkoji-builder 1.36.0\npython3-koji-hub-plugins 1.36.0\nkoji-vm 1.36.0'} [2026-06-10 15:34:22,213][ INFO][PID:2370583] Retrieving pubkey [2026-06-10 15:34:22,216][ INFO][PID:2370583] Calling '/bin/sign -u tkopecek#koji@copr.fedorahosted.org -p' (attempt #1) [2026-06-10 15:34:22,603][ INFO][PID:2370583] Added pubkey for user tkopecek project koji into: /var/lib/copr/public_html/results/tkopecek/koji/pubkey.gpg [2026-06-10 15:34:22,609][ INFO][PID:2370583] Finished build: id=10587007 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/tkopecek/koji chroot=rhel-8-x86_64 [2026-06-10 15:34:23,512][ INFO][PID:2370583] Worker succeeded build, took 200.48610496520996 [2026-06-10 15:34:23,588][ INFO][PID:2370583] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "tkopecek", "project_name": "koji", "project_dirname": "koji", "submitter": "tkopecek", "ended_on": 1781105663.512228, "started_on": 1781105463.026123, "submitted_on": null, "status": 1, "chroot": "rhel-8-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10587007-rhel-8-x86_64", "build_id": 10587007, "package_name": "koji", "package_version": "1.36.0-20260610.67.g6e24be121", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/tkopecek/koji/koji", "git_hash": "6b9f3f4438e36085346d1603f3d327fcde787648", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "tkopecek/koji--tkopecek", "results": { "packages": [ { "name": "koji-utils", "epoch": null, "version": "1.36.0", "release": "20260610.67.g6e24be121.el8", "arch": "noarch" }, { "name": "koji-web", "epoch": null, "version": "1.36.0", "release": "20260610.67.g6e24be121.el8", "arch": "noarch" }, { "name": "python3-koji", "epoch": null, "version": "1.36.0", "release": "20260610.67.g6e24be121.el8", "arch": "noarch" }, { "name": "python3-koji-web", "epoch": null, "version": "1.36.0", "release": "20260610.67.g6e24be121.el8", "arch": "noarch" }, { "name": "koji", "epoch": null, "version": "1.36.0", "release": "20260610.67.g6e24be121.el8", "arch": "noarch" }, { "name": "koji-hub", "epoch": null, "version": "1.36.0", "release": "20260610.67.g6e24be121.el8", "arch": "noarch" }, { "name": "koji-hub-plugins", "epoch": null, "version": "1.36.0", "release": "20260610.67.g6e24be121.el8", "arch": "noarch" }, { "name": "python3-koji-hub", "epoch": null, "version": "1.36.0", "release": "20260610.67.g6e24be121.el8", "arch": "noarch" }, { "name": "python3-koji-cli-plugins", "epoch": null, "version": "1.36.0", "release": "20260610.67.g6e24be121.el8", "arch": "noarch" }, { "name": "koji", "epoch": null, "version": "1.36.0", "release": "20260610.67.g6e24be121.el8", "arch": "src" }, { "name": "koji-builder-plugins", "epoch": null, "version": "1.36.0", "release": "20260610.67.g6e24be121.el8", "arch": "noarch" }, { "name": "koji-builder", "epoch": null, "version": "1.36.0", "release": "20260610.67.g6e24be121.el8", "arch": "noarch" }, { "name": "python3-koji-hub-plugins", "epoch": null, "version": "1.36.0", "release": "20260610.67.g6e24be121.el8", "arch": "noarch" }, { "name": "koji-vm", "epoch": null, "version": "1.36.0", "release": "20260610.67.g6e24be121.el8", "arch": "noarch" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/tkopecek/koji/rhel-8-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "bootstrap": "on", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/tkopecek/koji", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/tkopecek/koji", "result_dir": "10587007-koji", "built_packages": "koji-utils 1.36.0\nkoji-web 1.36.0\npython3-koji 1.36.0\npython3-koji-web 1.36.0\nkoji 1.36.0\nkoji-hub 1.36.0\nkoji-hub-plugins 1.36.0\npython3-koji-hub 1.36.0\npython3-koji-cli-plugins 1.36.0\nkoji-builder-plugins 1.36.0\nkoji-builder 1.36.0\npython3-koji-hub-plugins 1.36.0\nkoji-vm 1.36.0", "rpmeta_prediction": 2, "id": 10587007, "mockchain_macros": { "copr_username": "tkopecek", "copr_projectname": "koji", "vendor": "Fedora Project COPR (tkopecek/koji)" } } ] } [2026-06-10 15:34:26,556][ INFO][PID:2370583] Sending fedora-messaging bus message in build.end [2026-06-10 15:34:28,962][ INFO][PID:2370583] Compressing /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/builder-live.log by gzip [2026-06-10 15:34:28,969][ INFO][PID:2370583] Running command 'gzip /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/builder-live.log' as PID 2580007 [2026-06-10 15:34:29,033][ INFO][PID:2370583] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/builder-live.log) [2026-06-10 15:34:29,034][ INFO][PID:2370583] Compressing /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/backend.log by gzip [2026-06-10 15:34:29,038][ INFO][PID:2370583] Running command 'gzip /var/lib/copr/public_html/results/tkopecek/koji/rhel-8-x86_64/10587007-koji/backend.log' as PID 2580031