[2026-09-15 14:10:16,793][ INFO][PID:1777369] Marking build as starting [2026-09-15 14:10:17,135][ INFO][PID:1777369] Checking that /var/lib/copr/public_html/results/@osbuild/image-builder/rhel-9-x86_64/repodata/repomd.xml exists [2026-09-15 14:10:17,136][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:10:17,156][ INFO][PID:1777369] rpmeta: predicted 4 min for image-builder on rhel-9-x86_64 -> normal builder sufficient [2026-09-15 14:10:17,158][ INFO][PID:1777369] VM allocation process starts [2026-09-15 14:10:17,163][ INFO][PID:1777369] Trying to allocate VM: ResallocHost, ticket_id=5039147, requested_tags=['arch_x86_64', 'copr_builder'] [2026-09-15 14:10:22,165][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:10:27,166][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:10:32,166][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:10:37,167][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:10:42,168][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:10:47,169][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:10:52,170][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:10:57,170][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:11:02,171][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:11:07,172][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:11:12,173][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:11:17,174][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:11:22,175][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:11:27,175][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:11:32,176][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:11:37,177][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:11:42,178][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:11:47,179][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:11:52,181][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:11:57,181][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:12:02,182][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:12:07,183][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:12:12,184][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:12:17,185][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:12:22,186][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:12:27,187][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:12:32,188][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:12:37,189][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:12:42,199][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:12:47,200][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:12:52,201][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:12:57,202][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:13:02,203][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:13:07,204][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:13:12,206][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:13:17,207][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:13:22,207][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:13:27,208][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:13:32,209][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:13:37,210][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:13:42,211][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:13:47,212][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:13:52,212][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:13:57,213][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:14:02,214][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:14:07,215][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:14:12,216][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:14:17,217][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:14:22,217][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:14:27,218][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:14:32,219][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:14:35,250][ INFO][PID:1777369] Allocated host ResallocHost, ticket_id=5039147, hostname=54.81.36.147, name=aws_x86_64_reserved_prod_37914632_20260915_141249, requested_tags=['arch_x86_64', 'copr_builder'] [2026-09-15 14:14:35,251][ INFO][PID:1777369] Allocating ssh connection to builder [2026-09-15 14:14:35,251][ INFO][PID:1777369] Checking that builder machine is OK [2026-09-15 14:14:35,527][ INFO][PID:1777369] Installed copr-rpmbuild version: 1.9 [2026-09-15 14:14:35,527][ INFO][PID:1777369] Running remote command: copr-builder-ready rhel-9-x86_64 [2026-09-15 14:24:35,685][ INFO][PID:1777369] Checking Red Hat subscription (attempt #1) Checking Red Hat subscription (attempt #2) Checking Red Hat subscription (attempt #3) Checking Red Hat subscription (attempt #4) Checking Red Hat subscription (attempt #5) Checking Red Hat subscription (attempt #6) Checking Red Hat subscription (attempt #7) Checking Red Hat subscription (attempt #8) Checking Red Hat subscription (attempt #9) Checking Red Hat subscription (attempt #10) Checking Red Hat subscription (attempt #11) Checking Red Hat subscription (attempt #12) Checking Red Hat subscription (attempt #13) Checking Red Hat subscription (attempt #14) Checking Red Hat subscription (attempt #15) Checking Red Hat subscription (attempt #16) Checking Red Hat subscription (attempt #17) Checking Red Hat subscription (attempt #18) Checking Red Hat subscription (attempt #19) Checking Red Hat subscription (attempt #20) Checking Red Hat subscription (attempt #21) Waiting for Red Hat subscription timeouted! [2026-09-15 14:24:35,685][ INFO][PID:1777369] Warning: Permanently added '54.81.36.147' (ED25519) to the list of known hosts. [2026-09-15 14:24:35,686][ ERROR][PID:1777369] Re-try request for task on 'ResallocHost, ticket_id=5039147, hostname=54.81.36.147, name=aws_x86_64_reserved_prod_37914632_20260915_141249, requested_tags=['arch_x86_64', 'copr_builder']': Builder wasn't ready, trying a new one [2026-09-15 14:24:35,691][ INFO][PID:1777369] VM Release request [2026-09-15 14:24:35,698][ INFO][PID:1777369] Retry #1 (on other host) [2026-09-15 14:24:35,698][ INFO][PID:1777369] Checking that /var/lib/copr/public_html/results/@osbuild/image-builder/rhel-9-x86_64/repodata/repomd.xml exists [2026-09-15 14:24:35,699][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:24:35,718][ INFO][PID:1777369] rpmeta: predicted 4 min for image-builder on rhel-9-x86_64 -> normal builder sufficient [2026-09-15 14:24:35,720][ INFO][PID:1777369] VM allocation process starts [2026-09-15 14:24:35,725][ INFO][PID:1777369] Trying to allocate VM: ResallocHost, ticket_id=5039530, requested_tags=['arch_x86_64', 'copr_builder'] [2026-09-15 14:24:38,733][ INFO][PID:1777369] Allocated host ResallocHost, ticket_id=5039530, hostname=2620:52:6:1161:dead:beef:cafe:c112, name=vmhost_x86_03_prod_37914435_20260915_141209, requested_tags=['arch_x86_64', 'copr_builder'] [2026-09-15 14:24:38,734][ INFO][PID:1777369] Allocating ssh connection to builder [2026-09-15 14:24:38,734][ INFO][PID:1777369] Checking that builder machine is OK [2026-09-15 14:24:39,275][ INFO][PID:1777369] Installed copr-rpmbuild version: 1.9 [2026-09-15 14:24:39,275][ INFO][PID:1777369] Running remote command: copr-builder-ready rhel-9-x86_64 [2026-09-15 14:34:39,575][ INFO][PID:1777369] Checking Red Hat subscription (attempt #1) Checking Red Hat subscription (attempt #2) Checking Red Hat subscription (attempt #3) Checking Red Hat subscription (attempt #4) Checking Red Hat subscription (attempt #5) Checking Red Hat subscription (attempt #6) Checking Red Hat subscription (attempt #7) Checking Red Hat subscription (attempt #8) Checking Red Hat subscription (attempt #9) Checking Red Hat subscription (attempt #10) Checking Red Hat subscription (attempt #11) Checking Red Hat subscription (attempt #12) Checking Red Hat subscription (attempt #13) Checking Red Hat subscription (attempt #14) Checking Red Hat subscription (attempt #15) Checking Red Hat subscription (attempt #16) Checking Red Hat subscription (attempt #17) Checking Red Hat subscription (attempt #18) Checking Red Hat subscription (attempt #19) Checking Red Hat subscription (attempt #20) Checking Red Hat subscription (attempt #21) Waiting for Red Hat subscription timeouted! [2026-09-15 14:34:39,575][ INFO][PID:1777369] Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c112' (ED25519) to the list of known hosts. [2026-09-15 14:34:39,576][ ERROR][PID:1777369] Re-try request for task on 'ResallocHost, ticket_id=5039530, hostname=2620:52:6:1161:dead:beef:cafe:c112, name=vmhost_x86_03_prod_37914435_20260915_141209, requested_tags=['arch_x86_64', 'copr_builder']': Builder wasn't ready, trying a new one [2026-09-15 14:34:39,580][ INFO][PID:1777369] VM Release request [2026-09-15 14:34:39,588][ INFO][PID:1777369] Retry #2 (on other host) [2026-09-15 14:34:39,588][ INFO][PID:1777369] Checking that /var/lib/copr/public_html/results/@osbuild/image-builder/rhel-9-x86_64/repodata/repomd.xml exists [2026-09-15 14:34:39,588][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:34:39,607][ INFO][PID:1777369] rpmeta: predicted 4 min for image-builder on rhel-9-x86_64 -> normal builder sufficient [2026-09-15 14:34:39,608][ INFO][PID:1777369] VM allocation process starts [2026-09-15 14:34:39,613][ INFO][PID:1777369] Trying to allocate VM: ResallocHost, ticket_id=5039769, requested_tags=['arch_x86_64', 'copr_builder'] [2026-09-15 14:34:44,614][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:34:49,615][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:34:54,616][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:34:59,616][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:35:04,617][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:35:09,618][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:35:14,619][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:35:19,620][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:35:24,620][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:35:29,621][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:35:34,622][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:35:39,623][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:35:44,623][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:35:49,624][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:35:54,625][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:35:59,626][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:36:04,627][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:36:09,627][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:36:14,628][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:36:19,629][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:36:24,630][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:36:29,630][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:36:34,631][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:36:39,632][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:36:44,633][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:36:49,634][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:36:54,634][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:36:59,635][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:37:04,636][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:37:09,637][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:37:14,638][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:37:19,639][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:37:24,639][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:37:29,640][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:37:34,641][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:37:39,642][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:37:44,643][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:37:49,643][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:37:54,644][ INFO][PID:1777369] Checking for cancel request [2026-09-15 14:37:57,667][ INFO][PID:1777369] Allocated host ResallocHost, ticket_id=5039769, hostname=2620:52:6:1161:dead:beef:cafe:c100, name=vmhost_x86_01_prod_37919740_20260915_143552, requested_tags=['arch_x86_64', 'copr_builder'] [2026-09-15 14:37:57,667][ INFO][PID:1777369] Allocating ssh connection to builder [2026-09-15 14:37:57,668][ INFO][PID:1777369] Checking that builder machine is OK [2026-09-15 14:37:58,232][ INFO][PID:1777369] Installed copr-rpmbuild version: 1.9 [2026-09-15 14:37:58,233][ INFO][PID:1777369] Running remote command: copr-builder-ready rhel-9-x86_64 [2026-09-15 14:47:58,568][ INFO][PID:1777369] Checking Red Hat subscription (attempt #1) Checking Red Hat subscription (attempt #2) Checking Red Hat subscription (attempt #3) Checking Red Hat subscription (attempt #4) Checking Red Hat subscription (attempt #5) Checking Red Hat subscription (attempt #6) Checking Red Hat subscription (attempt #7) Checking Red Hat subscription (attempt #8) Checking Red Hat subscription (attempt #9) Checking Red Hat subscription (attempt #10) Checking Red Hat subscription (attempt #11) Checking Red Hat subscription (attempt #12) Checking Red Hat subscription (attempt #13) Checking Red Hat subscription (attempt #14) Checking Red Hat subscription (attempt #15) Checking Red Hat subscription (attempt #16) Checking Red Hat subscription (attempt #17) Checking Red Hat subscription (attempt #18) Checking Red Hat subscription (attempt #19) Checking Red Hat subscription (attempt #20) Checking Red Hat subscription (attempt #21) Waiting for Red Hat subscription timeouted! [2026-09-15 14:47:58,569][ INFO][PID:1777369] Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c100' (ED25519) to the list of known hosts. [2026-09-15 14:47:58,569][ ERROR][PID:1777369] Re-try request for task on 'ResallocHost, ticket_id=5039769, hostname=2620:52:6:1161:dead:beef:cafe:c100, name=vmhost_x86_01_prod_37919740_20260915_143552, requested_tags=['arch_x86_64', 'copr_builder']': Builder wasn't ready, trying a new one [2026-09-15 14:47:58,574][ INFO][PID:1777369] VM Release request [2026-09-15 14:47:58,581][ ERROR][PID:1777369] Backend process error: Three host tried without success: {'54.81.36.147', '2620:52:6:1161:dead:beef:cafe:c100', '2620:52:6:1161:dead:beef:cafe:c112'} [2026-09-15 14:47:58,586][WARNING][PID:1777369] Switching not-finished job state to 'failed' [2026-09-15 14:47:58,586][ INFO][PID:1777369] Worker failed build, took 2261.7942185401917 [2026-09-15 14:47:58,586][ INFO][PID:1777369] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@osbuild", "project_name": "image-builder", "project_dirname": "image-builder", "submitter": "packit", "ended_on": 1789483678.5862203, "started_on": 1789481416.7920017, "submitted_on": null, "status": 0, "chroot": "rhel-9-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10988175-rhel-9-x86_64", "build_id": 10988175, "package_name": "image-builder", "package_version": "82.0.0-1.20260915140938209054.main.54.g98efb40af", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@osbuild/image-builder/image-builder", "git_hash": "dab8b13a6fdfb5839345b681378eaa7c8ba36794", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@osbuild/image-builder--packit", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@osbuild/image-builder/rhel-9-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null, "repo_gpgcheck": false } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@osbuild/image-builder", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@osbuild/image-builder", "result_dir": "10988175-image-builder", "built_packages": "", "rpmeta_prediction": 4, "id": 10988175, "mockchain_macros": { "copr_username": "@osbuild", "copr_projectname": "image-builder", "vendor": "Fedora Project COPR (@osbuild/image-builder)" } } ] } [2026-09-15 14:47:58,649][ INFO][PID:1777369] Sending fedora-messaging bus message in build.end [2026-09-15 14:47:59,007][ INFO][PID:1777369] Compressing /var/lib/copr/public_html/results/@osbuild/image-builder/rhel-9-x86_64/10988175-image-builder/builder-live.log by gzip [2026-09-15 14:47:59,008][ INFO][PID:1777369] Running command 'gzip /var/lib/copr/public_html/results/@osbuild/image-builder/rhel-9-x86_64/10988175-image-builder/builder-live.log' as PID 2270642 [2026-09-15 14:47:59,008][ INFO][PID:1777369] Finished after 0 seconds with exit code 1 (gzip /var/lib/copr/public_html/results/@osbuild/image-builder/rhel-9-x86_64/10988175-image-builder/builder-live.log) stdout: stderr: gzip: /var/lib/copr/public_html/results/@osbuild/image-builder/rhel-9-x86_64/10988175-image-builder/builder-live.log: No such file or directory [2026-09-15 14:47:59,009][ ERROR][PID:1777369] Unable to compress file /var/lib/copr/public_html/results/@osbuild/image-builder/rhel-9-x86_64/10988175-image-builder/builder-live.log [2026-09-15 14:47:59,014][ INFO][PID:1777369] Compressing /var/lib/copr/public_html/results/@osbuild/image-builder/rhel-9-x86_64/10988175-image-builder/backend.log by gzip [2026-09-15 14:47:59,015][ INFO][PID:1777369] Running command 'gzip /var/lib/copr/public_html/results/@osbuild/image-builder/rhel-9-x86_64/10988175-image-builder/backend.log' as PID 2270643