[2026-01-18 19:30:26,493][ INFO][PID:2229359] Marking build as starting [2026-01-18 19:30:26,621][ INFO][PID:2229359] Checking that /var/lib/copr/public_html/results/buckaroogeek/k8s-utils/fedora-43-ppc64le/repodata/repomd.xml exists [2026-01-18 19:30:26,690][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:30:26,693][ INFO][PID:2229359] VM allocation process starts [2026-01-18 19:30:26,715][ INFO][PID:2229359] Trying to allocate VM: ResallocHost, ticket_id=906219, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-18 19:30:31,719][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:30:36,720][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:30:41,723][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:30:46,726][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:30:51,732][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:30:56,733][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:31:01,736][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:31:06,738][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:31:11,739][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:31:16,741][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:31:21,747][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:31:26,763][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:31:31,764][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:31:36,765][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:31:41,766][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:31:46,767][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:31:51,768][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:31:56,769][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:32:01,771][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:32:06,772][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:32:11,774][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:32:16,775][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:32:21,776][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:32:26,825][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:32:31,827][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:32:36,828][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:32:41,829][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:32:46,830][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:32:51,832][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:32:56,848][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:33:01,868][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:33:06,931][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:33:11,944][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:33:16,976][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:33:21,997][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:33:27,001][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:33:32,002][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:33:37,003][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:33:42,004][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:33:44,901][ INFO][PID:2229359] Allocated host ResallocHost, ticket_id=906219, hostname=2620:52:6:1161:dead:beef:cafe:c109, name=vmhost_p09_02_prod_01371575_20260118_192836, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-18 19:33:44,902][ INFO][PID:2229359] Allocating ssh connection to builder [2026-01-18 19:33:44,902][ INFO][PID:2229359] Checking that builder machine is OK [2026-01-18 19:34:44,971][ ERROR][PID:2229359] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c109 port 22: Connection timed out [2026-01-18 19:34:54,972][ ERROR][PID:2229359] Re-try request for task on 'ResallocHost, ticket_id=906219, hostname=2620:52:6:1161:dead:beef:cafe:c109, name=vmhost_p09_02_prod_01371575_20260118_192836, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts [2026-01-18 19:34:54,973][ INFO][PID:2229359] Releasing VM back to pool [2026-01-18 19:34:54,982][ INFO][PID:2229359] Retry #1 (on other host) [2026-01-18 19:34:54,982][ INFO][PID:2229359] Checking that /var/lib/copr/public_html/results/buckaroogeek/k8s-utils/fedora-43-ppc64le/repodata/repomd.xml exists [2026-01-18 19:34:54,983][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:34:54,984][ INFO][PID:2229359] VM allocation process starts [2026-01-18 19:34:55,022][ INFO][PID:2229359] Trying to allocate VM: ResallocHost, ticket_id=906234, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-18 19:34:58,123][ INFO][PID:2229359] Allocated host ResallocHost, ticket_id=906234, hostname=2620:52:6:1161:dead:beef:cafe:c113, name=vmhost_p09_02_prod_01371505_20260118_192415, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-18 19:34:58,124][ INFO][PID:2229359] Allocating ssh connection to builder [2026-01-18 19:34:58,124][ INFO][PID:2229359] Checking that builder machine is OK [2026-01-18 19:35:58,193][ ERROR][PID:2229359] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c113 port 22: Connection timed out [2026-01-18 19:36:08,194][ ERROR][PID:2229359] Re-try request for task on 'ResallocHost, ticket_id=906234, hostname=2620:52:6:1161:dead:beef:cafe:c113, name=vmhost_p09_02_prod_01371505_20260118_192415, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts [2026-01-18 19:36:08,194][ INFO][PID:2229359] Releasing VM back to pool [2026-01-18 19:36:08,204][ INFO][PID:2229359] Retry #2 (on other host) [2026-01-18 19:36:08,204][ INFO][PID:2229359] Checking that /var/lib/copr/public_html/results/buckaroogeek/k8s-utils/fedora-43-ppc64le/repodata/repomd.xml exists [2026-01-18 19:36:08,205][ INFO][PID:2229359] Checking for cancel request [2026-01-18 19:36:08,206][ INFO][PID:2229359] VM allocation process starts [2026-01-18 19:36:08,273][ INFO][PID:2229359] Trying to allocate VM: ResallocHost, ticket_id=906238, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-18 19:36:11,310][ INFO][PID:2229359] Allocated host ResallocHost, ticket_id=906238, hostname=2620:52:6:1161:dead:beef:cafe:c150, name=vmhost_p09_03_prod_01371525_20260118_192512, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-18 19:36:11,311][ INFO][PID:2229359] Allocating ssh connection to builder [2026-01-18 19:36:11,311][ INFO][PID:2229359] Checking that builder machine is OK [2026-01-18 19:36:12,244][ INFO][PID:2229359] Running remote command: copr-builder-ready fedora-43-ppc64le [2026-01-18 19:37:12,253][ ERROR][PID:2229359] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c150 port 22: Connection timed out [2026-01-18 19:37:22,254][ ERROR][PID:2229359] Re-try request for task on 'ResallocHost, ticket_id=906238, hostname=2620:52:6:1161:dead:beef:cafe:c150, name=vmhost_p09_03_prod_01371525_20260118_192512, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts [2026-01-18 19:37:22,255][ INFO][PID:2229359] Releasing VM back to pool [2026-01-18 19:37:22,263][ ERROR][PID:2229359] Backend process error: Three host tried without success: {'2620:52:6:1161:dead:beef:cafe:c113', '2620:52:6:1161:dead:beef:cafe:c109', '2620:52:6:1161:dead:beef:cafe:c150'} [2026-01-18 19:37:22,264][WARNING][PID:2229359] Switching not-finished job state to 'failed' [2026-01-18 19:37:22,264][ INFO][PID:2229359] Worker failed build, took 415.8585555553436 [2026-01-18 19:37:22,265][ INFO][PID:2229359] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "buckaroogeek", "project_name": "k8s-utils", "project_dirname": "k8s-utils", "submitter": "buckaroogeek", "ended_on": 1768765042.2643104, "started_on": 1768764626.4057548, "submitted_on": null, "status": 0, "chroot": "fedora-43-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10033552-fedora-43-ppc64le", "build_id": 10033552, "package_name": "kompose", "package_version": "1.38.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/buckaroogeek/k8s-utils/kompose", "git_hash": "6391474b3a7f24de27c959c95ab247fba2a629a4", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "buckaroogeek/k8s-utils--buckaroogeek", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/buckaroogeek/k8s-utils/fedora-43-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/buckaroogeek/k8s-utils", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/buckaroogeek/k8s-utils", "result_dir": "10033552-kompose", "built_packages": "", "id": 10033552, "mockchain_macros": { "copr_username": "buckaroogeek", "copr_projectname": "k8s-utils", "vendor": "Fedora Project COPR (buckaroogeek/k8s-utils)" } } ] } [2026-01-18 19:37:22,325][ INFO][PID:2229359] Sending fedora-messaging bus message in build.end [2026-01-18 19:37:22,865][ INFO][PID:2229359] Compressing /var/lib/copr/public_html/results/buckaroogeek/k8s-utils/fedora-43-ppc64le/10033552-kompose/builder-live.log by gzip [2026-01-18 19:37:22,867][ INFO][PID:2229359] Running command 'gzip /var/lib/copr/public_html/results/buckaroogeek/k8s-utils/fedora-43-ppc64le/10033552-kompose/builder-live.log' as PID 2270775 [2026-01-18 19:37:22,868][ INFO][PID:2229359] Finished after 0 seconds with exit code 1 (gzip /var/lib/copr/public_html/results/buckaroogeek/k8s-utils/fedora-43-ppc64le/10033552-kompose/builder-live.log) stdout: stderr: gzip: /var/lib/copr/public_html/results/buckaroogeek/k8s-utils/fedora-43-ppc64le/10033552-kompose/builder-live.log: No such file or directory [2026-01-18 19:37:22,868][ ERROR][PID:2229359] Unable to compress file /var/lib/copr/public_html/results/buckaroogeek/k8s-utils/fedora-43-ppc64le/10033552-kompose/builder-live.log [2026-01-18 19:37:22,869][ INFO][PID:2229359] Compressing /var/lib/copr/public_html/results/buckaroogeek/k8s-utils/fedora-43-ppc64le/10033552-kompose/backend.log by gzip [2026-01-18 19:37:22,870][ INFO][PID:2229359] Running command 'gzip /var/lib/copr/public_html/results/buckaroogeek/k8s-utils/fedora-43-ppc64le/10033552-kompose/backend.log' as PID 2270777