[2026-04-20 13:17:46,276][  INFO][PID:1961701] Marking build as starting
[2026-04-20 13:17:46,982][  INFO][PID:1961701] Checking that /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-44-ppc64le/repodata/repomd.xml exists
[2026-04-20 13:17:46,989][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:17:46,989][  INFO][PID:1961701] VM allocation process starts
[2026-04-20 13:17:47,013][  INFO][PID:1961701] Trying to allocate VM: ResallocHost, ticket_id=2421891, requested_tags=['arch_ppc64le', 'copr_builder']
[2026-04-20 13:17:52,015][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:17:53,056][  INFO][PID:1961701] Allocated host ResallocHost, ticket_id=2421891, hostname=2620:52:6:1161:dead:beef:cafe:c14f, name=vmhost_p09_03_prod_07098595_20260420_104525, requested_tags=['arch_ppc64le', 'copr_builder']
[2026-04-20 13:17:53,057][  INFO][PID:1961701] Allocating ssh connection to builder
[2026-04-20 13:17:53,057][  INFO][PID:1961701] Checking that builder machine is OK
[2026-04-20 13:17:54,021][  INFO][PID:1961701] Installed copr-rpmbuild version: 1.8
[2026-04-20 13:17:54,022][  INFO][PID:1961701] Running remote command: copr-builder-ready fedora-44-ppc64le
[2026-04-20 13:17:54,603][  INFO][PID:1961701] Red Hat subscription not needed for fedora-44-ppc64le
Builder is ready to be used

[2026-04-20 13:17:54,604][  INFO][PID:1961701] Filling build.info file with builder info
[2026-04-20 13:17:54,604][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:17:54,605][  INFO][PID:1961701] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@osbuild",
            "project_name": "osbuild-composer",
            "project_dirname": "osbuild-composer",
            "submitter": "packit",
            "ended_on": null,
            "started_on": 1776691074.6054463,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-44-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "10348571-fedora-44-ppc64le",
            "build_id": 10348571,
            "package_name": "osbuild-composer",
            "package_version": "169-1.20260420131710720793.main.5.g2414f89f9",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@osbuild/osbuild-composer/osbuild-composer",
            "git_hash": "601f84c74abff0a1499af288559d7a2f27f82597",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@osbuild/osbuild-composer--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@osbuild/osbuild-composer/fedora-44-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@osbuild/osbuild-composer",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@osbuild/osbuild-composer",
            "result_dir": "10348571-osbuild-composer",
            "built_packages": "",
            "id": 10348571,
            "mockchain_macros": {
                "copr_username": "@osbuild",
                "copr_projectname": "osbuild-composer",
                "vendor": "Fedora Project COPR (@osbuild/osbuild-composer)"
            }
        }
    ]
}
[2026-04-20 13:17:54,675][  INFO][PID:1961701] Sending fedora-messaging bus message in build.start
[2026-04-20 13:17:55,291][  INFO][PID:1961701] Sending fedora-messaging bus message in chroot.start
[2026-04-20 13:17:55,320][  INFO][PID:1961701] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10348571-fedora-44-ppc64le --chroot fedora-44-ppc64le --detached
[2026-04-20 13:17:56,579][  INFO][PID:1961701] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c14f' (ED25519) to the list of known hosts.


[2026-04-20 13:17:56,580][  INFO][PID:1961701] Downloading the builder-live.log file, attempt 1
[2026-04-20 13:17:56,581][  INFO][PID:1961701] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c14f copr-rpmbuild-log
[2026-04-20 13:18:01,591][  INFO][PID:1961701] Periodic builder liveness probe: alive
[2026-04-20 13:18:01,594][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:18:06,594][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:18:11,596][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:18:16,598][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:18:21,599][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:18:26,602][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:18:31,604][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:18:36,605][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:18:41,606][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:18:46,610][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:18:51,614][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:18:56,616][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:19:01,617][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:19:06,619][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:19:11,620][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:19:16,622][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:19:21,625][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:19:26,627][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:19:31,665][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:19:36,668][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:19:41,671][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:19:46,673][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:19:51,675][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:19:56,677][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:20:01,680][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:20:06,681][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:20:11,690][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:20:16,691][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:20:21,693][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:20:26,697][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:20:31,698][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:20:36,704][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:20:41,707][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:20:46,762][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:20:51,765][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:20:56,777][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:21:01,778][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:21:06,790][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:21:11,795][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:21:16,800][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:21:21,803][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:21:26,811][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:21:31,813][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:21:36,823][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:21:41,825][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:21:46,838][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:21:51,840][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:21:56,845][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:22:01,850][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:22:06,856][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:22:11,859][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:22:16,863][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:22:21,865][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:22:26,866][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:22:31,868][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:22:36,876][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:22:41,878][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:22:46,883][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:22:51,888][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:22:56,907][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:23:01,909][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:23:06,940][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:23:11,942][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:23:16,944][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:23:21,947][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:23:26,957][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:23:31,958][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:23:36,968][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:23:41,972][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:23:46,974][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:23:51,976][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:23:57,500][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:24:02,501][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:24:07,504][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:24:12,506][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:24:17,509][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:24:22,513][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:24:27,517][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:24:32,519][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:24:37,565][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:24:42,590][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:24:47,591][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:24:52,638][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:24:57,640][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:25:02,784][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:25:07,792][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:25:12,797][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:25:17,799][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:25:22,808][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:25:27,814][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:25:32,978][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:25:37,981][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:25:42,983][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:25:47,989][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:25:52,997][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:25:57,998][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:26:03,209][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:26:08,214][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:26:13,226][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:26:18,227][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:26:23,228][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:26:28,230][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:26:33,231][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:26:38,233][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:26:43,238][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:26:48,240][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:26:53,245][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:26:58,250][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:27:03,254][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:27:08,272][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:27:13,280][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:27:18,335][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:27:23,342][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:27:28,355][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:27:33,371][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:27:38,454][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:27:43,455][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:27:48,457][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:27:53,466][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:27:58,573][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:28:03,617][  INFO][PID:1961701] Periodic builder liveness probe: alive
[2026-04-20 13:28:03,622][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:28:08,623][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:28:13,624][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:28:18,631][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:28:23,642][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:28:28,655][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:28:33,656][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:28:38,658][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:28:43,661][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:28:48,666][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:28:53,682][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:28:58,708][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:29:03,716][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:29:08,718][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:29:13,728][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:29:18,739][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:29:23,740][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:29:28,743][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:29:33,744][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:29:38,746][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:29:43,752][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:29:48,754][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:29:53,759][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:29:58,765][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:30:03,767][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:30:08,769][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:30:13,772][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:30:18,781][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:30:23,782][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:30:28,784][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:30:33,786][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:30:38,801][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:30:43,805][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:30:48,813][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:30:53,823][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:30:58,829][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:31:03,836][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:31:08,846][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:31:12,001][  INFO][PID:1961701] Downloading results from builder
[2026-04-20 13:31:12,002][  INFO][PID:1961701] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c14f]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-44-ppc64le/10348571-osbuild-composer started
[2026-04-20 13:31:12,006][  INFO][PID:1961701] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c14f]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-44-ppc64le/10348571-osbuild-composer/ &> /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-44-ppc64le/10348571-osbuild-composer/build-10348571.rsync.log
[2026-04-20 13:31:12,358][  INFO][PID:1961701] rsyncing finished.
[2026-04-20 13:31:12,360][ ERROR][PID:1961701] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-04-20 13:31:12,365][ ERROR][PID:1961701] SSH connection lost on #1 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-04-20 13:31:22,367][  INFO][PID:1961701] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c14f]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-44-ppc64le/10348571-osbuild-composer started
[2026-04-20 13:31:22,374][  INFO][PID:1961701] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c14f]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-44-ppc64le/10348571-osbuild-composer/ &> /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-44-ppc64le/10348571-osbuild-composer/build-10348571.rsync.log
[2026-04-20 13:31:22,825][  INFO][PID:1961701] rsyncing finished.
[2026-04-20 13:31:22,826][ ERROR][PID:1961701] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-04-20 13:31:22,826][ ERROR][PID:1961701] SSH connection lost on #2 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-04-20 13:31:32,827][  INFO][PID:1961701] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c14f]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-44-ppc64le/10348571-osbuild-composer started
[2026-04-20 13:31:32,832][  INFO][PID:1961701] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c14f]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-44-ppc64le/10348571-osbuild-composer/ &> /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-44-ppc64le/10348571-osbuild-composer/build-10348571.rsync.log
[2026-04-20 13:31:33,211][  INFO][PID:1961701] rsyncing finished.
[2026-04-20 13:31:33,213][ ERROR][PID:1961701] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-04-20 13:31:33,215][ ERROR][PID:1961701] SSH connection lost on #3 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-04-20 13:31:43,217][ ERROR][PID:1961701] Re-try request for task on 'ResallocHost, ticket_id=2421891, hostname=2620:52:6:1161:dead:beef:cafe:c14f, name=vmhost_p09_03_prod_07098595_20260420_104525, requested_tags=['arch_ppc64le', 'copr_builder']': Unable to finish after 3 SSH attempts
[2026-04-20 13:31:43,218][  INFO][PID:1961701] VM Release request
[2026-04-20 13:31:43,263][  INFO][PID:1961701] Retry #1 (on other host)
[2026-04-20 13:31:43,264][  INFO][PID:1961701] Checking that /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-44-ppc64le/repodata/repomd.xml exists
[2026-04-20 13:31:43,281][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:31:43,282][  INFO][PID:1961701] VM allocation process starts
[2026-04-20 13:31:43,294][  INFO][PID:1961701] Trying to allocate VM: ResallocHost, ticket_id=2422446, requested_tags=['arch_ppc64le', 'copr_builder']
[2026-04-20 13:31:48,298][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:31:53,306][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:31:58,312][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:32:01,366][  INFO][PID:1961701] Allocated host ResallocHost, ticket_id=2422446, hostname=2620:52:6:1161:dead:beef:cafe:c15a, name=vmhost_p09_02_prod_07112371_20260420_114354, requested_tags=['arch_ppc64le', 'copr_builder']
[2026-04-20 13:32:01,367][  INFO][PID:1961701] Allocating ssh connection to builder
[2026-04-20 13:32:01,367][  INFO][PID:1961701] Checking that builder machine is OK
[2026-04-20 13:32:01,699][ ERROR][PID:1961701] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c15a' (ED25519) to the list of known hosts.
Load key "/home/copr/.ssh/id_rsa": Permission denied
Permission denied, please try again.
Permission denied, please try again.
mockbuilder@2620:52:6:1161:dead:beef:cafe:c15a: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).

[2026-04-20 13:32:11,701][ ERROR][PID:1961701] Re-try request for task on 'ResallocHost, ticket_id=2422446, hostname=2620:52:6:1161:dead:beef:cafe:c15a, name=vmhost_p09_02_prod_07112371_20260420_114354, requested_tags=['arch_ppc64le', 'copr_builder']': Unable to finish after 1 SSH attempts
[2026-04-20 13:32:11,702][  INFO][PID:1961701] VM Release request
[2026-04-20 13:32:11,730][  INFO][PID:1961701] Retry #2 (on other host)
[2026-04-20 13:32:11,733][  INFO][PID:1961701] Checking that /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-44-ppc64le/repodata/repomd.xml exists
[2026-04-20 13:32:11,735][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:32:11,736][  INFO][PID:1961701] VM allocation process starts
[2026-04-20 13:32:11,771][  INFO][PID:1961701] Trying to allocate VM: ResallocHost, ticket_id=2422455, requested_tags=['arch_ppc64le', 'copr_builder']
[2026-04-20 13:32:16,772][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:32:21,774][  INFO][PID:1961701] Checking for cancel request
[2026-04-20 13:32:23,833][  INFO][PID:1961701] Allocated host ResallocHost, ticket_id=2422455, hostname=2620:52:6:1161:dead:beef:cafe:c16f, name=vmhost_p09_04_prod_07114192_20260420_115057, requested_tags=['arch_ppc64le', 'copr_builder']
[2026-04-20 13:32:23,834][  INFO][PID:1961701] Allocating ssh connection to builder
[2026-04-20 13:32:23,835][  INFO][PID:1961701] Checking that builder machine is OK
[2026-04-20 13:32:24,122][ ERROR][PID:1961701] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c16f' (ED25519) to the list of known hosts.
Load key "/home/copr/.ssh/id_rsa": Permission denied
Permission denied, please try again.
Permission denied, please try again.
mockbuilder@2620:52:6:1161:dead:beef:cafe:c16f: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).

[2026-04-20 13:32:34,127][ ERROR][PID:1961701] Re-try request for task on 'ResallocHost, ticket_id=2422455, hostname=2620:52:6:1161:dead:beef:cafe:c16f, name=vmhost_p09_04_prod_07114192_20260420_115057, requested_tags=['arch_ppc64le', 'copr_builder']': Unable to finish after 1 SSH attempts
[2026-04-20 13:32:34,128][  INFO][PID:1961701] VM Release request
[2026-04-20 13:32:34,142][ ERROR][PID:1961701] Backend process error: Three host tried without success: {'2620:52:6:1161:dead:beef:cafe:c16f', '2620:52:6:1161:dead:beef:cafe:c14f', '2620:52:6:1161:dead:beef:cafe:c15a'}
[2026-04-20 13:32:34,142][WARNING][PID:1961701] Switching not-finished job state to 'failed'
[2026-04-20 13:32:34,143][  INFO][PID:1961701] Worker failed build, took 879.537407875061
[2026-04-20 13:32:34,143][  INFO][PID:1961701] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@osbuild",
            "project_name": "osbuild-composer",
            "project_dirname": "osbuild-composer",
            "submitter": "packit",
            "ended_on": 1776691954.1428542,
            "started_on": 1776691074.6054463,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-44-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "10348571-fedora-44-ppc64le",
            "build_id": 10348571,
            "package_name": "osbuild-composer",
            "package_version": "169-1.20260420131710720793.main.5.g2414f89f9",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@osbuild/osbuild-composer/osbuild-composer",
            "git_hash": "601f84c74abff0a1499af288559d7a2f27f82597",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@osbuild/osbuild-composer--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@osbuild/osbuild-composer/fedora-44-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@osbuild/osbuild-composer",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@osbuild/osbuild-composer",
            "result_dir": "10348571-osbuild-composer",
            "built_packages": "",
            "id": 10348571,
            "mockchain_macros": {
                "copr_username": "@osbuild",
                "copr_projectname": "osbuild-composer",
                "vendor": "Fedora Project COPR (@osbuild/osbuild-composer)"
            }
        }
    ]
}
[2026-04-20 13:32:34,217][  INFO][PID:1961701] Sending fedora-messaging bus message in build.end
[2026-04-20 13:32:34,252][  INFO][PID:1961701] Compressing /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-44-ppc64le/10348571-osbuild-composer/builder-live.log by gzip
[2026-04-20 13:32:34,253][  INFO][PID:1961701] Running command 'gzip /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-44-ppc64le/10348571-osbuild-composer/builder-live.log' as PID 2157177
[2026-04-20 13:32:34,295][  INFO][PID:1961701] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-44-ppc64le/10348571-osbuild-composer/builder-live.log)
[2026-04-20 13:32:34,296][  INFO][PID:1961701] Compressing /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-44-ppc64le/10348571-osbuild-composer/backend.log by gzip
[2026-04-20 13:32:34,297][  INFO][PID:1961701] Running command 'gzip /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-44-ppc64le/10348571-osbuild-composer/backend.log' as PID 2157190