[2026-04-20 13:17:47,941][  INFO][PID:1961800] Marking build as starting
[2026-04-20 13:17:48,059][  INFO][PID:1961800] Checking that /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-42-ppc64le/repodata/repomd.xml exists
[2026-04-20 13:17:48,110][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:17:48,111][  INFO][PID:1961800] VM allocation process starts
[2026-04-20 13:17:48,143][  INFO][PID:1961800] Trying to allocate VM: ResallocHost, ticket_id=2421920, requested_tags=['arch_ppc64le', 'copr_builder']
[2026-04-20 13:17:53,144][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:17:58,146][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:18:00,200][  INFO][PID:1961800] Allocated host ResallocHost, ticket_id=2421920, hostname=2620:52:6:1161:dead:beef:cafe:c177, name=vmhost_p09_02_prod_07098965_20260420_104653, requested_tags=['arch_ppc64le', 'copr_builder']
[2026-04-20 13:18:00,201][  INFO][PID:1961800] Allocating ssh connection to builder
[2026-04-20 13:18:00,201][  INFO][PID:1961800] Checking that builder machine is OK
[2026-04-20 13:18:01,183][  INFO][PID:1961800] Installed copr-rpmbuild version: 1.8
[2026-04-20 13:18:01,187][  INFO][PID:1961800] Running remote command: copr-builder-ready fedora-42-ppc64le
[2026-04-20 13:18:01,844][  INFO][PID:1961800] Red Hat subscription not needed for fedora-42-ppc64le
Builder is ready to be used

[2026-04-20 13:18:01,845][  INFO][PID:1961800] Filling build.info file with builder info
[2026-04-20 13:18:01,846][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:18:01,850][  INFO][PID:1961800] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@osbuild",
            "project_name": "osbuild-composer",
            "project_dirname": "osbuild-composer",
            "submitter": "packit",
            "ended_on": null,
            "started_on": 1776691081.8500028,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-42-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "10348571-fedora-42-ppc64le",
            "build_id": 10348571,
            "package_name": "osbuild-composer",
            "package_version": "169-1.20260420131710720793.main.5.g2414f89f9",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@osbuild/osbuild-composer/osbuild-composer",
            "git_hash": "e2cc65c4f7a12dc5cecae3d3cc8465e71f9651c6",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@osbuild/osbuild-composer--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@osbuild/osbuild-composer/fedora-42-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@osbuild/osbuild-composer",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@osbuild/osbuild-composer",
            "result_dir": "10348571-osbuild-composer",
            "built_packages": "",
            "id": 10348571,
            "mockchain_macros": {
                "copr_username": "@osbuild",
                "copr_projectname": "osbuild-composer",
                "vendor": "Fedora Project COPR (@osbuild/osbuild-composer)"
            }
        }
    ]
}
[2026-04-20 13:18:01,999][  INFO][PID:1961800] Sending fedora-messaging bus message in build.start
[2026-04-20 13:18:03,529][  INFO][PID:1961800] Sending fedora-messaging bus message in chroot.start
[2026-04-20 13:18:03,583][  INFO][PID:1961800] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10348571-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached
[2026-04-20 13:18:04,808][  INFO][PID:1961800] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c177' (ED25519) to the list of known hosts.


[2026-04-20 13:18:04,813][  INFO][PID:1961800] Downloading the builder-live.log file, attempt 1
[2026-04-20 13:18:04,815][  INFO][PID:1961800] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c177 copr-rpmbuild-log
[2026-04-20 13:18:09,821][  INFO][PID:1961800] Periodic builder liveness probe: alive
[2026-04-20 13:18:09,823][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:18:14,824][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:18:19,825][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:18:24,834][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:18:29,836][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:18:34,837][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:18:39,839][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:18:44,842][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:18:49,851][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:18:54,852][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:18:59,854][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:19:04,855][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:19:09,856][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:19:14,857][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:19:19,860][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:19:24,864][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:19:29,866][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:19:34,870][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:19:39,873][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:19:44,874][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:19:49,876][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:19:54,877][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:19:59,884][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:20:04,897][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:20:09,906][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:20:14,908][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:20:19,910][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:20:24,915][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:20:29,949][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:20:34,951][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:20:39,955][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:20:44,962][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:20:49,963][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:20:54,969][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:20:59,980][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:21:04,982][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:21:09,985][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:21:14,993][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:21:19,995][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:21:24,999][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:21:30,004][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:21:35,009][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:21:40,012][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:21:45,016][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:21:50,020][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:21:55,024][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:22:00,026][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:22:05,030][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:22:10,033][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:22:15,038][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:22:20,040][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:22:25,042][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:22:30,043][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:22:35,048][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:22:40,050][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:22:45,052][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:22:50,056][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:22:55,116][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:23:00,119][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:23:05,121][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:23:10,123][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:23:15,127][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:23:20,129][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:23:25,131][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:23:30,172][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:23:35,173][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:23:40,174][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:23:45,176][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:23:50,190][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:23:55,192][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:24:00,195][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:24:05,197][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:24:10,199][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:24:15,207][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:24:20,217][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:24:25,221][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:24:30,223][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:24:35,230][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:24:40,240][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:24:45,247][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:24:50,325][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:24:55,327][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:25:00,334][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:25:05,335][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:25:10,337][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:25:15,338][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:25:20,345][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:25:25,346][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:25:30,351][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:25:35,353][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:25:40,354][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:25:45,357][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:25:50,358][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:25:55,359][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:26:00,360][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:26:05,364][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:26:10,370][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:26:15,371][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:26:20,372][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:26:25,378][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:26:30,380][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:26:35,381][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:26:40,385][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:26:45,389][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:26:50,394][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:26:55,395][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:27:00,397][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:27:05,399][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:27:10,401][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:27:15,403][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:27:20,414][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:27:25,458][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:27:30,510][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:27:35,513][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:27:40,517][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:27:45,522][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:27:50,528][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:27:55,533][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:28:00,606][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:28:05,609][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:28:10,624][  INFO][PID:1961800] Periodic builder liveness probe: alive
[2026-04-20 13:28:10,625][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:28:15,626][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:28:20,632][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:28:25,641][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:28:30,643][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:28:35,696][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:28:40,710][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:28:45,713][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:28:50,714][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:28:55,724][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:29:00,729][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:29:05,732][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:29:10,737][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:29:15,740][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:29:20,743][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:29:25,751][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:29:30,762][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:29:35,781][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:29:40,782][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:29:45,784][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:29:50,795][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:29:55,796][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:30:00,798][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:30:05,799][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:30:10,804][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:30:15,806][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:30:20,822][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:30:25,825][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:30:30,828][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:30:35,831][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:30:40,835][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:30:45,839][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:30:50,846][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:30:55,847][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:30:59,679][  INFO][PID:1961800] Downloading results from builder
[2026-04-20 13:30:59,680][  INFO][PID:1961800] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c177]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-42-ppc64le/10348571-osbuild-composer started
[2026-04-20 13:30:59,687][  INFO][PID:1961800] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c177]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-42-ppc64le/10348571-osbuild-composer/ &> /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-42-ppc64le/10348571-osbuild-composer/build-10348571.rsync.log
[2026-04-20 13:31:00,125][  INFO][PID:1961800] rsyncing finished.
[2026-04-20 13:31:00,126][ ERROR][PID:1961800] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-04-20 13:31:00,128][ ERROR][PID:1961800] SSH connection lost on #1 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-04-20 13:31:10,130][  INFO][PID:1961800] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c177]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-42-ppc64le/10348571-osbuild-composer started
[2026-04-20 13:31:10,134][  INFO][PID:1961800] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c177]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-42-ppc64le/10348571-osbuild-composer/ &> /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-42-ppc64le/10348571-osbuild-composer/build-10348571.rsync.log
[2026-04-20 13:31:10,602][  INFO][PID:1961800] rsyncing finished.
[2026-04-20 13:31:10,608][ ERROR][PID:1961800] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-04-20 13:31:10,610][ ERROR][PID:1961800] SSH connection lost on #2 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-04-20 13:31:20,617][  INFO][PID:1961800] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c177]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-42-ppc64le/10348571-osbuild-composer started
[2026-04-20 13:31:20,624][  INFO][PID:1961800] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c177]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-42-ppc64le/10348571-osbuild-composer/ &> /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-42-ppc64le/10348571-osbuild-composer/build-10348571.rsync.log
[2026-04-20 13:31:20,920][  INFO][PID:1961800] rsyncing finished.
[2026-04-20 13:31:20,924][ ERROR][PID:1961800] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-04-20 13:31:20,925][ ERROR][PID:1961800] SSH connection lost on #3 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-04-20 13:31:30,925][ ERROR][PID:1961800] Re-try request for task on 'ResallocHost, ticket_id=2421920, hostname=2620:52:6:1161:dead:beef:cafe:c177, name=vmhost_p09_02_prod_07098965_20260420_104653, requested_tags=['arch_ppc64le', 'copr_builder']': Unable to finish after 3 SSH attempts
[2026-04-20 13:31:30,929][  INFO][PID:1961800] VM Release request
[2026-04-20 13:31:30,957][  INFO][PID:1961800] Retry #1 (on other host)
[2026-04-20 13:31:30,959][  INFO][PID:1961800] Checking that /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-42-ppc64le/repodata/repomd.xml exists
[2026-04-20 13:31:31,046][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:31:31,055][  INFO][PID:1961800] VM allocation process starts
[2026-04-20 13:31:31,088][  INFO][PID:1961800] Trying to allocate VM: ResallocHost, ticket_id=2422439, requested_tags=['arch_ppc64le', 'copr_builder']
[2026-04-20 13:31:36,094][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:31:41,097][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:31:46,099][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:31:51,106][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:31:56,110][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:31:59,185][  INFO][PID:1961800] Allocated host ResallocHost, ticket_id=2422439, hostname=2620:52:6:1161:dead:beef:cafe:c15c, name=vmhost_p09_01_prod_07112090_20260420_114244, requested_tags=['arch_ppc64le', 'copr_builder']
[2026-04-20 13:31:59,186][  INFO][PID:1961800] Allocating ssh connection to builder
[2026-04-20 13:31:59,186][  INFO][PID:1961800] Checking that builder machine is OK
[2026-04-20 13:31:59,525][ ERROR][PID:1961800] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c15c' (ED25519) to the list of known hosts.
Load key "/home/copr/.ssh/id_rsa": Permission denied
Permission denied, please try again.
Permission denied, please try again.
mockbuilder@2620:52:6:1161:dead:beef:cafe:c15c: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).

[2026-04-20 13:32:09,526][ ERROR][PID:1961800] Re-try request for task on 'ResallocHost, ticket_id=2422439, hostname=2620:52:6:1161:dead:beef:cafe:c15c, name=vmhost_p09_01_prod_07112090_20260420_114244, requested_tags=['arch_ppc64le', 'copr_builder']': Unable to finish after 1 SSH attempts
[2026-04-20 13:32:09,528][  INFO][PID:1961800] VM Release request
[2026-04-20 13:32:09,544][  INFO][PID:1961800] Retry #2 (on other host)
[2026-04-20 13:32:09,545][  INFO][PID:1961800] Checking that /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-42-ppc64le/repodata/repomd.xml exists
[2026-04-20 13:32:09,546][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:32:09,547][  INFO][PID:1961800] VM allocation process starts
[2026-04-20 13:32:09,564][  INFO][PID:1961800] Trying to allocate VM: ResallocHost, ticket_id=2422454, requested_tags=['arch_ppc64le', 'copr_builder']
[2026-04-20 13:32:14,566][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:32:19,567][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:32:24,568][  INFO][PID:1961800] Checking for cancel request
[2026-04-20 13:32:27,669][  INFO][PID:1961800] Allocated host ResallocHost, ticket_id=2422454, hostname=2620:52:6:1161:dead:beef:cafe:c158, name=vmhost_p09_02_prod_07114155_20260420_115048, requested_tags=['arch_ppc64le', 'copr_builder']
[2026-04-20 13:32:27,670][  INFO][PID:1961800] Allocating ssh connection to builder
[2026-04-20 13:32:27,671][  INFO][PID:1961800] Checking that builder machine is OK
[2026-04-20 13:32:28,000][ ERROR][PID:1961800] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c158' (ED25519) to the list of known hosts.
Load key "/home/copr/.ssh/id_rsa": Permission denied
Permission denied, please try again.
Permission denied, please try again.
mockbuilder@2620:52:6:1161:dead:beef:cafe:c158: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).

[2026-04-20 13:32:38,002][ ERROR][PID:1961800] Re-try request for task on 'ResallocHost, ticket_id=2422454, hostname=2620:52:6:1161:dead:beef:cafe:c158, name=vmhost_p09_02_prod_07114155_20260420_115048, requested_tags=['arch_ppc64le', 'copr_builder']': Unable to finish after 1 SSH attempts
[2026-04-20 13:32:38,003][  INFO][PID:1961800] VM Release request
[2026-04-20 13:32:38,026][ ERROR][PID:1961800] Backend process error: Three host tried without success: {'2620:52:6:1161:dead:beef:cafe:c158', '2620:52:6:1161:dead:beef:cafe:c15c', '2620:52:6:1161:dead:beef:cafe:c177'}
[2026-04-20 13:32:38,028][WARNING][PID:1961800] Switching not-finished job state to 'failed'
[2026-04-20 13:32:38,029][  INFO][PID:1961800] Worker failed build, took 876.1788201332092
[2026-04-20 13:32:38,032][  INFO][PID:1961800] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@osbuild",
            "project_name": "osbuild-composer",
            "project_dirname": "osbuild-composer",
            "submitter": "packit",
            "ended_on": 1776691958.028823,
            "started_on": 1776691081.8500028,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-42-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "10348571-fedora-42-ppc64le",
            "build_id": 10348571,
            "package_name": "osbuild-composer",
            "package_version": "169-1.20260420131710720793.main.5.g2414f89f9",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@osbuild/osbuild-composer/osbuild-composer",
            "git_hash": "e2cc65c4f7a12dc5cecae3d3cc8465e71f9651c6",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@osbuild/osbuild-composer--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@osbuild/osbuild-composer/fedora-42-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@osbuild/osbuild-composer",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@osbuild/osbuild-composer",
            "result_dir": "10348571-osbuild-composer",
            "built_packages": "",
            "id": 10348571,
            "mockchain_macros": {
                "copr_username": "@osbuild",
                "copr_projectname": "osbuild-composer",
                "vendor": "Fedora Project COPR (@osbuild/osbuild-composer)"
            }
        }
    ]
}
[2026-04-20 13:32:38,233][  INFO][PID:1961800] Sending fedora-messaging bus message in build.end
[2026-04-20 13:32:38,314][  INFO][PID:1961800] Compressing /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-42-ppc64le/10348571-osbuild-composer/builder-live.log by gzip
[2026-04-20 13:32:38,318][  INFO][PID:1961800] Running command 'gzip /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-42-ppc64le/10348571-osbuild-composer/builder-live.log' as PID 2158770
[2026-04-20 13:32:38,443][  INFO][PID:1961800] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-42-ppc64le/10348571-osbuild-composer/builder-live.log)
[2026-04-20 13:32:38,444][  INFO][PID:1961800] Compressing /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-42-ppc64le/10348571-osbuild-composer/backend.log by gzip
[2026-04-20 13:32:38,450][  INFO][PID:1961800] Running command 'gzip /var/lib/copr/public_html/results/@osbuild/osbuild-composer/fedora-42-ppc64le/10348571-osbuild-composer/backend.log' as PID 2158798