[2026-04-20 13:17:48,014][  INFO][PID:1961776] Marking build as starting
[2026-04-20 13:17:48,137][  INFO][PID:1961776] Checking that /var/lib/copr/public_html/results/@osbuild/osbuild-composer/rhel-9-x86_64/repodata/repomd.xml exists
[2026-04-20 13:17:48,198][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:17:48,199][  INFO][PID:1961776] VM allocation process starts
[2026-04-20 13:17:48,250][  INFO][PID:1961776] Trying to allocate VM: ResallocHost, ticket_id=2421923, requested_tags=['arch_x86_64', 'copr_builder']
[2026-04-20 13:17:53,252][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:17:58,255][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:18:00,322][  INFO][PID:1961776] Allocated host ResallocHost, ticket_id=2421923, hostname=34.238.156.57, name=aws_x86_64_normal_prod_07115850_20260420_120804, requested_tags=['arch_x86_64', 'copr_builder']
[2026-04-20 13:18:00,324][  INFO][PID:1961776] Allocating ssh connection to builder
[2026-04-20 13:18:00,325][  INFO][PID:1961776] Checking that builder machine is OK
[2026-04-20 13:18:00,770][  INFO][PID:1961776] Installed copr-rpmbuild version: 1.8
[2026-04-20 13:18:00,775][  INFO][PID:1961776] Running remote command: copr-builder-ready rhel-9-x86_64
[2026-04-20 13:18:01,042][  INFO][PID:1961776] Checking Red Hat subscription (attempt #1)
Red Hat subscription active
Builder is ready to be used

[2026-04-20 13:18:01,044][  INFO][PID:1961776] Filling build.info file with builder info
[2026-04-20 13:18:01,045][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:18:01,047][  INFO][PID:1961776] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@osbuild",
            "project_name": "osbuild-composer",
            "project_dirname": "osbuild-composer",
            "submitter": "packit",
            "ended_on": null,
            "started_on": 1776691081.0477514,
            "submitted_on": null,
            "status": 3,
            "chroot": "rhel-9-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "10348571-rhel-9-x86_64",
            "build_id": 10348571,
            "package_name": "osbuild-composer",
            "package_version": "169-1.20260420131710720793.main.5.g2414f89f9",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@osbuild/osbuild-composer/osbuild-composer",
            "git_hash": "e2cc65c4f7a12dc5cecae3d3cc8465e71f9651c6",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@osbuild/osbuild-composer--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@osbuild/osbuild-composer/rhel-9-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@osbuild/osbuild-composer",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@osbuild/osbuild-composer",
            "result_dir": "10348571-osbuild-composer",
            "built_packages": "",
            "id": 10348571,
            "mockchain_macros": {
                "copr_username": "@osbuild",
                "copr_projectname": "osbuild-composer",
                "vendor": "Fedora Project COPR (@osbuild/osbuild-composer)"
            }
        }
    ]
}
[2026-04-20 13:18:01,135][  INFO][PID:1961776] Sending fedora-messaging bus message in build.start
[2026-04-20 13:18:02,035][  INFO][PID:1961776] Sending fedora-messaging bus message in chroot.start
[2026-04-20 13:18:02,099][  INFO][PID:1961776] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10348571-rhel-9-x86_64 --chroot rhel-9-x86_64 --detached
[2026-04-20 13:18:02,644][  INFO][PID:1961776] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '34.238.156.57' (ED25519) to the list of known hosts.


[2026-04-20 13:18:02,648][  INFO][PID:1961776] Downloading the builder-live.log file, attempt 1
[2026-04-20 13:18:02,651][  INFO][PID:1961776] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@34.238.156.57 copr-rpmbuild-log
[2026-04-20 13:18:07,657][  INFO][PID:1961776] Periodic builder liveness probe: alive
[2026-04-20 13:18:07,658][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:18:12,659][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:18:17,660][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:18:22,663][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:18:27,666][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:18:32,668][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:18:37,671][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:18:42,673][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:18:47,678][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:18:52,680][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:18:57,681][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:19:02,682][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:19:07,684][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:19:12,687][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:19:17,689][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:19:22,690][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:19:27,691][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:19:32,693][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:19:37,694][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:19:42,695][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:19:47,696][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:19:52,698][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:19:57,699][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:20:02,704][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:20:07,706][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:20:12,712][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:20:17,715][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:20:22,718][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:20:27,722][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:20:32,746][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:20:37,749][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:20:42,767][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:20:47,768][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:20:52,773][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:20:57,778][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:21:02,783][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:21:07,792][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:21:12,807][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:21:17,830][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:21:22,838][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:21:27,841][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:21:32,850][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:21:37,859][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:21:42,871][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:21:47,880][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:21:52,885][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:21:57,902][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:22:02,904][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:22:07,910][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:22:12,914][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:22:17,917][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:22:22,919][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:22:27,922][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:22:32,924][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:22:37,925][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:22:42,929][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:22:47,931][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:22:53,017][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:22:58,019][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:23:03,025][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:23:08,026][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:23:13,033][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:23:18,036][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:23:23,038][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:23:28,097][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:23:33,098][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:23:38,099][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:23:43,102][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:23:48,106][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:23:53,109][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:23:58,112][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:24:03,115][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:24:08,116][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:24:13,122][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:24:18,127][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:24:23,132][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:24:28,135][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:24:33,136][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:24:38,138][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:24:43,139][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:24:48,144][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:24:53,193][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:24:58,196][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:25:03,199][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:25:08,202][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:25:13,205][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:25:18,210][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:25:23,216][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:25:28,217][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:25:33,219][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:25:38,220][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:25:43,222][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:25:48,229][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:25:53,232][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:25:58,233][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:26:03,235][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:26:08,240][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:26:13,252][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:26:18,253][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:26:23,254][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:26:28,256][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:26:33,258][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:26:38,260][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:26:43,263][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:26:48,265][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:26:53,272][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:26:58,275][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:27:03,277][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:27:08,291][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:27:13,294][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:27:18,421][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:27:23,423][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:27:28,436][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:27:33,442][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:27:38,443][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:27:43,575][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:27:48,577][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:27:53,581][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:27:58,583][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:28:03,599][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:28:08,619][  INFO][PID:1961776] Periodic builder liveness probe: alive
[2026-04-20 13:28:08,619][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:28:13,621][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:28:18,656][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:28:23,666][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:28:28,670][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:28:33,672][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:28:38,673][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:28:43,675][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:28:48,680][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:28:53,693][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:28:58,737][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:29:03,739][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:29:08,744][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:29:13,749][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:29:18,754][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:29:23,756][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:29:28,759][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:29:33,761][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:29:38,763][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:29:43,772][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:29:48,774][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:29:53,781][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:29:58,782][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:30:03,784][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:30:08,788][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:30:13,792][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:30:18,797][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:30:23,799][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:30:26,348][  INFO][PID:1961776] Downloading results from builder
[2026-04-20 13:30:26,350][  INFO][PID:1961776] rsyncing of mockbuilder@34.238.156.57:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@osbuild/osbuild-composer/rhel-9-x86_64/10348571-osbuild-composer started
[2026-04-20 13:30:26,354][  INFO][PID:1961776] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@34.238.156.57:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@osbuild/osbuild-composer/rhel-9-x86_64/10348571-osbuild-composer/ &> /var/lib/copr/public_html/results/@osbuild/osbuild-composer/rhel-9-x86_64/10348571-osbuild-composer/build-10348571.rsync.log
[2026-04-20 13:30:26,639][  INFO][PID:1961776] rsyncing finished.
[2026-04-20 13:30:26,640][ ERROR][PID:1961776] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-04-20 13:30:26,640][ ERROR][PID:1961776] SSH connection lost on #1 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-04-20 13:30:36,644][  INFO][PID:1961776] rsyncing of mockbuilder@34.238.156.57:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@osbuild/osbuild-composer/rhel-9-x86_64/10348571-osbuild-composer started
[2026-04-20 13:30:36,650][  INFO][PID:1961776] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@34.238.156.57:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@osbuild/osbuild-composer/rhel-9-x86_64/10348571-osbuild-composer/ &> /var/lib/copr/public_html/results/@osbuild/osbuild-composer/rhel-9-x86_64/10348571-osbuild-composer/build-10348571.rsync.log
[2026-04-20 13:30:36,952][  INFO][PID:1961776] rsyncing finished.
[2026-04-20 13:30:36,954][ ERROR][PID:1961776] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-04-20 13:30:36,957][ ERROR][PID:1961776] SSH connection lost on #2 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-04-20 13:30:46,962][  INFO][PID:1961776] rsyncing of mockbuilder@34.238.156.57:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@osbuild/osbuild-composer/rhel-9-x86_64/10348571-osbuild-composer started
[2026-04-20 13:30:46,977][  INFO][PID:1961776] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@34.238.156.57:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@osbuild/osbuild-composer/rhel-9-x86_64/10348571-osbuild-composer/ &> /var/lib/copr/public_html/results/@osbuild/osbuild-composer/rhel-9-x86_64/10348571-osbuild-composer/build-10348571.rsync.log
[2026-04-20 13:30:47,580][  INFO][PID:1961776] rsyncing finished.
[2026-04-20 13:30:47,581][ ERROR][PID:1961776] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-04-20 13:30:47,583][ ERROR][PID:1961776] SSH connection lost on #3 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-04-20 13:30:57,591][ ERROR][PID:1961776] Re-try request for task on 'ResallocHost, ticket_id=2421923, hostname=34.238.156.57, name=aws_x86_64_normal_prod_07115850_20260420_120804, requested_tags=['arch_x86_64', 'copr_builder']': Unable to finish after 3 SSH attempts
[2026-04-20 13:30:57,592][  INFO][PID:1961776] VM Release request
[2026-04-20 13:30:57,627][  INFO][PID:1961776] Retry #1 (on other host)
[2026-04-20 13:30:57,629][  INFO][PID:1961776] Checking that /var/lib/copr/public_html/results/@osbuild/osbuild-composer/rhel-9-x86_64/repodata/repomd.xml exists
[2026-04-20 13:30:57,633][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:30:57,636][  INFO][PID:1961776] VM allocation process starts
[2026-04-20 13:30:57,654][  INFO][PID:1961776] Trying to allocate VM: ResallocHost, ticket_id=2422431, requested_tags=['arch_x86_64', 'copr_builder']
[2026-04-20 13:31:02,658][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:31:07,659][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:31:12,663][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:31:17,670][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:31:22,674][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:31:27,679][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:31:32,681][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:31:37,682][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:31:42,683][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:31:47,684][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:31:52,686][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:31:57,688][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:32:02,689][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:32:07,694][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:32:12,695][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:32:17,698][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:32:22,700][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:32:27,702][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:32:32,704][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:32:37,715][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:32:42,716][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:32:47,720][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:32:52,723][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:32:57,726][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:33:02,730][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:33:07,735][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:33:12,750][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:33:17,753][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:33:22,756][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:33:27,759][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:33:32,764][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:33:37,775][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:33:42,777][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:33:47,787][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:33:52,788][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:33:57,799][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:34:02,804][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:34:07,807][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:34:12,808][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:34:15,957][  INFO][PID:1961776] Allocated host ResallocHost, ticket_id=2422431, hostname=32.192.24.79, name=aws_x86_64_normalreserved_prod_07132434_20260420_133144, requested_tags=['arch_x86_64', 'copr_builder']
[2026-04-20 13:34:15,960][  INFO][PID:1961776] Allocating ssh connection to builder
[2026-04-20 13:34:15,963][  INFO][PID:1961776] Checking that builder machine is OK
[2026-04-20 13:34:16,114][ ERROR][PID:1961776] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
Warning: Permanently added '32.192.24.79' (ED25519) to the list of known hosts.
Load key "/home/copr/.ssh/id_rsa": Permission denied
Permission denied, please try again.
Permission denied, please try again.
mockbuilder@32.192.24.79: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).

[2026-04-20 13:34:26,115][ ERROR][PID:1961776] Re-try request for task on 'ResallocHost, ticket_id=2422431, hostname=32.192.24.79, name=aws_x86_64_normalreserved_prod_07132434_20260420_133144, requested_tags=['arch_x86_64', 'copr_builder']': Unable to finish after 1 SSH attempts
[2026-04-20 13:34:26,141][  INFO][PID:1961776] VM Release request
[2026-04-20 13:34:26,191][  INFO][PID:1961776] Retry #2 (on other host)
[2026-04-20 13:34:26,193][  INFO][PID:1961776] Checking that /var/lib/copr/public_html/results/@osbuild/osbuild-composer/rhel-9-x86_64/repodata/repomd.xml exists
[2026-04-20 13:34:26,262][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:34:26,263][  INFO][PID:1961776] VM allocation process starts
[2026-04-20 13:34:26,321][  INFO][PID:1961776] Trying to allocate VM: ResallocHost, ticket_id=2422560, requested_tags=['arch_x86_64', 'copr_builder']
[2026-04-20 13:34:31,325][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:34:36,350][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:34:41,352][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:34:46,353][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:34:51,356][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:34:56,360][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:35:01,362][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:35:06,366][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:35:11,376][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:35:16,377][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:35:21,399][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:35:26,408][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:35:31,414][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:35:36,422][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:35:41,436][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:35:46,445][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:35:51,455][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:35:56,464][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:36:01,465][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:36:06,472][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:36:11,478][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:36:16,482][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:36:21,486][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:36:26,504][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:36:31,505][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:36:36,508][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:36:41,524][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:36:46,531][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:36:51,536][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:36:56,542][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:37:01,553][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:37:06,562][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:37:11,573][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:37:16,576][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:37:21,585][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:37:26,597][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:37:31,602][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:37:36,610][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:37:41,627][  INFO][PID:1961776] Checking for cancel request
[2026-04-20 13:37:44,855][  INFO][PID:1961776] Allocated host ResallocHost, ticket_id=2422560, hostname=34.226.249.39, name=aws_x86_64_normalreserved_prod_07132597_20260420_133427, requested_tags=['arch_x86_64', 'copr_builder']
[2026-04-20 13:37:44,856][  INFO][PID:1961776] Allocating ssh connection to builder
[2026-04-20 13:37:44,858][  INFO][PID:1961776] Checking that builder machine is OK
[2026-04-20 13:37:45,104][ ERROR][PID:1961776] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
Warning: Permanently added '34.226.249.39' (ED25519) to the list of known hosts.
Load key "/home/copr/.ssh/id_rsa": Permission denied
Permission denied, please try again.
Permission denied, please try again.
mockbuilder@34.226.249.39: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).

[2026-04-20 13:37:55,108][ ERROR][PID:1961776] Re-try request for task on 'ResallocHost, ticket_id=2422560, hostname=34.226.249.39, name=aws_x86_64_normalreserved_prod_07132597_20260420_133427, requested_tags=['arch_x86_64', 'copr_builder']': Unable to finish after 1 SSH attempts
[2026-04-20 13:37:55,111][  INFO][PID:1961776] VM Release request
[2026-04-20 13:37:55,172][ ERROR][PID:1961776] Backend process error: Three host tried without success: {'34.226.249.39', '32.192.24.79', '34.238.156.57'}
[2026-04-20 13:37:55,184][WARNING][PID:1961776] Switching not-finished job state to 'failed'
[2026-04-20 13:37:55,185][  INFO][PID:1961776] Worker failed build, took 1194.1362607479095
[2026-04-20 13:37:55,186][  INFO][PID:1961776] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@osbuild",
            "project_name": "osbuild-composer",
            "project_dirname": "osbuild-composer",
            "submitter": "packit",
            "ended_on": 1776692275.1840122,
            "started_on": 1776691081.0477514,
            "submitted_on": null,
            "status": 0,
            "chroot": "rhel-9-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "10348571-rhel-9-x86_64",
            "build_id": 10348571,
            "package_name": "osbuild-composer",
            "package_version": "169-1.20260420131710720793.main.5.g2414f89f9",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@osbuild/osbuild-composer/osbuild-composer",
            "git_hash": "e2cc65c4f7a12dc5cecae3d3cc8465e71f9651c6",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@osbuild/osbuild-composer--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@osbuild/osbuild-composer/rhel-9-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@osbuild/osbuild-composer",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@osbuild/osbuild-composer",
            "result_dir": "10348571-osbuild-composer",
            "built_packages": "",
            "id": 10348571,
            "mockchain_macros": {
                "copr_username": "@osbuild",
                "copr_projectname": "osbuild-composer",
                "vendor": "Fedora Project COPR (@osbuild/osbuild-composer)"
            }
        }
    ]
}
[2026-04-20 13:37:55,398][  INFO][PID:1961776] Sending fedora-messaging bus message in build.end
[2026-04-20 13:37:55,564][  INFO][PID:1961776] Compressing /var/lib/copr/public_html/results/@osbuild/osbuild-composer/rhel-9-x86_64/10348571-osbuild-composer/builder-live.log by gzip
[2026-04-20 13:37:55,567][  INFO][PID:1961776] Running command 'gzip /var/lib/copr/public_html/results/@osbuild/osbuild-composer/rhel-9-x86_64/10348571-osbuild-composer/builder-live.log' as PID 2231477
[2026-04-20 13:37:56,060][  INFO][PID:1961776] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@osbuild/osbuild-composer/rhel-9-x86_64/10348571-osbuild-composer/builder-live.log)
[2026-04-20 13:37:56,061][  INFO][PID:1961776] Compressing /var/lib/copr/public_html/results/@osbuild/osbuild-composer/rhel-9-x86_64/10348571-osbuild-composer/backend.log by gzip
[2026-04-20 13:37:56,068][  INFO][PID:1961776] Running command 'gzip /var/lib/copr/public_html/results/@osbuild/osbuild-composer/rhel-9-x86_64/10348571-osbuild-composer/backend.log' as PID 2231615