[2026-04-20 13:17:47,940][  INFO][PID:1961793] Marking build as starting
[2026-04-20 13:17:48,120][  INFO][PID:1961793] Checking that /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-10-x86_64/repodata/repomd.xml exists
[2026-04-20 13:17:48,200][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:17:48,201][  INFO][PID:1961793] VM allocation process starts
[2026-04-20 13:17:48,280][  INFO][PID:1961793] Trying to allocate VM: ResallocHost, ticket_id=2421925, requested_tags=['arch_x86_64', 'copr_builder']
[2026-04-20 13:17:53,282][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:17:58,285][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:18:00,413][  INFO][PID:1961793] Allocated host ResallocHost, ticket_id=2421925, hostname=98.81.14.89, name=aws_x86_64_normal_prod_07115852_20260420_120804, requested_tags=['arch_x86_64', 'copr_builder']
[2026-04-20 13:18:00,415][  INFO][PID:1961793] Allocating ssh connection to builder
[2026-04-20 13:18:00,416][  INFO][PID:1961793] Checking that builder machine is OK
[2026-04-20 13:18:00,883][  INFO][PID:1961793] Installed copr-rpmbuild version: 1.8
[2026-04-20 13:18:00,888][  INFO][PID:1961793] Running remote command: copr-builder-ready centos-stream-10-x86_64
[2026-04-20 13:18:01,159][  INFO][PID:1961793] Red Hat subscription not needed for centos-stream-10-x86_64
Builder is ready to be used

[2026-04-20 13:18:01,162][  INFO][PID:1961793] Filling build.info file with builder info
[2026-04-20 13:18:01,163][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:18:01,172][  INFO][PID:1961793] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@osbuild",
            "project_name": "osbuild-composer",
            "project_dirname": "osbuild-composer",
            "submitter": "packit",
            "ended_on": null,
            "started_on": 1776691081.1725366,
            "submitted_on": null,
            "status": 3,
            "chroot": "centos-stream-10-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "10348571-centos-stream-10-x86_64",
            "build_id": 10348571,
            "package_name": "osbuild-composer",
            "package_version": "169-1.20260420131710720793.main.5.g2414f89f9",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@osbuild/osbuild-composer/osbuild-composer",
            "git_hash": "601f84c74abff0a1499af288559d7a2f27f82597",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@osbuild/osbuild-composer--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@osbuild/osbuild-composer/centos-stream-10-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@osbuild/osbuild-composer",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@osbuild/osbuild-composer",
            "result_dir": "10348571-osbuild-composer",
            "built_packages": "",
            "id": 10348571,
            "mockchain_macros": {
                "copr_username": "@osbuild",
                "copr_projectname": "osbuild-composer",
                "vendor": "Fedora Project COPR (@osbuild/osbuild-composer)"
            }
        }
    ]
}
[2026-04-20 13:18:01,282][  INFO][PID:1961793] Sending fedora-messaging bus message in build.start
[2026-04-20 13:18:02,364][  INFO][PID:1961793] Sending fedora-messaging bus message in chroot.start
[2026-04-20 13:18:02,436][  INFO][PID:1961793] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10348571-centos-stream-10-x86_64 --chroot centos-stream-10-x86_64 --detached
[2026-04-20 13:18:02,935][  INFO][PID:1961793] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '98.81.14.89' (ED25519) to the list of known hosts.


[2026-04-20 13:18:02,936][  INFO][PID:1961793] Downloading the builder-live.log file, attempt 1
[2026-04-20 13:18:02,953][  INFO][PID:1961793] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.81.14.89 copr-rpmbuild-log
[2026-04-20 13:18:07,949][  INFO][PID:1961793] Periodic builder liveness probe: alive
[2026-04-20 13:18:07,950][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:18:12,951][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:18:17,952][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:18:22,954][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:18:27,958][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:18:32,960][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:18:37,962][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:18:42,969][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:18:47,976][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:18:52,982][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:18:58,017][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:19:03,020][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:19:08,320][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:19:13,322][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:19:18,325][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:19:23,326][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:19:28,329][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:19:33,335][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:19:38,337][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:19:43,338][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:19:48,341][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:19:53,344][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:19:58,346][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:20:03,358][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:20:08,385][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:20:13,395][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:20:18,404][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:20:23,408][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:20:28,416][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:20:33,423][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:20:38,426][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:20:43,461][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:20:48,463][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:20:53,467][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:20:58,497][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:21:03,523][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:21:08,550][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:21:13,553][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:21:18,564][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:21:23,566][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:21:28,569][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:21:33,576][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:21:38,584][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:21:43,588][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:21:48,591][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:21:53,602][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:21:58,604][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:22:03,605][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:22:08,614][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:22:13,619][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:22:18,623][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:22:23,624][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:22:28,625][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:22:33,627][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:22:38,629][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:22:43,632][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:22:48,635][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:22:53,654][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:22:58,657][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:23:03,660][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:23:08,663][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:23:13,666][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:23:18,667][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:23:23,671][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:23:28,673][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:23:33,677][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:23:38,683][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:23:43,685][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:23:48,687][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:23:53,734][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:23:58,735][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:24:03,738][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:24:08,745][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:24:13,748][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:24:18,754][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:24:23,759][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:24:28,760][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:24:33,761][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:24:38,763][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:24:43,764][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:24:48,767][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:24:53,773][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:24:58,774][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:25:03,782][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:25:08,802][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:25:13,812][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:25:18,814][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:25:23,817][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:25:28,819][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:25:33,820][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:25:38,822][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:25:43,847][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:25:48,852][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:25:53,853][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:25:58,855][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:26:03,857][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:26:08,862][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:26:13,864][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:26:18,866][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:26:23,867][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:26:28,870][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:26:33,871][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:26:38,872][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:26:43,873][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:26:48,875][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:26:53,876][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:26:58,877][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:27:03,883][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:27:08,886][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:27:13,892][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:27:18,904][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:27:23,908][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:27:28,917][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:27:33,929][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:27:38,932][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:27:43,938][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:27:48,940][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:27:53,941][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:27:58,959][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:28:03,962][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:28:08,988][  INFO][PID:1961793] Periodic builder liveness probe: alive
[2026-04-20 13:28:08,988][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:28:13,990][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:28:19,004][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:28:24,013][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:28:29,026][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:28:34,034][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:28:39,036][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:28:44,038][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:28:49,049][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:28:54,055][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:28:59,063][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:29:04,068][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:29:09,075][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:29:14,087][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:29:19,101][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:29:24,114][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:29:29,130][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:29:34,143][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:29:39,145][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:29:44,150][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:29:49,162][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:29:54,166][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:29:59,172][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:30:04,173][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:30:09,177][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:30:14,179][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:30:19,184][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:30:21,935][  INFO][PID:1961793] Downloading results from builder
[2026-04-20 13:30:21,936][  INFO][PID:1961793] rsyncing of mockbuilder@98.81.14.89:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-10-x86_64/10348571-osbuild-composer started
[2026-04-20 13:30:21,939][  INFO][PID:1961793] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@98.81.14.89:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-10-x86_64/10348571-osbuild-composer/ &> /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-10-x86_64/10348571-osbuild-composer/build-10348571.rsync.log
[2026-04-20 13:30:22,251][  INFO][PID:1961793] rsyncing finished.
[2026-04-20 13:30:22,253][ ERROR][PID:1961793] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-04-20 13:30:22,255][ ERROR][PID:1961793] SSH connection lost on #1 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-04-20 13:30:32,258][  INFO][PID:1961793] rsyncing of mockbuilder@98.81.14.89:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-10-x86_64/10348571-osbuild-composer started
[2026-04-20 13:30:32,263][  INFO][PID:1961793] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@98.81.14.89:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-10-x86_64/10348571-osbuild-composer/ &> /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-10-x86_64/10348571-osbuild-composer/build-10348571.rsync.log
[2026-04-20 13:30:32,427][  INFO][PID:1961793] rsyncing finished.
[2026-04-20 13:30:32,428][ ERROR][PID:1961793] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-04-20 13:30:32,429][ ERROR][PID:1961793] SSH connection lost on #2 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-04-20 13:30:42,432][  INFO][PID:1961793] rsyncing of mockbuilder@98.81.14.89:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-10-x86_64/10348571-osbuild-composer started
[2026-04-20 13:30:42,436][  INFO][PID:1961793] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@98.81.14.89:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-10-x86_64/10348571-osbuild-composer/ &> /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-10-x86_64/10348571-osbuild-composer/build-10348571.rsync.log
[2026-04-20 13:30:42,732][  INFO][PID:1961793] rsyncing finished.
[2026-04-20 13:30:42,732][ ERROR][PID:1961793] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-04-20 13:30:42,733][ ERROR][PID:1961793] SSH connection lost on #3 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-04-20 13:30:52,735][ ERROR][PID:1961793] Re-try request for task on 'ResallocHost, ticket_id=2421925, hostname=98.81.14.89, name=aws_x86_64_normal_prod_07115852_20260420_120804, requested_tags=['arch_x86_64', 'copr_builder']': Unable to finish after 3 SSH attempts
[2026-04-20 13:30:52,738][  INFO][PID:1961793] VM Release request
[2026-04-20 13:30:52,786][  INFO][PID:1961793] Retry #1 (on other host)
[2026-04-20 13:30:52,787][  INFO][PID:1961793] Checking that /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-10-x86_64/repodata/repomd.xml exists
[2026-04-20 13:30:52,879][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:30:52,882][  INFO][PID:1961793] VM allocation process starts
[2026-04-20 13:30:52,908][  INFO][PID:1961793] Trying to allocate VM: ResallocHost, ticket_id=2422430, requested_tags=['arch_x86_64', 'copr_builder']
[2026-04-20 13:30:57,911][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:31:02,914][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:31:07,917][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:31:12,920][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:31:17,922][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:31:22,923][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:31:27,932][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:31:32,961][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:31:37,971][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:31:42,972][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:31:47,975][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:31:52,977][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:31:57,978][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:32:02,979][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:32:07,984][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:32:12,985][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:32:17,986][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:32:22,988][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:32:27,990][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:32:32,994][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:32:37,998][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:32:43,003][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:32:48,005][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:32:53,007][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:32:58,009][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:33:03,014][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:33:08,028][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:33:13,029][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:33:18,033][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:33:23,036][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:33:28,040][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:33:33,043][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:33:38,044][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:33:43,047][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:33:48,049][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:33:53,052][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:33:58,055][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:34:03,059][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:34:08,061][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:34:11,226][  INFO][PID:1961793] Allocated host ResallocHost, ticket_id=2422430, hostname=54.167.192.108, name=aws_x86_64_normalreserved_prod_07132417_20260420_133126, requested_tags=['arch_x86_64', 'copr_builder']
[2026-04-20 13:34:11,226][  INFO][PID:1961793] Allocating ssh connection to builder
[2026-04-20 13:34:11,227][  INFO][PID:1961793] Checking that builder machine is OK
[2026-04-20 13:34:11,424][ ERROR][PID:1961793] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
Warning: Permanently added '54.167.192.108' (ED25519) to the list of known hosts.
Load key "/home/copr/.ssh/id_rsa": Permission denied
Permission denied, please try again.
Permission denied, please try again.
mockbuilder@54.167.192.108: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).

[2026-04-20 13:34:21,429][ ERROR][PID:1961793] Re-try request for task on 'ResallocHost, ticket_id=2422430, hostname=54.167.192.108, name=aws_x86_64_normalreserved_prod_07132417_20260420_133126, requested_tags=['arch_x86_64', 'copr_builder']': Unable to finish after 1 SSH attempts
[2026-04-20 13:34:21,431][  INFO][PID:1961793] VM Release request
[2026-04-20 13:34:21,480][  INFO][PID:1961793] Retry #2 (on other host)
[2026-04-20 13:34:21,482][  INFO][PID:1961793] Checking that /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-10-x86_64/repodata/repomd.xml exists
[2026-04-20 13:34:21,485][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:34:21,497][  INFO][PID:1961793] VM allocation process starts
[2026-04-20 13:34:21,557][  INFO][PID:1961793] Trying to allocate VM: ResallocHost, ticket_id=2422556, requested_tags=['arch_x86_64', 'copr_builder']
[2026-04-20 13:34:26,567][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:34:31,574][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:34:36,582][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:34:41,588][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:34:46,601][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:34:51,608][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:34:56,623][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:35:01,636][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:35:06,644][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:35:11,650][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:35:16,670][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:35:21,677][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:35:26,679][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:35:31,680][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:35:36,683][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:35:41,688][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:35:46,694][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:35:51,697][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:35:56,699][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:36:01,710][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:36:06,720][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:36:11,734][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:36:16,744][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:36:21,748][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:36:26,754][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:36:31,761][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:36:36,764][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:36:41,776][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:36:46,782][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:36:51,785][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:36:56,802][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:37:01,841][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:37:06,850][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:37:11,861][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:37:16,863][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:37:21,873][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:37:26,886][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:37:31,891][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:37:36,894][  INFO][PID:1961793] Checking for cancel request
[2026-04-20 13:37:40,141][  INFO][PID:1961793] Allocated host ResallocHost, ticket_id=2422556, hostname=2620:52:6:1161:dead:beef:cafe:c114, name=vmhost_x86_02_prod_07132568_20260420_133404, requested_tags=['arch_x86_64', 'copr_builder']
[2026-04-20 13:37:40,147][  INFO][PID:1961793] Allocating ssh connection to builder
[2026-04-20 13:37:40,153][  INFO][PID:1961793] Checking that builder machine is OK
[2026-04-20 13:37:40,995][ ERROR][PID:1961793] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c114' (ED25519) to the list of known hosts.
Load key "/home/copr/.ssh/id_rsa": Permission denied
Permission denied, please try again.
Permission denied, please try again.
mockbuilder@2620:52:6:1161:dead:beef:cafe:c114: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).

[2026-04-20 13:37:51,002][ ERROR][PID:1961793] Re-try request for task on 'ResallocHost, ticket_id=2422556, hostname=2620:52:6:1161:dead:beef:cafe:c114, name=vmhost_x86_02_prod_07132568_20260420_133404, requested_tags=['arch_x86_64', 'copr_builder']': Unable to finish after 1 SSH attempts
[2026-04-20 13:37:51,009][  INFO][PID:1961793] VM Release request
[2026-04-20 13:37:51,089][ ERROR][PID:1961793] Backend process error: Three host tried without success: {'98.81.14.89', '54.167.192.108', '2620:52:6:1161:dead:beef:cafe:c114'}
[2026-04-20 13:37:51,092][WARNING][PID:1961793] Switching not-finished job state to 'failed'
[2026-04-20 13:37:51,096][  INFO][PID:1961793] Worker failed build, took 1189.9198775291443
[2026-04-20 13:37:51,105][  INFO][PID:1961793] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@osbuild",
            "project_name": "osbuild-composer",
            "project_dirname": "osbuild-composer",
            "submitter": "packit",
            "ended_on": 1776692271.0924141,
            "started_on": 1776691081.1725366,
            "submitted_on": null,
            "status": 0,
            "chroot": "centos-stream-10-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "10348571-centos-stream-10-x86_64",
            "build_id": 10348571,
            "package_name": "osbuild-composer",
            "package_version": "169-1.20260420131710720793.main.5.g2414f89f9",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@osbuild/osbuild-composer/osbuild-composer",
            "git_hash": "601f84c74abff0a1499af288559d7a2f27f82597",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@osbuild/osbuild-composer--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@osbuild/osbuild-composer/centos-stream-10-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@osbuild/osbuild-composer",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@osbuild/osbuild-composer",
            "result_dir": "10348571-osbuild-composer",
            "built_packages": "",
            "id": 10348571,
            "mockchain_macros": {
                "copr_username": "@osbuild",
                "copr_projectname": "osbuild-composer",
                "vendor": "Fedora Project COPR (@osbuild/osbuild-composer)"
            }
        }
    ]
}
[2026-04-20 13:37:51,387][  INFO][PID:1961793] Sending fedora-messaging bus message in build.end
[2026-04-20 13:37:51,537][  INFO][PID:1961793] Compressing /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-10-x86_64/10348571-osbuild-composer/builder-live.log by gzip
[2026-04-20 13:37:51,541][  INFO][PID:1961793] Running command 'gzip /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-10-x86_64/10348571-osbuild-composer/builder-live.log' as PID 2230429
[2026-04-20 13:37:51,707][  INFO][PID:1961793] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-10-x86_64/10348571-osbuild-composer/builder-live.log)
[2026-04-20 13:37:51,708][  INFO][PID:1961793] Compressing /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-10-x86_64/10348571-osbuild-composer/backend.log by gzip
[2026-04-20 13:37:51,716][  INFO][PID:1961793] Running command 'gzip /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-10-x86_64/10348571-osbuild-composer/backend.log' as PID 2230464