[2025-12-09 22:37:55,802][  INFO][PID:1417117] Marking build as starting
[2025-12-09 22:37:55,865][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:37:55,866][  INFO][PID:1417117] VM allocation process starts
[2025-12-09 22:37:55,914][  INFO][PID:1417117] Trying to allocate VM: ResallocHost, ticket_id=247924, requested_tags=['copr_builder', 'arch_x86_64']
[2025-12-09 22:37:59,008][  INFO][PID:1417117] Allocated host ResallocHost, ticket_id=247924, hostname=3.228.21.232, name=aws_x86_64_spot_prod_00290994_20251209_223439, requested_tags=['copr_builder', 'arch_x86_64']
[2025-12-09 22:37:59,008][  INFO][PID:1417117] Allocating ssh connection to builder
[2025-12-09 22:37:59,009][  INFO][PID:1417117] Checking that builder machine is OK
[2025-12-09 22:37:59,375][  INFO][PID:1417117] Running remote command: copr-builder-ready fedora-rawhide-x86_64
[2025-12-09 22:37:59,580][  INFO][PID:1417117] Red Hat subscription not needed for fedora-rawhide-x86_64
Builder is ready to be used

[2025-12-09 22:37:59,580][  INFO][PID:1417117] Filling build.info file with builder info
[2025-12-09 22:37:59,581][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:37:59,582][  INFO][PID:1417117] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "music",
            "project_name": "uv",
            "project_dirname": "uv",
            "submitter": "music",
            "ended_on": null,
            "started_on": 1765319879.5823581,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-rawhide-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "9892505-fedora-rawhide-x86_64",
            "build_id": 9892505,
            "package_name": "uv",
            "package_version": "0.9.16-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/music/uv/uv",
            "git_hash": "0b6905f07c01a3b3000788045d34c623b06f278e",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "music/uv--music",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/music/uv/fedora-rawhide-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/music/uv",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/music/uv",
            "result_dir": "09892505-uv",
            "built_packages": "",
            "id": 9892505,
            "mockchain_macros": {
                "copr_username": "music",
                "copr_projectname": "uv",
                "vendor": "Fedora Project COPR (music/uv)"
            }
        }
    ]
}
[2025-12-09 22:37:59,620][  INFO][PID:1417117] Sending fedora-messaging bus message in build.start
[2025-12-09 22:38:00,276][  INFO][PID:1417117] Sending fedora-messaging bus message in chroot.start
[2025-12-09 22:38:00,304][  INFO][PID:1417117] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9892505-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached
[2025-12-09 22:38:00,654][  INFO][PID:1417117] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '3.228.21.232' (ED25519) to the list of known hosts.


[2025-12-09 22:38:00,654][  INFO][PID:1417117] Downloading the builder-live.log file, attempt 1
[2025-12-09 22:38:00,656][  INFO][PID:1417117] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.228.21.232 copr-rpmbuild-log
[2025-12-09 22:38:05,662][  INFO][PID:1417117] Periodic builder liveness probe: alive
[2025-12-09 22:38:05,663][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:38:10,664][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:38:15,667][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:38:20,668][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:38:25,669][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:38:30,670][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:38:35,672][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:38:40,675][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:38:45,676][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:38:50,677][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:38:55,678][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:39:00,679][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:39:05,680][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:39:10,681][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:39:15,682][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:39:20,683][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:39:25,685][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:39:30,686][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:39:35,688][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:39:40,689][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:39:45,690][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:39:50,691][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:39:55,692][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:40:00,693][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:40:05,694][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:40:10,695][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:40:15,696][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:40:20,698][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:40:25,700][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:40:30,701][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:40:35,701][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:40:40,702][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:40:45,705][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:40:50,706][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:40:55,707][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:41:00,708][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:41:05,709][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:41:10,710][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:41:15,711][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:41:20,712][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:41:25,713][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:41:30,714][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:41:35,715][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:41:40,716][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:41:45,717][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:41:50,718][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:41:55,719][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:42:00,720][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:42:05,721][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:42:10,722][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:42:15,723][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:42:20,724][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:42:25,726][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:42:30,730][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:42:35,732][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:42:40,735][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:42:45,737][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:42:50,739][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:42:55,741][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:43:00,742][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:43:05,745][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:43:10,747][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:43:15,751][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:43:20,752][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:43:25,758][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:43:30,759][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:43:35,762][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:43:40,766][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:43:45,768][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:43:50,770][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:43:55,771][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:44:00,772][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:44:05,773][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:44:10,774][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:44:15,775][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:44:20,777][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:44:25,778][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:44:30,779][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:44:35,782][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:44:40,784][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:44:45,785][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:44:50,786][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:44:55,788][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:45:00,790][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:45:05,791][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:45:10,793][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:45:15,794][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:45:20,795][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:45:25,796][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:45:30,797][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:45:35,798][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:45:40,800][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:45:45,801][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:45:50,802][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:45:55,803][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:46:00,804][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:46:05,805][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:46:10,806][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:46:15,807][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:46:20,808][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:46:25,810][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:46:30,811][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:46:35,812][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:46:40,813][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:46:45,814][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:46:50,815][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:46:55,816][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:47:00,817][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:47:05,818][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:47:10,819][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:47:15,820][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:47:20,822][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:47:25,825][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:47:30,826][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:47:35,827][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:47:40,828][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:47:45,829][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:47:50,830][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:47:55,831][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:48:00,832][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:48:05,838][  INFO][PID:1417117] Periodic builder liveness probe: alive
[2025-12-09 22:48:05,838][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:48:10,839][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:48:15,840][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:48:20,841][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:48:25,376][ ERROR][PID:1417117] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-09 22:48:25,842][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:48:30,842][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:48:35,377][WARNING][PID:1417117] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-12-09 22:48:35,843][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:48:40,844][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:48:45,377][  INFO][PID:1417117] Downloading the builder-live.log file, attempt 2
[2025-12-09 22:48:45,379][  INFO][PID:1417117] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.228.21.232 copr-rpmbuild-log
[2025-12-09 22:48:45,846][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:48:50,846][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:48:55,847][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:49:00,848][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:49:05,849][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:49:10,850][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:49:15,851][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:49:20,852][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:49:25,853][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:49:30,854][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:49:35,855][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:49:40,856][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:49:45,386][ ERROR][PID:1417117] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-09 22:49:45,857][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:49:50,857][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:49:55,390][WARNING][PID:1417117] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-12-09 22:49:55,858][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:50:00,859][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:50:05,390][  INFO][PID:1417117] Downloading the builder-live.log file, attempt 3
[2025-12-09 22:50:05,392][  INFO][PID:1417117] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.228.21.232 copr-rpmbuild-log
[2025-12-09 22:50:05,860][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:50:10,861][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:50:15,862][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:50:20,863][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:50:25,864][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:50:30,865][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:50:35,866][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:50:40,867][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:50:45,868][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:50:50,869][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:50:55,870][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:51:00,871][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:51:05,459][ ERROR][PID:1417117] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-09 22:51:05,872][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:51:10,873][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:51:15,464][WARNING][PID:1417117] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-12-09 22:51:15,874][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:51:20,875][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:51:25,465][  INFO][PID:1417117] Downloading the builder-live.log file, attempt 4
[2025-12-09 22:51:25,466][  INFO][PID:1417117] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.228.21.232 copr-rpmbuild-log
[2025-12-09 22:51:25,875][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:51:30,876][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:51:35,877][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:51:40,878][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:51:45,879][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:51:50,880][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:51:55,881][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:52:00,882][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:52:05,883][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:52:10,884][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:52:15,885][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:52:20,886][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:52:25,531][ ERROR][PID:1417117] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-09 22:52:25,887][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:52:30,888][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:52:35,535][ ERROR][PID:1417117] Giving up for unstable SSH, failures: 1765320515.3771126, 1765320595.390123, 1765320675.4643524, 1765320755.534853
[2025-12-09 22:52:35,535][ ERROR][PID:1417117] Re-try request for task on 'ResallocHost, ticket_id=247924, hostname=3.228.21.232, name=aws_x86_64_spot_prod_00290994_20251209_223439, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-12-09 22:52:35,536][  INFO][PID:1417117] Releasing VM back to pool
[2025-12-09 22:52:35,547][  INFO][PID:1417117] Retry #1 (on other host)
[2025-12-09 22:52:35,547][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:52:35,548][  INFO][PID:1417117] VM allocation process starts
[2025-12-09 22:52:35,559][  INFO][PID:1417117] Trying to allocate VM: ResallocHost, ticket_id=248106, requested_tags=['copr_builder', 'arch_x86_64']
[2025-12-09 22:52:38,570][  INFO][PID:1417117] Allocated host ResallocHost, ticket_id=248106, hostname=44.221.75.117, name=aws_x86_64_spot_prod_00291138_20251209_223935, requested_tags=['copr_builder', 'arch_x86_64']
[2025-12-09 22:52:38,570][  INFO][PID:1417117] Allocating ssh connection to builder
[2025-12-09 22:52:38,571][  INFO][PID:1417117] Checking that builder machine is OK
[2025-12-09 22:53:38,634][ ERROR][PID:1417117] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 44.221.75.117 port 22: Connection timed out

[2025-12-09 22:53:48,634][ ERROR][PID:1417117] Re-try request for task on 'ResallocHost, ticket_id=248106, hostname=44.221.75.117, name=aws_x86_64_spot_prod_00291138_20251209_223935, requested_tags=['copr_builder', 'arch_x86_64']': Unable to finish after 1 SSH attempts
[2025-12-09 22:53:48,635][  INFO][PID:1417117] Releasing VM back to pool
[2025-12-09 22:53:48,646][  INFO][PID:1417117] Retry #2 (on other host)
[2025-12-09 22:53:48,646][  INFO][PID:1417117] Checking for cancel request
[2025-12-09 22:53:48,647][  INFO][PID:1417117] VM allocation process starts
[2025-12-09 22:53:48,658][  INFO][PID:1417117] Trying to allocate VM: ResallocHost, ticket_id=248118, requested_tags=['copr_builder', 'arch_x86_64']
[2025-12-09 22:53:51,676][  INFO][PID:1417117] Allocated host ResallocHost, ticket_id=248118, hostname=3.227.234.123, name=aws_x86_64_spot_prod_00291246_20251209_224456, requested_tags=['copr_builder', 'arch_x86_64']
[2025-12-09 22:53:51,677][  INFO][PID:1417117] Allocating ssh connection to builder
[2025-12-09 22:53:51,677][  INFO][PID:1417117] Checking that builder machine is OK
[2025-12-09 22:54:51,745][ ERROR][PID:1417117] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 3.227.234.123 port 22: Connection timed out

[2025-12-09 22:55:01,745][ ERROR][PID:1417117] Re-try request for task on 'ResallocHost, ticket_id=248118, hostname=3.227.234.123, name=aws_x86_64_spot_prod_00291246_20251209_224456, requested_tags=['copr_builder', 'arch_x86_64']': Unable to finish after 1 SSH attempts
[2025-12-09 22:55:01,746][  INFO][PID:1417117] Releasing VM back to pool
[2025-12-09 22:55:01,758][ ERROR][PID:1417117] Backend process error: Three host tried without success: {'3.228.21.232', '44.221.75.117', '3.227.234.123'}
[2025-12-09 22:55:01,758][WARNING][PID:1417117] Switching not-finished job state to 'failed'
[2025-12-09 22:55:01,759][  INFO][PID:1417117] Worker failed build, took 1022.1766059398651
[2025-12-09 22:55:01,759][  INFO][PID:1417117] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "music",
            "project_name": "uv",
            "project_dirname": "uv",
            "submitter": "music",
            "ended_on": 1765320901.758964,
            "started_on": 1765319879.5823581,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-rawhide-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "9892505-fedora-rawhide-x86_64",
            "build_id": 9892505,
            "package_name": "uv",
            "package_version": "0.9.16-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/music/uv/uv",
            "git_hash": "0b6905f07c01a3b3000788045d34c623b06f278e",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "music/uv--music",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/music/uv/fedora-rawhide-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/music/uv",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/music/uv",
            "result_dir": "09892505-uv",
            "built_packages": "",
            "id": 9892505,
            "mockchain_macros": {
                "copr_username": "music",
                "copr_projectname": "uv",
                "vendor": "Fedora Project COPR (music/uv)"
            }
        }
    ]
}
[2025-12-09 22:55:01,802][  INFO][PID:1417117] Sending fedora-messaging bus message in build.end
[2025-12-09 22:55:01,828][  INFO][PID:1417117] Compressing /var/lib/copr/public_html/results/music/uv/fedora-rawhide-x86_64/09892505-uv/builder-live.log by gzip
[2025-12-09 22:55:01,829][  INFO][PID:1417117] Running command 'gzip /var/lib/copr/public_html/results/music/uv/fedora-rawhide-x86_64/09892505-uv/builder-live.log' as PID 1507175
[2025-12-09 22:55:01,830][  INFO][PID:1417117] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/music/uv/fedora-rawhide-x86_64/09892505-uv/builder-live.log)
[2025-12-09 22:55:01,831][  INFO][PID:1417117] Compressing /var/lib/copr/public_html/results/music/uv/fedora-rawhide-x86_64/09892505-uv/backend.log by gzip
[2025-12-09 22:55:01,832][  INFO][PID:1417117] Running command 'gzip /var/lib/copr/public_html/results/music/uv/fedora-rawhide-x86_64/09892505-uv/backend.log' as PID 1507176