[2026-04-16 17:18:07,602][  INFO][PID:2951748] Marking build as starting
[2026-04-16 17:18:08,729][  INFO][PID:2951748] Checking that /var/lib/copr/public_html/results/rapier1/hpnss-build-tests/almalinux-kitten-10-s390x/repodata/repomd.xml exists
[2026-04-16 17:18:08,766][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:18:08,767][  INFO][PID:2951748] VM allocation process starts
[2026-04-16 17:18:08,781][  INFO][PID:2951748] Trying to allocate VM: ResallocHost, ticket_id=2375508, requested_tags=['arch_s390x', 'copr_builder']
[2026-04-16 17:18:13,783][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:18:14,823][  INFO][PID:2951748] Allocated host ResallocHost, ticket_id=2375508, hostname=13.218.249.204, name=aws_x86_64_spot_prod_06079373_20260416_171526, requested_tags=['arch_s390x', 'copr_builder']
[2026-04-16 17:18:14,823][  INFO][PID:2951748] Allocating ssh connection to builder
[2026-04-16 17:18:14,824][  INFO][PID:2951748] Checking that builder machine is OK
[2026-04-16 17:18:15,227][  INFO][PID:2951748] Installed copr-rpmbuild version: 1.8
[2026-04-16 17:18:15,228][  INFO][PID:2951748] Running remote command: copr-builder-ready almalinux-kitten-10-s390x
[2026-04-16 17:18:15,497][  INFO][PID:2951748] Red Hat subscription not needed for almalinux-kitten-10-s390x
Builder is ready to be used

[2026-04-16 17:18:15,498][  INFO][PID:2951748] Filling build.info file with builder info
[2026-04-16 17:18:15,500][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:18:15,502][  INFO][PID:2951748] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "rapier1",
            "project_name": "hpnss-build-tests",
            "project_dirname": "hpnss-build-tests",
            "submitter": "rapier1",
            "ended_on": null,
            "started_on": 1776359895.5019746,
            "submitted_on": null,
            "status": 3,
            "chroot": "almalinux-kitten-10-s390x",
            "arch": "s390x",
            "buildroot_pkgs": [],
            "task_id": "10339948-almalinux-kitten-10-s390x",
            "build_id": 10339948,
            "package_name": "hpnssh",
            "package_version": "10.3p1_hpn18.9.0-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rapier1/hpnss-build-tests/hpnssh",
            "git_hash": "2d798b968329ea9c63223fb184df56618343ea58",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rapier1/hpnss-build-tests--rapier1",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rapier1/hpnss-build-tests/almalinux-kitten-10-s390x/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_s390x"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rapier1/hpnss-build-tests",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rapier1/hpnss-build-tests",
            "result_dir": "10339948-hpnssh",
            "built_packages": "",
            "id": 10339948,
            "mockchain_macros": {
                "copr_username": "rapier1",
                "copr_projectname": "hpnss-build-tests",
                "vendor": "Fedora Project COPR (rapier1/hpnss-build-tests)"
            }
        }
    ]
}
[2026-04-16 17:18:15,791][  INFO][PID:2951748] Sending fedora-messaging bus message in build.start
[2026-04-16 17:18:17,110][  INFO][PID:2951748] Sending fedora-messaging bus message in chroot.start
[2026-04-16 17:18:17,159][  INFO][PID:2951748] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10339948-almalinux-kitten-10-s390x --chroot almalinux-kitten-10-s390x --detached
[2026-04-16 17:18:17,706][  INFO][PID:2951748] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '13.218.249.204' (ED25519) to the list of known hosts.


[2026-04-16 17:18:17,708][  INFO][PID:2951748] Downloading the builder-live.log file, attempt 1
[2026-04-16 17:18:17,710][  INFO][PID:2951748] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.218.249.204 copr-rpmbuild-log
[2026-04-16 17:18:22,716][  INFO][PID:2951748] Periodic builder liveness probe: alive
[2026-04-16 17:18:22,717][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:18:27,718][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:18:32,720][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:18:37,721][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:18:42,722][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:18:47,724][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:18:52,725][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:18:57,726][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:19:02,727][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:19:07,728][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:19:12,729][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:19:17,730][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:19:22,731][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:19:27,732][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:19:32,733][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:19:37,735][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:19:42,736][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:19:47,738][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:19:52,740][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:19:57,741][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:20:02,742][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:20:07,745][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:20:12,746][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:20:17,747][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:20:22,748][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:20:27,757][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:20:32,759][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:20:37,761][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:20:42,762][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:20:47,763][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:20:52,764][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:20:57,765][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:21:02,767][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:21:07,769][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:21:12,770][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:21:17,772][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:21:22,774][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:21:27,780][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:21:32,782][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:21:37,783][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:21:42,785][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:21:47,786][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:21:52,787][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:21:57,789][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:22:02,790][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:22:07,791][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:22:12,792][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:22:17,793][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:22:22,794][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:22:27,796][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:22:32,797][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:22:37,803][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:22:42,804][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:22:47,805][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:22:52,807][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:22:57,815][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:23:02,819][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:23:07,820][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:23:12,821][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:23:17,824][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:23:22,826][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:23:27,827][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:23:32,828][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:23:37,836][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:23:42,837][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:23:47,838][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:23:52,839][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:23:57,840][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:24:02,841][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:24:07,842][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:24:12,844][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:24:17,845][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:24:22,846][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:24:27,847][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:24:32,848][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:24:37,849][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:24:42,850][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:24:47,851][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:24:52,852][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:24:57,853][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:25:02,854][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:25:07,856][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:25:12,857][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:25:17,858][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:25:22,867][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:25:27,868][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:25:32,869][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:25:37,870][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:25:42,871][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:25:47,872][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:25:52,873][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:25:57,875][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:26:02,876][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:26:07,877][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:26:12,879][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:26:17,881][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:26:22,883][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:26:27,884][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:26:32,885][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:26:37,888][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:26:42,891][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:26:47,892][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:26:52,893][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:26:57,894][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:27:02,896][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:27:07,913][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:27:12,918][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:27:17,919][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:27:22,921][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:27:27,923][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:27:32,924][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:27:37,925][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:27:42,929][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:27:47,930][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:27:52,931][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:27:57,932][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:28:02,933][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:28:07,934][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:28:12,935][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:28:17,936][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:28:22,947][  INFO][PID:2951748] Periodic builder liveness probe: alive
[2026-04-16 17:28:22,947][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:28:27,948][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:28:32,949][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:28:37,950][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:28:42,951][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:28:47,952][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:28:52,953][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:28:57,954][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:29:02,956][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:29:07,958][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:29:12,959][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:29:17,961][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:29:22,963][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:29:27,970][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:29:32,971][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:29:37,972][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:29:42,973][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:29:47,974][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:29:52,975][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:29:57,976][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:30:02,977][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:30:07,978][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:30:12,979][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:30:17,980][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:30:22,981][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:30:27,982][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:30:32,983][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:30:37,984][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:30:42,985][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:30:47,991][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:30:52,992][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:30:57,994][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:31:02,997][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:31:07,998][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:31:12,999][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:31:18,000][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:31:23,001][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:31:28,002][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:31:33,003][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:31:38,004][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:31:43,005][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:31:48,006][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:31:53,007][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:31:58,009][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:32:03,010][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:32:08,014][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:32:13,022][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:32:18,023][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:32:23,024][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:32:28,025][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:32:33,026][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:32:38,027][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:32:43,028][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:32:48,029][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:32:53,030][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:32:58,031][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:33:03,032][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:33:08,033][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:33:13,034][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:33:18,035][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:33:23,036][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:33:28,037][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:33:33,038][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:33:38,039][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:33:43,040][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:33:48,042][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:33:53,043][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:33:58,044][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:34:03,045][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:34:08,046][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:34:13,047][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:34:18,048][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:34:23,050][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:34:26,260][ ERROR][PID:2951748] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-16 17:34:28,051][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:34:33,052][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:34:36,266][WARNING][PID:2951748] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-16 17:34:38,053][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:34:43,054][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:34:46,267][  INFO][PID:2951748] Downloading the builder-live.log file, attempt 2
[2026-04-16 17:34:46,277][  INFO][PID:2951748] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.218.249.204 copr-rpmbuild-log
[2026-04-16 17:34:48,055][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:34:53,056][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:34:58,057][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:35:03,058][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:35:08,059][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:35:13,060][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:35:18,061][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:35:23,062][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:35:28,063][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:35:33,065][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:35:38,066][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:35:43,067][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:35:46,360][ ERROR][PID:2951748] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-16 17:35:48,068][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:35:53,069][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:35:56,402][WARNING][PID:2951748] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-16 17:35:58,070][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:36:03,071][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:36:06,402][  INFO][PID:2951748] Downloading the builder-live.log file, attempt 3
[2026-04-16 17:36:06,544][  INFO][PID:2951748] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.218.249.204 copr-rpmbuild-log
[2026-04-16 17:36:08,072][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:36:13,073][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:36:18,074][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:36:23,075][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:36:28,076][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:36:33,077][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:36:38,078][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:36:43,079][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:36:48,080][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:36:53,081][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:36:58,082][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:37:03,083][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:37:06,608][ ERROR][PID:2951748] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-16 17:37:08,084][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:37:13,085][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:37:16,609][WARNING][PID:2951748] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-16 17:37:18,086][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:37:23,087][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:37:26,610][  INFO][PID:2951748] Downloading the builder-live.log file, attempt 4
[2026-04-16 17:37:26,611][  INFO][PID:2951748] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.218.249.204 copr-rpmbuild-log
[2026-04-16 17:37:28,088][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:37:33,089][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:37:38,090][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:37:43,091][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:37:48,093][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:37:53,093][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:37:58,095][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:38:03,095][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:38:08,096][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:38:13,097][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:38:18,098][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:38:23,104][  INFO][PID:2951748] Periodic builder liveness probe: alive
[2026-04-16 17:38:23,105][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:38:26,678][ ERROR][PID:2951748] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-16 17:38:28,106][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:38:33,107][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:38:36,679][ ERROR][PID:2951748] Giving up for unstable SSH, failures: 1776360876.2666678, 1776360956.4020216, 1776361036.6096976, 1776361116.6795783
[2026-04-16 17:38:36,680][ ERROR][PID:2951748] Re-try request for task on 'ResallocHost, ticket_id=2375508, hostname=13.218.249.204, name=aws_x86_64_spot_prod_06079373_20260416_171526, requested_tags=['arch_s390x', 'copr_builder']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2026-04-16 17:38:36,681][  INFO][PID:2951748] VM Release request
[2026-04-16 17:38:36,693][  INFO][PID:2951748] Retry #1 (on other host)
[2026-04-16 17:38:36,694][  INFO][PID:2951748] Checking that /var/lib/copr/public_html/results/rapier1/hpnss-build-tests/almalinux-kitten-10-s390x/repodata/repomd.xml exists
[2026-04-16 17:38:37,014][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:38:37,015][  INFO][PID:2951748] VM allocation process starts
[2026-04-16 17:38:37,029][  INFO][PID:2951748] Trying to allocate VM: ResallocHost, ticket_id=2375724, requested_tags=['arch_s390x', 'copr_builder']
[2026-04-16 17:38:40,054][  INFO][PID:2951748] Allocated host ResallocHost, ticket_id=2375724, hostname=2620:52:6:1161:dead:beef:cafe:c13e, name=vmhost_x86_03_prod_06079561_20260416_172322, requested_tags=['arch_s390x', 'copr_builder']
[2026-04-16 17:38:40,055][  INFO][PID:2951748] Allocating ssh connection to builder
[2026-04-16 17:38:40,056][  INFO][PID:2951748] Checking that builder machine is OK
[2026-04-16 17:38:40,620][  INFO][PID:2951748] Installed copr-rpmbuild version: 1.8
[2026-04-16 17:38:40,621][  INFO][PID:2951748] Running remote command: copr-builder-ready almalinux-kitten-10-s390x
[2026-04-16 17:38:40,985][  INFO][PID:2951748] Red Hat subscription not needed for almalinux-kitten-10-s390x
Builder is ready to be used

[2026-04-16 17:38:40,987][  INFO][PID:2951748] Filling build.info file with builder info
[2026-04-16 17:38:40,993][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:38:40,995][  INFO][PID:2951748] Not re-notifying FE and msg buses for the new host.
[2026-04-16 17:38:40,995][  INFO][PID:2951748] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10339948-almalinux-kitten-10-s390x --chroot almalinux-kitten-10-s390x --detached
[2026-04-16 17:38:41,688][  INFO][PID:2951748] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c13e' (ED25519) to the list of known hosts.


[2026-04-16 17:38:41,690][  INFO][PID:2951748] Downloading the builder-live.log file, attempt 1
[2026-04-16 17:38:41,692][  INFO][PID:2951748] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c13e copr-rpmbuild-log
[2026-04-16 17:38:46,690][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:38:51,691][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:38:56,692][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:39:01,693][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:39:06,694][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:39:11,701][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:39:16,703][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:39:21,704][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:39:26,705][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:39:31,706][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:39:36,707][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:39:41,708][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:39:46,781][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:39:51,783][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:39:56,825][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:40:01,826][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:40:06,827][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:40:11,828][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:40:16,829][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:40:21,830][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:40:26,831][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:40:31,832][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:40:36,922][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:40:41,948][  INFO][PID:2951748] Checking for cancel request
[2026-04-16 17:40:41,952][  INFO][PID:2951748] Calling cancel callback, and waiting for thread.join()
[2026-04-16 17:40:41,953][  INFO][PID:2951748] Canceling the build on the remote machine
[2026-04-16 17:40:45,465][  INFO][PID:2951748] Cancel request succeeded
out:
success
err:
Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c13e' (ED25519) to the list of known hosts.

[2026-04-16 17:40:45,466][ ERROR][PID:2951748] Build was canceled
[2026-04-16 17:40:45,466][  INFO][PID:2951748] VM Release request
[2026-04-16 17:40:45,476][WARNING][PID:2951748] Switching not-finished job state to 'failed'
[2026-04-16 17:40:45,476][  INFO][PID:2951748] Worker failed build, took 124.48126316070557
[2026-04-16 17:40:45,477][  INFO][PID:2951748] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "rapier1",
            "project_name": "hpnss-build-tests",
            "project_dirname": "hpnss-build-tests",
            "submitter": "rapier1",
            "ended_on": 1776361245.4764128,
            "started_on": 1776361120.9951496,
            "submitted_on": null,
            "status": 0,
            "chroot": "almalinux-kitten-10-s390x",
            "arch": "s390x",
            "buildroot_pkgs": [],
            "task_id": "10339948-almalinux-kitten-10-s390x",
            "build_id": 10339948,
            "package_name": "hpnssh",
            "package_version": "10.3p1_hpn18.9.0-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rapier1/hpnss-build-tests/hpnssh",
            "git_hash": "2d798b968329ea9c63223fb184df56618343ea58",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rapier1/hpnss-build-tests--rapier1",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rapier1/hpnss-build-tests/almalinux-kitten-10-s390x/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_s390x"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rapier1/hpnss-build-tests",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rapier1/hpnss-build-tests",
            "result_dir": "10339948-hpnssh",
            "built_packages": "",
            "id": 10339948,
            "mockchain_macros": {
                "copr_username": "rapier1",
                "copr_projectname": "hpnss-build-tests",
                "vendor": "Fedora Project COPR (rapier1/hpnss-build-tests)"
            }
        }
    ]
}
[2026-04-16 17:40:45,685][  INFO][PID:2951748] Sending fedora-messaging bus message in build.end
[2026-04-16 17:40:45,722][  INFO][PID:2951748] Compressing /var/lib/copr/public_html/results/rapier1/hpnss-build-tests/almalinux-kitten-10-s390x/10339948-hpnssh/builder-live.log by gzip
[2026-04-16 17:40:45,723][  INFO][PID:2951748] Running command 'gzip /var/lib/copr/public_html/results/rapier1/hpnss-build-tests/almalinux-kitten-10-s390x/10339948-hpnssh/builder-live.log' as PID 3104234
[2026-04-16 17:40:45,828][  INFO][PID:2951748] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rapier1/hpnss-build-tests/almalinux-kitten-10-s390x/10339948-hpnssh/builder-live.log)
[2026-04-16 17:40:45,829][  INFO][PID:2951748] Compressing /var/lib/copr/public_html/results/rapier1/hpnss-build-tests/almalinux-kitten-10-s390x/10339948-hpnssh/backend.log by gzip
[2026-04-16 17:40:45,830][  INFO][PID:2951748] Running command 'gzip /var/lib/copr/public_html/results/rapier1/hpnss-build-tests/almalinux-kitten-10-s390x/10339948-hpnssh/backend.log' as PID 3104241