[2026-04-20 13:17:47,489][  INFO][PID:1961751] Marking build as starting
[2026-04-20 13:17:47,863][  INFO][PID:1961751] Checking that /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-s390x/repodata/repomd.xml exists
[2026-04-20 13:17:47,869][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:17:47,870][  INFO][PID:1961751] VM allocation process starts
[2026-04-20 13:17:47,882][  INFO][PID:1961751] Trying to allocate VM: ResallocHost, ticket_id=2421916, requested_tags=['arch_s390x', 'copr_builder']
[2026-04-20 13:17:52,883][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:17:57,885][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:17:59,926][  INFO][PID:1961751] Allocated host ResallocHost, ticket_id=2421916, hostname=13.217.95.158, name=aws_x86_64_spot_prod_07130381_20260420_131241, requested_tags=['arch_s390x', 'copr_builder']
[2026-04-20 13:17:59,927][  INFO][PID:1961751] Allocating ssh connection to builder
[2026-04-20 13:17:59,928][  INFO][PID:1961751] Checking that builder machine is OK
[2026-04-20 13:18:00,271][  INFO][PID:1961751] Installed copr-rpmbuild version: 1.8
[2026-04-20 13:18:00,274][  INFO][PID:1961751] Running remote command: copr-builder-ready centos-stream-9-s390x
[2026-04-20 13:18:00,502][  INFO][PID:1961751] Red Hat subscription not needed for centos-stream-9-s390x
Builder is ready to be used

[2026-04-20 13:18:00,503][  INFO][PID:1961751] Filling build.info file with builder info
[2026-04-20 13:18:00,505][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:18:00,508][  INFO][PID:1961751] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@osbuild",
            "project_name": "osbuild-composer",
            "project_dirname": "osbuild-composer",
            "submitter": "packit",
            "ended_on": null,
            "started_on": 1776691080.5079505,
            "submitted_on": null,
            "status": 3,
            "chroot": "centos-stream-9-s390x",
            "arch": "s390x",
            "buildroot_pkgs": [],
            "task_id": "10348571-centos-stream-9-s390x",
            "build_id": 10348571,
            "package_name": "osbuild-composer",
            "package_version": "169-1.20260420131710720793.main.5.g2414f89f9",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@osbuild/osbuild-composer/osbuild-composer",
            "git_hash": "2de95c1b69944450f8aee003fd5664dc8dd8b588",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@osbuild/osbuild-composer--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@osbuild/osbuild-composer/centos-stream-9-s390x/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_s390x"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@osbuild/osbuild-composer",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@osbuild/osbuild-composer",
            "result_dir": "10348571-osbuild-composer",
            "built_packages": "",
            "id": 10348571,
            "mockchain_macros": {
                "copr_username": "@osbuild",
                "copr_projectname": "osbuild-composer",
                "vendor": "Fedora Project COPR (@osbuild/osbuild-composer)"
            }
        }
    ]
}
[2026-04-20 13:18:00,610][  INFO][PID:1961751] Sending fedora-messaging bus message in build.start
[2026-04-20 13:18:01,597][  INFO][PID:1961751] Sending fedora-messaging bus message in chroot.start
[2026-04-20 13:18:01,648][  INFO][PID:1961751] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10348571-centos-stream-9-s390x --chroot centos-stream-9-s390x --detached
[2026-04-20 13:18:02,147][  INFO][PID:1961751] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '13.217.95.158' (ED25519) to the list of known hosts.


[2026-04-20 13:18:02,148][  INFO][PID:1961751] Downloading the builder-live.log file, attempt 1
[2026-04-20 13:18:02,157][  INFO][PID:1961751] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.217.95.158 copr-rpmbuild-log
[2026-04-20 13:18:07,161][  INFO][PID:1961751] Periodic builder liveness probe: alive
[2026-04-20 13:18:07,161][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:18:12,163][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:18:17,164][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:18:22,166][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:18:27,168][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:18:32,170][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:18:37,172][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:18:42,173][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:18:47,174][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:18:52,177][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:18:57,179][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:19:02,181][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:19:07,183][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:19:12,184][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:19:17,185][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:19:22,186][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:19:27,190][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:19:32,192][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:19:37,193][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:19:42,194][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:19:47,196][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:19:52,199][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:19:57,203][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:20:02,208][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:20:07,212][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:20:12,234][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:20:17,240][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:20:22,242][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:20:27,244][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:20:32,246][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:20:37,248][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:20:42,253][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:20:47,255][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:20:52,256][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:20:57,259][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:21:02,267][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:21:07,270][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:21:12,284][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:21:17,308][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:21:22,310][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:21:27,313][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:21:32,324][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:21:37,336][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:21:42,339][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:21:47,344][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:21:52,346][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:21:57,356][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:22:02,358][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:22:07,364][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:22:12,376][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:22:17,379][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:22:22,381][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:22:27,382][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:22:32,388][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:22:37,391][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:22:42,392][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:22:47,394][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:22:52,395][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:22:57,398][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:23:02,402][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:23:07,464][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:23:12,469][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:23:17,471][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:23:22,479][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:23:27,578][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:23:32,580][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:23:37,582][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:23:42,587][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:23:47,591][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:23:52,592][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:23:57,594][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:24:02,595][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:24:07,596][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:24:12,606][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:24:17,607][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:24:22,609][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:24:27,610][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:24:32,611][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:24:37,657][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:24:42,659][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:24:47,663][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:24:52,945][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:24:57,947][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:25:02,951][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:25:07,954][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:25:12,958][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:25:17,961][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:25:22,964][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:25:27,968][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:25:32,970][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:25:37,971][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:25:42,973][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:25:47,977][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:25:52,983][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:25:57,985][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:26:03,209][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:26:08,215][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:26:13,232][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:26:18,233][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:26:23,236][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:26:28,238][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:26:33,239][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:26:38,241][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:26:43,249][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:26:48,251][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:26:53,253][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:26:58,255][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:27:03,256][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:27:08,272][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:27:13,278][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:27:18,409][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:27:23,413][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:27:28,436][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:27:33,437][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:27:38,439][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:27:43,468][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:27:48,470][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:27:53,473][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:27:58,474][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:28:03,486][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:28:08,512][  INFO][PID:1961751] Periodic builder liveness probe: alive
[2026-04-20 13:28:08,513][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:28:13,526][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:28:18,538][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:28:23,550][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:28:28,571][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:28:33,573][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:28:38,582][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:28:43,584][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:28:48,585][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:28:53,593][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:28:58,609][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:29:03,615][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:29:08,625][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:29:13,628][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:29:18,639][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:29:23,642][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:29:28,651][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:29:33,662][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:29:38,664][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:29:43,672][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:29:48,674][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:29:53,684][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:29:58,686][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:30:03,687][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:30:08,689][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:30:13,699][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:30:18,701][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:30:23,709][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:30:28,712][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:30:33,717][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:30:38,722][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:30:43,737][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:30:48,740][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:30:53,742][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:30:58,749][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:31:03,754][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:31:08,762][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:31:13,767][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:31:18,768][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:31:23,770][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:31:28,781][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:31:33,786][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:31:38,791][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:31:43,792][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:31:48,794][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:31:53,796][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:31:58,799][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:32:03,802][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:32:08,805][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:32:13,806][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:32:18,807][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:32:23,810][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:32:28,816][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:32:33,823][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:32:38,825][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:32:43,832][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:32:48,837][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:32:53,844][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:32:58,965][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:33:03,981][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:33:08,987][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:33:13,993][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:33:18,996][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:33:24,001][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:33:29,007][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:33:34,012][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:33:39,013][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:33:44,023][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:33:49,028][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:33:54,030][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:33:59,035][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:34:04,045][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:34:09,054][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:34:14,060][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:34:19,065][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:34:24,066][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:34:29,069][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:34:34,074][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:34:39,081][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:34:44,117][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:34:49,121][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:34:54,166][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:34:59,172][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:35:04,183][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:35:09,191][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:35:14,192][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:35:19,253][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:35:24,312][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:35:29,325][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:35:34,362][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:35:39,377][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:35:44,385][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:35:49,416][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:35:54,419][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:35:59,428][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:36:04,437][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:36:09,456][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:36:14,477][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:36:19,491][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:36:24,492][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:36:29,493][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:36:34,502][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:36:39,504][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:36:44,507][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:36:49,543][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:36:54,546][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:36:59,553][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:37:04,568][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:37:09,575][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:37:14,592][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:37:19,593][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:37:24,647][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:37:29,659][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:37:34,689][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:37:39,795][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:37:44,798][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:37:49,813][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:37:54,819][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:37:59,824][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:38:04,838][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:38:09,902][  INFO][PID:1961751] Periodic builder liveness probe: alive
[2026-04-20 13:38:09,914][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:38:14,937][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:38:19,962][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:38:24,982][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:38:29,988][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:38:34,998][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:38:40,006][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:38:45,011][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:38:50,029][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:38:55,076][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:39:00,080][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:39:05,093][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:39:10,096][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:39:15,100][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:39:20,112][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:39:25,121][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:39:30,131][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:39:35,132][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:39:40,141][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:39:45,147][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:39:50,151][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:39:55,156][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:40:00,164][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:40:05,171][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:40:10,180][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:40:15,196][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:40:20,217][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:40:25,225][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:40:30,228][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:40:35,235][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:40:40,243][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:40:45,245][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:40:50,247][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:40:55,250][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:41:00,253][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:41:05,259][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:41:10,260][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:41:15,262][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:41:20,295][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:41:25,299][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:41:30,466][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:41:35,472][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:41:40,475][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:41:45,482][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:41:50,511][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:41:55,534][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:42:00,549][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:42:05,556][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:42:10,565][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:42:15,566][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:42:20,570][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:42:25,572][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:42:30,573][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:42:35,580][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:42:40,585][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:42:45,589][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:42:50,597][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:42:55,603][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:43:00,619][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:43:05,640][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:43:10,662][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:43:15,682][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:43:20,689][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:43:25,706][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:43:30,719][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:43:35,732][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:43:40,751][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:43:45,754][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:43:50,760][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:43:55,761][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:44:00,766][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:44:05,773][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:44:10,784][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:44:15,798][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:44:20,813][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:44:25,829][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:44:30,832][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:44:35,858][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:44:40,870][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:44:45,878][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:44:50,906][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:44:55,916][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:45:00,922][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:45:05,932][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:45:10,956][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:45:15,965][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:45:20,977][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:45:26,001][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:45:31,014][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:45:36,062][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:45:41,074][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:45:46,082][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:45:51,142][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:45:56,165][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:46:01,200][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:46:06,202][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:46:11,203][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:46:16,215][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:46:21,227][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:46:26,238][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:46:31,247][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:46:36,250][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:46:41,298][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:46:46,318][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:46:51,381][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:46:56,396][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:47:01,402][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:47:06,403][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:47:11,405][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:47:16,408][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:47:21,482][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:47:26,520][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:47:31,538][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:47:36,547][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:47:41,558][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:47:46,568][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:47:51,608][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:47:56,619][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:48:01,631][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:48:06,641][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:48:11,746][  INFO][PID:1961751] Periodic builder liveness probe: alive
[2026-04-20 13:48:11,747][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:48:16,756][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:48:21,761][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:48:26,763][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:48:31,765][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:48:36,778][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:48:41,859][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:48:46,876][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:48:51,883][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:48:56,885][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:49:01,900][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:49:06,906][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:49:11,914][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:49:16,940][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:49:21,954][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:49:26,970][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:49:31,987][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:49:37,017][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:49:42,025][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:49:47,064][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:49:52,080][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:49:57,087][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:50:02,097][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:50:07,104][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:50:12,156][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:50:17,173][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:50:22,178][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:50:27,192][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:50:32,205][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:50:37,228][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:50:42,267][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:50:47,289][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:50:52,294][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:50:57,301][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:51:02,344][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:51:07,359][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:51:12,368][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:51:17,383][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:51:22,400][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:51:27,410][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:51:32,422][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:51:37,447][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:51:42,461][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:51:47,483][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:51:52,515][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:51:57,518][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:52:02,533][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:52:07,543][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:52:12,548][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:52:17,550][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:52:22,553][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:52:27,581][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:52:32,601][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:52:36,955][ ERROR][PID:1961751] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-20 13:52:37,618][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:52:42,637][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:52:46,957][WARNING][PID:1961751] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-20 13:52:47,664][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:52:52,688][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:52:56,963][  INFO][PID:1961751] Downloading the builder-live.log file, attempt 2
[2026-04-20 13:52:57,097][  INFO][PID:1961751] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.217.95.158 copr-rpmbuild-log
[2026-04-20 13:52:57,703][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:53:02,717][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:53:07,730][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:53:12,738][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:53:17,749][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:53:22,789][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:53:27,828][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:53:32,842][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:53:37,869][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:53:42,873][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:53:47,882][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:53:52,891][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:53:57,189][ ERROR][PID:1961751] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-20 13:53:57,914][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:54:02,921][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:54:07,229][WARNING][PID:1961751] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-20 13:54:07,925][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:54:12,934][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:54:17,233][  INFO][PID:1961751] Downloading the builder-live.log file, attempt 3
[2026-04-20 13:54:17,240][  INFO][PID:1961751] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.217.95.158 copr-rpmbuild-log
[2026-04-20 13:54:17,938][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:54:22,951][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:54:27,969][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:54:32,992][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:54:38,009][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:54:43,078][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:54:48,109][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:54:53,117][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:54:58,140][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:55:03,168][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:55:08,175][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:55:13,177][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:55:17,425][ ERROR][PID:1961751] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-20 13:55:18,195][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:55:23,204][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:55:27,436][WARNING][PID:1961751] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-20 13:55:28,230][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:55:33,252][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:55:37,437][  INFO][PID:1961751] Downloading the builder-live.log file, attempt 4
[2026-04-20 13:55:37,450][  INFO][PID:1961751] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.217.95.158 copr-rpmbuild-log
[2026-04-20 13:55:38,263][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:55:43,383][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:55:48,419][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:55:53,471][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:55:58,484][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:56:03,586][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:56:08,605][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:56:13,625][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:56:18,638][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:56:23,666][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:56:28,691][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:56:33,699][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:56:37,578][ ERROR][PID:1961751] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-20 13:56:38,700][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:56:43,707][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:56:47,594][ ERROR][PID:1961751] Giving up for unstable SSH, failures: 1776693166.957644, 1776693247.229102, 1776693327.4368937, 1776693407.5945675
[2026-04-20 13:56:47,599][ ERROR][PID:1961751] Re-try request for task on 'ResallocHost, ticket_id=2421916, hostname=13.217.95.158, name=aws_x86_64_spot_prod_07130381_20260420_131241, requested_tags=['arch_s390x', 'copr_builder']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2026-04-20 13:56:47,603][  INFO][PID:1961751] VM Release request
[2026-04-20 13:56:47,622][  INFO][PID:1961751] Retry #1 (on other host)
[2026-04-20 13:56:47,624][  INFO][PID:1961751] Checking that /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-s390x/repodata/repomd.xml exists
[2026-04-20 13:56:47,648][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:56:47,652][  INFO][PID:1961751] VM allocation process starts
[2026-04-20 13:56:47,696][  INFO][PID:1961751] Trying to allocate VM: ResallocHost, ticket_id=2423268, requested_tags=['arch_s390x', 'copr_builder']
[2026-04-20 13:56:52,698][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:56:57,700][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:57:02,704][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:57:07,706][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:57:12,713][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:57:17,714][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:57:22,717][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:57:27,721][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:57:32,733][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:57:37,751][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:57:42,753][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:57:47,755][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:57:52,775][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:57:57,793][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:58:02,794][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:58:07,795][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:58:12,801][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:58:17,814][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:58:22,820][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:58:27,821][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:58:32,836][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:58:37,845][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:58:42,855][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:58:47,867][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:58:52,870][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:58:57,875][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:59:02,876][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:59:07,884][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:59:12,892][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:59:17,904][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:59:22,908][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:59:27,914][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:59:32,919][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:59:37,926][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:59:42,931][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:59:47,936][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:59:52,946][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 13:59:57,956][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:00:02,970][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:00:06,097][  INFO][PID:1961751] Allocated host ResallocHost, ticket_id=2423268, hostname=3.239.49.15, name=aws_x86_64_reserved_prod_07133822_20260420_135656, requested_tags=['arch_s390x', 'copr_builder']
[2026-04-20 14:00:06,100][  INFO][PID:1961751] Allocating ssh connection to builder
[2026-04-20 14:00:06,102][  INFO][PID:1961751] Checking that builder machine is OK
[2026-04-20 14:00:06,421][ ERROR][PID:1961751] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
Warning: Permanently added '3.239.49.15' (ED25519) to the list of known hosts.
Load key "/home/copr/.ssh/id_rsa": Permission denied
Permission denied, please try again.
Permission denied, please try again.
mockbuilder@3.239.49.15: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).

[2026-04-20 14:00:16,423][ ERROR][PID:1961751] Re-try request for task on 'ResallocHost, ticket_id=2423268, hostname=3.239.49.15, name=aws_x86_64_reserved_prod_07133822_20260420_135656, requested_tags=['arch_s390x', 'copr_builder']': Unable to finish after 1 SSH attempts
[2026-04-20 14:00:16,435][  INFO][PID:1961751] VM Release request
[2026-04-20 14:00:16,519][  INFO][PID:1961751] Retry #2 (on other host)
[2026-04-20 14:00:16,524][  INFO][PID:1961751] Checking that /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-s390x/repodata/repomd.xml exists
[2026-04-20 14:00:16,528][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:00:16,547][  INFO][PID:1961751] VM allocation process starts
[2026-04-20 14:00:16,586][  INFO][PID:1961751] Trying to allocate VM: ResallocHost, ticket_id=2423411, requested_tags=['arch_s390x', 'copr_builder']
[2026-04-20 14:00:21,598][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:00:26,600][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:00:31,606][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:00:36,612][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:00:41,615][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:00:46,623][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:00:51,630][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:00:56,642][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:01:01,648][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:01:06,654][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:01:11,674][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:01:16,677][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:01:21,699][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:01:26,788][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:01:31,810][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:01:36,814][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:01:41,816][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:01:46,823][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:01:51,836][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:01:56,838][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:02:01,842][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:02:06,856][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:02:11,859][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:02:16,870][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:02:21,875][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:02:26,876][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:02:31,903][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:02:36,907][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:02:41,910][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:02:46,951][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:02:51,987][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:02:57,002][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:03:02,020][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:03:07,023][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:03:12,039][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:03:17,053][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:03:22,062][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:03:27,074][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:03:32,076][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:03:37,086][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:03:42,100][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:03:47,128][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:03:52,129][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:03:57,136][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:04:02,150][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:04:07,155][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:04:12,156][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:04:17,157][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:04:22,163][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:04:27,177][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:04:32,200][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:04:37,203][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:04:42,206][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:04:47,208][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:04:52,215][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:04:57,228][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:05:02,281][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:05:07,300][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:05:12,304][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:05:17,307][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:05:22,316][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:05:27,329][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:05:32,334][  INFO][PID:1961751] Checking for cancel request
[2026-04-20 14:05:35,586][  INFO][PID:1961751] Allocated host ResallocHost, ticket_id=2423411, hostname=54.90.228.174, name=aws_x86_64_normal_prod_07134079_20260420_140149, requested_tags=['arch_s390x', 'copr_builder']
[2026-04-20 14:05:35,587][  INFO][PID:1961751] Allocating ssh connection to builder
[2026-04-20 14:05:35,588][  INFO][PID:1961751] Checking that builder machine is OK
[2026-04-20 14:05:36,027][ ERROR][PID:1961751] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
Warning: Permanently added '54.90.228.174' (ED25519) to the list of known hosts.
Load key "/home/copr/.ssh/id_rsa": Permission denied
Permission denied, please try again.
Permission denied, please try again.
mockbuilder@54.90.228.174: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).

[2026-04-20 14:05:46,040][ ERROR][PID:1961751] Re-try request for task on 'ResallocHost, ticket_id=2423411, hostname=54.90.228.174, name=aws_x86_64_normal_prod_07134079_20260420_140149, requested_tags=['arch_s390x', 'copr_builder']': Unable to finish after 1 SSH attempts
[2026-04-20 14:05:46,043][  INFO][PID:1961751] VM Release request
[2026-04-20 14:05:46,099][ ERROR][PID:1961751] Backend process error: Three host tried without success: {'3.239.49.15', '13.217.95.158', '54.90.228.174'}
[2026-04-20 14:05:46,103][WARNING][PID:1961751] Switching not-finished job state to 'failed'
[2026-04-20 14:05:46,107][  INFO][PID:1961751] Worker failed build, took 2865.595423221588
[2026-04-20 14:05:46,115][  INFO][PID:1961751] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@osbuild",
            "project_name": "osbuild-composer",
            "project_dirname": "osbuild-composer",
            "submitter": "packit",
            "ended_on": 1776693946.1033738,
            "started_on": 1776691080.5079505,
            "submitted_on": null,
            "status": 0,
            "chroot": "centos-stream-9-s390x",
            "arch": "s390x",
            "buildroot_pkgs": [],
            "task_id": "10348571-centos-stream-9-s390x",
            "build_id": 10348571,
            "package_name": "osbuild-composer",
            "package_version": "169-1.20260420131710720793.main.5.g2414f89f9",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@osbuild/osbuild-composer/osbuild-composer",
            "git_hash": "2de95c1b69944450f8aee003fd5664dc8dd8b588",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@osbuild/osbuild-composer--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@osbuild/osbuild-composer/centos-stream-9-s390x/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_s390x"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@osbuild/osbuild-composer",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@osbuild/osbuild-composer",
            "result_dir": "10348571-osbuild-composer",
            "built_packages": "",
            "id": 10348571,
            "mockchain_macros": {
                "copr_username": "@osbuild",
                "copr_projectname": "osbuild-composer",
                "vendor": "Fedora Project COPR (@osbuild/osbuild-composer)"
            }
        }
    ]
}
[2026-04-20 14:05:46,364][  INFO][PID:1961751] Sending fedora-messaging bus message in build.end
[2026-04-20 14:05:46,639][  INFO][PID:1961751] Compressing /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-s390x/10348571-osbuild-composer/builder-live.log by gzip
[2026-04-20 14:05:46,641][  INFO][PID:1961751] Running command 'gzip /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-s390x/10348571-osbuild-composer/builder-live.log' as PID 2647019
[2026-04-20 14:05:46,725][  INFO][PID:1961751] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-s390x/10348571-osbuild-composer/builder-live.log)
[2026-04-20 14:05:46,728][  INFO][PID:1961751] Compressing /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-s390x/10348571-osbuild-composer/backend.log by gzip
[2026-04-20 14:05:46,732][  INFO][PID:1961751] Running command 'gzip /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-s390x/10348571-osbuild-composer/backend.log' as PID 2647060