[2026-04-07 20:04:33,634][  INFO][PID:2943177] Marking build as starting
[2026-04-07 20:04:33,698][  INFO][PID:2943177] Checking that /var/lib/copr/public_html/results/@yggdrasil/latest/rhel-10-s390x/repodata/repomd.xml exists
[2026-04-07 20:04:33,708][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:04:33,708][  INFO][PID:2943177] VM allocation process starts
[2026-04-07 20:04:33,732][  INFO][PID:2943177] Trying to allocate VM: ResallocHost, ticket_id=2211100, requested_tags=['copr_builder', 'arch_s390x']
[2026-04-07 20:04:36,751][  INFO][PID:2943177] Allocated host ResallocHost, ticket_id=2211100, hostname=44.200.45.92, name=aws_x86_64_spot_prod_05911813_20260407_195930, requested_tags=['copr_builder', 'arch_s390x']
[2026-04-07 20:04:36,752][  INFO][PID:2943177] Allocating ssh connection to builder
[2026-04-07 20:04:36,753][  INFO][PID:2943177] Checking that builder machine is OK
[2026-04-07 20:04:37,062][  INFO][PID:2943177] Running remote command: copr-builder-ready rhel-10-s390x
[2026-04-07 20:04:37,270][  INFO][PID:2943177] Checking Red Hat subscription (attempt #1)
Red Hat subscription active
Builder is ready to be used

[2026-04-07 20:04:37,271][  INFO][PID:2943177] Filling build.info file with builder info
[2026-04-07 20:04:37,279][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:04:37,281][  INFO][PID:2943177] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@yggdrasil",
            "project_name": "latest",
            "project_dirname": "latest",
            "submitter": "packit",
            "ended_on": null,
            "started_on": 1775592277.2810404,
            "submitted_on": null,
            "status": 3,
            "chroot": "rhel-10-s390x",
            "arch": "s390x",
            "buildroot_pkgs": [],
            "task_id": "10298637-rhel-10-s390x",
            "build_id": 10298637,
            "package_name": "rhc-worker-playbook",
            "package_version": "0.2.7-99.20260407git7b888e6.fc43",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@yggdrasil/latest/rhc-worker-playbook",
            "git_hash": "0d1cced7a0d389a7946e4ddeddc1182c6a52cf3e",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@yggdrasil/latest--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@yggdrasil/latest/rhel-10-s390x/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_s390x"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@yggdrasil/latest",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@yggdrasil/latest",
            "result_dir": "10298637-rhc-worker-playbook",
            "built_packages": "",
            "id": 10298637,
            "mockchain_macros": {
                "copr_username": "@yggdrasil",
                "copr_projectname": "latest",
                "vendor": "Fedora Project COPR (@yggdrasil/latest)"
            }
        }
    ]
}
[2026-04-07 20:04:37,329][  INFO][PID:2943177] Sending fedora-messaging bus message in build.start
[2026-04-07 20:04:38,034][  INFO][PID:2943177] Sending fedora-messaging bus message in chroot.start
[2026-04-07 20:04:38,065][  INFO][PID:2943177] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10298637-rhel-10-s390x --chroot rhel-10-s390x --detached
[2026-04-07 20:04:38,394][  INFO][PID:2943177] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '44.200.45.92' (ED25519) to the list of known hosts.


[2026-04-07 20:04:38,395][  INFO][PID:2943177] Downloading the builder-live.log file, attempt 1
[2026-04-07 20:04:38,397][  INFO][PID:2943177] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.200.45.92 copr-rpmbuild-log
[2026-04-07 20:04:43,403][  INFO][PID:2943177] Periodic builder liveness probe: alive
[2026-04-07 20:04:43,404][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:04:48,405][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:04:53,436][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:04:58,437][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:05:03,438][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:05:08,439][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:05:13,518][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:05:18,526][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:05:23,529][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:05:28,530][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:05:33,531][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:05:38,532][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:05:43,533][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:05:48,541][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:05:53,542][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:05:58,545][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:06:03,546][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:06:08,547][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:06:13,548][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:06:18,549][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:06:23,550][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:06:28,551][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:06:33,555][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:06:38,557][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:06:43,559][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:06:48,562][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:06:53,565][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:06:58,566][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:07:03,569][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:07:08,571][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:07:13,574][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:07:18,581][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:07:23,584][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:07:28,614][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:07:33,617][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:07:38,622][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:07:43,630][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:07:48,631][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:07:53,690][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:07:58,693][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:08:03,698][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:08:08,718][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:08:13,720][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:08:18,721][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:08:23,729][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:08:28,735][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:08:33,740][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:08:38,747][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:08:43,748][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:08:48,758][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:08:53,761][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:08:58,796][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:09:03,799][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:09:08,816][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:09:13,819][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:09:18,823][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:09:23,828][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:09:28,830][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:09:33,871][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:09:38,872][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:09:43,880][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:09:48,882][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:09:53,886][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:09:58,889][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:10:03,893][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:10:08,897][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:10:13,900][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:10:18,901][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:10:23,902][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:10:28,906][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:10:33,907][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:10:38,909][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:10:43,925][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:10:48,926][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:10:53,927][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:10:58,929][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:11:03,931][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:11:08,932][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:11:13,933][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:11:18,939][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:11:23,942][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:11:28,944][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:11:33,945][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:11:38,946][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:11:43,951][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:11:48,953][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:11:53,962][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:11:58,964][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:12:03,967][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:12:08,969][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:12:13,974][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:12:18,365][ ERROR][PID:2943177] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-07 20:12:18,984][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:12:23,987][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:12:28,367][WARNING][PID:2943177] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-07 20:12:28,989][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:12:33,990][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:12:38,368][  INFO][PID:2943177] Downloading the builder-live.log file, attempt 2
[2026-04-07 20:12:38,370][  INFO][PID:2943177] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.200.45.92 copr-rpmbuild-log
[2026-04-07 20:12:38,996][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:12:43,998][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:12:49,011][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:12:54,012][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:12:59,014][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:13:04,016][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:13:09,018][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:13:14,020][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:13:19,022][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:13:24,036][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:13:29,061][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:13:34,063][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:13:38,446][ ERROR][PID:2943177] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-07 20:13:39,064][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:13:44,066][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:13:48,481][WARNING][PID:2943177] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-07 20:13:49,067][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:13:54,068][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:13:58,482][  INFO][PID:2943177] Downloading the builder-live.log file, attempt 3
[2026-04-07 20:13:58,494][  INFO][PID:2943177] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.200.45.92 copr-rpmbuild-log
[2026-04-07 20:13:59,069][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:14:04,071][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:14:09,072][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:14:14,076][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:14:19,077][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:14:24,079][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:14:29,081][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:14:34,083][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:14:39,084][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:14:44,095][  INFO][PID:2943177] Periodic builder liveness probe: alive
[2026-04-07 20:14:44,095][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:14:49,097][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:14:54,102][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:14:58,562][ ERROR][PID:2943177] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-07 20:14:59,104][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:15:04,105][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:15:08,589][WARNING][PID:2943177] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-07 20:15:09,106][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:15:14,107][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:15:18,590][  INFO][PID:2943177] Downloading the builder-live.log file, attempt 4
[2026-04-07 20:15:18,591][  INFO][PID:2943177] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.200.45.92 copr-rpmbuild-log
[2026-04-07 20:15:19,108][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:15:24,109][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:15:29,110][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:15:34,113][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:15:39,135][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:15:44,137][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:15:49,138][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:15:54,139][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:15:59,140][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:16:04,142][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:16:09,143][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:16:14,160][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:16:18,659][ ERROR][PID:2943177] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-07 20:16:19,161][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:16:24,162][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:16:28,699][ ERROR][PID:2943177] Giving up for unstable SSH, failures: 1775592748.3677306, 1775592828.4811728, 1775592908.589502, 1775592988.6983364
[2026-04-07 20:16:28,705][ ERROR][PID:2943177] Re-try request for task on 'ResallocHost, ticket_id=2211100, hostname=44.200.45.92, name=aws_x86_64_spot_prod_05911813_20260407_195930, requested_tags=['copr_builder', 'arch_s390x']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2026-04-07 20:16:28,707][  INFO][PID:2943177] Releasing VM back to pool
[2026-04-07 20:16:28,728][  INFO][PID:2943177] Retry #1 (on other host)
[2026-04-07 20:16:28,731][  INFO][PID:2943177] Checking that /var/lib/copr/public_html/results/@yggdrasil/latest/rhel-10-s390x/repodata/repomd.xml exists
[2026-04-07 20:16:28,741][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:16:28,742][  INFO][PID:2943177] VM allocation process starts
[2026-04-07 20:16:28,759][  INFO][PID:2943177] Trying to allocate VM: ResallocHost, ticket_id=2211362, requested_tags=['copr_builder', 'arch_s390x']
[2026-04-07 20:16:31,775][  INFO][PID:2943177] Allocated host ResallocHost, ticket_id=2211362, hostname=54.209.235.140, name=aws_x86_64_spot_prod_05912553_20260407_201503, requested_tags=['copr_builder', 'arch_s390x']
[2026-04-07 20:16:31,775][  INFO][PID:2943177] Allocating ssh connection to builder
[2026-04-07 20:16:31,776][  INFO][PID:2943177] Checking that builder machine is OK
[2026-04-07 20:16:32,131][  INFO][PID:2943177] Running remote command: copr-builder-ready rhel-10-s390x
[2026-04-07 20:16:32,347][  INFO][PID:2943177] Checking Red Hat subscription (attempt #1)
Red Hat subscription active
Builder is ready to be used

[2026-04-07 20:16:32,348][  INFO][PID:2943177] Filling build.info file with builder info
[2026-04-07 20:16:32,363][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:16:32,364][  INFO][PID:2943177] Not re-notifying FE and msg buses for the new host.
[2026-04-07 20:16:32,364][  INFO][PID:2943177] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10298637-rhel-10-s390x --chroot rhel-10-s390x --detached
[2026-04-07 20:16:32,727][  INFO][PID:2943177] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '54.209.235.140' (ED25519) to the list of known hosts.


[2026-04-07 20:16:32,727][  INFO][PID:2943177] Downloading the builder-live.log file, attempt 1
[2026-04-07 20:16:32,729][  INFO][PID:2943177] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.209.235.140 copr-rpmbuild-log
[2026-04-07 20:16:37,728][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:16:42,730][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:16:47,732][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:16:52,733][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:16:57,736][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:17:02,737][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:17:07,747][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:17:12,749][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:17:17,751][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:17:22,753][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:17:27,759][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:17:32,761][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:17:37,762][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:17:42,763][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:17:47,764][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:17:52,765][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:17:57,767][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:18:02,768][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:18:07,769][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:18:12,771][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:18:17,772][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:18:22,773][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:18:27,780][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:18:32,782][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:18:37,785][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:18:42,787][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:18:47,788][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:18:52,789][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:18:57,790][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:19:02,793][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:19:07,801][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:19:12,802][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:19:17,803][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:19:22,811][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:19:27,816][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:19:32,817][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:19:37,818][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:19:42,821][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:19:47,822][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:19:52,823][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:19:57,824][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:20:02,826][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:20:07,828][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:20:12,830][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:20:17,832][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:20:22,833][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:20:27,834][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:20:32,835][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:20:37,837][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:20:42,838][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:20:47,839][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:20:52,840][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:20:57,842][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:21:02,880][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:21:07,881][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:21:12,882][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:21:17,883][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:21:22,884][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:21:27,885][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:21:32,886][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:21:37,887][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:21:42,891][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:21:47,900][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:21:52,910][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:21:57,911][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:22:02,918][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:22:07,923][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:22:12,924][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:22:17,925][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:22:22,926][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:22:27,927][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:22:32,928][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:22:37,928][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:22:42,929][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:22:47,942][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:22:52,944][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:22:57,945][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:23:02,946][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:23:07,947][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:23:12,948][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:23:17,949][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:23:22,950][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:23:27,951][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:23:32,951][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:23:37,952][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:23:42,953][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:23:47,954][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:23:52,955][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:23:57,957][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:24:02,958][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:24:07,959][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:24:12,960][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:24:17,961][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:24:22,961][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:24:27,970][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:24:32,971][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:24:37,972][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:24:42,973][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:24:47,979][  INFO][PID:2943177] Periodic builder liveness probe: alive
[2026-04-07 20:24:47,980][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:24:52,981][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:24:57,982][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:25:02,993][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:25:07,994][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:25:12,995][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:25:17,995][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:25:23,018][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:25:28,019][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:25:33,020][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:25:38,021][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:25:43,023][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:25:48,024][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:25:53,025][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:25:58,026][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:26:03,027][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:26:08,028][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:26:13,029][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:26:18,030][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:26:23,031][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:26:28,039][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:26:33,040][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:26:38,041][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:26:43,042][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:26:48,043][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:26:53,044][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:26:58,045][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:27:03,046][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:27:08,047][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:27:12,273][ ERROR][PID:2943177] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-07 20:27:13,048][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:27:18,049][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:27:22,398][WARNING][PID:2943177] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-07 20:27:23,050][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:27:28,051][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:27:32,398][  INFO][PID:2943177] Downloading the builder-live.log file, attempt 2
[2026-04-07 20:27:32,400][  INFO][PID:2943177] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.209.235.140 copr-rpmbuild-log
[2026-04-07 20:27:33,052][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:27:38,053][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:27:43,054][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:27:48,054][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:27:53,056][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:27:58,070][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:28:03,071][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:28:08,072][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:28:13,073][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:28:18,074][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:28:23,075][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:28:28,076][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:28:32,437][ ERROR][PID:2943177] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-07 20:28:33,077][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:28:38,078][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:28:42,438][WARNING][PID:2943177] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-07 20:28:43,079][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:28:48,080][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:28:52,439][  INFO][PID:2943177] Downloading the builder-live.log file, attempt 3
[2026-04-07 20:28:52,440][  INFO][PID:2943177] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.209.235.140 copr-rpmbuild-log
[2026-04-07 20:28:53,081][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:28:58,082][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:29:03,084][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:29:08,085][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:29:13,086][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:29:18,087][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:29:23,088][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:29:28,089][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:29:33,090][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:29:38,091][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:29:43,092][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:29:48,093][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:29:52,506][ ERROR][PID:2943177] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-07 20:29:53,094][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:29:58,095][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:30:02,507][WARNING][PID:2943177] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-07 20:30:03,096][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:30:08,097][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:30:12,508][  INFO][PID:2943177] Downloading the builder-live.log file, attempt 4
[2026-04-07 20:30:12,509][  INFO][PID:2943177] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.209.235.140 copr-rpmbuild-log
[2026-04-07 20:30:13,098][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:30:18,099][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:30:23,102][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:30:28,103][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:30:33,104][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:30:38,105][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:30:43,106][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:30:48,107][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:30:53,108][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:30:58,109][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:31:03,110][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:31:08,111][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:31:12,575][ ERROR][PID:2943177] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-07 20:31:13,112][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:31:18,115][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:31:22,576][ ERROR][PID:2943177] Giving up for unstable SSH, failures: 1775593642.3980892, 1775593722.43872, 1775593802.5073125, 1775593882.5765731
[2026-04-07 20:31:22,577][ ERROR][PID:2943177] Re-try request for task on 'ResallocHost, ticket_id=2211362, hostname=54.209.235.140, name=aws_x86_64_spot_prod_05912553_20260407_201503, requested_tags=['copr_builder', 'arch_s390x']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2026-04-07 20:31:22,577][  INFO][PID:2943177] Releasing VM back to pool
[2026-04-07 20:31:22,588][  INFO][PID:2943177] Retry #2 (on other host)
[2026-04-07 20:31:22,589][  INFO][PID:2943177] Checking that /var/lib/copr/public_html/results/@yggdrasil/latest/rhel-10-s390x/repodata/repomd.xml exists
[2026-04-07 20:31:22,589][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:31:22,590][  INFO][PID:2943177] VM allocation process starts
[2026-04-07 20:31:22,600][  INFO][PID:2943177] Trying to allocate VM: ResallocHost, ticket_id=2211596, requested_tags=['copr_builder', 'arch_s390x']
[2026-04-07 20:31:25,609][  INFO][PID:2943177] Allocated host ResallocHost, ticket_id=2211596, hostname=3.239.163.37, name=aws_x86_64_normalreserved_prod_05912774_20260407_202628, requested_tags=['copr_builder', 'arch_s390x']
[2026-04-07 20:31:25,610][  INFO][PID:2943177] Allocating ssh connection to builder
[2026-04-07 20:31:25,610][  INFO][PID:2943177] Checking that builder machine is OK
[2026-04-07 20:31:25,941][  INFO][PID:2943177] Running remote command: copr-builder-ready rhel-10-s390x
[2026-04-07 20:31:26,151][  INFO][PID:2943177] Checking Red Hat subscription (attempt #1)
Red Hat subscription active
Builder is ready to be used

[2026-04-07 20:31:26,151][  INFO][PID:2943177] Filling build.info file with builder info
[2026-04-07 20:31:26,160][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:31:26,161][  INFO][PID:2943177] Not re-notifying FE and msg buses for the new host.
[2026-04-07 20:31:26,162][  INFO][PID:2943177] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10298637-rhel-10-s390x --chroot rhel-10-s390x --detached
[2026-04-07 20:31:26,512][  INFO][PID:2943177] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '3.239.163.37' (ED25519) to the list of known hosts.


[2026-04-07 20:31:26,512][  INFO][PID:2943177] Downloading the builder-live.log file, attempt 1
[2026-04-07 20:31:26,514][  INFO][PID:2943177] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.239.163.37 copr-rpmbuild-log
[2026-04-07 20:31:31,513][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:31:36,514][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:31:41,515][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:31:46,516][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:31:51,517][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:31:56,518][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:32:01,519][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:32:06,520][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:32:11,521][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:32:16,525][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:32:21,526][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:32:26,527][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:32:31,527][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:32:36,529][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:32:41,530][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:32:46,532][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:32:51,533][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:32:56,534][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:33:01,535][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:33:06,535][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:33:11,536][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:33:16,537][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:33:21,539][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:33:26,540][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:33:31,541][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:33:36,542][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:33:41,543][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:33:46,544][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:33:51,545][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:33:56,546][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:34:01,546][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:34:06,547][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:34:11,548][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:34:16,549][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:34:21,550][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:34:26,551][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:34:31,552][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:34:36,553][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:34:41,554][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:34:46,555][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:34:51,560][  INFO][PID:2943177] Periodic builder liveness probe: alive
[2026-04-07 20:34:51,561][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:34:56,562][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:35:01,563][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:35:06,564][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:35:11,565][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:35:16,566][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:35:21,567][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:35:26,568][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:35:31,569][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:35:36,570][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:35:41,571][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:35:46,572][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:35:51,573][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:35:56,574][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:36:01,575][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:36:06,576][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:36:11,577][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:36:16,578][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:36:21,579][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:36:26,580][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:36:31,581][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:36:36,582][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:36:41,583][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:36:46,584][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:36:51,585][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:36:56,586][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:37:01,587][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:37:06,588][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:37:11,589][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:37:16,590][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:37:21,591][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:37:26,592][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:37:31,593][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:37:36,599][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:37:41,600][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:37:46,601][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:37:51,603][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:37:56,604][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:38:01,605][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:38:06,606][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:38:11,607][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:38:16,620][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:38:21,621][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:38:26,622][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:38:31,623][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:38:36,624][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:38:41,813][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:38:46,814][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:38:51,815][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:38:56,817][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:39:01,818][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:39:06,818][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:39:11,825][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:39:16,886][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:39:21,960][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:39:27,151][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:39:32,188][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:39:37,210][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:39:42,234][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:39:47,331][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:39:52,332][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:39:57,341][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:40:02,342][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:40:07,402][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:40:12,403][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:40:17,610][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:40:22,632][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:40:27,671][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:40:32,683][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:40:37,684][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:40:42,684][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:40:47,708][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:40:52,708][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:40:57,709][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:41:02,710][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:41:07,711][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:41:12,722][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:41:18,216][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:41:23,218][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:41:28,219][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:41:33,221][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:41:38,224][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:41:43,225][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:41:48,226][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:41:53,227][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:41:58,260][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:42:03,261][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:42:08,262][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:42:13,263][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:42:18,264][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:42:23,265][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:42:28,266][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:42:33,267][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:42:38,268][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:42:43,269][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:42:48,270][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:42:53,398][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:42:58,398][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:43:03,507][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:43:08,819][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:43:13,821][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:43:18,822][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:43:24,001][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:43:29,003][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:43:34,007][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:43:39,116][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:43:44,133][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:43:49,134][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:43:54,135][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:43:59,158][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:44:04,192][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:44:09,223][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:44:14,228][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:44:19,575][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:44:24,581][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:44:29,589][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:44:34,590][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:44:39,591][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:44:44,593][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:44:49,599][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:44:54,609][  INFO][PID:2943177] Periodic builder liveness probe: alive
[2026-04-07 20:44:54,620][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:44:59,621][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:45:04,625][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:45:09,626][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:45:14,627][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:45:19,628][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:45:24,631][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:45:29,632][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:45:34,633][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:45:39,634][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:45:44,635][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:45:49,636][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:45:54,643][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:45:59,650][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:46:04,655][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:46:09,656][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:46:14,657][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:46:19,658][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:46:24,659][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:46:29,661][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:46:34,667][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:46:39,668][  INFO][PID:2943177] Checking for cancel request
[2026-04-07 20:46:40,196][  INFO][PID:2943177] Downloading results from builder
[2026-04-07 20:46:40,197][  INFO][PID:2943177] rsyncing of mockbuilder@3.239.163.37:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@yggdrasil/latest/rhel-10-s390x/10298637-rhc-worker-playbook started
[2026-04-07 20:46:40,198][  INFO][PID:2943177] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@3.239.163.37:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@yggdrasil/latest/rhel-10-s390x/10298637-rhc-worker-playbook/ &> /var/lib/copr/public_html/results/@yggdrasil/latest/rhel-10-s390x/10298637-rhc-worker-playbook/build-10298637.rsync.log
[2026-04-07 20:46:40,654][  INFO][PID:2943177] rsyncing finished.
[2026-04-07 20:46:40,655][  INFO][PID:2943177] Releasing VM back to pool
[2026-04-07 20:46:40,663][  INFO][PID:2943177] Searching for 'success' file in resultdir
[2026-04-07 20:46:40,664][  INFO][PID:2943177] Going to sign pkgs from source: 10298637-rhel-10-s390x in chroot: /var/lib/copr/public_html/results/@yggdrasil/latest/rhel-10-s390x
[2026-04-07 20:46:40,665][  INFO][PID:2943177] Calling '/bin/sign -u @yggdrasil#latest@copr.fedorahosted.org -p' (attempt #1)
[2026-04-07 20:46:40,941][  INFO][PID:2943177] Calling '/bin/sign -4 -h sha256 -u @yggdrasil#latest@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@yggdrasil/latest/rhel-10-s390x/10298637-rhc-worker-playbook/rhc-worker-playbook-0.2.7-99.20260407git7b888e6.el10.s390x.rpm' (attempt #1)
[2026-04-07 20:46:42,058][  INFO][PID:2943177] signed rpm: /var/lib/copr/public_html/results/@yggdrasil/latest/rhel-10-s390x/10298637-rhc-worker-playbook/rhc-worker-playbook-0.2.7-99.20260407git7b888e6.el10.s390x.rpm
[2026-04-07 20:46:42,058][  INFO][PID:2943177] Calling '/bin/sign -4 -h sha256 -u @yggdrasil#latest@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@yggdrasil/latest/rhel-10-s390x/10298637-rhc-worker-playbook/rhc-worker-playbook-0.2.7-99.20260407git7b888e6.el10.src.rpm' (attempt #1)
[2026-04-07 20:46:43,127][  INFO][PID:2943177] signed rpm: /var/lib/copr/public_html/results/@yggdrasil/latest/rhel-10-s390x/10298637-rhc-worker-playbook/rhc-worker-playbook-0.2.7-99.20260407git7b888e6.el10.src.rpm
[2026-04-07 20:46:43,128][  INFO][PID:2943177] Calling '/bin/sign -4 -h sha256 -u @yggdrasil#latest@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@yggdrasil/latest/rhel-10-s390x/10298637-rhc-worker-playbook/rhc-worker-playbook-debuginfo-0.2.7-99.20260407git7b888e6.el10.s390x.rpm' (attempt #1)
[2026-04-07 20:46:43,953][  INFO][PID:2943177] signed rpm: /var/lib/copr/public_html/results/@yggdrasil/latest/rhel-10-s390x/10298637-rhc-worker-playbook/rhc-worker-playbook-debuginfo-0.2.7-99.20260407git7b888e6.el10.s390x.rpm
[2026-04-07 20:46:43,954][  INFO][PID:2943177] Calling '/bin/sign -4 -h sha256 -u @yggdrasil#latest@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@yggdrasil/latest/rhel-10-s390x/10298637-rhc-worker-playbook/rhc-worker-playbook-debugsource-0.2.7-99.20260407git7b888e6.el10.s390x.rpm' (attempt #1)
[2026-04-07 20:46:44,711][  INFO][PID:2943177] signed rpm: /var/lib/copr/public_html/results/@yggdrasil/latest/rhel-10-s390x/10298637-rhc-worker-playbook/rhc-worker-playbook-debugsource-0.2.7-99.20260407git7b888e6.el10.s390x.rpm
[2026-04-07 20:46:44,712][  INFO][PID:2943177] Sign done
[2026-04-07 20:46:44,712][  INFO][PID:2943177] Incremental createrepo run, adding 10298637-rhc-worker-playbook into https://download.copr.fedorainfracloud.org/results/@yggdrasil/latest/rhel-10-s390x, (auto-create-repo=True)
[2026-04-07 20:46:44,713][  INFO][PID:2943177] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@yggdrasil/latest/rhel-10-s390x --add 10298637-rhc-worker-playbook --no-appstream-metadata' as PID 3178245
[2026-04-07 20:46:45,499][  INFO][PID:2943177] Finished after 0 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@yggdrasil/latest/rhel-10-s390x --add 10298637-rhc-worker-playbook --no-appstream-metadata)
[2026-04-07 20:46:45,500][  INFO][PID:2943177] Getting build details
[2026-04-07 20:46:45,500][  INFO][PID:2943177] Listing built binary packages in /var/lib/copr/public_html/results/@yggdrasil/latest/rhel-10-s390x/10298637-rhc-worker-playbook
[2026-04-07 20:46:45,501][  INFO][PID:2943177] Built packages:
['rhc-worker-playbook-debuginfo 0.2.7', 'rhc-worker-playbook 0.2.7', 'rhc-worker-playbook-debugsource 0.2.7']
[2026-04-07 20:46:45,501][  INFO][PID:2943177] build details: {'built_packages': 'rhc-worker-playbook-debuginfo 0.2.7\nrhc-worker-playbook 0.2.7\nrhc-worker-playbook-debugsource 0.2.7'}
[2026-04-07 20:46:45,501][  INFO][PID:2943177] Retrieving pubkey
[2026-04-07 20:46:45,502][  INFO][PID:2943177] Calling '/bin/sign -u @yggdrasil#latest@copr.fedorahosted.org -p' (attempt #1)
[2026-04-07 20:46:45,789][  INFO][PID:2943177] Added pubkey for user @yggdrasil project latest into: /var/lib/copr/public_html/results/@yggdrasil/latest/pubkey.gpg
[2026-04-07 20:46:45,790][  INFO][PID:2943177] Finished build: id=10298637 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@yggdrasil/latest chroot=rhel-10-s390x 
[2026-04-07 20:46:45,792][  INFO][PID:2943177] Worker succeeded build, took 919.6305735111237
[2026-04-07 20:46:45,792][  INFO][PID:2943177] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@yggdrasil",
            "project_name": "latest",
            "project_dirname": "latest",
            "submitter": "packit",
            "ended_on": 1775594805.7920098,
            "started_on": 1775593886.1614363,
            "submitted_on": null,
            "status": 1,
            "chroot": "rhel-10-s390x",
            "arch": "s390x",
            "buildroot_pkgs": [],
            "task_id": "10298637-rhel-10-s390x",
            "build_id": 10298637,
            "package_name": "rhc-worker-playbook",
            "package_version": "0.2.7-99.20260407git7b888e6.fc43",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@yggdrasil/latest/rhc-worker-playbook",
            "git_hash": "0d1cced7a0d389a7946e4ddeddc1182c6a52cf3e",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@yggdrasil/latest--packit",
            "results": {
                "packages": [
                    {
                        "name": "rhc-worker-playbook-debuginfo",
                        "epoch": null,
                        "version": "0.2.7",
                        "release": "99.20260407git7b888e6.el10",
                        "arch": "s390x"
                    },
                    {
                        "name": "rhc-worker-playbook",
                        "epoch": null,
                        "version": "0.2.7",
                        "release": "99.20260407git7b888e6.el10",
                        "arch": "s390x"
                    },
                    {
                        "name": "rhc-worker-playbook-debugsource",
                        "epoch": null,
                        "version": "0.2.7",
                        "release": "99.20260407git7b888e6.el10",
                        "arch": "s390x"
                    },
                    {
                        "name": "rhc-worker-playbook",
                        "epoch": null,
                        "version": "0.2.7",
                        "release": "99.20260407git7b888e6.el10",
                        "arch": "src"
                    }
                ]
            },
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@yggdrasil/latest/rhel-10-s390x/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_s390x"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@yggdrasil/latest",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@yggdrasil/latest",
            "result_dir": "10298637-rhc-worker-playbook",
            "built_packages": "rhc-worker-playbook-debuginfo 0.2.7\nrhc-worker-playbook 0.2.7\nrhc-worker-playbook-debugsource 0.2.7",
            "id": 10298637,
            "mockchain_macros": {
                "copr_username": "@yggdrasil",
                "copr_projectname": "latest",
                "vendor": "Fedora Project COPR (@yggdrasil/latest)"
            }
        }
    ]
}
[2026-04-07 20:46:45,837][  INFO][PID:2943177] Sending fedora-messaging bus message in build.end
[2026-04-07 20:46:45,866][  INFO][PID:2943177] Compressing /var/lib/copr/public_html/results/@yggdrasil/latest/rhel-10-s390x/10298637-rhc-worker-playbook/builder-live.log by gzip
[2026-04-07 20:46:45,867][  INFO][PID:2943177] Running command 'gzip /var/lib/copr/public_html/results/@yggdrasil/latest/rhel-10-s390x/10298637-rhc-worker-playbook/builder-live.log' as PID 3178461
[2026-04-07 20:46:45,961][  INFO][PID:2943177] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@yggdrasil/latest/rhel-10-s390x/10298637-rhc-worker-playbook/builder-live.log)
[2026-04-07 20:46:45,961][  INFO][PID:2943177] Compressing /var/lib/copr/public_html/results/@yggdrasil/latest/rhel-10-s390x/10298637-rhc-worker-playbook/backend.log by gzip
[2026-04-07 20:46:45,962][  INFO][PID:2943177] Running command 'gzip /var/lib/copr/public_html/results/@yggdrasil/latest/rhel-10-s390x/10298637-rhc-worker-playbook/backend.log' as PID 3178462