[2026-04-30 15:23:05,395][  INFO][PID:1262875] Marking build as starting
[2026-04-30 15:23:05,720][  INFO][PID:1262875] Checking that /var/lib/copr/public_html/results/keithbowes/deponejo/centos-stream-10-s390x/repodata/repomd.xml exists
[2026-04-30 15:23:05,907][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:23:05,926][  INFO][PID:1262875] VM allocation process starts
[2026-04-30 15:23:06,034][  INFO][PID:1262875] Trying to allocate VM: ResallocHost, ticket_id=2672424, requested_tags=['arch_s390x', 'copr_builder']
[2026-04-30 15:23:11,074][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:23:16,089][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:23:21,092][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:23:26,097][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:23:31,101][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:23:36,105][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:23:41,107][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:23:46,112][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:23:51,114][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:23:56,117][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:24:01,120][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:24:06,123][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:24:11,126][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:24:14,262][  INFO][PID:1262875] Allocated host ResallocHost, ticket_id=2672424, hostname=44.210.103.78, name=aws_x86_64_spot_prod_08358008_20260430_152220, requested_tags=['arch_s390x', 'copr_builder']
[2026-04-30 15:24:14,264][  INFO][PID:1262875] Allocating ssh connection to builder
[2026-04-30 15:24:14,265][  INFO][PID:1262875] Checking that builder machine is OK
[2026-04-30 15:24:14,634][  INFO][PID:1262875] Installed copr-rpmbuild version: 1.8
[2026-04-30 15:24:14,635][  INFO][PID:1262875] Running remote command: copr-builder-ready centos-stream-10-s390x
[2026-04-30 15:24:14,870][  INFO][PID:1262875] Red Hat subscription not needed for centos-stream-10-s390x
Builder is ready to be used

[2026-04-30 15:24:14,874][  INFO][PID:1262875] Filling build.info file with builder info
[2026-04-30 15:24:14,877][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:24:14,880][  INFO][PID:1262875] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "keithbowes",
            "project_name": "deponejo",
            "project_dirname": "deponejo",
            "submitter": "keithbowes",
            "ended_on": null,
            "started_on": 1777562654.880517,
            "submitted_on": null,
            "status": 3,
            "chroot": "centos-stream-10-s390x",
            "arch": "s390x",
            "buildroot_pkgs": [],
            "task_id": "10412257-centos-stream-10-s390x",
            "build_id": 10412257,
            "package_name": "neomutt",
            "package_version": "20260406-2",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/keithbowes/deponejo/neomutt",
            "git_hash": "cd6e360f1f91413b1a1ed6efcaca830db80073dd",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "keithbowes/deponejo--keithbowes",
            "results": null,
            "appstream": true,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/keithbowes/deponejo/centos-stream-10-s390x/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_s390x"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/keithbowes/deponejo",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/keithbowes/deponejo",
            "result_dir": "10412257-neomutt",
            "built_packages": "",
            "id": 10412257,
            "mockchain_macros": {
                "copr_username": "keithbowes",
                "copr_projectname": "deponejo",
                "vendor": "Fedora Project COPR (keithbowes/deponejo)"
            }
        }
    ]
}
[2026-04-30 15:24:14,993][  INFO][PID:1262875] Sending fedora-messaging bus message in build.start
[2026-04-30 15:24:15,720][  INFO][PID:1262875] Sending fedora-messaging bus message in chroot.start
[2026-04-30 15:24:15,766][  INFO][PID:1262875] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10412257-centos-stream-10-s390x --chroot centos-stream-10-s390x --detached
[2026-04-30 15:24:16,301][  INFO][PID:1262875] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '44.210.103.78' (ED25519) to the list of known hosts.


[2026-04-30 15:24:16,302][  INFO][PID:1262875] Downloading the builder-live.log file, attempt 1
[2026-04-30 15:24:16,304][  INFO][PID:1262875] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.210.103.78 copr-rpmbuild-log
[2026-04-30 15:24:21,338][  INFO][PID:1262875] Periodic builder liveness probe: alive
[2026-04-30 15:24:21,340][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:24:26,344][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:24:31,346][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:24:36,348][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:24:41,350][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:24:46,352][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:24:51,353][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:24:56,356][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:25:01,359][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:25:06,360][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:25:11,362][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:25:16,366][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:25:21,369][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:25:26,372][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:25:31,374][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:25:36,375][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:25:41,377][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:25:46,379][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:25:51,380][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:25:56,382][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:26:01,383][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:26:06,385][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:26:11,387][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:26:16,388][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:26:21,391][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:26:26,395][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:26:31,396][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:26:36,398][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:26:41,399][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:26:46,402][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:26:51,441][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:26:56,446][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:27:01,452][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:27:06,454][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:27:11,456][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:27:16,458][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:27:21,461][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:27:26,463][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:27:31,465][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:27:36,473][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:27:41,525][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:27:46,526][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:27:51,528][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:27:56,531][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:28:01,533][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:28:06,535][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:28:11,538][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:28:16,545][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:28:21,785][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:28:26,787][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:28:31,792][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:28:36,793][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:28:41,795][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:28:46,796][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:28:51,807][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:28:56,808][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:29:01,809][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:29:06,813][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:29:11,815][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:29:16,817][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:29:21,819][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:29:26,821][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:29:31,823][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:29:36,825][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:29:41,826][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:29:46,836][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:29:51,838][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:29:56,840][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:30:01,842][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:30:06,843][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:30:11,846][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:30:16,849][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:30:21,852][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:30:26,854][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:30:31,855][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:30:36,857][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:30:41,859][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:30:46,861][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:30:51,863][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:30:56,864][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:31:01,866][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:31:06,868][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:31:11,870][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:31:16,872][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:31:21,875][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:31:26,876][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:31:31,879][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:31:36,880][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:31:41,882][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:31:46,884][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:31:51,886][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:31:56,890][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:32:01,893][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:32:06,895][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:32:11,897][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:32:16,968][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:32:21,979][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:32:26,980][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:32:31,981][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:32:36,983][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:32:41,990][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:32:46,992][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:32:51,993][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:32:56,995][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:33:01,997][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:33:06,999][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:33:12,000][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:33:17,002][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:33:22,003][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:33:27,006][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:33:32,010][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:33:37,012][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:33:42,014][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:33:47,015][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:33:52,018][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:33:57,019][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:34:02,022][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:34:07,029][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:34:12,030][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:34:17,048][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:34:22,084][  INFO][PID:1262875] Periodic builder liveness probe: alive
[2026-04-30 15:34:22,088][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:34:27,094][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:34:32,100][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:34:37,101][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:34:42,103][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:34:47,109][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:34:52,110][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:34:57,113][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:35:02,115][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:35:07,116][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:35:12,118][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:35:17,120][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:35:22,122][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:35:27,124][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:35:32,126][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:35:37,129][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:35:42,131][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:35:47,133][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:35:52,134][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:35:57,136][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:36:02,138][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:36:07,143][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:36:12,147][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:36:17,149][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:36:22,151][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:36:27,153][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:36:32,297][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:36:37,300][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:36:42,303][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:36:47,305][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:36:52,311][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:36:57,313][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:37:02,316][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:37:07,318][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:37:12,319][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:37:17,321][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:37:22,323][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:37:27,324][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:37:32,326][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:37:37,327][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:37:42,329][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:37:45,172][ ERROR][PID:1262875] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-30 15:37:47,330][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:37:52,332][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:37:55,187][WARNING][PID:1262875] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-30 15:37:57,333][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:38:02,335][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:38:05,188][  INFO][PID:1262875] Downloading the builder-live.log file, attempt 2
[2026-04-30 15:38:05,191][  INFO][PID:1262875] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.210.103.78 copr-rpmbuild-log
[2026-04-30 15:38:07,347][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:38:12,348][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:38:17,350][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:38:22,351][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:38:27,353][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:38:32,355][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:38:37,356][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:38:42,358][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:38:47,360][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:38:52,363][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:38:57,364][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:39:02,366][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:39:05,257][ ERROR][PID:1262875] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-30 15:39:07,369][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:39:12,370][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:39:15,271][WARNING][PID:1262875] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-30 15:39:17,371][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:39:22,373][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:39:25,272][  INFO][PID:1262875] Downloading the builder-live.log file, attempt 3
[2026-04-30 15:39:25,274][  INFO][PID:1262875] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.210.103.78 copr-rpmbuild-log
[2026-04-30 15:39:27,374][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:39:32,376][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:39:37,378][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:39:42,380][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:39:47,381][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:39:52,382][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:39:57,384][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:40:02,385][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:40:07,387][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:40:12,388][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:40:17,390][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:40:22,392][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:40:25,342][ ERROR][PID:1262875] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-30 15:40:27,393][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:40:32,395][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:40:35,363][WARNING][PID:1262875] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-30 15:40:37,397][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:40:42,399][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:40:45,364][  INFO][PID:1262875] Downloading the builder-live.log file, attempt 4
[2026-04-30 15:40:45,365][  INFO][PID:1262875] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.210.103.78 copr-rpmbuild-log
[2026-04-30 15:40:47,400][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:40:52,401][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:40:57,403][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:41:02,404][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:41:07,406][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:41:12,407][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:41:17,409][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:41:22,411][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:41:27,412][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:41:32,414][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:41:37,415][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:41:42,417][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:41:45,449][ ERROR][PID:1262875] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-30 15:41:47,419][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:41:52,420][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:41:55,461][ ERROR][PID:1262875] Giving up for unstable SSH, failures: 1777563475.1879253, 1777563555.2712498, 1777563635.3631718, 1777563715.4612737
[2026-04-30 15:41:55,472][ ERROR][PID:1262875] Re-try request for task on 'ResallocHost, ticket_id=2672424, hostname=44.210.103.78, name=aws_x86_64_spot_prod_08358008_20260430_152220, requested_tags=['arch_s390x', 'copr_builder']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2026-04-30 15:41:55,486][  INFO][PID:1262875] VM Release request
[2026-04-30 15:41:55,505][  INFO][PID:1262875] Retry #1 (on other host)
[2026-04-30 15:41:55,506][  INFO][PID:1262875] Checking that /var/lib/copr/public_html/results/keithbowes/deponejo/centos-stream-10-s390x/repodata/repomd.xml exists
[2026-04-30 15:41:55,645][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:41:55,646][  INFO][PID:1262875] VM allocation process starts
[2026-04-30 15:41:55,666][  INFO][PID:1262875] Trying to allocate VM: ResallocHost, ticket_id=2672678, requested_tags=['arch_s390x', 'copr_builder']
[2026-04-30 15:42:00,668][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:42:05,669][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:42:10,671][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:42:15,672][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:42:20,673][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:42:25,675][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:42:30,676][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:42:35,678][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:42:40,681][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:42:45,688][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:42:50,691][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:42:55,694][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:43:00,698][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:43:05,700][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:43:10,704][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:43:15,707][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:43:20,709][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:43:25,713][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:43:30,715][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:43:35,716][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:43:40,718][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:43:45,719][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:43:50,732][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:43:55,734][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:44:00,735][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:44:05,738][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:44:10,739][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:44:15,741][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:44:20,742][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:44:25,744][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:44:30,745][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:44:35,747][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:44:40,749][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:44:45,751][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:44:50,756][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:44:55,799][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:45:00,801][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:45:05,802][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:45:10,804][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:45:15,806][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:45:20,811][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:45:25,813][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:45:30,815][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:45:35,821][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:45:40,824][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:45:45,826][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:45:50,828][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:45:55,846][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:46:00,851][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:46:05,852][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:46:10,889][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:46:13,853][  INFO][PID:1262875] Allocated host ResallocHost, ticket_id=2672678, hostname=107.22.11.140, name=aws_x86_64_reserved_prod_08358014_20260430_152239, requested_tags=['arch_s390x', 'copr_builder']
[2026-04-30 15:46:13,854][  INFO][PID:1262875] Allocating ssh connection to builder
[2026-04-30 15:46:13,856][  INFO][PID:1262875] Checking that builder machine is OK
[2026-04-30 15:46:14,256][  INFO][PID:1262875] Installed copr-rpmbuild version: 1.8
[2026-04-30 15:46:14,257][  INFO][PID:1262875] Running remote command: copr-builder-ready centos-stream-10-s390x
[2026-04-30 15:46:14,521][  INFO][PID:1262875] Red Hat subscription not needed for centos-stream-10-s390x
Builder is ready to be used

[2026-04-30 15:46:14,522][  INFO][PID:1262875] Filling build.info file with builder info
[2026-04-30 15:46:14,525][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:46:14,526][  INFO][PID:1262875] Not re-notifying FE and msg buses for the new host.
[2026-04-30 15:46:14,527][  INFO][PID:1262875] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10412257-centos-stream-10-s390x --chroot centos-stream-10-s390x --detached
[2026-04-30 15:46:15,022][  INFO][PID:1262875] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '107.22.11.140' (ED25519) to the list of known hosts.


[2026-04-30 15:46:15,023][  INFO][PID:1262875] Downloading the builder-live.log file, attempt 1
[2026-04-30 15:46:15,026][  INFO][PID:1262875] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@107.22.11.140 copr-rpmbuild-log
[2026-04-30 15:46:20,037][  INFO][PID:1262875] Periodic builder liveness probe: alive
[2026-04-30 15:46:20,038][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:46:25,040][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:46:30,042][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:46:35,044][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:46:40,047][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:46:45,048][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:46:50,050][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:46:55,053][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:47:00,062][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:47:05,064][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:47:10,065][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:47:15,067][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:47:20,068][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:47:25,070][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:47:30,073][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:47:35,074][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:47:40,075][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:47:45,077][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:47:50,078][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:47:55,080][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:48:00,082][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:48:05,087][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:48:10,088][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:48:15,089][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:48:20,091][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:48:25,096][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:48:30,098][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:48:35,104][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:48:40,106][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:48:45,113][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:48:50,119][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:48:55,122][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:49:00,124][  INFO][PID:1262875] Checking for cancel request
[2026-04-30 15:49:03,547][  INFO][PID:1262875] Downloading results from builder
[2026-04-30 15:49:03,549][  INFO][PID:1262875] rsyncing of mockbuilder@107.22.11.140:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/keithbowes/deponejo/centos-stream-10-s390x/10412257-neomutt started
[2026-04-30 15:49:03,554][  INFO][PID:1262875] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@107.22.11.140:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/keithbowes/deponejo/centos-stream-10-s390x/10412257-neomutt/ &> /var/lib/copr/public_html/results/keithbowes/deponejo/centos-stream-10-s390x/10412257-neomutt/build-10412257.rsync.log
[2026-04-30 15:49:03,971][  INFO][PID:1262875] rsyncing finished.
[2026-04-30 15:49:03,973][  INFO][PID:1262875] VM Release request
[2026-04-30 15:49:03,998][  INFO][PID:1262875] Searching for 'success' file in resultdir
[2026-04-30 15:49:04,001][ ERROR][PID:1262875] Build failed: Backend process error: No success file => build failure
[2026-04-30 15:49:04,029][  INFO][PID:1262875] Finished build: id=10412257 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/keithbowes/deponejo chroot=centos-stream-10-s390x 
[2026-04-30 15:49:04,049][ ERROR][PID:1262875] Backend process error: No success file => build failure
[2026-04-30 15:49:04,127][  INFO][PID:1262875] Worker failed build, took 169.600599527359
[2026-04-30 15:49:04,136][  INFO][PID:1262875] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "keithbowes",
            "project_name": "deponejo",
            "project_dirname": "deponejo",
            "submitter": "keithbowes",
            "ended_on": 1777564144.1273677,
            "started_on": 1777563974.5267682,
            "submitted_on": null,
            "status": 0,
            "chroot": "centos-stream-10-s390x",
            "arch": "s390x",
            "buildroot_pkgs": [],
            "task_id": "10412257-centos-stream-10-s390x",
            "build_id": 10412257,
            "package_name": "neomutt",
            "package_version": "20260406-2",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/keithbowes/deponejo/neomutt",
            "git_hash": "cd6e360f1f91413b1a1ed6efcaca830db80073dd",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "keithbowes/deponejo--keithbowes",
            "results": null,
            "appstream": true,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/keithbowes/deponejo/centos-stream-10-s390x/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_s390x"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/keithbowes/deponejo",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/keithbowes/deponejo",
            "result_dir": "10412257-neomutt",
            "built_packages": "",
            "id": 10412257,
            "mockchain_macros": {
                "copr_username": "keithbowes",
                "copr_projectname": "deponejo",
                "vendor": "Fedora Project COPR (keithbowes/deponejo)"
            }
        }
    ]
}
[2026-04-30 15:49:04,314][  INFO][PID:1262875] Sending fedora-messaging bus message in build.end
[2026-04-30 15:49:04,367][  INFO][PID:1262875] Compressing /var/lib/copr/public_html/results/keithbowes/deponejo/centos-stream-10-s390x/10412257-neomutt/builder-live.log by gzip
[2026-04-30 15:49:04,371][  INFO][PID:1262875] Running command 'gzip /var/lib/copr/public_html/results/keithbowes/deponejo/centos-stream-10-s390x/10412257-neomutt/builder-live.log' as PID 1445998
[2026-04-30 15:49:04,407][  INFO][PID:1262875] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/keithbowes/deponejo/centos-stream-10-s390x/10412257-neomutt/builder-live.log)
[2026-04-30 15:49:04,408][  INFO][PID:1262875] Compressing /var/lib/copr/public_html/results/keithbowes/deponejo/centos-stream-10-s390x/10412257-neomutt/backend.log by gzip
[2026-04-30 15:49:04,411][  INFO][PID:1262875] Running command 'gzip /var/lib/copr/public_html/results/keithbowes/deponejo/centos-stream-10-s390x/10412257-neomutt/backend.log' as PID 1446008