[2025-11-13 16:20:59,193][  INFO][PID:2321220] Marking build as starting
[2025-11-13 16:20:59,277][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:20:59,278][  INFO][PID:2321220] VM allocation process starts
[2025-11-13 16:20:59,311][  INFO][PID:2321220] Trying to allocate VM: ResallocHost, ticket_id=6167848, requested_tags=['copr_builder', 'arch_s390x']
[2025-11-13 16:21:04,312][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:21:09,313][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:21:14,314][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:21:19,315][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:21:24,316][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:21:29,317][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:21:34,318][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:21:39,319][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:21:44,320][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:21:49,321][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:21:54,322][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:21:59,323][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:22:04,325][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:22:09,328][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:22:14,329][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:22:19,330][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:22:24,331][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:22:29,334][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:22:34,335][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:22:39,336][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:22:44,337][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:22:49,338][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:22:54,339][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:22:59,340][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:23:04,342][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:23:09,343][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:23:14,344][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:23:19,345][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:23:24,346][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:23:29,347][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:23:34,348][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:23:39,349][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:23:44,350][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:23:49,352][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:23:54,353][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:23:59,353][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:24:04,354][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:24:09,355][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:24:14,356][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:24:19,357][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:24:24,358][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:24:29,359][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:24:34,360][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:24:39,361][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:24:44,362][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:24:49,363][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:24:54,363][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:24:59,364][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:25:04,365][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:25:09,367][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:25:14,368][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:25:17,424][  INFO][PID:2321220] Allocated host ResallocHost, ticket_id=6167848, hostname=13.122.86.161, name=copr_ic_s390x_eu_es_3_prod_07980112_20251113_162148, requested_tags=['copr_builder', 'arch_s390x']
[2025-11-13 16:25:17,425][  INFO][PID:2321220] Allocating ssh connection to builder
[2025-11-13 16:25:17,425][  INFO][PID:2321220] Checking that builder machine is OK
[2025-11-13 16:25:18,708][  INFO][PID:2321220] Running remote command: copr-builder-ready fedora-rawhide-s390x
[2025-11-13 16:25:19,873][  INFO][PID:2321220] Red Hat subscription not needed for fedora-rawhide-s390x
Builder is ready to be used

[2025-11-13 16:25:19,874][  INFO][PID:2321220] Filling build.info file with builder info
[2025-11-13 16:25:19,874][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:25:19,876][  INFO][PID:2321220] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "ngompa",
            "project_name": "fish4",
            "project_dirname": "fish4:pr:fork-packit-rpms-fish-23",
            "submitter": "https://src.fedoraproject.org/user/packit",
            "ended_on": null,
            "started_on": 1763051119.8757322,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-rawhide-s390x",
            "arch": "s390x",
            "buildroot_pkgs": [],
            "task_id": "9795427-fedora-rawhide-s390x",
            "build_id": 9795427,
            "package_name": "fish",
            "package_version": "4.2.1-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/ngompa/fish4:pr:fork-packit-rpms-fish-23/fish",
            "git_hash": "947709b5ba02d7453be3e067688ebf8ad40216d1",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "ngompa/fish4--https://src.fedoraproject.org/user/packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/ngompa/fish4/fedora-rawhide-s390x/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/ngompa/fish4:pr:fork-packit-rpms-fish-23/fedora-rawhide-s390x/",
                    "id": "copr_coprdir",
                    "name": "Coprdir repository",
                    "priority": null
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_s390x"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/ngompa/fish4:pr:fork-packit-rpms-fish-23",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/ngompa/fish4:pr:fork-packit-rpms-fish-23",
            "result_dir": "09795427-fish",
            "built_packages": "",
            "id": 9795427,
            "mockchain_macros": {
                "copr_username": "ngompa",
                "copr_projectname": "fish4",
                "vendor": "Fedora Project COPR (ngompa/fish4)"
            }
        }
    ]
}
[2025-11-13 16:25:19,917][  INFO][PID:2321220] Sending fedora-messaging bus message in build.start
[2025-11-13 16:25:20,583][  INFO][PID:2321220] Sending fedora-messaging bus message in chroot.start
[2025-11-13 16:25:20,607][  INFO][PID:2321220] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9795427-fedora-rawhide-s390x --chroot fedora-rawhide-s390x --detached
[2025-11-13 16:25:22,053][  INFO][PID:2321220] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '13.122.86.161' (ED25519) to the list of known hosts.


[2025-11-13 16:25:22,054][  INFO][PID:2321220] Downloading the builder-live.log file, attempt 1
[2025-11-13 16:25:22,055][  INFO][PID:2321220] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.122.86.161 copr-rpmbuild-log
[2025-11-13 16:25:27,060][  INFO][PID:2321220] Periodic builder liveness probe: alive
[2025-11-13 16:25:27,060][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:25:32,061][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:25:37,062][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:25:42,063][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:25:47,065][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:25:52,066][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:25:57,067][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:26:02,068][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:26:07,069][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:26:12,070][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:26:17,071][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:26:22,072][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:26:27,073][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:26:32,074][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:26:37,075][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:26:42,076][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:26:47,077][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:26:52,078][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:26:57,079][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:27:02,080][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:27:07,081][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:27:12,082][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:27:17,083][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:27:22,084][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:27:27,085][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:27:32,087][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:27:37,088][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:27:42,089][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:27:47,090][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:27:52,091][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:27:57,092][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:28:02,093][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:28:07,095][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:28:12,096][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:28:17,097][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:28:22,098][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:28:27,099][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:28:32,099][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:28:37,100][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:28:42,101][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:28:47,103][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:28:52,103][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:28:57,105][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:29:02,107][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:29:07,108][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:29:12,109][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:29:17,110][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:29:22,111][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:29:27,112][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:29:32,113][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:29:37,114][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:29:42,115][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:29:47,116][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:29:52,118][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:29:57,119][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:30:02,120][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:30:07,121][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:30:12,122][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:30:17,123][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:30:22,124][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:30:27,126][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:30:32,127][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:30:37,127][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:30:42,129][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:30:47,130][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:30:52,131][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:30:57,132][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:31:02,133][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:31:07,134][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:31:12,135][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:31:17,136][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:31:22,137][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:31:27,138][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:31:32,140][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:31:37,141][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:31:42,142][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:31:47,143][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:31:52,144][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:31:57,156][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:32:02,157][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:32:07,158][  INFO][PID:2321220] Checking for cancel request
[2025-11-13 16:32:11,189][  INFO][PID:2321220] Downloading results from builder
[2025-11-13 16:32:11,190][  INFO][PID:2321220] rsyncing of mockbuilder@13.122.86.161:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/ngompa/fish4:pr:fork-packit-rpms-fish-23/fedora-rawhide-s390x/09795427-fish started
[2025-11-13 16:32:11,191][  INFO][PID:2321220] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@13.122.86.161:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/ngompa/fish4:pr:fork-packit-rpms-fish-23/fedora-rawhide-s390x/09795427-fish/ &> /var/lib/copr/public_html/results/ngompa/fish4:pr:fork-packit-rpms-fish-23/fedora-rawhide-s390x/09795427-fish/build-09795427.rsync.log
[2025-11-13 16:32:14,076][  INFO][PID:2321220] rsyncing finished.
[2025-11-13 16:32:14,076][  INFO][PID:2321220] Releasing VM back to pool
[2025-11-13 16:32:14,098][  INFO][PID:2321220] Searching for 'success' file in resultdir
[2025-11-13 16:32:14,099][ ERROR][PID:2321220] Build failed: Backend process error: No success file => build failure
[2025-11-13 16:32:14,099][  INFO][PID:2321220] Finished build: id=9795427 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/ngompa/fish4:pr:fork-packit-rpms-fish-23 chroot=fedora-rawhide-s390x 
[2025-11-13 16:32:14,102][ ERROR][PID:2321220] Backend process error: No success file => build failure
[2025-11-13 16:32:14,102][  INFO][PID:2321220] Worker failed build, took 414.2271649837494
[2025-11-13 16:32:14,103][  INFO][PID:2321220] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "ngompa",
            "project_name": "fish4",
            "project_dirname": "fish4:pr:fork-packit-rpms-fish-23",
            "submitter": "https://src.fedoraproject.org/user/packit",
            "ended_on": 1763051534.1028972,
            "started_on": 1763051119.8757322,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-rawhide-s390x",
            "arch": "s390x",
            "buildroot_pkgs": [],
            "task_id": "9795427-fedora-rawhide-s390x",
            "build_id": 9795427,
            "package_name": "fish",
            "package_version": "4.2.1-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/ngompa/fish4:pr:fork-packit-rpms-fish-23/fish",
            "git_hash": "947709b5ba02d7453be3e067688ebf8ad40216d1",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "ngompa/fish4--https://src.fedoraproject.org/user/packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/ngompa/fish4/fedora-rawhide-s390x/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/ngompa/fish4:pr:fork-packit-rpms-fish-23/fedora-rawhide-s390x/",
                    "id": "copr_coprdir",
                    "name": "Coprdir repository",
                    "priority": null
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_s390x"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/ngompa/fish4:pr:fork-packit-rpms-fish-23",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/ngompa/fish4:pr:fork-packit-rpms-fish-23",
            "result_dir": "09795427-fish",
            "built_packages": "",
            "id": 9795427,
            "mockchain_macros": {
                "copr_username": "ngompa",
                "copr_projectname": "fish4",
                "vendor": "Fedora Project COPR (ngompa/fish4)"
            }
        }
    ]
}
[2025-11-13 16:32:14,158][  INFO][PID:2321220] Sending fedora-messaging bus message in build.end
[2025-11-13 16:32:14,185][  INFO][PID:2321220] Compressing /var/lib/copr/public_html/results/ngompa/fish4:pr:fork-packit-rpms-fish-23/fedora-rawhide-s390x/09795427-fish/builder-live.log by gzip
[2025-11-13 16:32:14,186][  INFO][PID:2321220] Running command 'gzip /var/lib/copr/public_html/results/ngompa/fish4:pr:fork-packit-rpms-fish-23/fedora-rawhide-s390x/09795427-fish/builder-live.log' as PID 2382435
[2025-11-13 16:32:14,201][  INFO][PID:2321220] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/ngompa/fish4:pr:fork-packit-rpms-fish-23/fedora-rawhide-s390x/09795427-fish/builder-live.log)
[2025-11-13 16:32:14,201][  INFO][PID:2321220] Compressing /var/lib/copr/public_html/results/ngompa/fish4:pr:fork-packit-rpms-fish-23/fedora-rawhide-s390x/09795427-fish/backend.log by gzip
[2025-11-13 16:32:14,203][  INFO][PID:2321220] Running command 'gzip /var/lib/copr/public_html/results/ngompa/fish4:pr:fork-packit-rpms-fish-23/fedora-rawhide-s390x/09795427-fish/backend.log' as PID 2382436