[2026-03-09 19:22:41,106][  INFO][PID:1179233] Marking build as starting
[2026-03-09 19:22:41,176][  INFO][PID:1179233] Checking that /var/lib/copr/public_html/results/@CoreOS/continuous/rhel-9-s390x/repodata/repomd.xml exists
[2026-03-09 19:22:41,275][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:22:41,275][  INFO][PID:1179233] VM allocation process starts
[2026-03-09 19:22:41,288][  INFO][PID:1179233] Trying to allocate VM: ResallocHost, ticket_id=1782657, requested_tags=['copr_builder', 'arch_s390x']
[2026-03-09 19:22:46,289][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:22:51,290][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:22:56,291][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:23:01,292][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:23:06,293][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:23:11,294][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:23:16,295][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:23:21,296][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:23:26,297][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:23:31,298][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:23:36,300][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:23:41,301][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:23:46,302][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:23:51,303][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:23:56,304][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:24:01,305][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:24:06,306][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:24:11,307][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:24:16,308][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:24:21,311][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:24:26,311][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:24:31,313][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:24:36,314][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:24:41,315][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:24:46,316][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:24:51,317][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:24:56,318][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:25:01,319][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:25:06,320][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:25:11,321][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:25:16,332][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:25:21,333][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:25:26,334][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:25:31,335][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:25:36,336][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:25:41,337][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:25:46,338][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:25:51,339][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:25:56,369][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:26:01,370][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:26:06,371][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:26:11,372][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:26:16,373][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:26:21,391][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:26:26,392][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:26:31,393][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:26:36,394][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:26:41,420][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:26:46,421][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:26:51,422][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:26:56,423][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:26:59,378][  INFO][PID:1179233] Allocated host ResallocHost, ticket_id=1782657, hostname=13.122.90.7, name=copr_ic_s390x_eu_es_3_prod_02956235_20260309_192331, requested_tags=['copr_builder', 'arch_s390x']
[2026-03-09 19:26:59,379][  INFO][PID:1179233] Allocating ssh connection to builder
[2026-03-09 19:26:59,379][  INFO][PID:1179233] Checking that builder machine is OK
[2026-03-09 19:27:00,823][  INFO][PID:1179233] Running remote command: copr-builder-ready rhel-9-s390x
[2026-03-09 19:27:02,158][  INFO][PID:1179233] Checking Red Hat subscription (attempt #1)
Red Hat subscription active
Builder is ready to be used

[2026-03-09 19:27:02,159][  INFO][PID:1179233] Filling build.info file with builder info
[2026-03-09 19:27:02,159][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:27:02,160][  INFO][PID:1179233] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@CoreOS",
            "project_name": "continuous",
            "project_dirname": "continuous",
            "submitter": "https://api.github.com/users/jmarrero",
            "ended_on": null,
            "started_on": 1773084422.1607745,
            "submitted_on": null,
            "status": 3,
            "chroot": "rhel-9-s390x",
            "arch": "s390x",
            "buildroot_pkgs": [],
            "task_id": "10204731-rhel-9-s390x",
            "build_id": 10204731,
            "package_name": "rpm-ostree",
            "package_version": "2026.1.12.g13421c58-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@CoreOS/continuous/rpm-ostree",
            "git_hash": "37a579f93582ece70348ec2ee979e6d56181a268",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@CoreOS/continuous--https://api.github.com/users/jmarrero",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous/rhel-9-s390x/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/rhel-9-s390x/",
                    "id": "copr_rhcontainerbot_bootc",
                    "name": "Additional repo copr_rhcontainerbot_bootc"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_s390x"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@CoreOS/continuous",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous",
            "result_dir": "10204731-rpm-ostree",
            "built_packages": "",
            "id": 10204731,
            "mockchain_macros": {
                "copr_username": "@CoreOS",
                "copr_projectname": "continuous",
                "vendor": "Fedora Project COPR (@CoreOS/continuous)"
            }
        }
    ]
}
[2026-03-09 19:27:02,237][  INFO][PID:1179233] Sending fedora-messaging bus message in build.start
[2026-03-09 19:27:02,858][  INFO][PID:1179233] Sending fedora-messaging bus message in chroot.start
[2026-03-09 19:27:02,892][  INFO][PID:1179233] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10204731-rhel-9-s390x --chroot rhel-9-s390x --detached
[2026-03-09 19:27:04,399][  INFO][PID:1179233] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '13.122.90.7' (ED25519) to the list of known hosts.


[2026-03-09 19:27:04,400][  INFO][PID:1179233] Downloading the builder-live.log file, attempt 1
[2026-03-09 19:27:04,401][  INFO][PID:1179233] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.122.90.7 copr-rpmbuild-log
[2026-03-09 19:27:09,421][  INFO][PID:1179233] Periodic builder liveness probe: alive
[2026-03-09 19:27:09,423][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:27:14,426][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:27:19,429][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:27:24,452][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:27:29,455][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:27:34,457][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:27:39,459][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:27:44,460][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:27:49,488][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:27:54,490][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:27:59,494][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:28:04,495][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:28:09,497][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:28:14,503][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:28:19,512][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:28:24,514][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:28:29,516][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:28:34,520][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:28:39,533][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:28:44,536][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:28:49,550][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:28:54,552][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:28:59,554][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:29:04,555][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:29:09,556][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:29:14,557][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:29:19,558][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:29:24,559][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:29:29,572][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:29:34,573][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:29:39,574][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:29:44,575][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:29:49,576][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:29:54,578][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:29:59,579][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:30:04,599][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:30:09,600][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:30:14,601][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:30:19,602][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:30:24,604][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:30:29,605][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:30:34,606][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:30:39,607][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:30:44,608][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:30:49,609][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:30:54,611][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:30:59,613][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:31:04,614][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:31:09,622][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:31:14,624][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:31:19,625][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:31:24,626][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:31:29,628][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:31:34,629][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:31:39,630][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:31:44,631][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:31:49,634][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:31:54,635][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:31:59,636][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:32:04,637][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:32:09,639][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:32:14,640][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:32:19,641][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:32:24,642][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:32:29,643][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:32:34,653][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:32:39,654][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:32:44,655][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:32:49,656][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:32:54,657][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:32:59,658][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:33:04,659][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:33:09,660][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:33:14,661][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:33:19,662][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:33:24,663][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:33:29,664][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:33:34,665][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:33:39,667][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:33:44,677][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:33:49,679][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:33:54,680][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:33:59,681][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:34:04,682][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:34:09,683][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:34:14,684][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:34:19,685][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:34:24,686][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:34:29,687][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:34:34,688][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:34:39,689][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:34:44,690][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:34:49,691][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:34:54,712][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:34:59,713][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:35:04,715][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:35:09,718][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:35:14,719][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:35:19,720][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:35:24,722][  INFO][PID:1179233] Checking for cancel request
[2026-03-09 19:35:29,149][  INFO][PID:1179233] Downloading results from builder
[2026-03-09 19:35:29,150][  INFO][PID:1179233] rsyncing of mockbuilder@13.122.90.7:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@CoreOS/continuous/rhel-9-s390x/10204731-rpm-ostree started
[2026-03-09 19:35:29,151][  INFO][PID:1179233] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@13.122.90.7:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@CoreOS/continuous/rhel-9-s390x/10204731-rpm-ostree/ &> /var/lib/copr/public_html/results/@CoreOS/continuous/rhel-9-s390x/10204731-rpm-ostree/build-10204731.rsync.log
[2026-03-09 19:35:33,637][  INFO][PID:1179233] rsyncing finished.
[2026-03-09 19:35:33,637][  INFO][PID:1179233] Releasing VM back to pool
[2026-03-09 19:35:33,648][  INFO][PID:1179233] Searching for 'success' file in resultdir
[2026-03-09 19:35:33,649][ ERROR][PID:1179233] Build failed: Backend process error: No success file => build failure
[2026-03-09 19:35:33,649][  INFO][PID:1179233] Finished build: id=10204731 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/@CoreOS/continuous chroot=rhel-9-s390x 
[2026-03-09 19:35:33,651][ ERROR][PID:1179233] Backend process error: No success file => build failure
[2026-03-09 19:35:33,651][  INFO][PID:1179233] Worker failed build, took 511.4907636642456
[2026-03-09 19:35:33,652][  INFO][PID:1179233] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@CoreOS",
            "project_name": "continuous",
            "project_dirname": "continuous",
            "submitter": "https://api.github.com/users/jmarrero",
            "ended_on": 1773084933.6515381,
            "started_on": 1773084422.1607745,
            "submitted_on": null,
            "status": 0,
            "chroot": "rhel-9-s390x",
            "arch": "s390x",
            "buildroot_pkgs": [],
            "task_id": "10204731-rhel-9-s390x",
            "build_id": 10204731,
            "package_name": "rpm-ostree",
            "package_version": "2026.1.12.g13421c58-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@CoreOS/continuous/rpm-ostree",
            "git_hash": "37a579f93582ece70348ec2ee979e6d56181a268",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@CoreOS/continuous--https://api.github.com/users/jmarrero",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous/rhel-9-s390x/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/rhel-9-s390x/",
                    "id": "copr_rhcontainerbot_bootc",
                    "name": "Additional repo copr_rhcontainerbot_bootc"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_s390x"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@CoreOS/continuous",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous",
            "result_dir": "10204731-rpm-ostree",
            "built_packages": "",
            "id": 10204731,
            "mockchain_macros": {
                "copr_username": "@CoreOS",
                "copr_projectname": "continuous",
                "vendor": "Fedora Project COPR (@CoreOS/continuous)"
            }
        }
    ]
}
[2026-03-09 19:35:33,731][  INFO][PID:1179233] Sending fedora-messaging bus message in build.end
[2026-03-09 19:35:33,764][  INFO][PID:1179233] Compressing /var/lib/copr/public_html/results/@CoreOS/continuous/rhel-9-s390x/10204731-rpm-ostree/builder-live.log by gzip
[2026-03-09 19:35:33,765][  INFO][PID:1179233] Running command 'gzip /var/lib/copr/public_html/results/@CoreOS/continuous/rhel-9-s390x/10204731-rpm-ostree/builder-live.log' as PID 1290646
[2026-03-09 19:35:33,829][  INFO][PID:1179233] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@CoreOS/continuous/rhel-9-s390x/10204731-rpm-ostree/builder-live.log)
[2026-03-09 19:35:33,830][  INFO][PID:1179233] Compressing /var/lib/copr/public_html/results/@CoreOS/continuous/rhel-9-s390x/10204731-rpm-ostree/backend.log by gzip
[2026-03-09 19:35:33,831][  INFO][PID:1179233] Running command 'gzip /var/lib/copr/public_html/results/@CoreOS/continuous/rhel-9-s390x/10204731-rpm-ostree/backend.log' as PID 1290663