[2026-03-04 14:18:24,366][ INFO][PID:4172584] Marking build as starting [2026-03-04 14:18:24,425][ INFO][PID:4172584] Checking that /var/lib/copr/public_html/results/@rhel-lightspeed/goose/fedora-rawhide-s390x/repodata/repomd.xml exists [2026-03-04 14:18:24,494][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:18:24,495][ INFO][PID:4172584] VM allocation process starts [2026-03-04 14:18:24,507][ INFO][PID:4172584] Trying to allocate VM: ResallocHost, ticket_id=1711345, requested_tags=['copr_builder', 'arch_s390x'] [2026-03-04 14:18:29,509][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:18:34,510][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:18:39,595][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:18:44,596][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:18:49,597][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:18:54,598][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:18:59,654][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:19:04,655][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:19:09,713][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:19:14,714][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:19:19,716][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:19:24,717][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:19:29,719][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:19:34,743][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:19:39,744][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:19:44,804][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:19:49,806][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:19:54,948][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:20:00,074][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:20:07,118][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:20:12,121][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:20:17,385][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:20:22,629][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:20:27,799][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:20:32,828][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:20:37,863][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:20:42,865][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:20:49,530][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:20:54,589][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:20:59,661][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:21:04,718][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:21:09,730][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:21:14,838][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:21:19,850][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:21:24,854][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:21:29,877][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:21:34,961][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:21:40,188][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:21:45,394][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:21:50,766][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:21:55,856][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:22:00,928][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:22:06,076][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:22:11,182][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:22:16,383][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:22:21,384][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:22:26,385][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:22:31,478][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:22:36,626][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:22:41,628][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:22:46,813][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:22:51,815][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:22:56,816][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:23:01,938][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:23:06,966][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:23:11,968][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:23:17,030][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:23:22,046][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:23:27,083][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:23:32,257][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:23:37,399][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:23:42,577][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:23:42,792][ INFO][PID:4172584] Allocated host ResallocHost, ticket_id=1711345, hostname=13.116.84.76, name=copr_ic_s390x_br_sao_1_prod_02833557_20260304_142005, requested_tags=['copr_builder', 'arch_s390x'] [2026-03-04 14:23:42,792][ INFO][PID:4172584] Allocating ssh connection to builder [2026-03-04 14:23:42,793][ INFO][PID:4172584] Checking that builder machine is OK [2026-03-04 14:23:44,483][ INFO][PID:4172584] Running remote command: copr-builder-ready fedora-rawhide-s390x [2026-03-04 14:23:46,121][ INFO][PID:4172584] Red Hat subscription not needed for fedora-rawhide-s390x Builder is ready to be used [2026-03-04 14:23:46,122][ INFO][PID:4172584] Filling build.info file with builder info [2026-03-04 14:23:46,139][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:23:46,140][ INFO][PID:4172584] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@rhel-lightspeed", "project_name": "goose", "project_dirname": "goose", "submitter": "packit", "ended_on": null, "started_on": 1772634226.1406908, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "10190402-fedora-rawhide-s390x", "build_id": 10190402, "package_name": "goose", "package_version": "1.26.1-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@rhel-lightspeed/goose/goose", "git_hash": "d6f6f98b4c1f759f805cd3c48b51707059b9dbfc", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@rhel-lightspeed/goose--packit", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@rhel-lightspeed/goose/fedora-rawhide-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@rhel-lightspeed/goose", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@rhel-lightspeed/goose", "result_dir": "10190402-goose", "built_packages": "", "id": 10190402, "mockchain_macros": { "copr_username": "@rhel-lightspeed", "copr_projectname": "goose", "vendor": "Fedora Project COPR (@rhel-lightspeed/goose)" } } ] } [2026-03-04 14:23:46,192][ INFO][PID:4172584] Sending fedora-messaging bus message in build.start [2026-03-04 14:23:46,751][ INFO][PID:4172584] Sending fedora-messaging bus message in chroot.start [2026-03-04 14:23:46,779][ INFO][PID:4172584] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10190402-fedora-rawhide-s390x --chroot fedora-rawhide-s390x --detached [2026-03-04 14:23:48,581][ INFO][PID:4172584] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '13.116.84.76' (ED25519) to the list of known hosts. [2026-03-04 14:23:48,613][ INFO][PID:4172584] Downloading the builder-live.log file, attempt 1 [2026-03-04 14:23:48,870][ INFO][PID:4172584] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.116.84.76 copr-rpmbuild-log [2026-03-04 14:23:53,621][ INFO][PID:4172584] Periodic builder liveness probe: alive [2026-03-04 14:23:53,622][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:23:58,622][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:24:03,625][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:24:08,626][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:24:13,627][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:24:18,628][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:24:23,630][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:24:28,630][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:24:33,632][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:24:38,633][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:24:43,634][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:24:48,635][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:24:53,636][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:24:58,637][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:25:03,639][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:25:08,640][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:25:13,641][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:25:18,642][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:25:23,643][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:25:29,066][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:25:34,068][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:25:39,070][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:25:44,075][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:25:49,077][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:25:54,079][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:25:59,082][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:26:04,083][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:26:09,296][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:26:14,690][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:26:19,822][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:26:25,023][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:26:30,240][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:26:35,487][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:26:40,829][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:26:46,066][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:26:51,396][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:26:56,608][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:27:01,610][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:27:06,730][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:27:11,734][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:27:16,735][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:27:21,757][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:27:26,759][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:27:31,829][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:27:37,063][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:27:42,194][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:27:47,195][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:27:52,196][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:27:57,197][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:28:02,198][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:28:07,199][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:28:12,201][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:28:17,527][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:28:22,683][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:28:27,746][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:28:32,978][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:28:38,090][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:28:43,331][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:28:48,545][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:28:53,679][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:28:58,936][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:29:04,200][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:29:09,450][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:29:14,453][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:29:19,755][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:29:24,846][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:29:30,074][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:29:35,186][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:29:40,311][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:29:45,398][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:29:50,434][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:29:55,439][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:30:00,450][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:30:05,453][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:30:10,548][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:30:15,550][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:30:20,561][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:30:25,562][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:30:30,564][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:30:35,603][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:30:40,627][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:30:45,628][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:30:50,659][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:30:55,679][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:31:00,770][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:31:05,868][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:31:10,915][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:31:15,916][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:31:20,933][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:31:26,284][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:31:31,286][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:31:36,287][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:31:41,288][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:31:46,761][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:31:51,762][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:31:56,764][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:32:01,765][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:32:06,767][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:32:11,769][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:32:16,770][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:32:21,771][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:32:26,772][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:32:31,773][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:32:36,788][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:32:41,794][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:32:46,801][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:32:51,815][ INFO][PID:4172584] Checking for cancel request [2026-03-04 14:32:53,719][ INFO][PID:4172584] Downloading results from builder [2026-03-04 14:32:53,720][ INFO][PID:4172584] rsyncing of mockbuilder@13.116.84.76:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@rhel-lightspeed/goose/fedora-rawhide-s390x/10190402-goose started [2026-03-04 14:32:53,720][ INFO][PID:4172584] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@13.116.84.76:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@rhel-lightspeed/goose/fedora-rawhide-s390x/10190402-goose/ &> /var/lib/copr/public_html/results/@rhel-lightspeed/goose/fedora-rawhide-s390x/10190402-goose/build-10190402.rsync.log [2026-03-04 14:33:41,693][ INFO][PID:4172584] rsyncing finished. [2026-03-04 14:33:41,708][ INFO][PID:4172584] Releasing VM back to pool [2026-03-04 14:33:41,718][ INFO][PID:4172584] Searching for 'success' file in resultdir [2026-03-04 14:33:41,718][ ERROR][PID:4172584] Build failed: Backend process error: No success file => build failure [2026-03-04 14:33:41,719][ INFO][PID:4172584] Finished build: id=10190402 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/@rhel-lightspeed/goose chroot=fedora-rawhide-s390x [2026-03-04 14:33:41,721][ ERROR][PID:4172584] Backend process error: No success file => build failure [2026-03-04 14:33:41,722][ INFO][PID:4172584] Worker failed build, took 595.581286907196 [2026-03-04 14:33:41,722][ INFO][PID:4172584] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@rhel-lightspeed", "project_name": "goose", "project_dirname": "goose", "submitter": "packit", "ended_on": 1772634821.7219777, "started_on": 1772634226.1406908, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "10190402-fedora-rawhide-s390x", "build_id": 10190402, "package_name": "goose", "package_version": "1.26.1-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@rhel-lightspeed/goose/goose", "git_hash": "d6f6f98b4c1f759f805cd3c48b51707059b9dbfc", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@rhel-lightspeed/goose--packit", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@rhel-lightspeed/goose/fedora-rawhide-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@rhel-lightspeed/goose", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@rhel-lightspeed/goose", "result_dir": "10190402-goose", "built_packages": "", "id": 10190402, "mockchain_macros": { "copr_username": "@rhel-lightspeed", "copr_projectname": "goose", "vendor": "Fedora Project COPR (@rhel-lightspeed/goose)" } } ] } [2026-03-04 14:33:41,776][ INFO][PID:4172584] Sending fedora-messaging bus message in build.end [2026-03-04 14:33:41,804][ INFO][PID:4172584] Compressing /var/lib/copr/public_html/results/@rhel-lightspeed/goose/fedora-rawhide-s390x/10190402-goose/builder-live.log by gzip [2026-03-04 14:33:41,806][ INFO][PID:4172584] Running command 'gzip /var/lib/copr/public_html/results/@rhel-lightspeed/goose/fedora-rawhide-s390x/10190402-goose/builder-live.log' as PID 75319 [2026-03-04 14:33:41,962][ INFO][PID:4172584] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@rhel-lightspeed/goose/fedora-rawhide-s390x/10190402-goose/builder-live.log) [2026-03-04 14:33:41,963][ INFO][PID:4172584] Compressing /var/lib/copr/public_html/results/@rhel-lightspeed/goose/fedora-rawhide-s390x/10190402-goose/backend.log by gzip [2026-03-04 14:33:41,964][ INFO][PID:4172584] Running command 'gzip /var/lib/copr/public_html/results/@rhel-lightspeed/goose/fedora-rawhide-s390x/10190402-goose/backend.log' as PID 75333