[2026-04-16 16:51:01,560][ INFO][PID:2729152] Marking build as starting [2026-04-16 16:51:01,693][ INFO][PID:2729152] Checking that /var/lib/copr/public_html/results/rapier1/hpnss-build-tests/fedora-eln-s390x/repodata/repomd.xml exists [2026-04-16 16:51:01,908][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:51:01,909][ INFO][PID:2729152] VM allocation process starts [2026-04-16 16:51:01,929][ INFO][PID:2729152] Trying to allocate VM: ResallocHost, ticket_id=2374972, requested_tags=['arch_s390x', 'copr_builder'] [2026-04-16 16:51:06,932][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:51:11,934][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:51:16,935][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:51:21,936][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:51:26,938][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:51:30,024][ INFO][PID:2729152] Allocated host ResallocHost, ticket_id=2374972, hostname=44.222.176.41, name=aws_x86_64_spot_prod_06078339_20260416_164917, requested_tags=['arch_s390x', 'copr_builder'] [2026-04-16 16:51:30,025][ INFO][PID:2729152] Allocating ssh connection to builder [2026-04-16 16:51:30,028][ INFO][PID:2729152] Checking that builder machine is OK [2026-04-16 16:51:30,419][ INFO][PID:2729152] Installed copr-rpmbuild version: 1.8 [2026-04-16 16:51:30,420][ INFO][PID:2729152] Running remote command: copr-builder-ready fedora-eln-s390x [2026-04-16 16:51:30,716][ INFO][PID:2729152] Red Hat subscription not needed for fedora-eln-s390x Builder is ready to be used [2026-04-16 16:51:30,718][ INFO][PID:2729152] Filling build.info file with builder info [2026-04-16 16:51:30,718][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:51:30,720][ INFO][PID:2729152] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "rapier1", "project_name": "hpnss-build-tests", "project_dirname": "hpnss-build-tests", "submitter": "rapier1", "ended_on": null, "started_on": 1776358290.7198045, "submitted_on": null, "status": 3, "chroot": "fedora-eln-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "10339847-fedora-eln-s390x", "build_id": 10339847, "package_name": "hpnssh", "package_version": "10.3p1_hpn18.9.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rapier1/hpnss-build-tests/hpnssh", "git_hash": "cdc2aec99e1fcacb3056dde33faadccb33f1f048", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rapier1/hpnss-build-tests--rapier1", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rapier1/hpnss-build-tests/fedora-eln-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rapier1/hpnss-build-tests", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rapier1/hpnss-build-tests", "result_dir": "10339847-hpnssh", "built_packages": "", "id": 10339847, "mockchain_macros": { "copr_username": "rapier1", "copr_projectname": "hpnss-build-tests", "vendor": "Fedora Project COPR (rapier1/hpnss-build-tests)" } } ] } [2026-04-16 16:51:30,941][ INFO][PID:2729152] Sending fedora-messaging bus message in build.start [2026-04-16 16:51:32,999][ INFO][PID:2729152] Sending fedora-messaging bus message in chroot.start [2026-04-16 16:51:33,081][ INFO][PID:2729152] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10339847-fedora-eln-s390x --chroot fedora-eln-s390x --detached [2026-04-16 16:51:33,577][ INFO][PID:2729152] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '44.222.176.41' (ED25519) to the list of known hosts. [2026-04-16 16:51:33,579][ INFO][PID:2729152] Downloading the builder-live.log file, attempt 1 [2026-04-16 16:51:33,587][ INFO][PID:2729152] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.222.176.41 copr-rpmbuild-log [2026-04-16 16:51:38,614][ INFO][PID:2729152] Periodic builder liveness probe: alive [2026-04-16 16:51:38,614][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:51:43,616][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:51:48,620][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:51:53,621][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:51:58,622][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:52:03,623][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:52:08,625][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:52:13,626][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:52:18,633][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:52:23,634][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:52:28,637][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:52:33,638][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:52:38,639][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:52:43,643][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:52:48,644][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:52:53,652][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:52:58,654][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:53:03,656][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:53:08,657][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:53:13,658][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:53:18,660][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:53:23,661][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:53:28,668][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:53:33,670][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:53:38,674][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:53:43,676][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:53:48,677][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:53:53,678][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:53:58,680][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:54:03,682][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:54:08,685][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:54:13,687][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:54:18,688][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:54:23,689][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:54:28,691][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:54:33,692][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:54:38,694][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:54:43,697][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:54:48,698][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:54:53,699][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:54:58,700][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:55:03,702][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:55:08,706][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:55:13,707][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:55:18,708][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:55:23,710][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:55:26,972][ ERROR][PID:2729152] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-16 16:55:28,711][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:55:33,714][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:55:36,973][WARNING][PID:2729152] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-16 16:55:38,717][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:55:43,718][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:55:46,974][ INFO][PID:2729152] Downloading the builder-live.log file, attempt 2 [2026-04-16 16:55:46,977][ INFO][PID:2729152] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.222.176.41 copr-rpmbuild-log [2026-04-16 16:55:48,719][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:55:53,720][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:55:58,721][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:56:03,722][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:56:08,723][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:56:13,724][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:56:18,725][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:56:23,727][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:56:28,728][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:56:33,729][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:56:38,730][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:56:43,731][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:56:47,044][ ERROR][PID:2729152] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-16 16:56:48,732][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:56:53,734][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:56:57,049][WARNING][PID:2729152] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-16 16:56:58,735][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:57:03,736][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:57:07,050][ INFO][PID:2729152] Downloading the builder-live.log file, attempt 3 [2026-04-16 16:57:07,051][ INFO][PID:2729152] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.222.176.41 copr-rpmbuild-log [2026-04-16 16:57:08,737][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:57:13,738][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:57:18,739][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:57:23,740][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:57:28,749][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:57:33,750][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:57:38,752][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:57:43,753][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:57:48,754][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:57:53,755][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:57:58,766][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:58:03,767][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:58:07,153][ ERROR][PID:2729152] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-16 16:58:08,768][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:58:13,770][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:58:17,157][WARNING][PID:2729152] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-16 16:58:18,773][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:58:23,775][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:58:27,158][ INFO][PID:2729152] Downloading the builder-live.log file, attempt 4 [2026-04-16 16:58:27,174][ INFO][PID:2729152] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.222.176.41 copr-rpmbuild-log [2026-04-16 16:58:28,776][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:58:33,777][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:58:38,779][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:58:43,780][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:58:48,781][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:58:53,782][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:58:58,783][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:59:03,798][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:59:08,799][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:59:13,802][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:59:18,805][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:59:23,806][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:59:27,215][ ERROR][PID:2729152] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-16 16:59:28,807][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:59:33,808][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:59:37,228][ ERROR][PID:2729152] Giving up for unstable SSH, failures: 1776358536.9733045, 1776358617.0491965, 1776358697.1577046, 1776358777.2283118 [2026-04-16 16:59:37,229][ ERROR][PID:2729152] Re-try request for task on 'ResallocHost, ticket_id=2374972, hostname=44.222.176.41, name=aws_x86_64_spot_prod_06078339_20260416_164917, requested_tags=['arch_s390x', 'copr_builder']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-04-16 16:59:37,230][ INFO][PID:2729152] VM Release request [2026-04-16 16:59:37,239][ INFO][PID:2729152] Retry #1 (on other host) [2026-04-16 16:59:37,239][ INFO][PID:2729152] Checking that /var/lib/copr/public_html/results/rapier1/hpnss-build-tests/fedora-eln-s390x/repodata/repomd.xml exists [2026-04-16 16:59:37,329][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:59:37,330][ INFO][PID:2729152] VM allocation process starts [2026-04-16 16:59:37,373][ INFO][PID:2729152] Trying to allocate VM: ResallocHost, ticket_id=2375047, requested_tags=['arch_s390x', 'copr_builder'] [2026-04-16 16:59:40,389][ INFO][PID:2729152] Allocated host ResallocHost, ticket_id=2375047, hostname=100.26.58.41, name=aws_x86_64_normalreserved_prod_06078849_20260416_165748, requested_tags=['arch_s390x', 'copr_builder'] [2026-04-16 16:59:40,389][ INFO][PID:2729152] Allocating ssh connection to builder [2026-04-16 16:59:40,390][ INFO][PID:2729152] Checking that builder machine is OK [2026-04-16 16:59:40,767][ INFO][PID:2729152] Installed copr-rpmbuild version: 1.8 [2026-04-16 16:59:40,768][ INFO][PID:2729152] Running remote command: copr-builder-ready fedora-eln-s390x [2026-04-16 16:59:40,990][ INFO][PID:2729152] Red Hat subscription not needed for fedora-eln-s390x Builder is ready to be used [2026-04-16 16:59:40,991][ INFO][PID:2729152] Filling build.info file with builder info [2026-04-16 16:59:41,054][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:59:41,055][ INFO][PID:2729152] Not re-notifying FE and msg buses for the new host. [2026-04-16 16:59:41,056][ INFO][PID:2729152] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10339847-fedora-eln-s390x --chroot fedora-eln-s390x --detached [2026-04-16 16:59:41,539][ INFO][PID:2729152] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '100.26.58.41' (ED25519) to the list of known hosts. [2026-04-16 16:59:41,539][ INFO][PID:2729152] Downloading the builder-live.log file, attempt 1 [2026-04-16 16:59:41,541][ INFO][PID:2729152] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.26.58.41 copr-rpmbuild-log [2026-04-16 16:59:46,540][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:59:51,579][ INFO][PID:2729152] Checking for cancel request [2026-04-16 16:59:56,591][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:00:01,706][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:00:06,707][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:00:11,708][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:00:16,767][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:00:21,775][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:00:26,795][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:00:31,796][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:00:36,814][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:00:41,825][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:00:47,103][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:00:52,108][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:00:57,111][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:01:02,603][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:01:07,607][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:01:12,610][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:01:17,611][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:01:22,612][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:01:27,613][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:01:32,626][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:01:37,634][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:01:42,647][ INFO][PID:2729152] Periodic builder liveness probe: alive [2026-04-16 17:01:42,648][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:01:47,650][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:01:52,670][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:01:57,671][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:02:02,672][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:02:07,673][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:02:12,674][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:02:17,674][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:02:22,676][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:02:27,707][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:02:32,709][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:02:37,710][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:02:42,711][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:02:47,712][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:02:52,713][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:02:57,714][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:03:02,715][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:03:07,716][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:03:12,718][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:03:17,719][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:03:22,720][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:03:27,721][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:03:32,724][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:03:37,726][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:03:42,727][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:03:47,728][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:03:52,729][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:03:57,730][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:04:02,731][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:04:07,732][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:04:12,733][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:04:17,734][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:04:22,736][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:04:27,741][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:04:32,742][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:04:37,744][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:04:42,745][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:04:47,747][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:04:52,750][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:04:57,761][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:05:02,762][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:05:07,763][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:05:12,765][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:05:17,768][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:05:22,770][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:05:27,776][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:05:32,777][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:05:37,781][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:05:42,782][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:05:47,784][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:05:52,786][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:05:57,787][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:06:02,789][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:06:07,791][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:06:12,793][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:06:17,793][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:06:22,796][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:06:27,797][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:06:32,799][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:06:37,800][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:06:42,816][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:06:47,817][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:06:52,819][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:06:57,822][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:07:02,826][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:07:07,831][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:07:12,832][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:07:17,834][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:07:22,836][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:07:27,844][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:07:32,845][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:07:37,846][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:07:42,857][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:07:47,862][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:07:52,867][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:07:57,868][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:08:02,875][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:08:07,902][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:08:12,910][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:08:17,913][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:08:22,915][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:08:27,921][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:08:32,924][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:08:37,927][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:08:42,928][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:08:47,930][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:08:52,931][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:08:57,933][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:09:02,939][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:09:07,941][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:09:12,945][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:09:18,064][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:09:23,066][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:09:28,068][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:09:33,069][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:09:38,070][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:09:43,072][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:09:48,073][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:09:53,101][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:09:58,102][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:10:03,104][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:10:08,106][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:10:13,108][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:10:18,110][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:10:23,114][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:10:28,134][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:10:33,136][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:10:38,138][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:10:43,139][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:10:48,141][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:10:53,142][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:10:58,144][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:11:03,145][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:11:08,147][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:11:13,149][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:11:18,150][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:11:23,152][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:11:28,153][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:11:33,156][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:11:38,157][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:11:43,175][ INFO][PID:2729152] Periodic builder liveness probe: alive [2026-04-16 17:11:43,177][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:11:48,179][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:11:53,180][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:11:58,184][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:12:03,187][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:12:08,190][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:12:13,193][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:12:18,194][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:12:23,198][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:12:28,205][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:12:33,213][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:12:38,216][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:12:43,217][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:12:48,245][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:12:53,254][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:12:58,270][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:13:03,279][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:13:08,282][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:13:13,284][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:13:18,290][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:13:23,293][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:13:28,295][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:13:33,298][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:13:38,302][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:13:43,303][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:13:48,305][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:13:53,307][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:13:58,309][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:14:03,313][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:14:08,314][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:14:13,318][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:14:18,320][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:14:23,321][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:14:28,323][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:14:33,324][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:14:38,335][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:14:43,347][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:14:48,348][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:14:53,349][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:14:58,350][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:15:03,351][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:15:08,353][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:15:13,355][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:15:18,357][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:15:23,358][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:15:28,359][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:15:33,360][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:15:38,362][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:15:43,363][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:15:48,364][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:15:53,365][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:15:58,366][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:16:03,371][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:16:08,373][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:16:13,377][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:16:18,380][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:16:23,384][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:16:28,399][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:16:33,405][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:16:38,406][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:16:43,414][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:16:48,416][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:16:53,418][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:16:58,429][ INFO][PID:2729152] Checking for cancel request [2026-04-16 17:16:58,430][ INFO][PID:2729152] Calling cancel callback, and waiting for thread.join() [2026-04-16 17:16:58,437][ INFO][PID:2729152] Canceling the build on the remote machine [2026-04-16 17:17:01,861][ INFO][PID:2729152] Cancel request succeeded out: success err: Warning: Permanently added '100.26.58.41' (ED25519) to the list of known hosts. [2026-04-16 17:17:01,862][ ERROR][PID:2729152] Build was canceled [2026-04-16 17:17:01,863][ INFO][PID:2729152] VM Release request [2026-04-16 17:17:01,883][WARNING][PID:2729152] Switching not-finished job state to 'failed' [2026-04-16 17:17:01,883][ INFO][PID:2729152] Worker failed build, took 1040.8271942138672 [2026-04-16 17:17:01,884][ INFO][PID:2729152] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "rapier1", "project_name": "hpnss-build-tests", "project_dirname": "hpnss-build-tests", "submitter": "rapier1", "ended_on": 1776359821.8830194, "started_on": 1776358781.0558252, "submitted_on": null, "status": 0, "chroot": "fedora-eln-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "10339847-fedora-eln-s390x", "build_id": 10339847, "package_name": "hpnssh", "package_version": "10.3p1_hpn18.9.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rapier1/hpnss-build-tests/hpnssh", "git_hash": "cdc2aec99e1fcacb3056dde33faadccb33f1f048", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rapier1/hpnss-build-tests--rapier1", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rapier1/hpnss-build-tests/fedora-eln-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rapier1/hpnss-build-tests", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rapier1/hpnss-build-tests", "result_dir": "10339847-hpnssh", "built_packages": "", "id": 10339847, "mockchain_macros": { "copr_username": "rapier1", "copr_projectname": "hpnss-build-tests", "vendor": "Fedora Project COPR (rapier1/hpnss-build-tests)" } } ] } [2026-04-16 17:17:02,274][ INFO][PID:2729152] Sending fedora-messaging bus message in build.end [2026-04-16 17:17:02,341][ INFO][PID:2729152] Compressing /var/lib/copr/public_html/results/rapier1/hpnss-build-tests/fedora-eln-s390x/10339847-hpnssh/builder-live.log by gzip [2026-04-16 17:17:02,343][ INFO][PID:2729152] Running command 'gzip /var/lib/copr/public_html/results/rapier1/hpnss-build-tests/fedora-eln-s390x/10339847-hpnssh/builder-live.log' as PID 2942332 [2026-04-16 17:17:02,597][ INFO][PID:2729152] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rapier1/hpnss-build-tests/fedora-eln-s390x/10339847-hpnssh/builder-live.log) [2026-04-16 17:17:02,598][ INFO][PID:2729152] Compressing /var/lib/copr/public_html/results/rapier1/hpnss-build-tests/fedora-eln-s390x/10339847-hpnssh/backend.log by gzip [2026-04-16 17:17:02,605][ INFO][PID:2729152] Running command 'gzip /var/lib/copr/public_html/results/rapier1/hpnss-build-tests/fedora-eln-s390x/10339847-hpnssh/backend.log' as PID 2942380