[2026-04-08 19:41:02,347][ INFO][PID:2670340] Marking build as starting [2026-04-08 19:41:02,410][ INFO][PID:2670340] Checking that https://download.copr.fedorainfracloud.org/results/@go-sig/golang-rawhide-dwarf5/fedora-rawhide-s390x//repodata/repomd.xml exists [2026-04-08 19:41:02,833][ INFO][PID:2670340] Checking that https://download.copr.fedorainfracloud.org/results/@go-sig/golang-rawhide-dwarf5:pr:fork-alexsaezm-rpms-golang-297/fedora-rawhide-s390x//repodata/repomd.xml exists [2026-04-08 19:41:03,089][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:41:03,090][ INFO][PID:2670340] VM allocation process starts [2026-04-08 19:41:03,101][ INFO][PID:2670340] Trying to allocate VM: ResallocHost, ticket_id=2231562, requested_tags=['copr_builder', 'arch_s390x'] [2026-04-08 19:41:08,102][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:41:13,103][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:41:18,104][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:41:23,106][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:41:28,109][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:41:33,110][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:41:38,111][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:41:43,114][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:41:48,119][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:41:53,121][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:41:58,125][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:42:03,149][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:42:08,150][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:42:13,151][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:42:18,157][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:42:23,158][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:42:28,192][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:42:33,203][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:42:38,234][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:42:43,235][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:42:48,236][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:42:53,237][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:42:58,239][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:43:03,284][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:43:08,314][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:43:13,318][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:43:18,333][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:43:23,371][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:43:28,404][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:43:33,414][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:43:38,415][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:43:43,416][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:43:48,422][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:43:53,423][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:43:58,438][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:44:03,439][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:44:08,441][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:44:13,442][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:44:18,452][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:44:21,205][ INFO][PID:2670340] Allocated host ResallocHost, ticket_id=2231562, hostname=44.197.112.77, name=aws_x86_64_spot_prod_05946357_20260408_194237, requested_tags=['copr_builder', 'arch_s390x'] [2026-04-08 19:44:21,206][ INFO][PID:2670340] Allocating ssh connection to builder [2026-04-08 19:44:21,206][ INFO][PID:2670340] Checking that builder machine is OK [2026-04-08 19:44:21,551][ INFO][PID:2670340] Running remote command: copr-builder-ready fedora-rawhide-s390x [2026-04-08 19:44:21,774][ INFO][PID:2670340] Red Hat subscription not needed for fedora-rawhide-s390x Builder is ready to be used [2026-04-08 19:44:21,775][ INFO][PID:2670340] Filling build.info file with builder info [2026-04-08 19:44:21,803][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:44:21,804][ INFO][PID:2670340] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@go-sig", "project_name": "golang-rawhide-dwarf5", "project_dirname": "golang-rawhide-dwarf5:pr:fork-alexsaezm-rpms-golang-297", "submitter": "https://src.fedoraproject.org/user/alexsaezm", "ended_on": null, "started_on": 1775677461.8044403, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "10302719-fedora-rawhide-s390x", "build_id": 10302719, "package_name": "golang", "package_version": "1.26.2-2", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@go-sig/golang-rawhide-dwarf5:pr:fork-alexsaezm-rpms-golang-297/golang", "git_hash": "6eaa91d9cd934502f532f2f16da04d66a328c07d", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@go-sig/golang-rawhide-dwarf5--https://src.fedoraproject.org/user/alexsaezm", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@go-sig/golang-rawhide-dwarf5/fedora-rawhide-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@go-sig/golang-rawhide-dwarf5:pr:fork-alexsaezm-rpms-golang-297/fedora-rawhide-s390x/", "id": "copr_coprdir", "name": "Coprdir repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [ "dwarf5" ], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@go-sig/golang-rawhide-dwarf5:pr:fork-alexsaezm-rpms-golang-297", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@go-sig/golang-rawhide-dwarf5:pr:fork-alexsaezm-rpms-golang-297", "result_dir": "10302719-golang", "built_packages": "", "id": 10302719, "mockchain_macros": { "copr_username": "@go-sig", "copr_projectname": "golang-rawhide-dwarf5", "vendor": "Fedora Project COPR (@go-sig/golang-rawhide-dwarf5)" } } ] } [2026-04-08 19:44:21,858][ INFO][PID:2670340] Sending fedora-messaging bus message in build.start [2026-04-08 19:44:22,464][ INFO][PID:2670340] Sending fedora-messaging bus message in chroot.start [2026-04-08 19:44:22,494][ INFO][PID:2670340] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10302719-fedora-rawhide-s390x --chroot fedora-rawhide-s390x --detached [2026-04-08 19:44:22,854][ INFO][PID:2670340] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '44.197.112.77' (ED25519) to the list of known hosts. [2026-04-08 19:44:22,855][ INFO][PID:2670340] Downloading the builder-live.log file, attempt 1 [2026-04-08 19:44:22,856][ INFO][PID:2670340] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.197.112.77 copr-rpmbuild-log [2026-04-08 19:44:27,870][ INFO][PID:2670340] Periodic builder liveness probe: alive [2026-04-08 19:44:27,910][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:44:32,911][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:44:37,912][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:44:42,938][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:44:47,939][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:44:52,940][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:44:57,941][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:45:02,963][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:45:07,965][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:45:12,966][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:45:17,968][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:45:22,969][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:45:27,970][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:45:32,971][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:45:37,983][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:45:42,986][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:45:47,987][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:45:52,989][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:45:57,991][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:46:02,992][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:46:07,993][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:46:12,994][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:46:17,995][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:46:22,996][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:46:27,997][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:46:32,999][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:46:38,000][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:46:43,001][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:46:48,002][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:46:53,003][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:46:58,005][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:47:03,017][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:47:08,019][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:47:13,020][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:47:18,021][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:47:23,023][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:47:28,024][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:47:33,025][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:47:38,027][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:47:43,031][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:47:48,032][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:47:53,034][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:47:58,036][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:48:03,040][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:48:08,044][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:48:13,046][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:48:18,047][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:48:23,048][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:48:28,051][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:48:33,053][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:48:38,055][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:48:43,058][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:48:48,062][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:48:53,068][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:48:58,070][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:49:03,072][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:49:08,081][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:49:13,084][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:49:18,085][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:49:23,087][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:49:28,092][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:49:33,094][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:49:38,098][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:49:43,100][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:49:48,102][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:49:53,104][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:49:58,105][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:50:03,107][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:50:08,109][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:50:13,110][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:50:18,111][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:50:23,112][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:50:28,114][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:50:33,115][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:50:38,116][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:50:43,117][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:50:48,118][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:50:53,119][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:50:58,123][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:51:03,128][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:51:08,130][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:51:13,132][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:51:18,133][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:51:23,134][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:51:28,137][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:51:33,139][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:51:38,142][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:51:43,144][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:51:48,146][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:51:53,148][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:51:58,150][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:52:03,152][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:52:08,154][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:52:13,157][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:52:18,158][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:52:23,162][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:52:28,165][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:52:33,171][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:52:38,178][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:52:43,179][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:52:48,184][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:52:53,190][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:52:58,193][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:53:03,199][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:53:08,201][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:53:13,203][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:53:18,208][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:53:23,209][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:53:28,212][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:53:33,213][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:53:38,219][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:53:43,222][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:53:48,225][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:53:53,228][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:53:58,243][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:54:03,250][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:54:08,257][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:54:13,261][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:54:18,266][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:54:23,274][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:54:28,298][ INFO][PID:2670340] Periodic builder liveness probe: alive [2026-04-08 19:54:28,302][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:54:33,308][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:54:38,311][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:54:43,317][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:54:48,319][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:54:53,328][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:54:58,341][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:55:03,348][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:55:08,353][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:55:13,354][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:55:18,363][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:55:23,364][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:55:28,366][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:55:33,367][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:55:38,370][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:55:43,372][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:55:48,375][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:55:53,434][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:55:58,843][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:56:03,844][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:56:08,846][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:56:13,848][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:56:18,849][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:56:23,887][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:56:28,892][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:56:33,895][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:56:38,896][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:56:43,898][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:56:48,905][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:56:54,032][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:56:59,053][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:57:04,059][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:57:09,428][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:57:14,429][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:57:19,430][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:57:24,434][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:57:29,437][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:57:34,438][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:57:39,439][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:57:44,440][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:57:49,447][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:57:54,448][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:57:59,466][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:58:04,476][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:58:09,479][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:58:14,481][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:58:19,484][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:58:24,524][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:58:29,526][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:58:34,529][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:58:39,531][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:58:44,656][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:58:49,658][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:58:54,659][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:59:00,266][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:59:05,288][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:59:10,290][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:59:15,291][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:59:20,293][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:59:25,294][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:59:30,295][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:59:35,296][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:59:40,310][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:59:45,393][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:59:50,398][ INFO][PID:2670340] Checking for cancel request [2026-04-08 19:59:55,403][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:00:00,406][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:00:05,657][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:00:10,658][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:00:15,661][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:00:20,662][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:00:25,663][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:00:30,664][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:00:35,666][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:00:40,667][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:00:45,668][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:00:50,670][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:00:55,672][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:01:00,674][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:01:05,675][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:01:10,696][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:01:15,698][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:01:20,699][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:01:25,703][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:01:30,704][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:01:35,712][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:01:40,715][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:01:45,730][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:01:50,735][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:01:55,748][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:02:00,750][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:02:05,755][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:02:10,759][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:02:15,762][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:02:20,763][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:02:25,767][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:02:30,768][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:02:35,769][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:02:40,770][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:02:45,771][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:02:50,772][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:02:55,773][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:03:00,775][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:03:05,776][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:03:10,777][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:03:15,779][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:03:20,780][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:03:25,781][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:03:30,783][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:03:35,784][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:03:40,786][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:03:45,787][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:03:50,788][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:03:55,789][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:04:00,790][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:04:05,791][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:04:10,792][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:04:15,793][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:04:20,794][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:04:25,795][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:04:30,807][ INFO][PID:2670340] Periodic builder liveness probe: alive [2026-04-08 20:04:30,808][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:04:35,809][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:04:40,810][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:04:45,811][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:04:50,812][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:04:55,813][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:05:00,814][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:05:05,815][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:05:10,816][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:05:15,818][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:05:20,821][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:05:25,823][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:05:30,825][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:05:35,827][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:05:40,832][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:05:45,835][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:05:50,838][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:05:55,846][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:06:00,847][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:06:05,849][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:06:10,852][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:06:15,856][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:06:20,858][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:06:25,859][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:06:30,860][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:06:35,862][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:06:40,863][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:06:45,864][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:06:50,866][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:06:55,867][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:07:00,868][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:07:05,873][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:07:10,878][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:07:15,879][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:07:20,880][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:07:25,883][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:07:30,885][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:07:35,886][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:07:40,887][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:07:45,888][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:07:50,889][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:07:55,891][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:08:00,893][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:08:05,897][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:08:10,899][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:08:15,901][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:08:20,902][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:08:25,905][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:08:30,911][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:08:35,920][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:08:40,926][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:08:45,941][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:08:50,943][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:08:55,951][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:09:00,952][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:09:05,959][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:09:10,967][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:09:15,973][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:09:20,974][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:09:25,978][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:09:30,983][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:09:35,985][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:09:40,989][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:09:45,996][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:09:50,998][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:09:56,001][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:10:01,003][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:10:06,005][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:10:11,007][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:10:16,009][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:10:21,038][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:10:26,041][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:10:31,047][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:10:36,053][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:10:41,061][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:10:46,065][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:10:51,068][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:10:56,073][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:11:01,079][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:11:06,083][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:11:11,087][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:11:16,095][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:11:21,101][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:11:26,106][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:11:31,109][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:11:36,110][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:11:41,117][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:11:46,118][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:11:51,121][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:11:56,125][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:12:01,126][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:12:06,127][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:12:11,128][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:12:16,149][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:12:21,151][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:12:26,204][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:12:31,205][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:12:36,217][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:12:41,219][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:12:46,221][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:12:51,223][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:12:56,226][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:13:01,231][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:13:06,233][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:13:11,246][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:13:16,251][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:13:21,260][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:13:26,263][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:13:31,269][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:13:36,273][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:13:41,275][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:13:46,276][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:13:51,277][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:13:56,285][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:14:01,286][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:14:06,295][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:14:11,302][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:14:16,304][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:14:21,305][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:14:26,307][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:14:31,316][ INFO][PID:2670340] Periodic builder liveness probe: alive [2026-04-08 20:14:31,332][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:14:36,334][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:14:41,337][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:14:46,338][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:14:51,340][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:14:56,346][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:15:01,355][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:15:06,357][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:15:11,358][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:15:16,359][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:15:21,360][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:15:26,411][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:15:31,412][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:15:36,413][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:15:41,416][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:15:46,418][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:15:51,422][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:15:56,425][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:16:01,426][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:16:06,428][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:16:11,440][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:16:16,442][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:16:21,443][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:16:26,444][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:16:31,445][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:16:36,446][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:16:41,447][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:16:46,448][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:16:51,449][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:16:56,450][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:17:01,451][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:17:06,452][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:17:11,453][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:17:17,387][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:17:22,388][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:17:27,390][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:17:32,391][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:17:37,392][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:17:42,950][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:17:48,420][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:17:53,678][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:17:58,703][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:18:03,707][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:18:08,744][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:18:13,797][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:18:18,994][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:18:24,003][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:18:29,005][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:18:34,007][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:18:39,042][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:18:44,044][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:18:49,045][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:18:54,046][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:18:59,047][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:19:04,048][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:19:09,049][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:19:14,050][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:19:19,155][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:19:24,157][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:19:29,158][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:19:34,438][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:19:39,445][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:19:44,623][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:19:49,624][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:19:54,625][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:19:59,626][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:20:04,643][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:20:09,748][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:20:14,749][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:20:19,752][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:20:24,753][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:20:29,754][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:20:34,764][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:20:39,767][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:20:44,770][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:20:49,771][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:20:54,772][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:20:59,774][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:21:04,777][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:21:09,785][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:21:14,786][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:21:19,787][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:21:24,792][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:21:29,800][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:21:34,801][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:21:39,803][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:21:44,804][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:21:49,812][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:21:54,813][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:21:59,816][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:22:04,819][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:22:09,821][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:22:14,822][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:22:19,867][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:22:24,867][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:22:29,985][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:22:34,986][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:22:39,993][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:22:44,995][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:22:49,997][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:22:54,998][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:23:00,120][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:23:05,122][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:23:10,123][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:23:15,181][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:23:19,127][ ERROR][PID:2670340] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-08 20:23:20,183][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:23:25,185][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:23:29,137][WARNING][PID:2670340] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-08 20:23:30,211][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:23:35,213][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:23:39,137][ INFO][PID:2670340] Downloading the builder-live.log file, attempt 2 [2026-04-08 20:23:39,175][ INFO][PID:2670340] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.197.112.77 copr-rpmbuild-log [2026-04-08 20:23:40,215][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:23:45,216][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:23:50,217][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:23:55,438][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:24:00,439][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:24:05,450][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:24:10,482][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:24:15,483][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:24:20,484][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:24:25,573][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:24:30,575][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:24:35,640][ INFO][PID:2670340] Periodic builder liveness probe: alive [2026-04-08 20:24:35,919][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:24:39,237][ ERROR][PID:2670340] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-08 20:24:40,920][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:24:45,921][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:24:49,242][WARNING][PID:2670340] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-08 20:24:50,922][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:24:55,923][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:24:59,244][ INFO][PID:2670340] Downloading the builder-live.log file, attempt 3 [2026-04-08 20:24:59,245][ INFO][PID:2670340] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.197.112.77 copr-rpmbuild-log [2026-04-08 20:25:00,924][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:25:05,925][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:25:10,926][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:25:15,927][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:25:20,928][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:25:25,929][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:25:30,931][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:25:35,933][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:25:40,934][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:25:45,936][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:25:50,937][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:25:55,951][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:25:59,312][ ERROR][PID:2670340] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-08 20:26:00,952][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:26:05,953][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:26:09,314][WARNING][PID:2670340] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-08 20:26:10,958][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:26:15,961][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:26:19,314][ INFO][PID:2670340] Downloading the builder-live.log file, attempt 4 [2026-04-08 20:26:19,316][ INFO][PID:2670340] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.197.112.77 copr-rpmbuild-log [2026-04-08 20:26:20,964][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:26:25,965][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:26:30,966][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:26:35,967][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:26:40,968][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:26:45,969][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:26:50,970][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:26:55,971][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:27:00,973][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:27:05,974][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:27:10,975][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:27:15,977][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:27:19,383][ ERROR][PID:2670340] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-08 20:27:20,990][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:27:26,020][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:27:29,387][ ERROR][PID:2670340] Giving up for unstable SSH, failures: 1775679809.137056, 1775679889.2426476, 1775679969.3140254, 1775680049.387215 [2026-04-08 20:27:29,388][ ERROR][PID:2670340] Re-try request for task on 'ResallocHost, ticket_id=2231562, hostname=44.197.112.77, name=aws_x86_64_spot_prod_05946357_20260408_194237, requested_tags=['copr_builder', 'arch_s390x']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-04-08 20:27:29,388][ INFO][PID:2670340] Releasing VM back to pool [2026-04-08 20:27:29,427][ INFO][PID:2670340] Retry #1 (on other host) [2026-04-08 20:27:29,428][ INFO][PID:2670340] Checking that https://download.copr.fedorainfracloud.org/results/@go-sig/golang-rawhide-dwarf5/fedora-rawhide-s390x//repodata/repomd.xml exists [2026-04-08 20:27:29,713][ INFO][PID:2670340] Checking that https://download.copr.fedorainfracloud.org/results/@go-sig/golang-rawhide-dwarf5:pr:fork-alexsaezm-rpms-golang-297/fedora-rawhide-s390x//repodata/repomd.xml exists [2026-04-08 20:27:30,057][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:27:30,060][ INFO][PID:2670340] VM allocation process starts [2026-04-08 20:27:30,074][ INFO][PID:2670340] Trying to allocate VM: ResallocHost, ticket_id=2232456, requested_tags=['copr_builder', 'arch_s390x'] [2026-04-08 20:27:33,087][ INFO][PID:2670340] Allocated host ResallocHost, ticket_id=2232456, hostname=100.53.249.171, name=aws_x86_64_spot_prod_05947618_20260408_202337, requested_tags=['copr_builder', 'arch_s390x'] [2026-04-08 20:27:33,088][ INFO][PID:2670340] Allocating ssh connection to builder [2026-04-08 20:27:33,088][ INFO][PID:2670340] Checking that builder machine is OK [2026-04-08 20:27:33,421][ INFO][PID:2670340] Running remote command: copr-builder-ready fedora-rawhide-s390x [2026-04-08 20:27:33,627][ INFO][PID:2670340] Red Hat subscription not needed for fedora-rawhide-s390x Builder is ready to be used [2026-04-08 20:27:33,628][ INFO][PID:2670340] Filling build.info file with builder info [2026-04-08 20:27:33,675][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:27:33,677][ INFO][PID:2670340] Not re-notifying FE and msg buses for the new host. [2026-04-08 20:27:33,678][ INFO][PID:2670340] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10302719-fedora-rawhide-s390x --chroot fedora-rawhide-s390x --detached [2026-04-08 20:27:34,024][ INFO][PID:2670340] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '100.53.249.171' (ED25519) to the list of known hosts. [2026-04-08 20:27:34,025][ INFO][PID:2670340] Downloading the builder-live.log file, attempt 1 [2026-04-08 20:27:34,027][ INFO][PID:2670340] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.53.249.171 copr-rpmbuild-log [2026-04-08 20:27:39,026][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:27:44,027][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:27:49,028][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:27:54,033][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:27:59,035][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:28:04,036][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:28:09,038][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:28:14,039][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:28:19,040][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:28:24,042][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:28:29,043][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:28:34,044][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:28:39,045][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:28:44,046][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:28:49,047][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:28:54,048][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:28:57,833][ ERROR][PID:2670340] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-08 20:28:59,049][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:29:04,050][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:29:07,833][WARNING][PID:2670340] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-08 20:29:09,051][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:29:14,052][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:29:17,834][ INFO][PID:2670340] Downloading the builder-live.log file, attempt 2 [2026-04-08 20:29:17,836][ INFO][PID:2670340] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.53.249.171 copr-rpmbuild-log [2026-04-08 20:29:19,055][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:29:24,056][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:29:29,057][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:29:34,058][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:29:39,061][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:29:44,062][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:29:49,063][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:29:54,064][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:29:59,066][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:30:04,068][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:30:09,069][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:30:14,071][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:30:17,907][ ERROR][PID:2670340] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-08 20:30:19,074][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:30:24,076][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:30:27,911][WARNING][PID:2670340] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-08 20:30:29,078][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:30:34,080][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:30:37,914][ INFO][PID:2670340] Downloading the builder-live.log file, attempt 3 [2026-04-08 20:30:37,917][ INFO][PID:2670340] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.53.249.171 copr-rpmbuild-log [2026-04-08 20:30:39,083][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:30:44,086][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:30:49,087][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:30:54,091][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:30:59,092][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:31:04,093][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:31:09,094][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:31:14,097][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:31:19,101][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:31:24,102][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:31:29,103][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:31:34,104][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:31:37,991][ ERROR][PID:2670340] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-08 20:31:39,105][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:31:44,107][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:31:47,997][WARNING][PID:2670340] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-08 20:31:49,108][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:31:54,112][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:31:58,000][ INFO][PID:2670340] Downloading the builder-live.log file, attempt 4 [2026-04-08 20:31:58,006][ INFO][PID:2670340] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.53.249.171 copr-rpmbuild-log [2026-04-08 20:31:59,118][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:32:04,119][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:32:09,121][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:32:14,122][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:32:19,124][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:32:24,127][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:32:29,128][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:32:34,129][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:32:39,130][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:32:44,132][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:32:49,133][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:32:54,135][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:32:58,085][ ERROR][PID:2670340] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-08 20:32:59,137][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:33:04,138][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:33:08,089][ ERROR][PID:2670340] Giving up for unstable SSH, failures: 1775680147.8339193, 1775680227.911684, 1775680307.9978416, 1775680388.0894802 [2026-04-08 20:33:08,091][ ERROR][PID:2670340] Re-try request for task on 'ResallocHost, ticket_id=2232456, hostname=100.53.249.171, name=aws_x86_64_spot_prod_05947618_20260408_202337, requested_tags=['copr_builder', 'arch_s390x']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-04-08 20:33:08,092][ INFO][PID:2670340] Releasing VM back to pool [2026-04-08 20:33:08,107][ INFO][PID:2670340] Retry #2 (on other host) [2026-04-08 20:33:08,107][ INFO][PID:2670340] Checking that https://download.copr.fedorainfracloud.org/results/@go-sig/golang-rawhide-dwarf5/fedora-rawhide-s390x//repodata/repomd.xml exists [2026-04-08 20:33:08,283][ INFO][PID:2670340] Checking that https://download.copr.fedorainfracloud.org/results/@go-sig/golang-rawhide-dwarf5:pr:fork-alexsaezm-rpms-golang-297/fedora-rawhide-s390x//repodata/repomd.xml exists [2026-04-08 20:33:08,427][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:33:08,429][ INFO][PID:2670340] VM allocation process starts [2026-04-08 20:33:08,441][ INFO][PID:2670340] Trying to allocate VM: ResallocHost, ticket_id=2232596, requested_tags=['copr_builder', 'arch_s390x'] [2026-04-08 20:33:13,443][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:33:14,505][ INFO][PID:2670340] Allocated host ResallocHost, ticket_id=2232596, hostname=98.92.169.244, name=aws_x86_64_spot_prod_05947920_20260408_203109, requested_tags=['copr_builder', 'arch_s390x'] [2026-04-08 20:33:14,506][ INFO][PID:2670340] Allocating ssh connection to builder [2026-04-08 20:33:14,507][ INFO][PID:2670340] Checking that builder machine is OK [2026-04-08 20:33:14,871][ INFO][PID:2670340] Running remote command: copr-builder-ready fedora-rawhide-s390x [2026-04-08 20:33:15,092][ INFO][PID:2670340] Red Hat subscription not needed for fedora-rawhide-s390x Builder is ready to be used [2026-04-08 20:33:15,092][ INFO][PID:2670340] Filling build.info file with builder info [2026-04-08 20:33:15,097][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:33:15,098][ INFO][PID:2670340] Not re-notifying FE and msg buses for the new host. [2026-04-08 20:33:15,100][ INFO][PID:2670340] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10302719-fedora-rawhide-s390x --chroot fedora-rawhide-s390x --detached [2026-04-08 20:33:15,447][ INFO][PID:2670340] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '98.92.169.244' (ED25519) to the list of known hosts. [2026-04-08 20:33:15,448][ INFO][PID:2670340] Downloading the builder-live.log file, attempt 1 [2026-04-08 20:33:15,449][ INFO][PID:2670340] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.92.169.244 copr-rpmbuild-log [2026-04-08 20:33:20,448][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:33:25,449][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:33:30,454][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:33:35,461][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:33:40,463][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:33:45,464][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:33:50,465][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:33:55,467][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:34:00,469][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:34:00,735][ ERROR][PID:2670340] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-08 20:34:05,471][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:34:10,474][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:34:10,737][WARNING][PID:2670340] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-08 20:34:15,476][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:34:20,478][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:34:20,738][ INFO][PID:2670340] Downloading the builder-live.log file, attempt 2 [2026-04-08 20:34:20,740][ INFO][PID:2670340] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.92.169.244 copr-rpmbuild-log [2026-04-08 20:34:25,480][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:34:30,482][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:34:35,484][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:34:40,493][ INFO][PID:2670340] Periodic builder liveness probe: alive [2026-04-08 20:34:40,494][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:34:45,495][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:34:50,496][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:34:55,498][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:35:00,499][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:35:05,500][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:35:10,510][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:35:15,513][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:35:20,516][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:35:20,821][ ERROR][PID:2670340] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-08 20:35:25,530][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:35:30,532][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:35:30,824][WARNING][PID:2670340] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-08 20:35:35,533][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:35:40,534][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:35:40,825][ INFO][PID:2670340] Downloading the builder-live.log file, attempt 3 [2026-04-08 20:35:40,827][ INFO][PID:2670340] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.92.169.244 copr-rpmbuild-log [2026-04-08 20:35:45,537][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:35:50,541][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:35:55,552][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:36:00,554][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:36:05,562][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:36:10,563][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:36:15,569][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:36:20,571][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:36:25,573][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:36:30,575][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:36:35,577][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:36:40,586][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:36:40,903][ ERROR][PID:2670340] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-08 20:36:45,588][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:36:50,589][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:36:50,911][WARNING][PID:2670340] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-08 20:36:55,591][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:37:00,594][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:37:00,912][ INFO][PID:2670340] Downloading the builder-live.log file, attempt 4 [2026-04-08 20:37:00,914][ INFO][PID:2670340] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.92.169.244 copr-rpmbuild-log [2026-04-08 20:37:05,595][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:37:10,596][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:37:15,597][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:37:20,599][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:37:25,601][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:37:30,605][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:37:35,606][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:37:40,607][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:37:45,608][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:37:50,609][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:37:55,611][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:38:00,613][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:38:00,993][ ERROR][PID:2670340] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-08 20:38:05,614][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:38:10,615][ INFO][PID:2670340] Checking for cancel request [2026-04-08 20:38:10,994][ ERROR][PID:2670340] Giving up for unstable SSH, failures: 1775680450.737715, 1775680530.8247185, 1775680610.911254, 1775680690.9946864 [2026-04-08 20:38:10,995][ ERROR][PID:2670340] Re-try request for task on 'ResallocHost, ticket_id=2232596, hostname=98.92.169.244, name=aws_x86_64_spot_prod_05947920_20260408_203109, requested_tags=['copr_builder', 'arch_s390x']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-04-08 20:38:10,996][ INFO][PID:2670340] Releasing VM back to pool [2026-04-08 20:38:11,012][ ERROR][PID:2670340] Backend process error: Three host tried without success: {'98.92.169.244', '100.53.249.171', '44.197.112.77'} [2026-04-08 20:38:11,013][WARNING][PID:2670340] Switching not-finished job state to 'failed' [2026-04-08 20:38:11,013][ INFO][PID:2670340] Worker failed build, took 295.9142556190491 [2026-04-08 20:38:11,014][ INFO][PID:2670340] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@go-sig", "project_name": "golang-rawhide-dwarf5", "project_dirname": "golang-rawhide-dwarf5:pr:fork-alexsaezm-rpms-golang-297", "submitter": "https://src.fedoraproject.org/user/alexsaezm", "ended_on": 1775680691.0131335, "started_on": 1775680395.098878, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "10302719-fedora-rawhide-s390x", "build_id": 10302719, "package_name": "golang", "package_version": "1.26.2-2", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@go-sig/golang-rawhide-dwarf5:pr:fork-alexsaezm-rpms-golang-297/golang", "git_hash": "6eaa91d9cd934502f532f2f16da04d66a328c07d", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@go-sig/golang-rawhide-dwarf5--https://src.fedoraproject.org/user/alexsaezm", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@go-sig/golang-rawhide-dwarf5/fedora-rawhide-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@go-sig/golang-rawhide-dwarf5:pr:fork-alexsaezm-rpms-golang-297/fedora-rawhide-s390x/", "id": "copr_coprdir", "name": "Coprdir repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [ "dwarf5" ], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@go-sig/golang-rawhide-dwarf5:pr:fork-alexsaezm-rpms-golang-297", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@go-sig/golang-rawhide-dwarf5:pr:fork-alexsaezm-rpms-golang-297", "result_dir": "10302719-golang", "built_packages": "", "id": 10302719, "mockchain_macros": { "copr_username": "@go-sig", "copr_projectname": "golang-rawhide-dwarf5", "vendor": "Fedora Project COPR (@go-sig/golang-rawhide-dwarf5)" } } ] } [2026-04-08 20:38:11,068][ INFO][PID:2670340] Sending fedora-messaging bus message in build.end [2026-04-08 20:38:11,116][ INFO][PID:2670340] Compressing /var/lib/copr/public_html/results/@go-sig/golang-rawhide-dwarf5:pr:fork-alexsaezm-rpms-golang-297/fedora-rawhide-s390x/10302719-golang/builder-live.log by gzip [2026-04-08 20:38:11,117][ INFO][PID:2670340] Running command 'gzip /var/lib/copr/public_html/results/@go-sig/golang-rawhide-dwarf5:pr:fork-alexsaezm-rpms-golang-297/fedora-rawhide-s390x/10302719-golang/builder-live.log' as PID 3094043 [2026-04-08 20:38:11,218][ INFO][PID:2670340] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@go-sig/golang-rawhide-dwarf5:pr:fork-alexsaezm-rpms-golang-297/fedora-rawhide-s390x/10302719-golang/builder-live.log) [2026-04-08 20:38:11,219][ INFO][PID:2670340] Compressing /var/lib/copr/public_html/results/@go-sig/golang-rawhide-dwarf5:pr:fork-alexsaezm-rpms-golang-297/fedora-rawhide-s390x/10302719-golang/backend.log by gzip [2026-04-08 20:38:11,220][ INFO][PID:2670340] Running command 'gzip /var/lib/copr/public_html/results/@go-sig/golang-rawhide-dwarf5:pr:fork-alexsaezm-rpms-golang-297/fedora-rawhide-s390x/10302719-golang/backend.log' as PID 3094105