[2025-12-17 02:46:07,402][ INFO][PID:512384] Marking build as starting [2025-12-17 02:46:07,466][ INFO][PID:512384] Checking that /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/repodata/repomd.xml exists [2025-12-17 02:46:07,483][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:46:07,483][ INFO][PID:512384] VM allocation process starts [2025-12-17 02:46:07,494][ INFO][PID:512384] Trying to allocate VM: ResallocHost, ticket_id=380184, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-17 02:46:12,495][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:46:17,496][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:46:22,497][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:46:27,498][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:46:32,499][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:46:37,500][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:46:42,501][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:46:47,502][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:46:52,503][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:46:57,504][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:47:02,504][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:47:07,505][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:47:12,506][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:47:17,507][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:47:22,508][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:47:27,536][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:47:32,537][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:47:37,538][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:47:42,539][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:47:47,540][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:47:52,541][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:47:57,542][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:48:02,543][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:48:07,544][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:48:12,545][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:48:17,546][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:48:22,547][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:48:25,566][ INFO][PID:512384] Allocated host ResallocHost, ticket_id=380184, hostname=2620:52:6:1161:dead:beef:cafe:c193, name=vmhost_p09_04_prod_00628073_20251217_024245, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-17 02:48:25,567][ INFO][PID:512384] Allocating ssh connection to builder [2025-12-17 02:48:25,567][ INFO][PID:512384] Checking that builder machine is OK [2025-12-17 02:48:26,417][ INFO][PID:512384] Running remote command: copr-builder-ready fedora-41-ppc64le [2025-12-17 02:48:27,049][ INFO][PID:512384] Red Hat subscription not needed for fedora-41-ppc64le Builder is ready to be used [2025-12-17 02:48:27,050][ INFO][PID:512384] Filling build.info file with builder info [2025-12-17 02:48:27,051][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:48:27,051][ INFO][PID:512384] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "openblas-0.3.23", "project_dirname": "openblas-0.3.23", "submitter": "https://src.fedoraproject.org/user/luya", "ended_on": null, "started_on": 1765939707.0515351, "submitted_on": null, "status": 3, "chroot": "fedora-41-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9917156-fedora-41-ppc64le", "build_id": 9917156, "package_name": "blender", "package_version": "1:5.0.1-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/blender", "git_hash": "3bd0c3a8e341bb41ccc0799183e6e0a0d5d4babf", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/luya", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23", "result_dir": "09917156-blender", "built_packages": "", "id": 9917156, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "openblas-0.3.23", "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)" } } ] } [2025-12-17 02:48:27,119][ INFO][PID:512384] Sending fedora-messaging bus message in build.start [2025-12-17 02:48:27,626][ INFO][PID:512384] Sending fedora-messaging bus message in chroot.start [2025-12-17 02:48:27,654][ INFO][PID:512384] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9917156-fedora-41-ppc64le --chroot fedora-41-ppc64le --detached [2025-12-17 02:48:28,607][ INFO][PID:512384] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c193' (ED25519) to the list of known hosts. [2025-12-17 02:48:28,608][ INFO][PID:512384] Downloading the builder-live.log file, attempt 1 [2025-12-17 02:48:28,609][ INFO][PID:512384] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c193 copr-rpmbuild-log [2025-12-17 02:48:33,617][ INFO][PID:512384] Periodic builder liveness probe: alive [2025-12-17 02:48:33,618][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:48:38,619][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:48:43,620][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:48:48,621][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:48:53,621][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:48:58,622][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:49:03,623][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:49:08,624][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:49:13,625][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:49:18,626][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:49:23,627][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:49:28,628][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:49:33,629][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:49:38,630][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:49:43,632][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:49:48,633][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:49:53,645][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:49:58,646][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:50:03,647][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:50:08,648][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:50:13,649][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:50:18,650][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:50:23,870][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:50:29,215][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:50:34,418][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:50:39,422][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:50:44,475][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:50:49,480][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:50:54,818][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:51:00,262][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:51:05,263][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:51:10,264][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:51:15,265][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:51:20,285][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:51:25,286][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:51:30,287][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:51:35,288][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:51:40,290][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:51:45,291][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:51:50,292][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:51:52,380][ ERROR][PID:512384] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-17 02:51:55,293][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:52:00,328][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:52:02,389][WARNING][PID:512384] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-17 02:52:05,381][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:52:10,453][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:52:12,390][ INFO][PID:512384] Downloading the builder-live.log file, attempt 2 [2025-12-17 02:52:12,415][ INFO][PID:512384] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c193 copr-rpmbuild-log [2025-12-17 02:52:15,454][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:52:20,455][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:52:25,456][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:52:30,837][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:52:35,838][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:52:40,839][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:52:45,840][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:52:50,841][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:52:55,842][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:53:00,843][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:53:05,844][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:53:10,845][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:53:12,477][ ERROR][PID:512384] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-17 02:53:15,846][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:53:20,847][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:53:22,482][WARNING][PID:512384] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-17 02:53:25,848][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:53:30,849][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:53:32,483][ INFO][PID:512384] Downloading the builder-live.log file, attempt 3 [2025-12-17 02:53:32,484][ INFO][PID:512384] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c193 copr-rpmbuild-log [2025-12-17 02:53:35,849][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:53:40,855][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:53:45,855][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:53:50,856][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:53:55,857][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:54:00,858][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:54:05,859][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:54:10,860][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:54:15,861][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:54:20,862][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:54:25,863][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:54:30,863][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:54:32,540][ ERROR][PID:512384] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-17 02:54:35,864][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:54:40,865][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:54:42,543][WARNING][PID:512384] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-17 02:54:45,866][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:54:50,867][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:54:52,543][ INFO][PID:512384] Downloading the builder-live.log file, attempt 4 [2025-12-17 02:54:52,545][ INFO][PID:512384] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c193 copr-rpmbuild-log [2025-12-17 02:54:55,933][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:55:00,935][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:55:05,937][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:55:10,938][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:55:15,940][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:55:20,946][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:55:25,948][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:55:30,949][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:55:35,950][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:55:40,951][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:55:45,952][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:55:50,975][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:55:52,605][ ERROR][PID:512384] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-17 02:55:55,977][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:56:00,983][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:56:02,637][ ERROR][PID:512384] Giving up for unstable SSH, failures: 1765939922.3857636, 1765940002.4827368, 1765940082.543194, 1765940162.6194835 [2025-12-17 02:56:02,640][ ERROR][PID:512384] Re-try request for task on 'ResallocHost, ticket_id=380184, hostname=2620:52:6:1161:dead:beef:cafe:c193, name=vmhost_p09_04_prod_00628073_20251217_024245, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-12-17 02:56:02,641][ INFO][PID:512384] Releasing VM back to pool [2025-12-17 02:56:02,652][ INFO][PID:512384] Retry #1 (on other host) [2025-12-17 02:56:02,653][ INFO][PID:512384] Checking that /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/repodata/repomd.xml exists [2025-12-17 02:56:02,653][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:56:02,654][ INFO][PID:512384] VM allocation process starts [2025-12-17 02:56:02,665][ INFO][PID:512384] Trying to allocate VM: ResallocHost, ticket_id=380229, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-17 02:56:05,723][ INFO][PID:512384] Allocated host ResallocHost, ticket_id=380229, hostname=2620:52:6:1161:dead:beef:cafe:c18b, name=vmhost_p09_04_prod_00628121_20251217_024624, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-17 02:56:05,725][ INFO][PID:512384] Allocating ssh connection to builder [2025-12-17 02:56:05,726][ INFO][PID:512384] Checking that builder machine is OK [2025-12-17 02:56:06,739][ INFO][PID:512384] Running remote command: copr-builder-ready fedora-41-ppc64le [2025-12-17 02:56:07,292][ INFO][PID:512384] Red Hat subscription not needed for fedora-41-ppc64le Builder is ready to be used [2025-12-17 02:56:07,293][ INFO][PID:512384] Filling build.info file with builder info [2025-12-17 02:56:07,306][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:56:07,308][ INFO][PID:512384] Not re-notifying FE and msg buses for the new host. [2025-12-17 02:56:07,311][ INFO][PID:512384] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9917156-fedora-41-ppc64le --chroot fedora-41-ppc64le --detached [2025-12-17 02:56:08,294][ INFO][PID:512384] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c18b' (ED25519) to the list of known hosts. [2025-12-17 02:56:08,295][ INFO][PID:512384] Downloading the builder-live.log file, attempt 1 [2025-12-17 02:56:08,296][ INFO][PID:512384] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c18b copr-rpmbuild-log [2025-12-17 02:56:13,295][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:56:18,296][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:56:23,297][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:56:28,298][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:56:33,299][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:56:38,300][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:56:43,300][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:56:48,301][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:56:53,302][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:56:58,303][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:57:03,304][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:57:08,305][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:57:13,306][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:57:18,307][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:57:23,308][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:57:28,309][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:57:33,311][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:57:38,312][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:57:43,313][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:57:48,314][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:57:53,315][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:57:58,316][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:58:03,317][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:58:08,318][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:58:13,319][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:58:18,320][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:58:23,321][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:58:28,322][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:58:33,323][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:58:38,330][ INFO][PID:512384] Periodic builder liveness probe: alive [2025-12-17 02:58:38,335][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:58:43,336][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:58:48,337][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:58:53,338][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:58:58,339][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:59:03,340][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:59:08,341][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:59:13,342][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:59:18,343][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:59:23,344][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:59:28,344][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:59:33,346][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:59:38,346][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:59:43,348][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:59:48,349][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:59:53,350][ INFO][PID:512384] Checking for cancel request [2025-12-17 02:59:58,351][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:00:03,351][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:00:08,352][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:00:13,353][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:00:18,354][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:00:23,355][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:00:28,356][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:00:33,357][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:00:38,358][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:00:43,359][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:00:48,360][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:00:53,361][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:00:58,362][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:01:03,363][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:01:08,364][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:01:13,365][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:01:18,366][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:01:23,367][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:01:28,368][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:01:33,369][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:01:38,370][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:01:43,371][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:01:48,372][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:01:53,373][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:01:58,374][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:02:03,375][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:02:08,376][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:02:13,377][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:02:18,378][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:02:23,379][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:02:28,380][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:02:33,381][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:02:38,382][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:02:43,383][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:02:48,384][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:02:53,385][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:02:58,386][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:03:03,387][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:03:08,388][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:03:13,389][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:03:18,390][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:03:23,391][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:03:28,392][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:03:33,393][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:03:38,394][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:03:43,395][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:03:48,396][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:03:53,397][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:03:58,398][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:04:03,399][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:04:08,400][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:04:13,401][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:04:18,402][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:04:23,403][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:04:28,404][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:04:33,405][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:04:38,406][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:04:43,407][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:04:48,408][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:04:53,409][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:04:58,410][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:05:03,411][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:05:08,412][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:05:13,537][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:05:18,538][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:05:23,539][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:05:28,540][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:05:33,541][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:05:38,542][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:05:43,543][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:05:48,543][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:05:53,544][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:05:58,551][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:06:03,568][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:06:08,569][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:06:13,570][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:06:18,571][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:06:23,572][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:06:28,573][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:06:33,574][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:06:38,577][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:06:43,578][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:06:48,579][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:06:53,580][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:06:58,581][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:07:03,582][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:07:08,583][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:07:13,584][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:07:18,585][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:07:23,586][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:07:28,587][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:07:33,588][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:07:38,589][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:07:43,590][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:07:48,591][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:07:53,593][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:07:58,596][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:08:03,598][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:08:08,599][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:08:13,599][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:08:18,600][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:08:23,601][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:08:28,602][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:08:33,603][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:08:38,624][ INFO][PID:512384] Periodic builder liveness probe: alive [2025-12-17 03:08:38,631][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:08:43,633][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:08:48,635][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:08:53,635][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:08:58,637][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:09:03,638][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:09:08,640][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:09:13,641][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:09:18,643][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:09:23,644][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:09:28,647][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:09:33,648][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:09:38,649][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:09:43,653][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:09:48,655][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:09:53,657][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:09:58,658][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:10:03,660][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:10:08,661][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:10:13,663][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:10:18,664][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:10:23,665][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:10:28,666][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:10:33,669][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:10:38,673][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:10:43,674][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:10:48,676][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:10:53,677][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:10:58,678][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:11:03,680][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:11:08,681][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:11:13,682][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:11:18,683][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:11:23,685][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:11:28,697][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:11:33,699][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:11:38,701][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:11:43,703][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:11:48,705][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:11:53,706][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:11:58,707][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:12:03,708][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:12:08,711][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:12:13,715][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:12:18,717][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:12:23,718][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:12:28,719][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:12:33,720][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:12:38,724][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:12:43,729][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:12:48,730][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:12:53,732][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:12:58,734][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:13:03,736][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:13:08,739][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:13:13,741][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:13:18,747][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:13:23,748][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:13:28,750][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:13:33,752][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:13:38,753][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:13:43,755][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:13:48,760][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:13:53,782][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:13:58,784][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:14:03,790][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:14:08,791][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:14:13,793][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:14:18,796][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:14:23,796][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:14:28,798][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:14:33,799][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:14:38,801][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:14:43,802][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:14:48,802][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:14:53,803][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:14:58,805][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:15:03,806][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:15:08,807][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:15:13,808][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:15:18,809][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:15:23,811][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:15:28,812][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:15:33,813][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:15:38,815][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:15:43,816][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:15:48,869][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:15:53,870][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:15:58,871][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:16:03,872][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:16:08,873][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:16:13,874][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:16:18,875][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:16:23,877][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:16:28,878][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:16:33,879][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:16:38,880][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:16:43,886][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:16:48,888][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:16:53,889][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:16:58,890][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:17:03,891][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:17:08,892][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:17:13,905][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:17:19,389][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:17:24,390][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:17:29,391][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:17:34,392][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:17:39,393][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:17:44,394][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:17:49,395][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:17:54,396][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:17:59,398][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:18:04,399][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:18:09,400][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:18:14,401][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:18:19,402][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:18:24,403][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:18:29,403][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:18:34,404][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:18:39,625][ INFO][PID:512384] Periodic builder liveness probe: alive [2025-12-17 03:18:39,653][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:18:44,654][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:18:49,654][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:18:54,655][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:18:59,656][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:19:04,657][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:19:09,658][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:19:14,659][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:19:19,660][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:19:24,661][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:19:29,662][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:19:34,663][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:19:39,664][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:19:44,665][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:19:49,666][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:19:54,667][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:19:59,667][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:20:04,668][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:20:09,669][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:20:14,670][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:20:19,671][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:20:24,672][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:20:29,673][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:20:34,673][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:20:39,674][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:20:44,675][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:20:49,676][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:20:54,677][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:20:59,678][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:21:04,679][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:21:09,680][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:21:14,681][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:21:19,682][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:21:24,683][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:21:29,683][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:21:34,684][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:21:39,685][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:21:44,686][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:21:49,687][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:21:54,688][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:21:59,689][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:22:04,690][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:22:09,691][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:22:14,692][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:22:19,692][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:22:24,693][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:22:29,694][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:22:34,695][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:22:39,696][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:22:44,697][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:22:49,698][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:22:54,709][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:22:59,710][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:23:05,083][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:23:10,084][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:23:15,085][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:23:20,086][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:23:25,087][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:23:30,088][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:23:35,089][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:23:40,090][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:23:45,091][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:23:50,092][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:23:55,093][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:24:00,093][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:24:05,094][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:24:10,662][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:24:15,663][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:24:20,664][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:24:25,664][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:24:30,665][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:24:35,666][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:24:40,667][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:24:45,668][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:24:50,669][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:24:55,670][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:25:00,671][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:25:05,672][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:25:10,672][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:25:15,675][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:25:20,677][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:25:25,677][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:25:30,678][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:25:35,679][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:25:40,680][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:25:45,681][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:25:50,682][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:25:55,682][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:26:00,683][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:26:05,783][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:26:10,783][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:26:15,784][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:26:20,785][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:26:25,806][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:26:30,808][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:26:35,808][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:26:40,809][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:26:45,868][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:26:50,868][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:26:55,869][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:27:00,870][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:27:06,104][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:27:11,105][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:27:16,106][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:27:21,107][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:27:26,108][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:27:31,109][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:27:36,110][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:27:41,110][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:27:46,111][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:27:51,112][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:27:56,113][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:28:01,114][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:28:06,115][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:28:11,116][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:28:16,117][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:28:21,117][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:28:26,118][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:28:31,321][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:28:36,322][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:28:41,340][ INFO][PID:512384] Periodic builder liveness probe: alive [2025-12-17 03:28:41,340][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:28:46,341][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:28:51,342][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:28:56,343][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:29:01,343][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:29:06,344][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:29:11,345][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:29:16,346][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:29:21,349][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:29:26,350][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:29:31,351][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:29:36,352][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:29:41,352][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:29:46,353][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:29:51,354][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:29:56,356][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:30:01,368][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:30:06,370][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:30:11,371][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:30:16,372][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:30:21,373][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:30:26,374][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:30:31,375][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:30:36,384][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:30:41,385][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:30:46,386][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:30:51,387][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:30:56,388][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:31:01,388][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:31:06,823][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:31:11,875][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:31:16,877][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:31:21,878][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:31:26,880][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:31:32,013][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:31:37,014][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:31:42,015][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:31:47,016][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:31:52,017][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:31:57,018][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:32:02,018][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:32:07,019][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:32:12,111][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:32:17,112][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:32:22,113][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:32:27,113][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:32:32,114][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:32:37,115][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:32:42,116][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:32:47,451][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:32:52,452][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:32:57,453][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:33:02,454][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:33:08,146][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:33:13,151][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:33:18,154][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:33:23,357][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:33:28,574][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:33:33,766][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:33:38,768][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:33:43,769][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:33:48,770][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:33:53,771][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:33:58,846][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:34:03,847][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:34:08,848][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:34:13,849][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:34:18,850][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:34:23,851][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:34:28,852][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:34:33,853][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:34:38,854][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:34:43,855][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:34:48,991][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:34:53,993][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:34:58,995][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:35:03,997][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:35:08,998][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:35:13,999][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:35:18,999][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:35:24,325][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:35:29,328][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:35:34,329][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:35:39,331][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:35:44,332][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:35:49,333][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:35:54,334][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:35:59,335][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:36:04,336][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:36:09,338][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:36:14,339][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:36:19,378][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:36:24,382][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:36:29,384][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:36:34,386][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:36:39,388][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:36:44,389][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:36:49,392][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:36:54,393][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:36:59,395][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:37:04,396][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:37:09,398][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:37:14,400][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:37:19,402][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:37:24,403][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:37:29,404][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:37:34,405][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:37:39,406][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:37:44,407][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:37:49,408][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:37:54,409][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:37:59,410][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:38:04,411][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:38:09,413][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:38:14,414][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:38:19,416][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:38:24,418][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:38:29,419][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:38:34,421][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:38:39,422][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:38:44,430][ INFO][PID:512384] Periodic builder liveness probe: alive [2025-12-17 03:38:44,431][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:38:49,431][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:38:54,432][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:38:59,433][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:39:04,434][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:39:09,438][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:39:14,439][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:39:19,441][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:39:24,443][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:39:29,444][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:39:34,445][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:39:39,446][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:39:44,447][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:39:49,448][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:39:54,449][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:39:59,450][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:40:04,452][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:40:09,453][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:40:14,454][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:40:19,455][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:40:24,456][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:40:29,457][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:40:34,458][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:40:39,459][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:40:44,460][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:40:49,461][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:40:54,462][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:40:59,463][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:41:04,465][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:41:09,467][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:41:14,505][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:41:19,507][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:41:24,508][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:41:29,510][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:41:34,514][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:41:39,515][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:41:44,517][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:41:49,579][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:41:54,580][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:41:59,585][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:42:04,587][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:42:09,592][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:42:14,599][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:42:19,602][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:42:24,610][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:42:29,612][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:42:34,616][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:42:39,617][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:42:44,625][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:42:49,629][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:42:54,631][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:42:59,634][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:43:04,637][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:43:09,639][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:43:14,643][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:43:19,647][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:43:24,648][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:43:29,649][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:43:34,650][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:43:39,651][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:43:44,652][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:43:49,653][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:43:54,653][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:43:59,655][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:44:04,656][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:44:09,657][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:44:15,203][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:44:20,630][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:44:25,651][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:44:30,666][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:44:35,668][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:44:40,685][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:44:45,689][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:44:50,691][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:44:55,692][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:45:00,693][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:45:05,694][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:45:10,695][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:45:15,696][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:45:20,697][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:45:25,698][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:45:30,699][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:45:35,700][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:45:40,701][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:45:45,702][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:45:50,703][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:45:55,704][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:46:00,739][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:46:05,741][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:46:10,742][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:46:15,743][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:46:20,744][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:46:25,745][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:46:30,746][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:46:35,747][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:46:40,748][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:46:45,749][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:46:50,750][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:46:55,751][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:47:00,752][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:47:05,753][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:47:10,754][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:47:15,755][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:47:20,756][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:47:25,758][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:47:30,759][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:47:35,760][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:47:40,761][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:47:45,762][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:47:50,764][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:47:55,765][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:48:00,766][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:48:05,767][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:48:10,768][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:48:15,769][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:48:20,770][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:48:25,771][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:48:30,771][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:48:35,772][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:48:40,773][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:48:45,780][ INFO][PID:512384] Periodic builder liveness probe: alive [2025-12-17 03:48:45,781][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:48:50,781][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:48:55,782][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:49:00,783][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:49:05,784][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:49:10,785][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:49:16,333][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:49:21,335][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:49:26,336][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:49:31,337][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:49:36,338][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:49:41,373][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:49:46,375][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:49:51,839][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:49:56,842][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:50:01,843][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:50:06,845][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:50:11,845][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:50:16,846][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:50:21,847][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:50:26,849][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:50:32,695][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:50:37,696][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:50:42,771][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:50:47,772][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:50:52,773][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:50:57,774][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:51:02,775][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:51:07,776][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:51:12,777][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:51:17,778][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:51:22,779][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:51:27,780][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:51:32,967][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:51:37,968][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:51:42,969][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:51:47,970][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:51:52,971][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:51:57,972][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:52:02,979][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:52:08,258][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:52:13,259][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:52:18,260][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:52:23,261][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:52:28,263][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:52:33,264][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:52:38,265][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:52:43,266][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:52:48,267][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:52:53,268][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:52:58,269][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:53:03,270][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:53:08,271][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:53:13,397][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:53:18,398][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:53:23,400][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:53:28,401][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:53:33,402][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:53:38,405][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:53:43,406][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:53:48,407][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:53:53,838][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:53:58,841][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:54:03,844][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:54:08,846][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:54:13,847][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:54:18,849][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:54:23,851][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:54:28,852][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:54:33,853][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:54:38,855][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:54:43,857][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:54:48,858][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:54:53,859][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:54:58,860][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:55:03,861][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:55:08,862][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:55:13,870][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:55:18,871][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:55:23,880][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:55:28,886][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:55:33,888][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:55:38,888][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:55:43,889][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:55:48,898][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:55:53,899][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:55:58,900][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:56:03,901][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:56:08,901][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:56:13,902][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:56:18,903][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:56:23,904][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:56:28,905][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:56:33,906][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:56:38,907][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:56:43,913][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:56:48,914][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:56:53,915][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:56:58,915][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:57:03,916][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:57:08,917][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:57:13,918][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:57:18,919][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:57:23,920][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:57:28,921][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:57:33,922][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:57:38,923][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:57:43,924][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:57:48,925][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:57:53,926][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:57:58,927][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:58:03,937][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:58:08,938][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:58:13,939][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:58:18,940][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:58:23,941][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:58:28,942][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:58:33,942][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:58:38,943][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:58:43,945][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:58:49,142][ INFO][PID:512384] Periodic builder liveness probe: alive [2025-12-17 03:58:49,162][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:58:54,163][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:58:59,165][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:59:04,171][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:59:09,172][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:59:14,173][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:59:19,174][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:59:24,175][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:59:29,176][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:59:34,177][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:59:39,178][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:59:44,179][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:59:49,180][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:59:54,208][ INFO][PID:512384] Checking for cancel request [2025-12-17 03:59:59,209][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:00:04,211][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:00:09,212][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:00:14,213][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:00:19,214][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:00:24,215][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:00:29,217][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:00:34,218][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:00:39,222][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:00:44,223][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:00:49,223][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:00:54,224][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:00:59,225][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:01:04,227][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:01:09,228][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:01:14,231][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:01:19,232][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:01:24,233][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:01:29,236][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:01:34,237][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:01:39,238][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:01:44,239][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:01:49,240][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:01:54,241][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:01:59,242][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:02:04,243][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:02:09,244][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:02:14,245][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:02:19,246][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:02:24,247][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:02:29,248][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:02:34,249][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:02:39,250][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:02:44,251][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:02:49,252][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:02:54,253][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:02:59,256][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:03:04,258][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:03:09,259][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:03:14,305][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:03:19,307][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:03:24,308][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:03:29,309][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:03:34,310][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:03:39,313][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:03:44,317][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:03:49,320][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:03:54,321][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:03:59,322][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:04:04,323][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:04:09,324][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:04:14,326][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:04:19,327][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:04:24,328][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:04:29,330][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:04:34,333][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:04:39,334][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:04:44,336][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:04:49,340][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:04:54,350][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:04:59,353][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:05:04,355][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:05:09,364][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:05:14,370][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:05:19,376][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:05:24,377][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:05:29,378][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:05:34,380][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:05:39,381][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:05:44,382][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:05:49,383][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:05:54,385][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:05:59,386][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:06:04,387][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:06:09,388][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:06:14,389][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:06:19,390][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:06:24,391][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:06:29,394][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:06:34,396][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:06:39,398][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:06:44,399][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:06:49,400][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:06:54,401][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:06:59,402][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:07:04,408][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:07:09,409][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:07:14,415][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:07:19,416][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:07:24,417][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:07:29,418][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:07:34,419][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:07:39,420][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:07:44,421][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:07:49,423][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:07:54,425][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:07:59,426][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:08:04,427][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:08:09,428][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:08:14,429][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:08:19,429][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:08:24,431][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:08:29,432][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:08:34,433][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:08:39,434][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:08:44,435][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:08:49,444][ INFO][PID:512384] Periodic builder liveness probe: dead [2025-12-17 04:08:49,449][ INFO][PID:512384] calling cancel callback, and waiting [2025-12-17 04:09:49,650][ ERROR][PID:512384] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c18b port 22: Connection timed out [2025-12-17 04:10:59,725][ ERROR][PID:512384] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c18b port 22: Connection timed out [2025-12-17 04:11:16,951][ INFO][PID:512384] Cancel request succeeded out: success err: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c18b' (ED25519) to the list of known hosts. [2025-12-17 04:11:16,972][ ERROR][PID:512384] Re-try request for task on 'ResallocHost, ticket_id=380229, hostname=2620:52:6:1161:dead:beef:cafe:c18b, name=vmhost_p09_04_prod_00628121_20251217_024624, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED [2025-12-17 04:11:16,975][ INFO][PID:512384] Releasing VM back to pool [2025-12-17 04:11:16,996][ INFO][PID:512384] Retry #2 (on other host) [2025-12-17 04:11:17,011][ INFO][PID:512384] Checking that /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/repodata/repomd.xml exists [2025-12-17 04:11:17,021][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:11:17,023][ INFO][PID:512384] VM allocation process starts [2025-12-17 04:11:17,057][ INFO][PID:512384] Trying to allocate VM: ResallocHost, ticket_id=380793, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-17 04:11:20,161][ INFO][PID:512384] Allocated host ResallocHost, ticket_id=380793, hostname=2620:52:6:1161:dead:beef:cafe:c151, name=vmhost_p09_03_prod_00628508_20251217_031601, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-17 04:11:20,166][ INFO][PID:512384] Allocating ssh connection to builder [2025-12-17 04:11:20,169][ INFO][PID:512384] Checking that builder machine is OK [2025-12-17 04:11:21,216][ INFO][PID:512384] Running remote command: copr-builder-ready fedora-41-ppc64le [2025-12-17 04:11:21,772][ INFO][PID:512384] Red Hat subscription not needed for fedora-41-ppc64le Builder is ready to be used [2025-12-17 04:11:21,778][ INFO][PID:512384] Filling build.info file with builder info [2025-12-17 04:11:21,850][ INFO][PID:512384] Checking for cancel request [2025-12-17 04:11:21,860][ INFO][PID:512384] Not re-notifying FE and msg buses for the new host. [2025-12-17 04:11:21,868][ INFO][PID:512384] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9917156-fedora-41-ppc64le --chroot fedora-41-ppc64le --detached [2025-12-17 04:12:21,937][ ERROR][PID:512384] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c151 port 22: Connection timed out [2025-12-17 04:12:31,938][ ERROR][PID:512384] Re-try request for task on 'ResallocHost, ticket_id=380793, hostname=2620:52:6:1161:dead:beef:cafe:c151, name=vmhost_p09_03_prod_00628508_20251217_031601, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts [2025-12-17 04:12:31,938][ INFO][PID:512384] Releasing VM back to pool [2025-12-17 04:12:31,961][ ERROR][PID:512384] Backend process error: Three host tried without success: {'2620:52:6:1161:dead:beef:cafe:c151', '2620:52:6:1161:dead:beef:cafe:c193', '2620:52:6:1161:dead:beef:cafe:c18b'} [2025-12-17 04:12:31,964][WARNING][PID:512384] Switching not-finished job state to 'failed' [2025-12-17 04:12:31,965][ INFO][PID:512384] Worker failed build, took 70.11087942123413 [2025-12-17 04:12:31,985][ INFO][PID:512384] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "openblas-0.3.23", "project_dirname": "openblas-0.3.23", "submitter": "https://src.fedoraproject.org/user/luya", "ended_on": 1765944751.9643888, "started_on": 1765944681.8535094, "submitted_on": null, "status": 0, "chroot": "fedora-41-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9917156-fedora-41-ppc64le", "build_id": 9917156, "package_name": "blender", "package_version": "1:5.0.1-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/blender", "git_hash": "3bd0c3a8e341bb41ccc0799183e6e0a0d5d4babf", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/luya", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23", "result_dir": "09917156-blender", "built_packages": "", "id": 9917156, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "openblas-0.3.23", "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)" } } ] } [2025-12-17 04:12:33,008][ INFO][PID:512384] Sending fedora-messaging bus message in build.end [2025-12-17 04:12:33,468][ INFO][PID:512384] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09917156-blender/builder-live.log by gzip [2025-12-17 04:12:33,484][ INFO][PID:512384] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09917156-blender/builder-live.log' as PID 867241 [2025-12-17 04:12:34,204][ INFO][PID:512384] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09917156-blender/builder-live.log) [2025-12-17 04:12:34,209][ INFO][PID:512384] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09917156-blender/backend.log by gzip [2025-12-17 04:12:34,210][ INFO][PID:512384] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09917156-blender/backend.log' as PID 867367