[2025-12-19 15:35:11,702][ INFO][PID:225017] Marking build as starting [2025-12-19 15:35:11,781][ INFO][PID:225017] Checking that /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/repodata/repomd.xml exists [2025-12-19 15:35:11,895][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:35:11,896][ INFO][PID:225017] VM allocation process starts [2025-12-19 15:35:11,906][ INFO][PID:225017] Trying to allocate VM: ResallocHost, ticket_id=444749, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-19 15:35:16,909][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:35:17,966][ INFO][PID:225017] Allocated host ResallocHost, ticket_id=444749, hostname=2620:52:6:1161:dead:beef:cafe:c188, name=vmhost_p09_04_prod_00705469_20251219_152149, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-19 15:35:17,967][ INFO][PID:225017] Allocating ssh connection to builder [2025-12-19 15:35:17,968][ INFO][PID:225017] Checking that builder machine is OK [2025-12-19 15:35:18,992][ INFO][PID:225017] Running remote command: copr-builder-ready fedora-41-ppc64le [2025-12-19 15:35:19,548][ INFO][PID:225017] Red Hat subscription not needed for fedora-41-ppc64le Builder is ready to be used [2025-12-19 15:35:19,548][ INFO][PID:225017] Filling build.info file with builder info [2025-12-19 15:35:19,552][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:35:19,555][ INFO][PID:225017] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "openblas-0.3.23", "project_dirname": "openblas-0.3.23", "submitter": "https://src.fedoraproject.org/user/yselkowitz", "ended_on": null, "started_on": 1766158519.5557616, "submitted_on": null, "status": 3, "chroot": "fedora-41-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9936013-fedora-41-ppc64le", "build_id": 9936013, "package_name": "maxima", "package_version": "5.49.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/maxima", "git_hash": "2e0fe29ce95da11434563e27c51a329d0dca69d6", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/yselkowitz", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23", "result_dir": "09936013-maxima", "built_packages": "", "id": 9936013, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "openblas-0.3.23", "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)" } } ] } [2025-12-19 15:35:19,617][ INFO][PID:225017] Sending fedora-messaging bus message in build.start [2025-12-19 15:35:20,301][ INFO][PID:225017] Sending fedora-messaging bus message in chroot.start [2025-12-19 15:35:20,342][ INFO][PID:225017] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9936013-fedora-41-ppc64le --chroot fedora-41-ppc64le --detached [2025-12-19 15:35:21,267][ INFO][PID:225017] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c188' (ED25519) to the list of known hosts. [2025-12-19 15:35:21,268][ INFO][PID:225017] Downloading the builder-live.log file, attempt 1 [2025-12-19 15:35:21,271][ INFO][PID:225017] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c188 copr-rpmbuild-log [2025-12-19 15:35:26,277][ INFO][PID:225017] Periodic builder liveness probe: alive [2025-12-19 15:35:26,278][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:35:31,279][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:35:36,280][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:35:41,283][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:35:46,284][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:35:51,286][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:35:56,288][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:36:01,291][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:36:06,292][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:36:11,294][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:36:16,298][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:36:21,299][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:36:26,301][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:36:31,303][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:36:36,304][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:36:41,305][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:36:46,307][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:36:51,308][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:36:56,309][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:37:01,311][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:37:06,313][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:37:11,314][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:37:16,316][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:37:21,318][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:37:26,319][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:37:31,322][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:37:36,331][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:37:41,332][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:37:46,333][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:37:51,334][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:37:56,335][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:38:01,337][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:38:06,340][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:38:11,342][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:38:16,345][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:38:21,347][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:38:26,350][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:38:31,351][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:38:36,353][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:38:41,374][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:38:46,377][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:38:51,378][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:38:56,381][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:39:01,389][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:39:06,390][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:39:11,392][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:39:16,394][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:39:21,395][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:39:26,398][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:39:31,400][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:39:36,401][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:39:41,402][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:39:46,404][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:39:51,405][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:39:56,407][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:40:01,412][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:40:06,414][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:40:11,415][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:40:16,416][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:40:21,417][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:40:26,418][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:40:31,419][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:40:36,420][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:40:41,421][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:40:46,422][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:40:51,423][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:40:56,425][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:41:01,426][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:41:06,471][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:41:11,473][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:41:16,474][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:41:21,475][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:41:26,477][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:41:31,478][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:41:36,480][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:41:41,481][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:41:46,484][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:41:51,487][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:41:56,488][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:42:01,489][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:42:06,490][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:42:11,493][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:42:16,494][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:42:21,495][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:42:26,496][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:42:31,497][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:42:36,498][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:42:41,499][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:42:46,501][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:42:51,502][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:42:56,520][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:43:01,521][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:43:06,522][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:43:11,523][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:43:16,525][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:43:21,526][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:43:26,527][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:43:31,528][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:43:36,529][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:43:41,530][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:43:46,531][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:43:51,532][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:43:56,536][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:44:01,537][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:44:06,538][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:44:11,539][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:44:16,540][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:44:21,541][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:44:26,542][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:44:31,543][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:44:36,544][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:44:41,545][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:44:46,546][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:44:51,548][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:44:56,549][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:45:01,550][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:45:06,551][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:45:11,553][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:45:16,556][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:45:21,557][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:45:26,563][ INFO][PID:225017] Periodic builder liveness probe: alive [2025-12-19 15:45:26,564][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:45:31,564][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:45:36,565][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:45:41,589][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:45:46,590][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:45:51,591][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:45:56,592][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:46:01,593][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:46:06,594][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:46:11,595][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:46:16,596][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:46:21,599][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:46:26,600][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:46:31,601][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:46:36,604][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:46:41,605][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:46:46,606][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:46:51,607][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:46:56,609][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:47:01,610][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:47:06,613][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:47:11,614][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:47:16,616][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:47:21,617][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:47:26,620][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:47:31,621][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:47:36,623][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:47:41,625][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:47:46,626][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:47:51,628][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:47:56,635][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:48:01,636][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:48:06,637][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:48:11,638][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:48:16,644][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:48:21,645][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:48:26,646][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:48:31,647][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:48:36,648][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:48:41,649][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:48:46,650][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:48:51,652][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:48:56,654][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:49:01,655][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:49:06,656][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:49:11,658][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:49:16,661][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:49:21,664][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:49:26,665][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:49:31,666][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:49:36,667][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:49:41,669][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:49:46,672][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:49:51,673][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:49:56,674][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:50:01,676][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:50:06,677][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:50:11,678][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:50:16,683][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:50:21,684][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:50:26,685][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:50:31,686][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:50:36,687][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:50:41,688][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:50:46,690][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:50:51,691][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:50:56,692][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:51:01,693][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:51:06,694][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:51:11,695][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:51:16,696][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:51:21,699][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:51:26,700][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:51:31,701][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:51:36,702][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:51:41,704][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:51:46,706][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:51:51,708][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:51:56,709][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:52:01,710][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:52:06,711][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:52:11,713][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:52:16,714][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:52:21,721][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:52:26,728][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:52:31,732][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:52:36,738][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:52:41,740][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:52:46,741][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:52:51,746][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:52:56,747][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:53:01,754][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:53:06,757][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:53:11,760][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:53:16,761][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:53:21,763][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:53:26,765][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:53:31,766][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:53:36,768][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:53:41,769][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:53:46,770][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:53:51,771][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:53:56,772][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:54:01,773][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:54:06,774][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:54:11,776][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:54:16,777][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:54:21,779][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:54:26,780][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:54:31,782][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:54:36,783][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:54:41,785][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:54:46,786][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:54:51,788][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:54:56,793][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:55:01,796][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:55:06,799][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:55:11,800][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:55:16,801][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:55:21,804][ INFO][PID:225017] Checking for cancel request [2025-12-19 15:55:26,815][ INFO][PID:225017] Periodic builder liveness probe: dead [2025-12-19 15:55:26,816][ INFO][PID:225017] calling cancel callback, and waiting [2025-12-19 15:56:25,377][ ERROR][PID:225017] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-19 15:56:26,849][ ERROR][PID:225017] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c188 port 22: Connection timed out [2025-12-19 15:56:35,379][WARNING][PID:225017] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-19 15:56:45,379][ INFO][PID:225017] Downloading the builder-live.log file, attempt 2 [2025-12-19 15:56:45,381][ INFO][PID:225017] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c188 copr-rpmbuild-log [2025-12-19 15:57:36,878][ ERROR][PID:225017] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c188 port 22: Connection timed out [2025-12-19 15:57:45,514][ ERROR][PID:225017] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-19 15:57:48,332][WARNING][PID:225017] Can't cancel build out: err: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c188' (ED25519) to the list of known hosts. Traceback (most recent call last): File "/usr/bin/copr-rpmbuild-cancel", line 85, in _main() ~~~~~^^ File "/usr/bin/copr-rpmbuild-cancel", line 69, in _main with open(pidfile, "r") as pidfd: ~~~~^^^^^^^^^^^^^^ FileNotFoundError: [Errno 2] No such file or directory: '/var/lib/copr-rpmbuild/pid' [2025-12-19 15:57:55,558][WARNING][PID:225017] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-19 15:58:05,559][ INFO][PID:225017] Downloading the builder-live.log file, attempt 3 [2025-12-19 15:58:05,560][ INFO][PID:225017] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c188 copr-rpmbuild-log [2025-12-19 16:00:06,766][ ERROR][PID:225017] Re-try request for task on 'ResallocHost, ticket_id=444749, hostname=2620:52:6:1161:dead:beef:cafe:c188, name=vmhost_p09_04_prod_00705469_20251219_152149, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED [2025-12-19 16:00:06,780][ INFO][PID:225017] Releasing VM back to pool [2025-12-19 16:00:06,790][ INFO][PID:225017] Retry #1 (on other host) [2025-12-19 16:00:06,791][ INFO][PID:225017] Checking that /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/repodata/repomd.xml exists [2025-12-19 16:00:07,041][ INFO][PID:225017] Checking for cancel request [2025-12-19 16:00:07,042][ INFO][PID:225017] VM allocation process starts [2025-12-19 16:00:07,054][ INFO][PID:225017] Trying to allocate VM: ResallocHost, ticket_id=445128, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-19 16:00:10,069][ INFO][PID:225017] Allocated host ResallocHost, ticket_id=445128, hostname=2620:52:6:1161:dead:beef:cafe:c189, name=vmhost_p09_04_prod_00705706_20251219_153518, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-19 16:00:10,070][ INFO][PID:225017] Allocating ssh connection to builder [2025-12-19 16:00:10,071][ INFO][PID:225017] Checking that builder machine is OK [2025-12-19 16:00:10,948][ INFO][PID:225017] Running remote command: copr-builder-ready fedora-41-ppc64le [2025-12-19 16:00:11,511][ INFO][PID:225017] Red Hat subscription not needed for fedora-41-ppc64le Builder is ready to be used [2025-12-19 16:00:11,511][ INFO][PID:225017] Filling build.info file with builder info [2025-12-19 16:00:11,575][ INFO][PID:225017] Checking for cancel request [2025-12-19 16:00:11,577][ INFO][PID:225017] Not re-notifying FE and msg buses for the new host. [2025-12-19 16:00:11,578][ INFO][PID:225017] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9936013-fedora-41-ppc64le --chroot fedora-41-ppc64le --detached [2025-12-19 16:00:12,558][ INFO][PID:225017] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c189' (ED25519) to the list of known hosts. [2025-12-19 16:00:12,561][ INFO][PID:225017] Downloading the builder-live.log file, attempt 1 [2025-12-19 16:00:12,562][ INFO][PID:225017] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c189 copr-rpmbuild-log [2025-12-19 16:00:17,562][ INFO][PID:225017] calling cancel callback, and waiting [2025-12-19 16:00:21,320][ INFO][PID:225017] Cancel request succeeded out: success err: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c189' (ED25519) to the list of known hosts. [2025-12-19 16:00:21,321][ INFO][PID:225017] Downloading results from builder [2025-12-19 16:00:21,322][ INFO][PID:225017] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c189]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09936013-maxima started [2025-12-19 16:00:21,322][ INFO][PID:225017] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c189]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09936013-maxima/ &> /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09936013-maxima/build-09936013.rsync.log [2025-12-19 16:00:21,855][ INFO][PID:225017] rsyncing finished. [2025-12-19 16:00:21,856][ INFO][PID:225017] Releasing VM back to pool [2025-12-19 16:00:21,869][ INFO][PID:225017] Searching for 'success' file in resultdir [2025-12-19 16:00:21,870][ ERROR][PID:225017] Build failed: Backend process error: No success file => build failure [2025-12-19 16:00:21,870][ INFO][PID:225017] Finished build: id=9936013 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/openblas-0.3.23 chroot=fedora-41-ppc64le [2025-12-19 16:00:21,872][ ERROR][PID:225017] Backend process error: No success file => build failure [2025-12-19 16:00:21,873][ INFO][PID:225017] Worker failed build, took 10.295350313186646 [2025-12-19 16:00:21,874][ INFO][PID:225017] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "openblas-0.3.23", "project_dirname": "openblas-0.3.23", "submitter": "https://src.fedoraproject.org/user/yselkowitz", "ended_on": 1766160021.8730855, "started_on": 1766160011.5777352, "submitted_on": null, "status": 0, "chroot": "fedora-41-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9936013-fedora-41-ppc64le", "build_id": 9936013, "package_name": "maxima", "package_version": "5.49.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/maxima", "git_hash": "2e0fe29ce95da11434563e27c51a329d0dca69d6", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/yselkowitz", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23", "result_dir": "09936013-maxima", "built_packages": "", "id": 9936013, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "openblas-0.3.23", "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)" } } ] } [2025-12-19 16:00:21,938][ INFO][PID:225017] Sending fedora-messaging bus message in build.end [2025-12-19 16:00:21,969][ INFO][PID:225017] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09936013-maxima/builder-live.log by gzip [2025-12-19 16:00:21,970][ INFO][PID:225017] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09936013-maxima/builder-live.log' as PID 359514 [2025-12-19 16:00:21,971][ INFO][PID:225017] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09936013-maxima/builder-live.log) [2025-12-19 16:00:21,972][ INFO][PID:225017] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09936013-maxima/backend.log by gzip [2025-12-19 16:00:21,973][ INFO][PID:225017] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09936013-maxima/backend.log' as PID 359515