[2025-09-01 16:38:17,023][ INFO][PID:1004471] Marking build as starting [2025-09-01 16:38:17,076][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:38:17,078][ INFO][PID:1004471] VM allocation process starts [2025-09-01 16:38:17,096][ INFO][PID:1004471] Trying to allocate VM: ResallocHost, ticket_id=4861928, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-09-01 16:38:22,098][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:38:27,099][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:38:32,100][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:38:37,102][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:38:42,105][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:38:47,107][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:38:52,109][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:38:57,110][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:39:02,113][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:39:05,209][ INFO][PID:1004471] Allocated host ResallocHost, ticket_id=4861928, hostname=140.211.168.61, name=copr_osuosl_p09_prod_06528892_20250901_163524, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-09-01 16:39:05,210][ INFO][PID:1004471] Allocating ssh connection to builder [2025-09-01 16:39:05,212][ INFO][PID:1004471] Checking that builder machine is OK [2025-09-01 16:39:06,761][ INFO][PID:1004471] Running remote command: copr-builder-ready fedora-42-ppc64le [2025-09-01 16:39:07,785][ INFO][PID:1004471] Red Hat subscription not needed for fedora-42-ppc64le Builder is ready to be used [2025-09-01 16:39:07,786][ INFO][PID:1004471] Filling build.info file with builder info [2025-09-01 16:39:07,787][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:39:07,789][ INFO][PID:1004471] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "openblas-0.3.23", "project_dirname": "openblas-0.3.23", "submitter": "https://src.fedoraproject.org/user/gbcox", "ended_on": null, "started_on": 1756744747.7893934, "submitted_on": null, "status": 3, "chroot": "fedora-42-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9513121-fedora-42-ppc64le", "build_id": 9513121, "package_name": "copyq", "package_version": "11.0.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/copyq", "git_hash": "2964cb184fc624f438f4f3b4223a795595e8f942", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/gbcox", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23", "result_dir": "09513121-copyq", "built_packages": "", "id": 9513121, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "openblas-0.3.23", "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)" } } ] } [2025-09-01 16:39:07,842][ INFO][PID:1004471] Sending fedora-messaging bus message in build.start [2025-09-01 16:39:08,765][ INFO][PID:1004471] Sending fedora-messaging bus message in chroot.start [2025-09-01 16:39:08,792][ INFO][PID:1004471] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9513121-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached [2025-09-01 16:39:10,063][ INFO][PID:1004471] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '140.211.168.61' (ED25519) to the list of known hosts. [2025-09-01 16:39:10,064][ INFO][PID:1004471] Downloading the builder-live.log file, attempt 1 [2025-09-01 16:39:10,066][ INFO][PID:1004471] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.61 copr-rpmbuild-log [2025-09-01 16:39:15,071][ INFO][PID:1004471] Periodic builder liveness probe: alive [2025-09-01 16:39:15,323][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:39:20,326][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:39:25,371][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:39:30,946][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:39:36,827][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:39:41,848][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:39:46,865][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:39:51,867][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:39:57,005][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:40:02,092][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:40:08,518][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:40:13,523][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:40:18,572][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:40:23,626][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:40:28,720][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:40:33,723][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:40:38,725][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:40:43,887][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:40:48,894][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:40:53,897][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:40:58,899][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:41:03,900][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:41:08,908][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:41:13,926][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:41:18,934][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:41:23,937][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:41:28,973][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:41:33,978][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:41:38,981][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:41:43,983][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:41:48,984][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:41:53,985][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:41:58,987][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:42:03,990][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:42:09,034][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:42:14,038][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:42:19,062][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:42:24,063][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:42:29,064][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:42:34,066][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:42:39,068][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:42:44,069][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:42:49,076][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:42:54,078][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:42:59,080][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:43:04,081][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:43:09,084][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:43:14,185][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:43:19,885][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:43:25,666][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:43:32,458][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:43:38,205][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:43:43,554][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:43:50,037][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:43:55,484][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:44:01,114][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:44:06,626][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:44:12,054][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:44:17,431][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:44:23,870][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:44:30,331][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:44:35,698][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:44:42,127][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:44:47,724][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:44:54,096][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:45:00,087][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:45:06,026][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:45:12,226][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:45:18,611][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:45:23,950][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:45:29,423][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:45:34,425][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:45:39,427][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:45:44,428][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:45:49,430][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:45:54,431][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:45:59,432][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:46:04,433][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:46:09,435][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:46:14,436][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:46:19,437][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:46:24,440][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:46:29,442][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:46:34,446][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:46:39,447][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:46:44,449][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:46:49,450][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:46:54,451][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:46:59,452][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:47:04,453][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:47:09,455][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:47:14,456][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:47:19,457][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:47:24,458][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:47:29,459][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:47:34,460][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:47:39,461][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:47:44,462][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:47:49,462][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:47:54,463][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:47:59,464][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:48:04,465][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:48:09,466][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:48:14,467][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:48:19,468][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:48:24,469][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:48:29,470][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:48:34,471][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:48:39,472][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:48:44,476][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:48:49,477][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:48:54,478][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:48:59,480][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:49:04,482][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:49:09,483][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:49:14,484][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:49:19,490][ INFO][PID:1004471] Periodic builder liveness probe: alive [2025-09-01 16:49:19,491][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:49:24,492][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:49:29,494][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:49:34,495][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:49:39,497][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:49:44,498][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:49:49,500][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:49:54,501][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:49:59,503][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:50:04,504][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:50:09,505][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:50:14,507][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:50:19,508][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:50:24,514][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:50:29,526][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:50:34,540][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:50:39,544][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:50:44,550][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:50:49,552][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:50:54,553][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:50:59,554][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:51:04,555][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:51:09,556][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:51:14,562][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:51:19,567][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:51:24,568][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:51:29,569][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:51:34,570][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:51:39,571][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:51:44,572][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:51:49,573][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:51:54,576][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:51:59,579][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:52:04,580][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:52:09,581][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:52:14,583][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:52:19,585][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:52:24,587][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:52:29,588][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:52:34,591][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:52:39,592][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:52:44,601][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:52:49,608][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:52:54,611][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:52:59,613][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:53:04,636][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:53:09,640][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:53:14,643][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:53:19,645][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:53:24,646][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:53:29,648][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:53:35,145][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:53:40,417][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:53:45,418][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:53:50,423][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:53:55,426][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:54:00,825][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:54:07,524][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:54:13,125][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:54:18,187][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:54:23,530][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:54:29,274][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:54:37,151][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:54:43,713][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:54:50,468][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:54:55,916][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:55:01,118][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:55:07,791][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:55:13,018][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:55:18,263][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:55:23,264][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:55:28,494][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:55:33,495][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:55:38,497][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:55:43,946][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:55:50,040][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:55:55,041][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:56:00,664][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:56:05,853][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:56:11,623][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:56:16,656][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:56:21,988][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:56:28,438][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:56:33,443][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:56:39,751][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:56:45,408][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:56:52,532][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:56:58,577][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:57:03,687][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:57:09,996][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:57:15,584][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:57:20,973][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:57:25,974][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:57:31,879][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:57:37,622][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:57:43,111][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:57:48,499][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:57:53,577][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:57:58,583][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:58:05,508][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:58:11,757][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:58:17,417][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:58:22,457][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:58:29,537][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:58:36,842][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:58:43,961][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:58:50,304][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:58:56,610][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:59:02,286][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:59:09,740][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:59:15,176][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:59:21,467][ INFO][PID:1004471] Periodic builder liveness probe: alive [2025-09-01 16:59:22,233][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:59:27,239][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:59:32,921][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:59:38,324][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:59:44,120][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:59:49,262][ INFO][PID:1004471] Checking for cancel request [2025-09-01 16:59:56,458][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:00:03,454][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:00:10,012][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:00:15,713][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:00:21,240][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:00:26,241][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:00:31,880][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:00:36,890][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:00:41,892][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:00:46,895][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:00:51,900][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:00:58,931][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:01:03,936][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:01:08,939][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:01:15,546][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:01:21,096][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:01:26,961][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:01:32,654][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:01:39,551][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:01:47,207][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:01:53,101][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:02:00,865][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:02:07,475][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:02:13,035][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:02:19,810][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:02:26,509][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:02:32,917][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:02:41,733][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:02:47,255][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:02:52,852][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:02:58,617][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:03:04,630][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:03:11,442][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:03:16,728][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:03:22,648][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:03:27,650][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:03:34,679][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:03:39,784][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:03:45,140][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:03:50,146][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:03:55,648][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:04:01,648][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:04:07,141][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:04:12,216][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:04:17,271][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:04:22,769][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:04:27,771][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:04:33,079][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:04:38,080][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:04:44,214][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:04:50,795][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:04:56,415][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:05:01,422][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:05:07,944][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:05:15,873][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:05:22,085][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:05:29,081][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:05:34,966][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:05:40,205][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:05:45,712][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:05:51,457][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:05:58,111][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:06:03,135][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:06:08,179][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:06:14,809][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:06:19,810][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:06:25,034][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:06:31,169][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:06:36,277][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:06:42,962][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:06:47,991][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:06:54,274][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:06:59,619][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:07:06,398][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:07:12,155][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:07:18,151][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:07:23,154][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:07:28,163][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:07:33,719][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:07:40,390][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:07:45,716][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:07:52,818][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:07:59,026][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:08:04,034][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:08:10,293][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:08:15,298][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:08:21,401][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:08:26,901][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:08:31,917][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:08:37,279][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:08:42,724][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:08:49,414][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:08:54,704][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:08:59,905][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:09:05,457][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:09:10,459][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:09:15,460][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:09:20,999][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:09:26,215][ INFO][PID:1004471] Periodic builder liveness probe: dead [2025-09-01 17:09:26,335][ INFO][PID:1004471] calling cancel callback, and waiting [2025-09-01 17:10:26,506][ ERROR][PID:1004471] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: Connection timed out during banner exchange Connection to 140.211.168.61 port 22 timed out [2025-09-01 17:11:36,751][ ERROR][PID:1004471] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.61 port 22: Connection timed out [2025-09-01 17:11:39,159][ ERROR][PID:1004471] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-09-01 17:11:49,166][WARNING][PID:1004471] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-09-01 17:11:59,167][ INFO][PID:1004471] Downloading the builder-live.log file, attempt 2 [2025-09-01 17:11:59,173][ INFO][PID:1004471] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.61 copr-rpmbuild-log [2025-09-01 17:12:46,835][ ERROR][PID:1004471] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.61 port 22: Connection timed out [2025-09-01 17:12:59,246][ ERROR][PID:1004471] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-09-01 17:13:09,249][WARNING][PID:1004471] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-09-01 17:13:19,250][ INFO][PID:1004471] Downloading the builder-live.log file, attempt 3 [2025-09-01 17:13:19,252][ INFO][PID:1004471] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.61 copr-rpmbuild-log [2025-09-01 17:13:56,905][ ERROR][PID:1004471] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.61 port 22: Connection timed out [2025-09-01 17:14:06,907][ ERROR][PID:1004471] Can't ssh to cancel build. [2025-09-01 17:14:19,361][ ERROR][PID:1004471] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-09-01 17:14:29,553][WARNING][PID:1004471] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-09-01 17:14:39,553][ INFO][PID:1004471] Downloading the builder-live.log file, attempt 4 [2025-09-01 17:14:39,555][ INFO][PID:1004471] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.61 copr-rpmbuild-log [2025-09-01 17:15:39,623][ ERROR][PID:1004471] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-09-01 17:15:49,760][ ERROR][PID:1004471] Giving up for unstable SSH, failures: 1756746709.1661243, 1756746789.249635, 1756746869.5531735, 1756746949.760059 [2025-09-01 17:15:49,761][ ERROR][PID:1004471] Re-try request for task on 'ResallocHost, ticket_id=4861928, hostname=140.211.168.61, name=copr_osuosl_p09_prod_06528892_20250901_163524, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED [2025-09-01 17:15:49,761][ INFO][PID:1004471] Releasing VM back to pool [2025-09-01 17:15:49,771][ INFO][PID:1004471] Retry #1 (on other host) [2025-09-01 17:15:49,772][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:15:49,773][ INFO][PID:1004471] VM allocation process starts [2025-09-01 17:15:49,784][ INFO][PID:1004471] Trying to allocate VM: ResallocHost, ticket_id=4862576, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-09-01 17:15:52,796][ INFO][PID:1004471] Allocated host ResallocHost, ticket_id=4862576, hostname=2620:52:3:1:dead:beef:cafe:c2a6, name=copr_p09_01_prod_06529439_20250901_170759, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-09-01 17:15:52,796][ INFO][PID:1004471] Allocating ssh connection to builder [2025-09-01 17:15:52,797][ INFO][PID:1004471] Checking that builder machine is OK [2025-09-01 17:15:53,658][ INFO][PID:1004471] Running remote command: copr-builder-ready fedora-42-ppc64le [2025-09-01 17:15:54,419][ INFO][PID:1004471] Red Hat subscription not needed for fedora-42-ppc64le Builder is ready to be used [2025-09-01 17:15:54,420][ INFO][PID:1004471] Filling build.info file with builder info [2025-09-01 17:15:54,424][ INFO][PID:1004471] Checking for cancel request [2025-09-01 17:15:54,425][ INFO][PID:1004471] Not re-notifying FE and msg buses for the new host. [2025-09-01 17:15:54,425][ INFO][PID:1004471] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9513121-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached [2025-09-01 17:15:55,239][ INFO][PID:1004471] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c2a6' (ED25519) to the list of known hosts. [2025-09-01 17:15:55,240][ INFO][PID:1004471] Downloading the builder-live.log file, attempt 1 [2025-09-01 17:15:55,241][ INFO][PID:1004471] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c2a6 copr-rpmbuild-log [2025-09-01 17:16:00,240][ INFO][PID:1004471] calling cancel callback, and waiting [2025-09-01 17:16:03,841][ INFO][PID:1004471] Cancel request succeeded out: success err: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c2a6' (ED25519) to the list of known hosts. [2025-09-01 17:16:03,841][ INFO][PID:1004471] Downloading results from builder [2025-09-01 17:16:03,842][ INFO][PID:1004471] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c2a6]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09513121-copyq started [2025-09-01 17:16:03,843][ INFO][PID:1004471] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c2a6]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09513121-copyq/ &> /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09513121-copyq/build-09513121.rsync.log [2025-09-01 17:16:04,318][ INFO][PID:1004471] rsyncing finished. [2025-09-01 17:16:04,318][ INFO][PID:1004471] Releasing VM back to pool [2025-09-01 17:16:04,331][ INFO][PID:1004471] Searching for 'success' file in resultdir [2025-09-01 17:16:04,332][ ERROR][PID:1004471] Build failed: Backend process error: No success file => build failure [2025-09-01 17:16:04,332][ INFO][PID:1004471] Finished build: id=9513121 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/openblas-0.3.23 chroot=fedora-42-ppc64le [2025-09-01 17:16:04,334][ ERROR][PID:1004471] Backend process error: No success file => build failure [2025-09-01 17:16:04,335][ INFO][PID:1004471] Worker failed build, took 9.909808874130249 [2025-09-01 17:16:04,335][ INFO][PID:1004471] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "openblas-0.3.23", "project_dirname": "openblas-0.3.23", "submitter": "https://src.fedoraproject.org/user/gbcox", "ended_on": 1756746964.3350835, "started_on": 1756746954.4252746, "submitted_on": null, "status": 0, "chroot": "fedora-42-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9513121-fedora-42-ppc64le", "build_id": 9513121, "package_name": "copyq", "package_version": "11.0.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/copyq", "git_hash": "2964cb184fc624f438f4f3b4223a795595e8f942", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/gbcox", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23", "result_dir": "09513121-copyq", "built_packages": "", "id": 9513121, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "openblas-0.3.23", "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)" } } ] } [2025-09-01 17:16:04,375][ INFO][PID:1004471] Sending fedora-messaging bus message in build.end [2025-09-01 17:16:04,403][ INFO][PID:1004471] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09513121-copyq/builder-live.log by gzip [2025-09-01 17:16:04,405][ INFO][PID:1004471] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09513121-copyq/builder-live.log' as PID 1267764 [2025-09-01 17:16:04,407][ INFO][PID:1004471] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09513121-copyq/builder-live.log) [2025-09-01 17:16:04,408][ INFO][PID:1004471] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09513121-copyq/backend.log by gzip [2025-09-01 17:16:04,410][ INFO][PID:1004471] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09513121-copyq/backend.log' as PID 1267765