[2025-10-03 16:25:28,518][ INFO][PID:3117305] Marking build as starting [2025-10-03 16:25:28,565][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:25:28,566][ INFO][PID:3117305] VM allocation process starts [2025-10-03 16:25:28,591][ INFO][PID:3117305] Trying to allocate VM: ResallocHost, ticket_id=5465744, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-10-03 16:25:33,593][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:25:38,593][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:25:43,594][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:25:48,595][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:25:53,596][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:25:58,597][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:26:03,598][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:26:08,599][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:26:13,600][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:26:18,601][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:26:23,602][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:26:28,607][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:26:33,608][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:26:38,609][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:26:43,610][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:26:48,611][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:26:53,612][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:26:58,613][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:27:03,614][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:27:08,615][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:27:13,616][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:27:18,617][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:27:23,618][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:27:28,619][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:27:33,621][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:27:38,621][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:27:43,623][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:27:48,624][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:27:53,625][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:27:58,628][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:28:03,629][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:28:08,630][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:28:13,631][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:28:18,631][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:28:23,632][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:28:28,633][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:28:33,634][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:28:38,635][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:28:43,636][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:28:48,637][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:28:53,638][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:28:58,639][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:29:03,640][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:29:08,641][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:29:13,641][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:29:18,642][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:29:23,643][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:29:28,644][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:29:33,645][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:29:38,646][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:29:43,647][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:29:48,648][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:29:53,649][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:29:58,651][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:30:03,653][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:30:08,655][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:30:13,656][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:30:18,658][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:30:23,659][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:30:28,660][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:30:33,661][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:30:38,662][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:30:43,663][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:30:48,664][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:30:53,665][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:30:58,666][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:31:03,667][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:31:08,668][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:31:13,669][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:31:18,670][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:31:23,671][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:31:28,672][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:31:33,674][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:31:38,675][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:31:43,677][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:31:48,678][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:31:53,679][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:31:58,680][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:32:03,681][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:32:08,682][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:32:13,683][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:32:18,684][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:32:23,685][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:32:28,686][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:32:33,687][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:32:38,688][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:32:43,689][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:32:48,690][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:32:53,691][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:32:58,692][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:33:03,693][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:33:08,694][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:33:13,695][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:33:18,696][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:33:23,697][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:33:28,698][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:33:33,699][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:33:38,699][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:33:43,700][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:33:48,701][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:33:53,702][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:33:58,703][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:34:03,704][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:34:08,705][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:34:13,706][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:34:18,707][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:34:23,708][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:34:28,709][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:34:33,710][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:34:38,711][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:34:43,712][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:34:46,831][ INFO][PID:3117305] Allocated host ResallocHost, ticket_id=5465744, hostname=2620:52:3:1:dead:beef:cafe:c250, name=copr_hv_ppc64le_02_prod_07210517_20251003_163134, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-10-03 16:34:46,831][ INFO][PID:3117305] Allocating ssh connection to builder [2025-10-03 16:34:46,832][ INFO][PID:3117305] Checking that builder machine is OK [2025-10-03 16:34:48,777][ INFO][PID:3117305] Running remote command: copr-builder-ready fedora-41-ppc64le [2025-10-03 16:34:49,997][ INFO][PID:3117305] Red Hat subscription not needed for fedora-41-ppc64le Builder is ready to be used [2025-10-03 16:34:49,997][ INFO][PID:3117305] Filling build.info file with builder info [2025-10-03 16:34:49,998][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:34:49,999][ INFO][PID:3117305] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "openblas-0.3.23", "project_dirname": "openblas-0.3.23", "submitter": "https://src.fedoraproject.org/user/farchord", "ended_on": null, "started_on": 1759509289.99894, "submitted_on": null, "status": 3, "chroot": "fedora-41-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9643070-fedora-41-ppc64le", "build_id": 9643070, "package_name": "kwin", "package_version": "6.4.91-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/kwin", "git_hash": "12e7d1d6c1537a7f1de173e27f26718537d4b146", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/farchord", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23", "result_dir": "09643070-kwin", "built_packages": "", "id": 9643070, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "openblas-0.3.23", "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)" } } ] } [2025-10-03 16:34:50,046][ INFO][PID:3117305] Sending fedora-messaging bus message in build.start [2025-10-03 16:34:50,642][ INFO][PID:3117305] Sending fedora-messaging bus message in chroot.start [2025-10-03 16:34:50,664][ INFO][PID:3117305] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9643070-fedora-41-ppc64le --chroot fedora-41-ppc64le --detached [2025-10-03 16:34:53,226][ INFO][PID:3117305] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c250' (ED25519) to the list of known hosts. [2025-10-03 16:34:53,227][ INFO][PID:3117305] Downloading the builder-live.log file, attempt 1 [2025-10-03 16:34:53,228][ INFO][PID:3117305] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c250 copr-rpmbuild-log [2025-10-03 16:34:58,235][ INFO][PID:3117305] Periodic builder liveness probe: alive [2025-10-03 16:34:58,236][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:35:03,236][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:35:08,237][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:35:13,238][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:35:18,239][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:35:23,240][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:35:28,241][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:35:33,242][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:35:38,243][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:35:43,243][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:35:48,244][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:35:53,245][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:35:58,246][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:36:03,247][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:36:08,248][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:36:13,249][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:36:18,250][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:36:23,251][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:36:28,252][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:36:33,253][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:36:38,254][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:36:43,255][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:36:48,256][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:36:53,257][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:36:58,258][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:37:03,260][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:37:08,260][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:37:13,261][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:37:18,262][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:37:23,263][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:37:28,264][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:37:33,265][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:37:38,266][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:37:43,267][ INFO][PID:3117305] Checking for cancel request [2025-10-03 16:37:44,597][ INFO][PID:3117305] Downloading results from builder [2025-10-03 16:37:44,598][ INFO][PID:3117305] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c250]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09643070-kwin started [2025-10-03 16:37:44,599][ INFO][PID:3117305] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c250]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09643070-kwin/ &> /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09643070-kwin/build-09643070.rsync.log [2025-10-03 16:37:45,629][ INFO][PID:3117305] rsyncing finished. [2025-10-03 16:37:45,629][ INFO][PID:3117305] Releasing VM back to pool [2025-10-03 16:37:45,655][ INFO][PID:3117305] Searching for 'success' file in resultdir [2025-10-03 16:37:45,656][ ERROR][PID:3117305] Build failed: Backend process error: No success file => build failure [2025-10-03 16:37:45,656][ INFO][PID:3117305] Finished build: id=9643070 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/openblas-0.3.23 chroot=fedora-41-ppc64le [2025-10-03 16:37:45,658][ ERROR][PID:3117305] Backend process error: No success file => build failure [2025-10-03 16:37:45,658][ INFO][PID:3117305] Worker failed build, took 175.6597330570221 [2025-10-03 16:37:45,659][ INFO][PID:3117305] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "openblas-0.3.23", "project_dirname": "openblas-0.3.23", "submitter": "https://src.fedoraproject.org/user/farchord", "ended_on": 1759509465.658673, "started_on": 1759509289.99894, "submitted_on": null, "status": 0, "chroot": "fedora-41-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9643070-fedora-41-ppc64le", "build_id": 9643070, "package_name": "kwin", "package_version": "6.4.91-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/kwin", "git_hash": "12e7d1d6c1537a7f1de173e27f26718537d4b146", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/farchord", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23", "result_dir": "09643070-kwin", "built_packages": "", "id": 9643070, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "openblas-0.3.23", "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)" } } ] } [2025-10-03 16:37:45,700][ INFO][PID:3117305] Sending fedora-messaging bus message in build.end [2025-10-03 16:37:45,723][ INFO][PID:3117305] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09643070-kwin/builder-live.log by gzip [2025-10-03 16:37:45,724][ INFO][PID:3117305] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09643070-kwin/builder-live.log' as PID 3174373 [2025-10-03 16:37:45,728][ INFO][PID:3117305] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09643070-kwin/builder-live.log) [2025-10-03 16:37:45,729][ INFO][PID:3117305] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09643070-kwin/backend.log by gzip [2025-10-03 16:37:45,730][ INFO][PID:3117305] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09643070-kwin/backend.log' as PID 3174374