[2025-09-01 09:13:44,707][ INFO][PID:2488080] Marking build as starting [2025-09-01 09:13:45,506][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:13:45,508][ INFO][PID:2488080] VM allocation process starts [2025-09-01 09:13:45,525][ INFO][PID:2488080] Trying to allocate VM: ResallocHost, ticket_id=4855022, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-09-01 09:13:50,533][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:13:55,534][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:14:00,539][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:14:03,621][ INFO][PID:2488080] Allocated host ResallocHost, ticket_id=4855022, hostname=2620:52:3:1:dead:beef:cafe:c20d, name=copr_hv_ppc64le_01_prod_06522798_20250901_083748, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-09-01 09:14:03,622][ INFO][PID:2488080] Allocating ssh connection to builder [2025-09-01 09:14:03,622][ INFO][PID:2488080] Checking that builder machine is OK [2025-09-01 09:14:05,023][ INFO][PID:2488080] Running remote command: copr-builder-ready fedora-rawhide-ppc64le [2025-09-01 09:14:05,737][ INFO][PID:2488080] Red Hat subscription not needed for fedora-rawhide-ppc64le Builder is ready to be used [2025-09-01 09:14:05,739][ INFO][PID:2488080] Filling build.info file with builder info [2025-09-01 09:14:05,740][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:14:05,745][ INFO][PID:2488080] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "openblas-0.3.23", "project_dirname": "openblas-0.3.23:pr:fork-lecris-rpms-arbor-10", "submitter": "https://src.fedoraproject.org/user/lecris", "ended_on": null, "started_on": 1756718045.7449605, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9511738-fedora-rawhide-ppc64le", "build_id": 9511738, "package_name": "arbor", "package_version": "0.9.0-15", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-arbor-10/arbor", "git_hash": "95bfa5d6e65c9bacd5144f80adf2c384f40a8b13", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/lecris", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-arbor-10/fedora-rawhide-ppc64le/", "id": "copr_coprdir", "name": "Coprdir repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-arbor-10", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-arbor-10", "result_dir": "09511738-arbor", "built_packages": "", "id": 9511738, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "openblas-0.3.23", "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)" } } ] } [2025-09-01 09:14:05,838][ INFO][PID:2488080] Sending fedora-messaging bus message in build.start [2025-09-01 09:14:09,098][ INFO][PID:2488080] Sending fedora-messaging bus message in chroot.start [2025-09-01 09:14:09,169][ INFO][PID:2488080] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9511738-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached [2025-09-01 09:14:10,575][ INFO][PID:2488080] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c20d' (ED25519) to the list of known hosts. [2025-09-01 09:14:10,579][ INFO][PID:2488080] Downloading the builder-live.log file, attempt 1 [2025-09-01 09:14:10,582][ INFO][PID:2488080] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c20d copr-rpmbuild-log [2025-09-01 09:14:15,642][ INFO][PID:2488080] Periodic builder liveness probe: alive [2025-09-01 09:14:15,646][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:14:20,656][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:14:25,659][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:14:30,662][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:14:35,665][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:14:40,667][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:14:45,669][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:14:50,671][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:14:55,678][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:15:00,683][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:15:05,692][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:15:10,697][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:15:15,698][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:15:20,701][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:15:25,702][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:15:30,703][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:15:35,704][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:15:40,706][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:15:45,708][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:15:50,709][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:15:55,710][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:16:00,713][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:16:05,714][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:16:10,719][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:16:15,721][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:16:20,722][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:16:25,723][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:16:30,725][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:16:35,727][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:16:40,732][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:16:45,740][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:16:50,741][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:16:55,743][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:17:00,749][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:17:05,752][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:17:10,755][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:17:15,761][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:17:20,767][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:17:25,769][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:17:30,772][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:17:35,775][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:17:40,780][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:17:45,781][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:17:50,784][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:17:55,785][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:18:00,786][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:18:05,787][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:18:10,788][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:18:15,789][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:18:20,790][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:18:25,792][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:18:30,793][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:18:35,794][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:18:40,795][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:18:45,797][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:18:50,798][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:18:55,799][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:19:00,800][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:19:05,801][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:19:10,802][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:19:15,804][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:19:20,805][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:19:25,807][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:19:30,808][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:19:35,809][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:19:40,811][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:19:45,815][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:19:50,817][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:19:55,821][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:20:00,824][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:20:05,825][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:20:10,828][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:20:15,830][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:20:20,831][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:20:25,834][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:20:30,839][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:20:35,844][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:20:40,846][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:20:45,851][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:20:50,855][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:20:55,860][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:21:00,863][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:21:05,867][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:21:10,869][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:21:15,871][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:21:20,875][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:21:25,877][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:21:30,881][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:21:35,887][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:21:40,891][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:21:45,894][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:21:50,897][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:21:55,899][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:22:00,900][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:22:05,902][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:22:10,903][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:22:15,904][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:22:20,905][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:22:25,908][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:22:30,912][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:22:35,917][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:22:40,918][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:22:45,919][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:22:50,920][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:22:55,922][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:23:00,924][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:23:05,926][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:23:10,927][ INFO][PID:2488080] Checking for cancel request [2025-09-01 09:23:15,178][ INFO][PID:2488080] Downloading results from builder [2025-09-01 09:23:15,179][ INFO][PID:2488080] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c20d]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-arbor-10/fedora-rawhide-ppc64le/09511738-arbor started [2025-09-01 09:23:15,179][ INFO][PID:2488080] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c20d]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-arbor-10/fedora-rawhide-ppc64le/09511738-arbor/ &> /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-arbor-10/fedora-rawhide-ppc64le/09511738-arbor/build-09511738.rsync.log [2025-09-01 09:23:16,359][ INFO][PID:2488080] rsyncing finished. [2025-09-01 09:23:16,360][ INFO][PID:2488080] Releasing VM back to pool [2025-09-01 09:23:16,372][ INFO][PID:2488080] Searching for 'success' file in resultdir [2025-09-01 09:23:16,373][ ERROR][PID:2488080] Build failed: Backend process error: No success file => build failure [2025-09-01 09:23:16,374][ INFO][PID:2488080] Finished build: id=9511738 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-arbor-10 chroot=fedora-rawhide-ppc64le [2025-09-01 09:23:16,376][ ERROR][PID:2488080] Backend process error: No success file => build failure [2025-09-01 09:23:16,377][ INFO][PID:2488080] Worker failed build, took 550.6321275234222 [2025-09-01 09:23:16,377][ INFO][PID:2488080] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "openblas-0.3.23", "project_dirname": "openblas-0.3.23:pr:fork-lecris-rpms-arbor-10", "submitter": "https://src.fedoraproject.org/user/lecris", "ended_on": 1756718596.377088, "started_on": 1756718045.7449605, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9511738-fedora-rawhide-ppc64le", "build_id": 9511738, "package_name": "arbor", "package_version": "0.9.0-15", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-arbor-10/arbor", "git_hash": "95bfa5d6e65c9bacd5144f80adf2c384f40a8b13", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/lecris", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-arbor-10/fedora-rawhide-ppc64le/", "id": "copr_coprdir", "name": "Coprdir repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-arbor-10", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-arbor-10", "result_dir": "09511738-arbor", "built_packages": "", "id": 9511738, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "openblas-0.3.23", "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)" } } ] } [2025-09-01 09:23:16,421][ INFO][PID:2488080] Sending fedora-messaging bus message in build.end [2025-09-01 09:23:16,448][ INFO][PID:2488080] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-arbor-10/fedora-rawhide-ppc64le/09511738-arbor/builder-live.log by gzip [2025-09-01 09:23:16,449][ INFO][PID:2488080] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-arbor-10/fedora-rawhide-ppc64le/09511738-arbor/builder-live.log' as PID 2597009 [2025-09-01 09:23:16,463][ INFO][PID:2488080] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-arbor-10/fedora-rawhide-ppc64le/09511738-arbor/builder-live.log) [2025-09-01 09:23:16,464][ INFO][PID:2488080] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-arbor-10/fedora-rawhide-ppc64le/09511738-arbor/backend.log by gzip [2025-09-01 09:23:16,465][ INFO][PID:2488080] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-arbor-10/fedora-rawhide-ppc64le/09511738-arbor/backend.log' as PID 2597012