[2025-09-01 09:13:45,770][ INFO][PID:2488284] Marking build as starting [2025-09-01 09:13:45,958][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:13:45,959][ INFO][PID:2488284] VM allocation process starts [2025-09-01 09:13:46,015][ INFO][PID:2488284] Trying to allocate VM: ResallocHost, ticket_id=4855051, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-09-01 09:13:51,018][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:13:56,021][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:14:01,026][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:14:06,028][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:14:11,032][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:14:16,038][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:14:21,040][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:14:24,365][ INFO][PID:2488284] Allocated host ResallocHost, ticket_id=4855051, hostname=2620:52:3:1:dead:beef:cafe:c20c, name=copr_hv_ppc64le_01_prod_06522948_20250901_084841, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-09-01 09:14:24,367][ INFO][PID:2488284] Allocating ssh connection to builder [2025-09-01 09:14:24,370][ INFO][PID:2488284] Checking that builder machine is OK [2025-09-01 09:14:26,268][ INFO][PID:2488284] Running remote command: copr-builder-ready fedora-rawhide-ppc64le [2025-09-01 09:14:27,010][ INFO][PID:2488284] Red Hat subscription not needed for fedora-rawhide-ppc64le Builder is ready to be used [2025-09-01 09:14:27,011][ INFO][PID:2488284] Filling build.info file with builder info [2025-09-01 09:14:27,012][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:14:27,019][ INFO][PID:2488284] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "scipy-1.8.3", "project_dirname": "scipy-1.8.3:pr:fork-lecris-rpms-arbor-10", "submitter": "https://src.fedoraproject.org/user/lecris", "ended_on": null, "started_on": 1756718067.0188437, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9511737-fedora-rawhide-ppc64le", "build_id": 9511737, "package_name": "arbor", "package_version": "0.9.0-15", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/scipy-1.8.3:pr:fork-lecris-rpms-arbor-10/arbor", "git_hash": "3a873eafc4d273c4cee626c44a2e7b4f01952da2", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/scipy-1.8.3--https://src.fedoraproject.org/user/lecris", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/scipy-1.8.3/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/scipy-1.8.3:pr:fork-lecris-rpms-arbor-10/fedora-rawhide-ppc64le/", "id": "copr_coprdir", "name": "Coprdir repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/scipy-1.8.3:pr:fork-lecris-rpms-arbor-10", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/scipy-1.8.3:pr:fork-lecris-rpms-arbor-10", "result_dir": "09511737-arbor", "built_packages": "", "id": 9511737, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "scipy-1.8.3", "vendor": "Fedora Project COPR (psimovec/scipy-1.8.3)" } } ] } [2025-09-01 09:14:27,079][ INFO][PID:2488284] Sending fedora-messaging bus message in build.start [2025-09-01 09:14:28,283][ INFO][PID:2488284] Sending fedora-messaging bus message in chroot.start [2025-09-01 09:14:28,320][ INFO][PID:2488284] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9511737-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached [2025-09-01 09:14:29,477][ INFO][PID:2488284] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c20c' (ED25519) to the list of known hosts. [2025-09-01 09:14:29,478][ INFO][PID:2488284] Downloading the builder-live.log file, attempt 1 [2025-09-01 09:14:29,481][ INFO][PID:2488284] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c20c copr-rpmbuild-log [2025-09-01 09:14:34,495][ INFO][PID:2488284] Periodic builder liveness probe: alive [2025-09-01 09:14:34,497][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:14:39,499][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:14:44,503][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:14:49,504][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:14:54,506][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:14:59,509][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:15:04,512][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:15:09,513][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:15:14,519][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:15:19,522][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:15:24,523][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:15:29,524][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:15:34,525][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:15:39,526][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:15:44,528][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:15:49,533][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:15:54,538][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:15:59,541][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:16:04,543][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:16:09,544][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:16:14,545][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:16:19,546][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:16:24,548][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:16:29,550][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:16:34,551][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:16:39,555][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:16:44,562][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:16:49,565][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:16:54,568][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:16:59,569][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:17:04,574][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:17:09,575][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:17:14,579][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:17:19,580][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:17:24,582][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:17:29,583][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:17:34,585][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:17:39,586][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:17:44,590][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:17:49,592][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:17:54,594][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:17:59,595][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:18:04,596][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:18:09,598][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:18:14,599][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:18:19,600][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:18:24,601][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:18:29,602][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:18:34,603][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:18:39,605][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:18:44,606][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:18:49,607][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:18:54,608][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:18:59,609][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:19:04,610][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:19:09,612][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:19:14,613][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:19:19,614][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:19:24,615][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:19:29,616][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:19:34,617][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:19:39,619][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:19:44,626][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:19:49,627][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:19:54,630][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:19:59,633][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:20:04,634][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:20:09,635][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:20:14,637][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:20:19,638][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:20:24,641][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:20:29,645][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:20:34,647][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:20:39,648][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:20:44,650][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:20:49,655][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:20:54,660][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:20:59,662][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:21:04,668][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:21:09,669][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:21:14,672][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:21:19,684][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:21:24,686][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:21:29,689][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:21:34,695][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:21:39,697][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:21:44,700][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:21:49,705][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:21:54,706][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:21:59,707][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:22:04,708][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:22:09,710][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:22:14,711][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:22:19,712][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:22:24,716][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:22:29,719][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:22:34,721][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:22:39,723][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:22:44,724][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:22:49,725][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:22:54,726][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:22:59,728][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:23:04,732][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:23:09,733][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:23:14,736][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:23:19,737][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:23:24,739][ INFO][PID:2488284] Checking for cancel request [2025-09-01 09:23:28,574][ INFO][PID:2488284] Downloading results from builder [2025-09-01 09:23:28,577][ INFO][PID:2488284] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c20c]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/scipy-1.8.3:pr:fork-lecris-rpms-arbor-10/fedora-rawhide-ppc64le/09511737-arbor started [2025-09-01 09:23:28,579][ INFO][PID:2488284] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c20c]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/scipy-1.8.3:pr:fork-lecris-rpms-arbor-10/fedora-rawhide-ppc64le/09511737-arbor/ &> /var/lib/copr/public_html/results/psimovec/scipy-1.8.3:pr:fork-lecris-rpms-arbor-10/fedora-rawhide-ppc64le/09511737-arbor/build-09511737.rsync.log [2025-09-01 09:23:29,620][ INFO][PID:2488284] rsyncing finished. [2025-09-01 09:23:29,620][ INFO][PID:2488284] Releasing VM back to pool [2025-09-01 09:23:29,669][ INFO][PID:2488284] Searching for 'success' file in resultdir [2025-09-01 09:23:29,670][ ERROR][PID:2488284] Build failed: Backend process error: No success file => build failure [2025-09-01 09:23:29,676][ INFO][PID:2488284] Finished build: id=9511737 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/scipy-1.8.3:pr:fork-lecris-rpms-arbor-10 chroot=fedora-rawhide-ppc64le [2025-09-01 09:23:29,679][ ERROR][PID:2488284] Backend process error: No success file => build failure [2025-09-01 09:23:29,681][ INFO][PID:2488284] Worker failed build, took 542.6622905731201 [2025-09-01 09:23:29,682][ INFO][PID:2488284] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "scipy-1.8.3", "project_dirname": "scipy-1.8.3:pr:fork-lecris-rpms-arbor-10", "submitter": "https://src.fedoraproject.org/user/lecris", "ended_on": 1756718609.6811342, "started_on": 1756718067.0188437, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9511737-fedora-rawhide-ppc64le", "build_id": 9511737, "package_name": "arbor", "package_version": "0.9.0-15", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/scipy-1.8.3:pr:fork-lecris-rpms-arbor-10/arbor", "git_hash": "3a873eafc4d273c4cee626c44a2e7b4f01952da2", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/scipy-1.8.3--https://src.fedoraproject.org/user/lecris", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/scipy-1.8.3/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/scipy-1.8.3:pr:fork-lecris-rpms-arbor-10/fedora-rawhide-ppc64le/", "id": "copr_coprdir", "name": "Coprdir repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/scipy-1.8.3:pr:fork-lecris-rpms-arbor-10", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/scipy-1.8.3:pr:fork-lecris-rpms-arbor-10", "result_dir": "09511737-arbor", "built_packages": "", "id": 9511737, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "scipy-1.8.3", "vendor": "Fedora Project COPR (psimovec/scipy-1.8.3)" } } ] } [2025-09-01 09:23:29,740][ INFO][PID:2488284] Sending fedora-messaging bus message in build.end [2025-09-01 09:23:29,793][ INFO][PID:2488284] Compressing /var/lib/copr/public_html/results/psimovec/scipy-1.8.3:pr:fork-lecris-rpms-arbor-10/fedora-rawhide-ppc64le/09511737-arbor/builder-live.log by gzip [2025-09-01 09:23:29,795][ INFO][PID:2488284] Running command 'gzip /var/lib/copr/public_html/results/psimovec/scipy-1.8.3:pr:fork-lecris-rpms-arbor-10/fedora-rawhide-ppc64le/09511737-arbor/builder-live.log' as PID 2599125 [2025-09-01 09:23:29,826][ INFO][PID:2488284] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/scipy-1.8.3:pr:fork-lecris-rpms-arbor-10/fedora-rawhide-ppc64le/09511737-arbor/builder-live.log) [2025-09-01 09:23:29,827][ INFO][PID:2488284] Compressing /var/lib/copr/public_html/results/psimovec/scipy-1.8.3:pr:fork-lecris-rpms-arbor-10/fedora-rawhide-ppc64le/09511737-arbor/backend.log by gzip [2025-09-01 09:23:29,831][ INFO][PID:2488284] Running command 'gzip /var/lib/copr/public_html/results/psimovec/scipy-1.8.3:pr:fork-lecris-rpms-arbor-10/fedora-rawhide-ppc64le/09511737-arbor/backend.log' as PID 2599134