[2025-09-23 06:00:02,816][ INFO][PID:2341177] Marking build as starting [2025-09-23 06:00:02,871][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:00:02,872][ INFO][PID:2341177] VM allocation process starts [2025-09-23 06:00:02,975][ INFO][PID:2341177] Trying to allocate VM: ResallocHost, ticket_id=5221652, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-09-23 06:00:05,998][ INFO][PID:2341177] Allocated host ResallocHost, ticket_id=5221652, hostname=2620:52:3:1:dead:beef:cafe:c20c, name=copr_hv_ppc64le_01_prod_06887149_20250923_055247, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-09-23 06:00:05,999][ INFO][PID:2341177] Allocating ssh connection to builder [2025-09-23 06:00:05,999][ INFO][PID:2341177] Checking that builder machine is OK [2025-09-23 06:00:09,123][ INFO][PID:2341177] Running remote command: copr-builder-ready fedora-41-ppc64le [2025-09-23 06:00:10,112][ INFO][PID:2341177] Red Hat subscription not needed for fedora-41-ppc64le Builder is ready to be used [2025-09-23 06:00:10,113][ INFO][PID:2341177] Filling build.info file with builder info [2025-09-23 06:00:10,114][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:00:10,115][ INFO][PID:2341177] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "openblas-0.3.23", "project_dirname": "openblas-0.3.23", "submitter": "https://src.fedoraproject.org/user/farchord", "ended_on": null, "started_on": 1758607210.1149125, "submitted_on": null, "status": 3, "chroot": "fedora-41-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9591572-fedora-41-ppc64le", "build_id": 9591572, "package_name": "mbox-importer", "package_version": "25.08.1-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/mbox-importer", "git_hash": "e7c377973b9569b14f46486f5f699157e5ad807e", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/farchord", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23", "result_dir": "09591572-mbox-importer", "built_packages": "", "id": 9591572, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "openblas-0.3.23", "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)" } } ] } [2025-09-23 06:00:10,161][ INFO][PID:2341177] Sending fedora-messaging bus message in build.start [2025-09-23 06:00:11,057][ INFO][PID:2341177] Sending fedora-messaging bus message in chroot.start [2025-09-23 06:00:11,100][ INFO][PID:2341177] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9591572-fedora-41-ppc64le --chroot fedora-41-ppc64le --detached [2025-09-23 06:00:12,553][ INFO][PID:2341177] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c20c' (ED25519) to the list of known hosts. [2025-09-23 06:00:12,554][ INFO][PID:2341177] Downloading the builder-live.log file, attempt 1 [2025-09-23 06:00:12,555][ INFO][PID:2341177] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c20c copr-rpmbuild-log [2025-09-23 06:00:17,564][ INFO][PID:2341177] Periodic builder liveness probe: alive [2025-09-23 06:00:17,565][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:00:22,566][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:00:27,568][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:00:32,569][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:00:37,570][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:00:42,571][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:00:47,573][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:00:52,575][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:00:57,580][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:01:02,581][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:01:07,582][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:01:12,584][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:01:17,585][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:01:22,588][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:01:27,589][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:01:32,590][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:01:37,591][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:01:42,592][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:01:47,593][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:01:52,596][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:01:57,597][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:02:02,598][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:02:07,600][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:02:12,601][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:02:17,603][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:02:22,604][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:02:27,605][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:02:32,606][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:02:37,607][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:02:42,608][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:02:47,609][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:02:52,610][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:02:57,611][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:03:02,612][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:03:07,614][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:03:12,615][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:03:17,618][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:03:22,620][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:03:27,621][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:03:32,623][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:03:37,624][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:03:42,625][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:03:47,626][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:03:52,628][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:03:57,629][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:04:02,630][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:04:07,631][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:04:12,633][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:04:17,633][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:04:22,634][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:04:27,638][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:04:32,640][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:04:37,641][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:04:42,644][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:04:47,645][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:04:52,646][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:04:57,647][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:05:02,649][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:05:07,650][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:05:12,651][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:05:17,652][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:05:22,653][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:05:27,654][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:05:32,655][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:05:37,656][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:05:42,657][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:05:47,658][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:05:52,659][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:05:57,660][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:06:02,661][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:06:07,662][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:06:12,664][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:06:17,665][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:06:22,666][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:06:27,667][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:06:32,668][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:06:37,669][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:06:42,671][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:06:47,673][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:06:52,674][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:06:57,675][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:07:02,677][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:07:07,680][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:07:12,682][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:07:17,684][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:07:22,688][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:07:27,689][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:07:32,690][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:07:37,692][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:07:42,693][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:07:47,695][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:07:52,697][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:07:57,699][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:08:02,702][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:08:07,708][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:08:12,710][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:08:17,711][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:08:22,714][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:08:27,716][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:08:32,719][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:08:37,728][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:08:42,729][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:08:47,731][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:08:52,733][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:08:57,735][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:09:02,741][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:09:07,746][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:09:12,747][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:09:17,749][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:09:22,752][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:09:27,754][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:09:32,755][ INFO][PID:2341177] Checking for cancel request [2025-09-23 06:09:37,698][ INFO][PID:2341177] Downloading results from builder [2025-09-23 06:09:37,699][ INFO][PID:2341177] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c20c]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09591572-mbox-importer started [2025-09-23 06:09:37,703][ INFO][PID:2341177] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c20c]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09591572-mbox-importer/ &> /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09591572-mbox-importer/build-09591572.rsync.log [2025-09-23 06:09:40,410][ INFO][PID:2341177] rsyncing finished. [2025-09-23 06:09:40,413][ INFO][PID:2341177] Releasing VM back to pool [2025-09-23 06:09:40,433][ INFO][PID:2341177] Searching for 'success' file in resultdir [2025-09-23 06:09:40,434][ ERROR][PID:2341177] Build failed: Backend process error: No success file => build failure [2025-09-23 06:09:40,436][ INFO][PID:2341177] Finished build: id=9591572 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/openblas-0.3.23 chroot=fedora-41-ppc64le [2025-09-23 06:09:40,439][ ERROR][PID:2341177] Backend process error: No success file => build failure [2025-09-23 06:09:40,441][ INFO][PID:2341177] Worker failed build, took 570.3262028694153 [2025-09-23 06:09:40,443][ INFO][PID:2341177] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "openblas-0.3.23", "project_dirname": "openblas-0.3.23", "submitter": "https://src.fedoraproject.org/user/farchord", "ended_on": 1758607780.4411154, "started_on": 1758607210.1149125, "submitted_on": null, "status": 0, "chroot": "fedora-41-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9591572-fedora-41-ppc64le", "build_id": 9591572, "package_name": "mbox-importer", "package_version": "25.08.1-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/mbox-importer", "git_hash": "e7c377973b9569b14f46486f5f699157e5ad807e", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/farchord", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23", "result_dir": "09591572-mbox-importer", "built_packages": "", "id": 9591572, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "openblas-0.3.23", "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)" } } ] } [2025-09-23 06:09:40,494][ INFO][PID:2341177] Sending fedora-messaging bus message in build.end [2025-09-23 06:09:40,541][ INFO][PID:2341177] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09591572-mbox-importer/builder-live.log by gzip [2025-09-23 06:09:40,543][ INFO][PID:2341177] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09591572-mbox-importer/builder-live.log' as PID 2419261 [2025-09-23 06:09:40,569][ INFO][PID:2341177] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09591572-mbox-importer/builder-live.log) [2025-09-23 06:09:40,570][ INFO][PID:2341177] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09591572-mbox-importer/backend.log by gzip [2025-09-23 06:09:40,575][ INFO][PID:2341177] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09591572-mbox-importer/backend.log' as PID 2419264