[2025-09-23 04:59:48,840][ INFO][PID:2082335] Marking build as starting [2025-09-23 04:59:48,899][ INFO][PID:2082335] Checking for cancel request [2025-09-23 04:59:48,900][ INFO][PID:2082335] VM allocation process starts [2025-09-23 04:59:48,947][ INFO][PID:2082335] Trying to allocate VM: ResallocHost, ticket_id=5221176, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-09-23 04:59:51,962][ INFO][PID:2082335] Allocated host ResallocHost, ticket_id=5221176, hostname=2620:52:3:1:dead:beef:cafe:c28c, name=copr_p09_01_prod_06886539_20250923_042425, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-09-23 04:59:51,963][ INFO][PID:2082335] Allocating ssh connection to builder [2025-09-23 04:59:51,963][ INFO][PID:2082335] Checking that builder machine is OK [2025-09-23 04:59:52,401][ INFO][PID:2082335] Running remote command: copr-builder-ready fedora-41-ppc64le [2025-09-23 04:59:52,944][ INFO][PID:2082335] Red Hat subscription not needed for fedora-41-ppc64le Builder is ready to be used [2025-09-23 04:59:52,944][ INFO][PID:2082335] Filling build.info file with builder info [2025-09-23 04:59:52,945][ INFO][PID:2082335] Checking for cancel request [2025-09-23 04:59:52,946][ INFO][PID:2082335] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "openblas-0.3.23", "project_dirname": "openblas-0.3.23", "submitter": "https://src.fedoraproject.org/user/farchord", "ended_on": null, "started_on": 1758603592.9459133, "submitted_on": null, "status": 3, "chroot": "fedora-41-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9591522-fedora-41-ppc64le", "build_id": 9591522, "package_name": "knights", "package_version": "25.08.1-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/knights", "git_hash": "778903293a0d837b5264b20e24aeb8194c97af79", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/farchord", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23", "result_dir": "09591522-knights", "built_packages": "", "id": 9591522, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "openblas-0.3.23", "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)" } } ] } [2025-09-23 04:59:56,096][ INFO][PID:2082335] Sending fedora-messaging bus message in build.start [2025-09-23 04:59:56,923][ INFO][PID:2082335] Sending fedora-messaging bus message in chroot.start [2025-09-23 04:59:56,966][ INFO][PID:2082335] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9591522-fedora-41-ppc64le --chroot fedora-41-ppc64le --detached [2025-09-23 04:59:57,966][ INFO][PID:2082335] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c28c' (ED25519) to the list of known hosts. [2025-09-23 04:59:57,967][ INFO][PID:2082335] Downloading the builder-live.log file, attempt 1 [2025-09-23 04:59:57,969][ INFO][PID:2082335] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c28c copr-rpmbuild-log [2025-09-23 05:00:02,973][ INFO][PID:2082335] Periodic builder liveness probe: alive [2025-09-23 05:00:02,974][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:00:07,975][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:00:12,976][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:00:17,977][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:00:22,978][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:00:27,979][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:00:32,980][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:00:37,981][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:00:42,982][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:00:47,983][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:00:52,984][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:00:57,985][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:01:02,986][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:01:07,987][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:01:12,988][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:01:17,989][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:01:22,990][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:01:27,991][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:01:32,992][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:01:37,993][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:01:42,994][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:01:47,995][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:01:52,997][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:01:57,998][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:02:02,999][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:02:08,000][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:02:13,001][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:02:18,002][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:02:23,004][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:02:28,005][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:02:33,006][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:02:38,007][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:02:43,008][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:02:48,009][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:02:53,010][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:02:58,011][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:03:03,012][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:03:08,013][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:03:13,014][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:03:18,015][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:03:23,016][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:03:28,017][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:03:33,019][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:03:38,020][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:03:43,020][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:03:48,021][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:03:53,023][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:03:58,024][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:04:03,025][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:04:08,026][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:04:13,027][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:04:18,028][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:04:23,029][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:04:28,031][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:04:33,032][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:04:38,033][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:04:43,034][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:04:48,035][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:04:53,037][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:04:58,037][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:05:03,038][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:05:08,039][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:05:13,040][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:05:18,041][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:05:23,042][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:05:28,043][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:05:33,044][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:05:38,045][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:05:43,046][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:05:48,047][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:05:53,104][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:05:58,105][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:06:03,106][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:06:08,107][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:06:13,108][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:06:18,109][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:06:23,110][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:06:28,111][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:06:33,112][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:06:38,113][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:06:43,114][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:06:48,116][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:06:53,117][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:06:58,117][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:07:03,121][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:07:08,121][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:07:13,198][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:07:18,199][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:07:23,200][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:07:28,201][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:07:33,261][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:07:38,262][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:07:43,263][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:07:48,264][ INFO][PID:2082335] Checking for cancel request [2025-09-23 05:07:48,736][ INFO][PID:2082335] Downloading results from builder [2025-09-23 05:07:48,737][ INFO][PID:2082335] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c28c]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09591522-knights started [2025-09-23 05:07:48,737][ INFO][PID:2082335] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c28c]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09591522-knights/ &> /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09591522-knights/build-09591522.rsync.log [2025-09-23 05:07:49,756][ INFO][PID:2082335] rsyncing finished. [2025-09-23 05:07:49,757][ INFO][PID:2082335] Releasing VM back to pool [2025-09-23 05:07:49,768][ INFO][PID:2082335] Searching for 'success' file in resultdir [2025-09-23 05:07:49,769][ INFO][PID:2082335] Going to sign pkgs from source: 9591522-fedora-41-ppc64le in chroot: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le [2025-09-23 05:07:49,770][ INFO][PID:2082335] Calling '/bin/sign -u psimovec#openblas-0.3.23@copr.fedorahosted.org -p' (attempt #1) [2025-09-23 05:07:50,107][ INFO][PID:2082335] Calling '/bin/sign -4 -h sha256 -u psimovec#openblas-0.3.23@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09591522-knights/knights-25.08.1-1.fc44.ppc64le.rpm' (attempt #1) [2025-09-23 05:07:51,258][ INFO][PID:2082335] signed rpm: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09591522-knights/knights-25.08.1-1.fc44.ppc64le.rpm [2025-09-23 05:07:51,259][ INFO][PID:2082335] Calling '/bin/sign -4 -h sha256 -u psimovec#openblas-0.3.23@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09591522-knights/knights-25.08.1-1.fc44.src.rpm' (attempt #1) [2025-09-23 05:07:52,260][ INFO][PID:2082335] signed rpm: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09591522-knights/knights-25.08.1-1.fc44.src.rpm [2025-09-23 05:07:52,261][ INFO][PID:2082335] Calling '/bin/sign -4 -h sha256 -u psimovec#openblas-0.3.23@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09591522-knights/knights-debuginfo-25.08.1-1.fc44.ppc64le.rpm' (attempt #1) [2025-09-23 05:07:53,655][ INFO][PID:2082335] signed rpm: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09591522-knights/knights-debuginfo-25.08.1-1.fc44.ppc64le.rpm [2025-09-23 05:07:53,655][ INFO][PID:2082335] Calling '/bin/sign -4 -h sha256 -u psimovec#openblas-0.3.23@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09591522-knights/knights-debugsource-25.08.1-1.fc44.ppc64le.rpm' (attempt #1) [2025-09-23 05:07:54,596][ INFO][PID:2082335] signed rpm: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09591522-knights/knights-debugsource-25.08.1-1.fc44.ppc64le.rpm [2025-09-23 05:07:54,597][ INFO][PID:2082335] Sign done [2025-09-23 05:07:54,598][ INFO][PID:2082335] Incremental createrepo run, adding 09591522-knights into https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-41-ppc64le, (auto-create-repo=True) [2025-09-23 05:07:54,598][ INFO][PID:2082335] Running command 'copr-repo --batched /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le --add 09591522-knights --no-appstream-metadata' as PID 2110426 [2025-09-23 05:08:04,410][ INFO][PID:2082335] Finished after 9 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le --add 09591522-knights --no-appstream-metadata) [2025-09-23 05:08:04,411][ INFO][PID:2082335] Getting build details [2025-09-23 05:08:04,411][ INFO][PID:2082335] Listing built binary packages in /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09591522-knights [2025-09-23 05:08:04,412][ INFO][PID:2082335] Built packages: ['knights 25.08.1', 'knights-debuginfo 25.08.1', 'knights-debugsource 25.08.1'] [2025-09-23 05:08:04,412][ INFO][PID:2082335] build details: {'built_packages': 'knights 25.08.1\nknights-debuginfo 25.08.1\nknights-debugsource 25.08.1'} [2025-09-23 05:08:04,412][ INFO][PID:2082335] Retrieving pubkey [2025-09-23 05:08:04,413][ INFO][PID:2082335] Calling '/bin/sign -u psimovec#openblas-0.3.23@copr.fedorahosted.org -p' (attempt #1) [2025-09-23 05:08:04,589][ INFO][PID:2082335] Added pubkey for user psimovec project openblas-0.3.23 into: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/pubkey.gpg [2025-09-23 05:08:04,590][ INFO][PID:2082335] Finished build: id=9591522 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/openblas-0.3.23 chroot=fedora-41-ppc64le [2025-09-23 05:08:04,591][ INFO][PID:2082335] Worker succeeded build, took 491.64578223228455 [2025-09-23 05:08:04,592][ INFO][PID:2082335] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "openblas-0.3.23", "project_dirname": "openblas-0.3.23", "submitter": "https://src.fedoraproject.org/user/farchord", "ended_on": 1758604084.5916955, "started_on": 1758603592.9459133, "submitted_on": null, "status": 1, "chroot": "fedora-41-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9591522-fedora-41-ppc64le", "build_id": 9591522, "package_name": "knights", "package_version": "25.08.1-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/knights", "git_hash": "778903293a0d837b5264b20e24aeb8194c97af79", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/farchord", "results": { "packages": [ { "name": "knights", "epoch": null, "version": "25.08.1", "release": "1.fc44", "arch": "ppc64le" }, { "name": "knights-debuginfo", "epoch": null, "version": "25.08.1", "release": "1.fc44", "arch": "ppc64le" }, { "name": "knights", "epoch": null, "version": "25.08.1", "release": "1.fc44", "arch": "src" }, { "name": "knights-debugsource", "epoch": null, "version": "25.08.1", "release": "1.fc44", "arch": "ppc64le" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23", "result_dir": "09591522-knights", "built_packages": "knights 25.08.1\nknights-debuginfo 25.08.1\nknights-debugsource 25.08.1", "id": 9591522, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "openblas-0.3.23", "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)" } } ] } [2025-09-23 05:08:04,698][ INFO][PID:2082335] Sending fedora-messaging bus message in build.end [2025-09-23 05:08:04,741][ INFO][PID:2082335] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09591522-knights/builder-live.log by gzip [2025-09-23 05:08:04,742][ INFO][PID:2082335] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09591522-knights/builder-live.log' as PID 2110796 [2025-09-23 05:08:04,761][ INFO][PID:2082335] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09591522-knights/builder-live.log) [2025-09-23 05:08:04,762][ INFO][PID:2082335] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09591522-knights/backend.log by gzip [2025-09-23 05:08:04,762][ INFO][PID:2082335] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09591522-knights/backend.log' as PID 2110797