[2025-11-12 17:01:32,980][ INFO][PID:2319558] Marking build as starting [2025-11-12 17:01:33,061][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:01:33,062][ INFO][PID:2319558] VM allocation process starts [2025-11-12 17:01:33,088][ INFO][PID:2319558] Trying to allocate VM: ResallocHost, ticket_id=6147826, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-11-12 17:01:38,090][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:01:43,091][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:01:48,092][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:01:51,143][ INFO][PID:2319558] Allocated host ResallocHost, ticket_id=6147826, hostname=2620:52:6:1161:dead:beef:cafe:c14e, name=vmhost_p09_03_prod_07960242_20251112_164351, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-11-12 17:01:51,147][ INFO][PID:2319558] Allocating ssh connection to builder [2025-11-12 17:01:51,148][ INFO][PID:2319558] Checking that builder machine is OK [2025-11-12 17:01:52,115][ INFO][PID:2319558] Running remote command: copr-builder-ready fedora-rawhide-ppc64le [2025-11-12 17:01:52,596][ INFO][PID:2319558] Red Hat subscription not needed for fedora-rawhide-ppc64le Builder is ready to be used [2025-11-12 17:01:52,597][ INFO][PID:2319558] Filling build.info file with builder info [2025-11-12 17:01:52,597][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:01:52,598][ INFO][PID:2319558] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "openblas-0.3.23", "project_dirname": "openblas-0.3.23:pr:fork-lecris-rpms-gdl-15", "submitter": "https://src.fedoraproject.org/user/lecris", "ended_on": null, "started_on": 1762966912.5985436, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9791731-fedora-rawhide-ppc64le", "build_id": 9791731, "package_name": "gdl", "package_version": "1.1.1-8", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-gdl-15/gdl", "git_hash": "83cd5e5f4108dbc6c3a577d7bdfec152fea3d963", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/lecris", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-gdl-15/fedora-rawhide-ppc64le/", "id": "copr_coprdir", "name": "Coprdir repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-gdl-15", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-gdl-15", "result_dir": "09791731-gdl", "built_packages": "", "id": 9791731, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "openblas-0.3.23", "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)" } } ] } [2025-11-12 17:01:52,648][ INFO][PID:2319558] Sending fedora-messaging bus message in build.start [2025-11-12 17:01:53,331][ INFO][PID:2319558] Sending fedora-messaging bus message in chroot.start [2025-11-12 17:01:53,356][ INFO][PID:2319558] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9791731-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached [2025-11-12 17:01:54,150][ INFO][PID:2319558] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c14e' (ED25519) to the list of known hosts. [2025-11-12 17:01:54,151][ INFO][PID:2319558] Downloading the builder-live.log file, attempt 1 [2025-11-12 17:01:54,152][ INFO][PID:2319558] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c14e copr-rpmbuild-log [2025-11-12 17:01:59,163][ INFO][PID:2319558] Periodic builder liveness probe: alive [2025-11-12 17:01:59,164][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:02:04,165][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:02:09,166][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:02:14,172][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:02:19,173][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:02:24,174][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:02:29,175][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:02:34,176][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:02:39,177][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:02:44,178][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:02:49,180][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:02:54,181][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:02:59,182][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:03:04,183][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:03:09,184][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:03:14,185][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:03:19,187][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:03:24,188][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:03:29,190][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:03:34,191][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:03:39,192][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:03:44,193][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:03:49,194][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:03:54,195][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:03:59,196][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:04:04,198][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:04:09,199][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:04:14,200][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:04:19,201][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:04:24,202][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:04:29,203][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:04:34,205][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:04:39,206][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:04:44,207][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:04:49,208][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:04:54,209][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:04:59,210][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:05:04,211][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:05:09,212][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:05:14,215][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:05:19,216][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:05:24,217][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:05:29,219][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:05:34,220][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:05:39,221][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:05:44,222][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:05:49,223][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:05:54,224][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:05:59,225][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:06:04,226][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:06:09,227][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:06:14,228][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:06:19,229][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:06:24,231][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:06:29,232][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:06:34,233][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:06:39,234][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:06:44,235][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:06:49,236][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:06:54,237][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:06:59,238][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:07:04,239][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:07:09,240][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:07:14,241][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:07:19,242][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:07:24,244][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:07:29,257][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:07:34,258][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:07:39,259][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:07:44,260][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:07:49,261][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:07:54,262][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:07:59,263][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:08:04,264][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:08:09,265][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:08:14,266][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:08:19,267][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:08:24,271][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:08:29,272][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:08:34,273][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:08:39,274][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:08:44,276][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:08:49,277][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:08:54,279][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:08:59,281][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:09:04,282][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:09:09,283][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:09:14,285][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:09:19,286][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:09:24,287][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:09:29,289][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:09:34,290][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:09:39,291][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:09:44,292][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:09:49,293][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:09:54,294][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:09:59,296][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:10:04,298][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:10:09,299][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:10:14,300][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:10:19,301][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:10:24,302][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:10:29,303][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:10:34,304][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:10:39,306][ INFO][PID:2319558] Checking for cancel request [2025-11-12 17:10:39,776][ INFO][PID:2319558] Downloading results from builder [2025-11-12 17:10:39,777][ INFO][PID:2319558] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c14e]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-gdl-15/fedora-rawhide-ppc64le/09791731-gdl started [2025-11-12 17:10:39,778][ INFO][PID:2319558] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c14e]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-gdl-15/fedora-rawhide-ppc64le/09791731-gdl/ &> /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-gdl-15/fedora-rawhide-ppc64le/09791731-gdl/build-09791731.rsync.log [2025-11-12 17:10:40,591][ INFO][PID:2319558] rsyncing finished. [2025-11-12 17:10:40,591][ INFO][PID:2319558] Releasing VM back to pool [2025-11-12 17:10:40,602][ INFO][PID:2319558] Searching for 'success' file in resultdir [2025-11-12 17:10:40,603][ ERROR][PID:2319558] Build failed: Backend process error: No success file => build failure [2025-11-12 17:10:40,604][ INFO][PID:2319558] Finished build: id=9791731 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-gdl-15 chroot=fedora-rawhide-ppc64le [2025-11-12 17:10:40,605][ ERROR][PID:2319558] Backend process error: No success file => build failure [2025-11-12 17:10:40,606][ INFO][PID:2319558] Worker failed build, took 528.0076608657837 [2025-11-12 17:10:40,606][ INFO][PID:2319558] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "openblas-0.3.23", "project_dirname": "openblas-0.3.23:pr:fork-lecris-rpms-gdl-15", "submitter": "https://src.fedoraproject.org/user/lecris", "ended_on": 1762967440.6062045, "started_on": 1762966912.5985436, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9791731-fedora-rawhide-ppc64le", "build_id": 9791731, "package_name": "gdl", "package_version": "1.1.1-8", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-gdl-15/gdl", "git_hash": "83cd5e5f4108dbc6c3a577d7bdfec152fea3d963", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/lecris", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-gdl-15/fedora-rawhide-ppc64le/", "id": "copr_coprdir", "name": "Coprdir repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-gdl-15", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-gdl-15", "result_dir": "09791731-gdl", "built_packages": "", "id": 9791731, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "openblas-0.3.23", "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)" } } ] } [2025-11-12 17:10:40,655][ INFO][PID:2319558] Sending fedora-messaging bus message in build.end [2025-11-12 17:10:40,680][ INFO][PID:2319558] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-gdl-15/fedora-rawhide-ppc64le/09791731-gdl/builder-live.log by gzip [2025-11-12 17:10:40,682][ INFO][PID:2319558] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-gdl-15/fedora-rawhide-ppc64le/09791731-gdl/builder-live.log' as PID 2381713 [2025-11-12 17:10:40,692][ INFO][PID:2319558] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-gdl-15/fedora-rawhide-ppc64le/09791731-gdl/builder-live.log) [2025-11-12 17:10:40,693][ INFO][PID:2319558] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-gdl-15/fedora-rawhide-ppc64le/09791731-gdl/backend.log by gzip [2025-11-12 17:10:40,694][ INFO][PID:2319558] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-lecris-rpms-gdl-15/fedora-rawhide-ppc64le/09791731-gdl/backend.log' as PID 2381714