[2026-05-07 08:41:08,141][ INFO][PID:3539999] Marking build as starting [2026-05-07 08:41:08,310][ INFO][PID:3539999] Checking that /var/lib/copr/public_html/results/jmarcoshp/mesa-custom/fedora-rawhide-ppc64le/repodata/repomd.xml exists [2026-05-07 08:41:08,316][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:41:08,318][ INFO][PID:3539999] VM allocation process starts [2026-05-07 08:41:08,329][ INFO][PID:3539999] Trying to allocate VM: ResallocHost, ticket_id=2767396, requested_tags=['arch_ppc64le', 'copr_builder'] [2026-05-07 08:41:13,331][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:41:14,356][ INFO][PID:3539999] Allocated host ResallocHost, ticket_id=2767396, hostname=2620:52:6:1161:dead:beef:cafe:c112, name=vmhost_p09_01_prod_08666278_20260507_075314, requested_tags=['arch_ppc64le', 'copr_builder'] [2026-05-07 08:41:14,356][ INFO][PID:3539999] Allocating ssh connection to builder [2026-05-07 08:41:14,357][ INFO][PID:3539999] Checking that builder machine is OK [2026-05-07 08:41:15,134][ INFO][PID:3539999] Installed copr-rpmbuild version: 1.8 [2026-05-07 08:41:15,135][ INFO][PID:3539999] Running remote command: copr-builder-ready fedora-rawhide-ppc64le [2026-05-07 08:41:15,609][ INFO][PID:3539999] Red Hat subscription not needed for fedora-rawhide-ppc64le Builder is ready to be used [2026-05-07 08:41:15,610][ INFO][PID:3539999] Filling build.info file with builder info [2026-05-07 08:41:15,611][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:41:15,612][ INFO][PID:3539999] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "jmarcoshp", "project_name": "mesa-custom", "project_dirname": "mesa-custom", "submitter": "https://api.github.com/users/github-actions%5Bbot%5D", "ended_on": null, "started_on": 1778143275.6122236, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10432324-fedora-rawhide-ppc64le", "build_id": 10432324, "package_name": "mesa", "package_version": "26.1.0-92.gitd593af3", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/jmarcoshp/mesa-custom/mesa", "git_hash": "5b8b16ac9e6acb5152fdab2914394343dccc73b6", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "jmarcoshp/mesa-custom--https://api.github.com/users/github-actions%5Bbot%5D", "results": null, "appstream": true, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/jmarcoshp/mesa-custom/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": 1 } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": 1, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/jmarcoshp/mesa-custom", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/jmarcoshp/mesa-custom", "result_dir": "10432324-mesa", "built_packages": "", "id": 10432324, "mockchain_macros": { "copr_username": "jmarcoshp", "copr_projectname": "mesa-custom", "vendor": "Fedora Project COPR (jmarcoshp/mesa-custom)" } } ] } [2026-05-07 08:41:15,669][ INFO][PID:3539999] Sending fedora-messaging bus message in build.start [2026-05-07 08:41:16,171][ INFO][PID:3539999] Sending fedora-messaging bus message in chroot.start [2026-05-07 08:41:16,202][ INFO][PID:3539999] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10432324-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached [2026-05-07 08:41:17,033][ INFO][PID:3539999] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c112' (ED25519) to the list of known hosts. [2026-05-07 08:41:17,034][ INFO][PID:3539999] Downloading the builder-live.log file, attempt 1 [2026-05-07 08:41:17,036][ INFO][PID:3539999] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c112 copr-rpmbuild-log [2026-05-07 08:41:22,040][ INFO][PID:3539999] Periodic builder liveness probe: alive [2026-05-07 08:41:22,041][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:41:27,042][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:41:32,049][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:41:37,051][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:41:42,052][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:41:47,054][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:41:52,056][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:41:57,062][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:42:02,064][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:42:07,066][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:42:12,071][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:42:17,072][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:42:22,074][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:42:27,075][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:42:32,076][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:42:37,077][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:42:42,079][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:42:47,080][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:42:52,087][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:42:57,094][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:43:02,102][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:43:07,110][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:43:12,111][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:43:17,113][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:43:22,114][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:43:27,115][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:43:32,116][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:43:37,118][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:43:42,119][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:43:47,121][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:43:52,123][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:43:57,124][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:44:02,125][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:44:07,127][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:44:12,129][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:44:17,135][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:44:22,137][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:44:27,144][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:44:32,146][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:44:37,147][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:44:42,148][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:44:47,150][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:44:52,151][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:44:57,155][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:45:02,159][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:45:07,166][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:45:12,167][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:45:17,169][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:45:22,170][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:45:27,171][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:45:32,173][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:45:37,175][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:45:42,177][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:45:47,178][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:45:52,180][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:45:57,187][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:46:02,194][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:46:07,200][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:46:12,201][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:46:17,203][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:46:22,205][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:46:27,208][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:46:32,213][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:46:37,222][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:46:42,223][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:46:47,225][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:46:52,227][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:46:57,228][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:47:02,229][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:47:07,230][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:47:12,238][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:47:17,240][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:47:22,241][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:47:27,243][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:47:32,247][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:47:37,249][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:47:42,250][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:47:47,252][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:47:52,256][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:47:57,262][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:48:02,263][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:48:07,264][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:48:12,266][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:48:17,267][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:48:22,268][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:48:27,275][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:48:32,278][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:48:37,280][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:48:42,281][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:48:47,283][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:48:52,284][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:48:57,286][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:49:02,288][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:49:07,291][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:49:12,292][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:49:17,296][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:49:22,297][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:49:27,307][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:49:32,309][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:49:37,311][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:49:42,315][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:49:47,316][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:49:52,319][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:49:57,320][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:50:02,321][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:50:07,323][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:50:12,324][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:50:17,325][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:50:22,326][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:50:27,328][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:50:32,329][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:50:37,330][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:50:42,332][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:50:47,333][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:50:52,335][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:50:57,337][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:51:02,339][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:51:07,340][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:51:12,347][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:51:17,349][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:51:22,623][ INFO][PID:3539999] Periodic builder liveness probe: alive [2026-05-07 08:51:22,654][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:51:27,656][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:51:32,657][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:51:37,658][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:51:42,660][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:51:47,661][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:51:52,663][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:51:57,664][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:52:02,665][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:52:07,666][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:52:12,668][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:52:17,669][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:52:22,671][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:52:27,672][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:52:32,673][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:52:37,674][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:52:42,675][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:52:47,677][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:52:52,678][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:52:57,679][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:53:02,680][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:53:07,681][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:53:12,683][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:53:17,684][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:53:22,685][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:53:27,686][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:53:32,687][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:53:37,689][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:53:42,690][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:53:47,691][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:53:52,692][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:53:57,694][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:54:02,695][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:54:07,696][ INFO][PID:3539999] Checking for cancel request [2026-05-07 08:54:11,383][ INFO][PID:3539999] Downloading results from builder [2026-05-07 08:54:11,413][ INFO][PID:3539999] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c112]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/jmarcoshp/mesa-custom/fedora-rawhide-ppc64le/10432324-mesa started [2026-05-07 08:54:11,463][ INFO][PID:3539999] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c112]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/jmarcoshp/mesa-custom/fedora-rawhide-ppc64le/10432324-mesa/ &> /var/lib/copr/public_html/results/jmarcoshp/mesa-custom/fedora-rawhide-ppc64le/10432324-mesa/build-10432324.rsync.log [2026-05-07 08:54:12,677][ INFO][PID:3539999] rsyncing finished. [2026-05-07 08:54:12,680][ INFO][PID:3539999] VM Release request [2026-05-07 08:54:12,702][ INFO][PID:3539999] Searching for 'success' file in resultdir [2026-05-07 08:54:12,708][ ERROR][PID:3539999] Build failed: Backend process error: No success file => build failure [2026-05-07 08:54:13,202][ INFO][PID:3539999] Finished build: id=10432324 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/jmarcoshp/mesa-custom chroot=fedora-rawhide-ppc64le [2026-05-07 08:54:13,396][ ERROR][PID:3539999] Backend process error: No success file => build failure [2026-05-07 08:54:13,472][ INFO][PID:3539999] Worker failed build, took 777.859747171402 [2026-05-07 08:54:13,490][ INFO][PID:3539999] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "jmarcoshp", "project_name": "mesa-custom", "project_dirname": "mesa-custom", "submitter": "https://api.github.com/users/github-actions%5Bbot%5D", "ended_on": 1778144053.4719708, "started_on": 1778143275.6122236, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10432324-fedora-rawhide-ppc64le", "build_id": 10432324, "package_name": "mesa", "package_version": "26.1.0-92.gitd593af3", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/jmarcoshp/mesa-custom/mesa", "git_hash": "5b8b16ac9e6acb5152fdab2914394343dccc73b6", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "jmarcoshp/mesa-custom--https://api.github.com/users/github-actions%5Bbot%5D", "results": null, "appstream": true, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/jmarcoshp/mesa-custom/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": 1 } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": 1, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/jmarcoshp/mesa-custom", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/jmarcoshp/mesa-custom", "result_dir": "10432324-mesa", "built_packages": "", "id": 10432324, "mockchain_macros": { "copr_username": "jmarcoshp", "copr_projectname": "mesa-custom", "vendor": "Fedora Project COPR (jmarcoshp/mesa-custom)" } } ] } [2026-05-07 08:54:13,929][ INFO][PID:3539999] Sending fedora-messaging bus message in build.end [2026-05-07 08:54:14,303][ INFO][PID:3539999] Compressing /var/lib/copr/public_html/results/jmarcoshp/mesa-custom/fedora-rawhide-ppc64le/10432324-mesa/builder-live.log by gzip [2026-05-07 08:54:14,330][ INFO][PID:3539999] Running command 'gzip /var/lib/copr/public_html/results/jmarcoshp/mesa-custom/fedora-rawhide-ppc64le/10432324-mesa/builder-live.log' as PID 3608812 [2026-05-07 08:54:14,520][ INFO][PID:3539999] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/jmarcoshp/mesa-custom/fedora-rawhide-ppc64le/10432324-mesa/builder-live.log) [2026-05-07 08:54:14,530][ INFO][PID:3539999] Compressing /var/lib/copr/public_html/results/jmarcoshp/mesa-custom/fedora-rawhide-ppc64le/10432324-mesa/backend.log by gzip [2026-05-07 08:54:14,532][ INFO][PID:3539999] Running command 'gzip /var/lib/copr/public_html/results/jmarcoshp/mesa-custom/fedora-rawhide-ppc64le/10432324-mesa/backend.log' as PID 3608823