[2026-11-04 18:16:20,014][ INFO][PID:38884] Marking build as starting [2026-11-04 18:16:20,346][ INFO][PID:38884] Checking that https://download.copr.fedorainfracloud.org/results/packit/osbuild-image-builder-2803/fedora-rawhide-ppc64le//repodata/repomd.xml exists [2026-11-04 18:16:20,668][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:16:20,689][ INFO][PID:38884] rpmeta: predicted 9 min for image-builder on fedora-rawhide-ppc64le -> normal builder sufficient [2026-11-04 18:16:20,690][ INFO][PID:38884] VM allocation process starts [2026-11-04 18:16:20,696][ INFO][PID:38884] Trying to allocate VM: ResallocHost, ticket_id=6196823, requested_tags=['arch_ppc64le', 'copr_builder'] [2026-11-04 18:16:23,708][ INFO][PID:38884] Allocated host ResallocHost, ticket_id=6196823, hostname=2620:52:6:1161:dead:beef:cafe:c119, name=vmhost_p09_02_prod_70676368_20261104_172413, requested_tags=['arch_ppc64le', 'copr_builder'] [2026-11-04 18:16:23,709][ INFO][PID:38884] Allocating ssh connection to builder [2026-11-04 18:16:23,710][ INFO][PID:38884] Checking that builder machine is OK [2026-11-04 18:16:25,101][ INFO][PID:38884] Installed copr-rpmbuild version: 1.11 [2026-11-04 18:16:25,101][ INFO][PID:38884] Running remote command: copr-builder-ready fedora-rawhide-ppc64le [2026-11-04 18:16:25,642][ INFO][PID:38884] Red Hat subscription not needed for fedora-rawhide-ppc64le Builder is ready to be used [2026-11-04 18:16:25,642][ INFO][PID:38884] Filling build.info file with builder info [2026-11-04 18:16:25,642][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:16:25,643][ INFO][PID:38884] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "packit", "project_name": "osbuild-image-builder-2803", "project_dirname": "osbuild-image-builder-2803", "submitter": "packit", "ended_on": null, "started_on": 1793816185.64317, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "11260101-fedora-rawhide-ppc64le", "build_id": 11260101, "package_name": "image-builder", "package_version": "89.0.0-1.20261104181536551658.pr2803.24.g006360171", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/packit/osbuild-image-builder-2803/image-builder", "git_hash": "165f02afa5a79e2af0a65e06bd6bf92d5eece414", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "prebuilt_tarball_url": null, "uses_devel_repo": false, "sandbox": "packit/osbuild-image-builder-2803--packit", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/packit/osbuild-image-builder-2803/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null, "repo_gpgcheck": false } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/packit/osbuild-image-builder-2803", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/packit/osbuild-image-builder-2803", "result_dir": "11260101-image-builder", "built_packages": "", "rpmeta_prediction": 9, "id": 11260101, "mockchain_macros": { "copr_username": "packit", "copr_projectname": "osbuild-image-builder-2803", "vendor": "Fedora Project COPR (packit/osbuild-image-builder-2803)" } } ] } [2026-11-04 18:16:25,922][ INFO][PID:38884] Sending fedora-messaging bus message in build.start [2026-11-04 18:16:26,346][ INFO][PID:38884] Sending fedora-messaging bus message in chroot.start [2026-11-04 18:16:26,378][ INFO][PID:38884] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/11260101-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached [2026-11-04 18:16:27,654][ INFO][PID:38884] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c119' (ED25519) to the list of known hosts. [2026-11-04 18:16:27,655][ INFO][PID:38884] Downloading the builder-live.log file, attempt 1 [2026-11-04 18:16:27,656][ INFO][PID:38884] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c119 copr-rpmbuild-log [2026-11-04 18:16:32,661][ INFO][PID:38884] Periodic builder liveness probe: alive [2026-11-04 18:16:32,662][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:16:37,663][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:16:42,663][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:16:47,664][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:16:52,665][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:16:57,666][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:17:02,667][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:17:07,668][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:17:12,669][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:17:17,670][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:17:22,671][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:17:27,673][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:17:32,673][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:17:37,674][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:17:42,675][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:17:47,676][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:17:52,677][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:17:57,678][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:18:02,679][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:18:07,680][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:18:12,681][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:18:17,682][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:18:22,682][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:18:27,683][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:18:32,684][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:18:37,685][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:18:42,686][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:18:47,687][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:18:52,688][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:18:57,689][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:19:02,690][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:19:07,690][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:19:12,691][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:19:17,692][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:19:22,693][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:19:27,694][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:19:32,695][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:19:37,696][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:19:42,696][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:19:47,697][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:19:52,698][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:19:57,699][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:20:02,700][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:20:07,701][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:20:12,702][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:20:17,702][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:20:22,703][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:20:27,704][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:20:32,705][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:20:37,706][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:20:42,707][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:20:47,708][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:20:52,709][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:20:57,710][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:21:02,710][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:21:07,711][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:21:12,712][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:21:17,713][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:21:22,714][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:21:27,715][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:21:32,716][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:21:37,717][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:21:42,717][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:21:47,718][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:21:52,719][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:21:57,720][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:22:02,721][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:22:07,722][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:22:12,723][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:22:17,724][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:22:22,726][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:22:27,727][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:22:32,728][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:22:37,729][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:22:42,730][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:22:47,733][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:22:52,734][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:22:57,735][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:23:02,736][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:23:07,737][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:23:12,737][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:23:17,738][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:23:22,739][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:23:27,740][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:23:32,741][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:23:37,742][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:23:42,743][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:23:47,744][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:23:52,745][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:23:57,746][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:24:02,747][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:24:07,748][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:24:12,749][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:24:17,750][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:24:22,751][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:24:27,752][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:24:32,753][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:24:37,754][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:24:42,754][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:24:47,756][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:24:52,757][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:24:57,758][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:25:02,759][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:25:07,760][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:25:12,761][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:25:17,762][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:25:22,762][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:25:27,764][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:25:32,766][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:25:37,767][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:25:42,768][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:25:47,769][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:25:52,770][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:25:57,771][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:26:02,771][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:26:07,772][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:26:12,773][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:26:17,774][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:26:22,775][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:26:27,776][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:26:32,780][ INFO][PID:38884] Periodic builder liveness probe: alive [2026-11-04 18:26:32,781][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:26:37,782][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:26:42,782][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:26:47,783][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:26:52,784][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:26:57,785][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:27:02,786][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:27:07,787][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:27:12,788][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:27:17,789][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:27:22,790][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:27:27,791][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:27:32,792][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:27:37,793][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:27:42,794][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:27:47,795][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:27:52,797][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:27:57,798][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:28:02,799][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:28:07,800][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:28:12,801][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:28:17,802][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:28:22,802][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:28:27,803][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:28:32,804][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:28:37,805][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:28:42,806][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:28:47,807][ INFO][PID:38884] Checking for cancel request [2026-11-04 18:28:51,052][ INFO][PID:38884] Downloading results from builder [2026-11-04 18:28:51,052][ INFO][PID:38884] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c119]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/packit/osbuild-image-builder-2803/fedora-rawhide-ppc64le/11260101-image-builder started [2026-11-04 18:28:51,053][ INFO][PID:38884] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c119]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/packit/osbuild-image-builder-2803/fedora-rawhide-ppc64le/11260101-image-builder/ &> /var/lib/copr/public_html/results/packit/osbuild-image-builder-2803/fedora-rawhide-ppc64le/11260101-image-builder/build-11260101.rsync.log [2026-11-04 18:28:51,813][ INFO][PID:38884] rsyncing finished. [2026-11-04 18:28:51,814][ INFO][PID:38884] VM Release request [2026-11-04 18:28:51,819][ INFO][PID:38884] Searching for 'success' file in resultdir [2026-11-04 18:28:51,820][ ERROR][PID:38884] Build failed: Backend process error: No success file => build failure [2026-11-04 18:28:51,825][ INFO][PID:38884] Finished build: id=11260101 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/packit/osbuild-image-builder-2803 chroot=fedora-rawhide-ppc64le [2026-11-04 18:28:51,826][ ERROR][PID:38884] Backend process error: No success file => build failure [2026-11-04 18:28:51,830][ INFO][PID:38884] Worker failed build, took 746.1877932548523 [2026-11-04 18:28:51,832][ INFO][PID:38884] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "packit", "project_name": "osbuild-image-builder-2803", "project_dirname": "osbuild-image-builder-2803", "submitter": "packit", "ended_on": 1793816931.8309634, "started_on": 1793816185.64317, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "11260101-fedora-rawhide-ppc64le", "build_id": 11260101, "package_name": "image-builder", "package_version": "89.0.0-1.20261104181536551658.pr2803.24.g006360171", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/packit/osbuild-image-builder-2803/image-builder", "git_hash": "165f02afa5a79e2af0a65e06bd6bf92d5eece414", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "prebuilt_tarball_url": null, "uses_devel_repo": false, "sandbox": "packit/osbuild-image-builder-2803--packit", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/packit/osbuild-image-builder-2803/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null, "repo_gpgcheck": false } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/packit/osbuild-image-builder-2803", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/packit/osbuild-image-builder-2803", "result_dir": "11260101-image-builder", "built_packages": "", "rpmeta_prediction": 9, "id": 11260101, "mockchain_macros": { "copr_username": "packit", "copr_projectname": "osbuild-image-builder-2803", "vendor": "Fedora Project COPR (packit/osbuild-image-builder-2803)" } } ] } [2026-11-04 18:28:51,895][ INFO][PID:38884] Sending fedora-messaging bus message in build.end [2026-11-04 18:28:51,914][ INFO][PID:38884] Compressing /var/lib/copr/public_html/results/packit/osbuild-image-builder-2803/fedora-rawhide-ppc64le/11260101-image-builder/builder-live.log by gzip [2026-11-04 18:28:51,915][ INFO][PID:38884] Running command 'gzip /var/lib/copr/public_html/results/packit/osbuild-image-builder-2803/fedora-rawhide-ppc64le/11260101-image-builder/builder-live.log' as PID 200324 [2026-11-04 18:28:51,921][ INFO][PID:38884] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/packit/osbuild-image-builder-2803/fedora-rawhide-ppc64le/11260101-image-builder/builder-live.log) [2026-11-04 18:28:51,921][ INFO][PID:38884] Compressing /var/lib/copr/public_html/results/packit/osbuild-image-builder-2803/fedora-rawhide-ppc64le/11260101-image-builder/backend.log by gzip [2026-11-04 18:28:51,922][ INFO][PID:38884] Running command 'gzip /var/lib/copr/public_html/results/packit/osbuild-image-builder-2803/fedora-rawhide-ppc64le/11260101-image-builder/backend.log' as PID 200325