[2026-02-09 17:12:39,034][ INFO][PID:1309416] Marking build as starting [2026-02-09 17:12:39,121][ INFO][PID:1309416] Checking that /var/lib/copr/public_html/results/neil/volk/epel-9-ppc64le/repodata/repomd.xml exists [2026-02-09 17:12:39,192][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:12:39,197][ INFO][PID:1309416] VM allocation process starts [2026-02-09 17:12:39,244][ INFO][PID:1309416] Trying to allocate VM: ResallocHost, ticket_id=1240940, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2026-02-09 17:12:44,250][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:12:49,252][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:12:54,258][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:12:59,259][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:13:04,261][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:13:09,265][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:13:14,269][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:13:19,271][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:13:24,279][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:13:27,409][ INFO][PID:1309416] Allocated host ResallocHost, ticket_id=1240940, hostname=2620:52:6:1161:dead:beef:cafe:c18f, name=vmhost_p09_04_prod_02095398_20260209_170804, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2026-02-09 17:13:27,410][ INFO][PID:1309416] Allocating ssh connection to builder [2026-02-09 17:13:27,412][ INFO][PID:1309416] Checking that builder machine is OK [2026-02-09 17:13:28,552][ INFO][PID:1309416] Running remote command: copr-builder-ready epel-9-ppc64le [2026-02-09 17:13:29,203][ INFO][PID:1309416] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2026-02-09 17:13:29,204][ INFO][PID:1309416] Filling build.info file with builder info [2026-02-09 17:13:29,205][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:13:29,211][ INFO][PID:1309416] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "neil", "project_name": "volk", "project_dirname": "volk", "submitter": "https://src.fedoraproject.org/user/jskarvad", "ended_on": null, "started_on": 1770657209.2115157, "submitted_on": null, "status": 3, "chroot": "epel-9-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10109609-epel-9-ppc64le", "build_id": 10109609, "package_name": "volk", "package_version": "3.3.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/neil/volk/volk", "git_hash": "42d332b2f72bcd518acdee6edd2a63a65d573fed", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "neil/volk--https://src.fedoraproject.org/user/jskarvad", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/neil/volk/epel-9-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/neil/volk", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/neil/volk", "result_dir": "10109609-volk", "built_packages": "", "id": 10109609, "mockchain_macros": { "copr_username": "neil", "copr_projectname": "volk", "vendor": "Fedora Project COPR (neil/volk)" } } ] } [2026-02-09 17:13:29,456][ INFO][PID:1309416] Sending fedora-messaging bus message in build.start [2026-02-09 17:13:30,897][ INFO][PID:1309416] Sending fedora-messaging bus message in chroot.start [2026-02-09 17:13:30,949][ INFO][PID:1309416] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10109609-epel-9-ppc64le --chroot epel-9-ppc64le --detached [2026-02-09 17:13:32,156][ INFO][PID:1309416] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c18f' (ED25519) to the list of known hosts. [2026-02-09 17:13:32,158][ INFO][PID:1309416] Downloading the builder-live.log file, attempt 1 [2026-02-09 17:13:32,161][ INFO][PID:1309416] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c18f copr-rpmbuild-log [2026-02-09 17:13:37,174][ INFO][PID:1309416] Periodic builder liveness probe: alive [2026-02-09 17:13:37,176][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:13:42,194][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:13:47,238][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:13:52,243][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:13:57,246][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:14:02,248][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:14:07,250][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:14:12,252][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:14:17,254][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:14:22,259][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:14:27,271][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:14:32,272][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:14:37,277][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:14:42,279][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:14:47,284][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:14:52,287][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:14:57,321][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:15:02,323][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:15:07,326][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:15:12,328][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:15:17,329][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:15:22,330][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:15:27,417][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:15:32,418][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:15:37,419][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:15:42,424][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:15:47,426][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:15:52,427][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:15:57,432][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:16:02,520][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:16:07,521][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:16:12,523][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:16:17,527][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:16:22,528][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:16:27,530][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:16:32,532][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:16:37,533][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:16:42,538][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:16:47,540][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:16:52,542][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:16:57,868][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:17:02,877][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:17:07,910][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:17:12,949][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:17:17,976][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:17:22,987][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:17:28,116][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:17:33,162][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:17:38,366][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:17:43,435][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:17:48,453][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:17:53,509][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:17:58,533][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:18:03,735][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:18:08,739][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:18:13,741][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:18:18,743][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:18:23,748][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:18:28,786][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:18:33,788][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:18:38,791][ INFO][PID:1309416] Checking for cancel request [2026-02-09 17:18:42,512][ INFO][PID:1309416] Downloading results from builder [2026-02-09 17:18:42,514][ INFO][PID:1309416] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18f]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/neil/volk/epel-9-ppc64le/10109609-volk started [2026-02-09 17:18:42,519][ INFO][PID:1309416] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18f]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/neil/volk/epel-9-ppc64le/10109609-volk/ &> /var/lib/copr/public_html/results/neil/volk/epel-9-ppc64le/10109609-volk/build-10109609.rsync.log [2026-02-09 17:19:42,600][ INFO][PID:1309416] rsyncing finished. [2026-02-09 17:19:42,617][ ERROR][PID:1309416] Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-02-09 17:19:42,617][ ERROR][PID:1309416] SSH connection lost on #1 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-02-09 17:19:52,618][ INFO][PID:1309416] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18f]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/neil/volk/epel-9-ppc64le/10109609-volk started [2026-02-09 17:19:52,620][ INFO][PID:1309416] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18f]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/neil/volk/epel-9-ppc64le/10109609-volk/ &> /var/lib/copr/public_html/results/neil/volk/epel-9-ppc64le/10109609-volk/build-10109609.rsync.log [2026-02-09 17:20:52,690][ INFO][PID:1309416] rsyncing finished. [2026-02-09 17:20:52,704][ ERROR][PID:1309416] Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-02-09 17:20:52,705][ ERROR][PID:1309416] SSH connection lost on #2 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-02-09 17:21:02,706][ INFO][PID:1309416] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18f]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/neil/volk/epel-9-ppc64le/10109609-volk started [2026-02-09 17:21:02,707][ INFO][PID:1309416] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18f]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/neil/volk/epel-9-ppc64le/10109609-volk/ &> /var/lib/copr/public_html/results/neil/volk/epel-9-ppc64le/10109609-volk/build-10109609.rsync.log [2026-02-09 17:21:03,934][ INFO][PID:1309416] rsyncing finished. [2026-02-09 17:21:03,935][ INFO][PID:1309416] Releasing VM back to pool [2026-02-09 17:21:03,945][ INFO][PID:1309416] Searching for 'success' file in resultdir [2026-02-09 17:21:03,946][ ERROR][PID:1309416] Build failed: Backend process error: No success file => build failure [2026-02-09 17:21:03,946][ INFO][PID:1309416] Finished build: id=10109609 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/neil/volk chroot=epel-9-ppc64le [2026-02-09 17:21:03,948][ ERROR][PID:1309416] Backend process error: No success file => build failure [2026-02-09 17:21:03,948][ INFO][PID:1309416] Worker failed build, took 454.73730635643005 [2026-02-09 17:21:03,949][ INFO][PID:1309416] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "neil", "project_name": "volk", "project_dirname": "volk", "submitter": "https://src.fedoraproject.org/user/jskarvad", "ended_on": 1770657663.948822, "started_on": 1770657209.2115157, "submitted_on": null, "status": 0, "chroot": "epel-9-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10109609-epel-9-ppc64le", "build_id": 10109609, "package_name": "volk", "package_version": "3.3.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/neil/volk/volk", "git_hash": "42d332b2f72bcd518acdee6edd2a63a65d573fed", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "neil/volk--https://src.fedoraproject.org/user/jskarvad", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/neil/volk/epel-9-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/neil/volk", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/neil/volk", "result_dir": "10109609-volk", "built_packages": "", "id": 10109609, "mockchain_macros": { "copr_username": "neil", "copr_projectname": "volk", "vendor": "Fedora Project COPR (neil/volk)" } } ] } [2026-02-09 17:21:04,005][ INFO][PID:1309416] Sending fedora-messaging bus message in build.end [2026-02-09 17:21:04,034][ INFO][PID:1309416] Compressing /var/lib/copr/public_html/results/neil/volk/epel-9-ppc64le/10109609-volk/builder-live.log by gzip [2026-02-09 17:21:04,035][ INFO][PID:1309416] Running command 'gzip /var/lib/copr/public_html/results/neil/volk/epel-9-ppc64le/10109609-volk/builder-live.log' as PID 1382633 [2026-02-09 17:21:04,173][ INFO][PID:1309416] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/neil/volk/epel-9-ppc64le/10109609-volk/builder-live.log) [2026-02-09 17:21:04,175][ INFO][PID:1309416] Compressing /var/lib/copr/public_html/results/neil/volk/epel-9-ppc64le/10109609-volk/backend.log by gzip [2026-02-09 17:21:04,176][ INFO][PID:1309416] Running command 'gzip /var/lib/copr/public_html/results/neil/volk/epel-9-ppc64le/10109609-volk/backend.log' as PID 1382650