[2026-03-11 03:26:42,513][ INFO][PID:2916938] Marking build as starting [2026-03-11 03:26:42,624][ INFO][PID:2916938] Checking that https://download.copr.fedorainfracloud.org/results/jwp/foxing/centos-stream-10-ppc64le//repodata/repomd.xml exists [2026-03-11 03:26:43,115][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:26:43,116][ INFO][PID:2916938] VM allocation process starts [2026-03-11 03:26:43,129][ INFO][PID:2916938] Trying to allocate VM: ResallocHost, ticket_id=1805125, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2026-03-11 03:26:46,151][ INFO][PID:2916938] Allocated host ResallocHost, ticket_id=1805125, hostname=2620:52:6:1161:dead:beef:cafe:c122, name=vmhost_p09_03_prod_02978258_20260311_002729, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2026-03-11 03:26:46,152][ INFO][PID:2916938] Allocating ssh connection to builder [2026-03-11 03:26:46,152][ INFO][PID:2916938] Checking that builder machine is OK [2026-03-11 03:26:47,109][ INFO][PID:2916938] Running remote command: copr-builder-ready centos-stream-10-ppc64le [2026-03-11 03:26:47,658][ INFO][PID:2916938] Red Hat subscription not needed for centos-stream-10-ppc64le Builder is ready to be used [2026-03-11 03:26:47,659][ INFO][PID:2916938] Filling build.info file with builder info [2026-03-11 03:26:47,659][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:26:47,660][ INFO][PID:2916938] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "jwp", "project_name": "foxing", "project_dirname": "foxing", "submitter": "jwp", "ended_on": null, "started_on": 1773199607.6607726, "submitted_on": null, "status": 3, "chroot": "centos-stream-10-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10208760-centos-stream-10-ppc64le", "build_id": 10208760, "package_name": "foxing", "package_version": "0.6.1-3", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/jwp/foxing/foxing", "git_hash": "f8a4020a169c33193c54190d5f4cab7e099eb850", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "jwp/foxing--jwp", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/jwp/foxing/centos-stream-10-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": true, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/jwp/foxing", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/jwp/foxing", "result_dir": "10208760-foxing", "built_packages": "", "id": 10208760, "mockchain_macros": { "copr_username": "jwp", "copr_projectname": "foxing", "vendor": "Fedora Project COPR (jwp/foxing)" } } ] } [2026-03-11 03:26:47,748][ INFO][PID:2916938] Sending fedora-messaging bus message in build.start [2026-03-11 03:26:48,311][ INFO][PID:2916938] Sending fedora-messaging bus message in chroot.start [2026-03-11 03:26:48,337][ INFO][PID:2916938] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10208760-centos-stream-10-ppc64le --chroot centos-stream-10-ppc64le --detached [2026-03-11 03:26:49,311][ INFO][PID:2916938] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c122' (ED25519) to the list of known hosts. [2026-03-11 03:26:49,312][ INFO][PID:2916938] Downloading the builder-live.log file, attempt 1 [2026-03-11 03:26:49,313][ INFO][PID:2916938] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c122 copr-rpmbuild-log [2026-03-11 03:26:54,317][ INFO][PID:2916938] Periodic builder liveness probe: alive [2026-03-11 03:26:54,317][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:26:59,318][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:27:04,319][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:27:09,320][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:27:14,321][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:27:19,322][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:27:24,323][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:27:29,324][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:27:34,325][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:27:39,326][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:27:44,327][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:27:49,328][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:27:54,329][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:27:59,330][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:28:04,331][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:28:09,332][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:28:14,333][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:28:19,334][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:28:24,335][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:28:29,335][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:28:34,336][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:28:39,337][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:28:44,338][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:28:49,340][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:28:54,341][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:28:59,342][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:29:04,342][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:29:09,343][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:29:14,345][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:29:19,345][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:29:24,346][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:29:29,347][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:29:34,348][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:29:39,349][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:29:44,350][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:29:49,351][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:29:54,352][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:29:59,353][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:30:04,354][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:30:09,355][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:30:14,356][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:30:19,357][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:30:24,357][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:30:29,358][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:30:34,359][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:30:39,360][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:30:44,361][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:30:49,362][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:30:54,363][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:30:59,364][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:31:04,365][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:31:09,366][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:31:14,367][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:31:19,368][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:31:24,368][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:31:29,369][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:31:34,370][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:31:39,371][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:31:44,372][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:31:49,373][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:31:54,374][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:31:59,375][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:32:04,376][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:32:09,377][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:32:14,378][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:32:19,379][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:32:24,380][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:32:29,381][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:32:34,382][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:32:39,383][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:32:44,384][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:32:49,385][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:32:54,386][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:32:59,387][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:33:04,388][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:33:09,389][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:33:14,390][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:33:19,391][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:33:24,391][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:33:29,392][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:33:34,393][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:33:39,394][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:33:44,395][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:33:49,397][ INFO][PID:2916938] Checking for cancel request [2026-03-11 03:33:50,831][ INFO][PID:2916938] Downloading results from builder [2026-03-11 03:33:50,834][ INFO][PID:2916938] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c122]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/jwp/foxing/centos-stream-10-ppc64le/10208760-foxing started [2026-03-11 03:33:50,835][ INFO][PID:2916938] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c122]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/jwp/foxing/centos-stream-10-ppc64le/10208760-foxing/ &> /var/lib/copr/public_html/results/jwp/foxing/centos-stream-10-ppc64le/10208760-foxing/build-10208760.rsync.log [2026-03-11 03:33:52,427][ INFO][PID:2916938] rsyncing finished. [2026-03-11 03:33:52,428][ INFO][PID:2916938] Releasing VM back to pool [2026-03-11 03:33:52,437][ INFO][PID:2916938] Searching for 'success' file in resultdir [2026-03-11 03:33:52,438][ ERROR][PID:2916938] Build failed: Backend process error: No success file => build failure [2026-03-11 03:33:52,438][ INFO][PID:2916938] Finished build: id=10208760 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/jwp/foxing chroot=centos-stream-10-ppc64le [2026-03-11 03:33:52,440][ ERROR][PID:2916938] Backend process error: No success file => build failure [2026-03-11 03:33:52,440][ INFO][PID:2916938] Worker failed build, took 424.7796676158905 [2026-03-11 03:33:52,440][ INFO][PID:2916938] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "jwp", "project_name": "foxing", "project_dirname": "foxing", "submitter": "jwp", "ended_on": 1773200032.4404402, "started_on": 1773199607.6607726, "submitted_on": null, "status": 0, "chroot": "centos-stream-10-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10208760-centos-stream-10-ppc64le", "build_id": 10208760, "package_name": "foxing", "package_version": "0.6.1-3", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/jwp/foxing/foxing", "git_hash": "f8a4020a169c33193c54190d5f4cab7e099eb850", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "jwp/foxing--jwp", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/jwp/foxing/centos-stream-10-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": true, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/jwp/foxing", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/jwp/foxing", "result_dir": "10208760-foxing", "built_packages": "", "id": 10208760, "mockchain_macros": { "copr_username": "jwp", "copr_projectname": "foxing", "vendor": "Fedora Project COPR (jwp/foxing)" } } ] } [2026-03-11 03:33:52,535][ INFO][PID:2916938] Sending fedora-messaging bus message in build.end [2026-03-11 03:33:52,562][ INFO][PID:2916938] Compressing /var/lib/copr/public_html/results/jwp/foxing/centos-stream-10-ppc64le/10208760-foxing/builder-live.log by gzip [2026-03-11 03:33:52,564][ INFO][PID:2916938] Running command 'gzip /var/lib/copr/public_html/results/jwp/foxing/centos-stream-10-ppc64le/10208760-foxing/builder-live.log' as PID 2948575 [2026-03-11 03:33:52,627][ INFO][PID:2916938] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/jwp/foxing/centos-stream-10-ppc64le/10208760-foxing/builder-live.log) [2026-03-11 03:33:52,628][ INFO][PID:2916938] Compressing /var/lib/copr/public_html/results/jwp/foxing/centos-stream-10-ppc64le/10208760-foxing/backend.log by gzip [2026-03-11 03:33:52,629][ INFO][PID:2916938] Running command 'gzip /var/lib/copr/public_html/results/jwp/foxing/centos-stream-10-ppc64le/10208760-foxing/backend.log' as PID 2948580