[2026-03-11 03:05:14,068][ INFO][PID:2783338] Marking build as starting [2026-03-11 03:05:14,170][ INFO][PID:2783338] Checking that https://download.copr.fedorainfracloud.org/results/jwp/foxing/rhel+epel-10-ppc64le//repodata/repomd.xml exists [2026-03-11 03:05:14,809][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:05:14,810][ INFO][PID:2783338] VM allocation process starts [2026-03-11 03:05:14,834][ INFO][PID:2783338] Trying to allocate VM: ResallocHost, ticket_id=1804791, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2026-03-11 03:05:17,854][ INFO][PID:2783338] Allocated host ResallocHost, ticket_id=1804791, hostname=2620:52:6:1161:dead:beef:cafe:c164, name=vmhost_p09_02_prod_02978002_20260311_000041, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2026-03-11 03:05:17,855][ INFO][PID:2783338] Allocating ssh connection to builder [2026-03-11 03:05:17,857][ INFO][PID:2783338] Checking that builder machine is OK [2026-03-11 03:05:18,917][ INFO][PID:2783338] Running remote command: copr-builder-ready rhel+epel-10-ppc64le [2026-03-11 03:05:19,456][ INFO][PID:2783338] Red Hat subscription not needed for rhel+epel-10-ppc64le Builder is ready to be used [2026-03-11 03:05:19,456][ INFO][PID:2783338] Filling build.info file with builder info [2026-03-11 03:05:19,457][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:05:19,458][ INFO][PID:2783338] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "jwp", "project_name": "foxing", "project_dirname": "foxing", "submitter": "jwp", "ended_on": null, "started_on": 1773198319.4582932, "submitted_on": null, "status": 3, "chroot": "rhel+epel-10-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10208760-rhel+epel-10-ppc64le", "build_id": 10208760, "package_name": "foxing", "package_version": "0.6.1-3", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/jwp/foxing/foxing", "git_hash": "f8a4020a169c33193c54190d5f4cab7e099eb850", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "jwp/foxing--jwp", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/jwp/foxing/rhel+epel-10-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": true, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/jwp/foxing", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/jwp/foxing", "result_dir": "10208760-foxing", "built_packages": "", "id": 10208760, "mockchain_macros": { "copr_username": "jwp", "copr_projectname": "foxing", "vendor": "Fedora Project COPR (jwp/foxing)" } } ] } [2026-03-11 03:05:19,548][ INFO][PID:2783338] Sending fedora-messaging bus message in build.start [2026-03-11 03:05:20,123][ INFO][PID:2783338] Sending fedora-messaging bus message in chroot.start [2026-03-11 03:05:20,154][ INFO][PID:2783338] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10208760-rhel+epel-10-ppc64le --chroot rhel+epel-10-ppc64le --detached [2026-03-11 03:05:21,158][ INFO][PID:2783338] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c164' (ED25519) to the list of known hosts. [2026-03-11 03:05:21,159][ INFO][PID:2783338] Downloading the builder-live.log file, attempt 1 [2026-03-11 03:05:21,162][ INFO][PID:2783338] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c164 copr-rpmbuild-log [2026-03-11 03:05:26,176][ INFO][PID:2783338] Periodic builder liveness probe: alive [2026-03-11 03:05:26,177][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:05:31,179][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:05:36,180][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:05:41,181][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:05:46,182][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:05:51,184][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:05:56,186][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:06:01,187][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:06:06,189][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:06:11,190][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:06:16,191][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:06:21,192][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:06:26,193][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:06:31,194][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:06:36,195][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:06:41,196][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:06:46,198][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:06:51,201][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:06:56,202][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:07:01,204][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:07:06,205][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:07:11,206][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:07:16,207][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:07:21,237][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:07:26,238][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:07:31,239][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:07:36,255][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:07:41,259][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:07:46,261][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:07:51,262][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:07:56,263][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:08:01,264][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:08:06,265][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:08:11,266][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:08:16,267][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:08:21,268][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:08:26,269][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:08:31,270][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:08:36,271][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:08:41,272][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:08:46,273][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:08:51,275][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:08:56,276][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:09:01,278][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:09:06,279][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:09:11,280][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:09:16,281][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:09:21,283][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:09:26,284][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:09:31,286][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:09:36,317][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:09:41,318][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:09:46,320][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:09:51,327][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:09:56,370][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:10:01,371][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:10:06,373][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:10:11,374][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:10:16,378][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:10:21,380][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:10:26,383][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:10:31,385][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:10:36,387][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:10:41,389][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:10:46,390][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:10:51,391][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:10:56,392][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:11:01,393][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:11:06,394][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:11:11,397][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:11:16,398][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:11:21,399][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:11:26,400][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:11:31,401][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:11:36,402][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:11:41,403][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:11:46,404][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:11:51,405][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:11:56,406][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:12:01,406][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:12:06,407][ INFO][PID:2783338] Checking for cancel request [2026-03-11 03:12:10,774][ INFO][PID:2783338] Downloading results from builder [2026-03-11 03:12:10,775][ INFO][PID:2783338] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c164]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/jwp/foxing/rhel+epel-10-ppc64le/10208760-foxing started [2026-03-11 03:12:10,775][ INFO][PID:2783338] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c164]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/jwp/foxing/rhel+epel-10-ppc64le/10208760-foxing/ &> /var/lib/copr/public_html/results/jwp/foxing/rhel+epel-10-ppc64le/10208760-foxing/build-10208760.rsync.log [2026-03-11 03:12:12,849][ INFO][PID:2783338] rsyncing finished. [2026-03-11 03:12:12,849][ INFO][PID:2783338] Releasing VM back to pool [2026-03-11 03:12:12,860][ INFO][PID:2783338] Searching for 'success' file in resultdir [2026-03-11 03:12:12,860][ ERROR][PID:2783338] Build failed: Backend process error: No success file => build failure [2026-03-11 03:12:12,861][ INFO][PID:2783338] Finished build: id=10208760 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/jwp/foxing chroot=rhel+epel-10-ppc64le [2026-03-11 03:12:12,863][ ERROR][PID:2783338] Backend process error: No success file => build failure [2026-03-11 03:12:12,864][ INFO][PID:2783338] Worker failed build, took 413.4059205055237 [2026-03-11 03:12:12,864][ INFO][PID:2783338] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "jwp", "project_name": "foxing", "project_dirname": "foxing", "submitter": "jwp", "ended_on": 1773198732.8642137, "started_on": 1773198319.4582932, "submitted_on": null, "status": 0, "chroot": "rhel+epel-10-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10208760-rhel+epel-10-ppc64le", "build_id": 10208760, "package_name": "foxing", "package_version": "0.6.1-3", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/jwp/foxing/foxing", "git_hash": "f8a4020a169c33193c54190d5f4cab7e099eb850", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "jwp/foxing--jwp", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/jwp/foxing/rhel+epel-10-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": true, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/jwp/foxing", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/jwp/foxing", "result_dir": "10208760-foxing", "built_packages": "", "id": 10208760, "mockchain_macros": { "copr_username": "jwp", "copr_projectname": "foxing", "vendor": "Fedora Project COPR (jwp/foxing)" } } ] } [2026-03-11 03:12:12,941][ INFO][PID:2783338] Sending fedora-messaging bus message in build.end [2026-03-11 03:12:12,970][ INFO][PID:2783338] Compressing /var/lib/copr/public_html/results/jwp/foxing/rhel+epel-10-ppc64le/10208760-foxing/builder-live.log by gzip [2026-03-11 03:12:12,972][ INFO][PID:2783338] Running command 'gzip /var/lib/copr/public_html/results/jwp/foxing/rhel+epel-10-ppc64le/10208760-foxing/builder-live.log' as PID 2825009 [2026-03-11 03:12:13,004][ INFO][PID:2783338] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/jwp/foxing/rhel+epel-10-ppc64le/10208760-foxing/builder-live.log) [2026-03-11 03:12:13,005][ INFO][PID:2783338] Compressing /var/lib/copr/public_html/results/jwp/foxing/rhel+epel-10-ppc64le/10208760-foxing/backend.log by gzip [2026-03-11 03:12:13,006][ INFO][PID:2783338] Running command 'gzip /var/lib/copr/public_html/results/jwp/foxing/rhel+epel-10-ppc64le/10208760-foxing/backend.log' as PID 2825010