[2026-02-10 15:32:54,151][ INFO][PID:1258405] Marking build as starting [2026-02-10 15:32:54,246][ INFO][PID:1258405] Checking that https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests/fedora-42-ppc64le//repodata/repomd.xml exists [2026-02-10 15:32:54,723][ INFO][PID:1258405] Checking that https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le//repodata/repomd.xml exists [2026-02-10 15:32:55,239][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:32:55,241][ INFO][PID:1258405] VM allocation process starts [2026-02-10 15:32:55,281][ INFO][PID:1258405] Trying to allocate VM: ResallocHost, ticket_id=1258520, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-02-10 15:33:00,285][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:33:05,289][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:33:07,383][ INFO][PID:1258405] Allocated host ResallocHost, ticket_id=1258520, hostname=2620:52:6:1161:dead:beef:cafe:c193, name=vmhost_p09_04_prod_02137863_20260210_152128, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-02-10 15:33:07,384][ INFO][PID:1258405] Allocating ssh connection to builder [2026-02-10 15:33:07,385][ INFO][PID:1258405] Checking that builder machine is OK [2026-02-10 15:33:08,420][ INFO][PID:1258405] Running remote command: copr-builder-ready fedora-42-ppc64le [2026-02-10 15:33:08,977][ INFO][PID:1258405] Red Hat subscription not needed for fedora-42-ppc64le Builder is ready to be used [2026-02-10 15:33:08,978][ INFO][PID:1258405] Filling build.info file with builder info [2026-02-10 15:33:08,979][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:33:08,982][ INFO][PID:1258405] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@copr", "project_name": "copr-pull-requests", "project_dirname": "copr-pull-requests:pr:4135", "submitter": null, "ended_on": null, "started_on": 1770737588.9826472, "submitted_on": null, "status": 3, "chroot": "fedora-42-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10113231-fedora-42-ppc64le", "build_id": 10113231, "package_name": "copr-rpmbuild", "package_version": "1.6.1.post1-1.git.123.a37624b", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@copr/copr-pull-requests:pr:4135/copr-rpmbuild", "git_hash": "ceb5bad15ad5356a58a75778fd33e1e4c4955bfa", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@copr/copr-pull-requests--e8526841-a343-4054-a58c-25263abad9ce", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests/fedora-42-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/", "id": "copr_coprdir", "name": "Coprdir repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-dev/fedora-42-ppc64le/", "id": "copr_copr_copr_dev", "name": "Additional repo copr_copr_copr_dev" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4135", "result_dir": "10113231-copr-rpmbuild", "built_packages": "", "id": 10113231, "mockchain_macros": { "copr_username": "@copr", "copr_projectname": "copr-pull-requests", "vendor": "Fedora Project COPR (@copr/copr-pull-requests)" } } ] } [2026-02-10 15:33:09,134][ INFO][PID:1258405] Sending fedora-messaging bus message in build.start [2026-02-10 15:33:09,945][ INFO][PID:1258405] Sending fedora-messaging bus message in chroot.start [2026-02-10 15:33:09,979][ INFO][PID:1258405] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10113231-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached [2026-02-10 15:33:11,032][ INFO][PID:1258405] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c193' (ED25519) to the list of known hosts. [2026-02-10 15:33:11,033][ INFO][PID:1258405] Downloading the builder-live.log file, attempt 1 [2026-02-10 15:33:11,035][ INFO][PID:1258405] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c193 copr-rpmbuild-log [2026-02-10 15:33:16,042][ INFO][PID:1258405] Periodic builder liveness probe: alive [2026-02-10 15:33:16,042][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:33:21,044][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:33:26,046][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:33:31,048][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:33:36,088][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:33:41,090][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:33:46,096][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:33:51,098][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:33:56,099][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:34:01,100][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:34:06,103][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:34:11,108][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:34:16,120][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:34:21,126][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:34:26,132][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:34:31,136][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:34:36,139][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:34:41,141][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:34:46,199][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:34:51,204][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:34:56,209][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:35:01,211][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:35:06,215][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:35:11,230][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:35:16,233][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:35:21,239][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:35:26,324][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:35:31,328][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:35:36,329][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:35:41,331][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:35:46,334][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:35:51,336][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:35:56,340][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:36:01,344][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:36:06,347][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:36:11,351][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:36:16,355][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:36:21,363][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:36:26,365][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:36:31,369][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:36:36,371][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:36:41,374][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:36:46,377][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:36:51,381][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:36:56,387][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:37:01,388][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:37:06,394][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:37:11,396][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:37:16,398][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:37:21,401][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:37:26,403][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:37:31,407][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:37:36,410][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:37:41,415][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:37:46,417][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:37:51,419][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:37:56,422][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:38:01,426][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:38:06,430][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:38:11,434][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:38:16,438][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:38:21,442][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:38:26,446][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:38:31,448][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:38:36,451][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:38:41,453][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:38:46,454][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:38:51,464][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:38:56,495][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:39:01,499][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:39:06,502][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:39:11,504][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:39:16,506][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:39:21,510][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:39:26,513][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:39:31,515][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:39:36,519][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:39:41,521][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:39:46,523][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:39:51,525][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:39:56,531][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:40:00,462][ INFO][PID:1258405] Downloading results from builder [2026-02-10 15:40:00,463][ INFO][PID:1258405] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c193]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild started [2026-02-10 15:40:00,465][ INFO][PID:1258405] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c193]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild/ &> /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild/build-10113231.rsync.log [2026-02-10 15:41:00,567][ INFO][PID:1258405] rsyncing finished. [2026-02-10 15:41:00,590][ ERROR][PID:1258405] Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-02-10 15:41:00,593][ ERROR][PID:1258405] SSH connection lost on #1 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-02-10 15:41:10,595][ INFO][PID:1258405] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c193]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild started [2026-02-10 15:41:10,600][ INFO][PID:1258405] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c193]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild/ &> /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild/build-10113231.rsync.log [2026-02-10 15:42:10,727][ INFO][PID:1258405] rsyncing finished. [2026-02-10 15:42:10,729][ ERROR][PID:1258405] Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-02-10 15:42:10,730][ ERROR][PID:1258405] SSH connection lost on #2 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-02-10 15:42:20,731][ INFO][PID:1258405] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c193]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild started [2026-02-10 15:42:20,733][ INFO][PID:1258405] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c193]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild/ &> /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild/build-10113231.rsync.log [2026-02-10 15:43:20,821][ INFO][PID:1258405] rsyncing finished. [2026-02-10 15:43:20,822][ ERROR][PID:1258405] Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-02-10 15:43:20,822][ ERROR][PID:1258405] SSH connection lost on #3 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-02-10 15:43:30,823][ ERROR][PID:1258405] Re-try request for task on 'ResallocHost, ticket_id=1258520, hostname=2620:52:6:1161:dead:beef:cafe:c193, name=vmhost_p09_04_prod_02137863_20260210_152128, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 3 SSH attempts [2026-02-10 15:43:30,827][ INFO][PID:1258405] Releasing VM back to pool [2026-02-10 15:43:30,845][ INFO][PID:1258405] Retry #1 (on other host) [2026-02-10 15:43:30,847][ INFO][PID:1258405] Checking that https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests/fedora-42-ppc64le//repodata/repomd.xml exists [2026-02-10 15:43:31,179][ INFO][PID:1258405] Checking that https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le//repodata/repomd.xml exists [2026-02-10 15:43:31,418][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:43:31,419][ INFO][PID:1258405] VM allocation process starts [2026-02-10 15:43:31,515][ INFO][PID:1258405] Trying to allocate VM: ResallocHost, ticket_id=1258696, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-02-10 15:43:36,516][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:43:37,563][ INFO][PID:1258405] Allocated host ResallocHost, ticket_id=1258696, hostname=2620:52:6:1161:dead:beef:cafe:c192, name=vmhost_p09_04_prod_02138901_20260210_153244, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-02-10 15:43:37,565][ INFO][PID:1258405] Allocating ssh connection to builder [2026-02-10 15:43:37,566][ INFO][PID:1258405] Checking that builder machine is OK [2026-02-10 15:43:38,629][ INFO][PID:1258405] Running remote command: copr-builder-ready fedora-42-ppc64le [2026-02-10 15:43:39,258][ INFO][PID:1258405] Red Hat subscription not needed for fedora-42-ppc64le Builder is ready to be used [2026-02-10 15:43:39,259][ INFO][PID:1258405] Filling build.info file with builder info [2026-02-10 15:43:39,273][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:43:39,276][ INFO][PID:1258405] Not re-notifying FE and msg buses for the new host. [2026-02-10 15:43:39,276][ INFO][PID:1258405] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10113231-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached [2026-02-10 15:43:40,329][ INFO][PID:1258405] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c192' (ED25519) to the list of known hosts. [2026-02-10 15:43:40,330][ INFO][PID:1258405] Downloading the builder-live.log file, attempt 1 [2026-02-10 15:43:40,332][ INFO][PID:1258405] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c192 copr-rpmbuild-log [2026-02-10 15:43:45,343][ INFO][PID:1258405] Periodic builder liveness probe: alive [2026-02-10 15:43:45,344][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:43:50,346][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:43:55,348][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:44:00,351][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:44:05,356][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:44:10,360][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:44:15,362][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:44:20,364][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:44:25,366][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:44:30,370][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:44:35,372][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:44:40,373][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:44:45,374][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:44:50,377][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:44:55,383][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:45:00,384][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:45:05,388][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:45:10,391][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:45:15,393][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:45:20,399][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:45:25,400][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:45:30,404][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:45:35,406][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:45:40,409][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:45:45,418][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:45:50,426][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:45:55,427][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:46:00,430][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:46:05,435][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:46:10,440][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:46:15,442][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:46:20,444][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:46:25,447][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:46:30,450][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:46:35,458][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:46:40,464][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:46:45,468][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:46:50,470][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:46:55,472][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:47:00,478][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:47:05,480][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:47:10,483][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:47:15,486][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:47:20,488][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:47:25,491][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:47:30,493][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:47:35,496][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:47:40,503][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:47:45,506][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:47:50,508][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:47:55,512][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:48:00,515][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:48:05,517][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:48:10,519][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:48:15,521][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:48:20,526][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:48:25,528][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:48:30,530][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:48:35,533][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:48:40,535][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:48:45,536][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:48:50,537][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:48:55,540][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:49:00,544][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:49:05,546][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:49:10,548][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:49:15,553][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:49:20,555][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:49:25,556][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:49:30,557][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:49:35,561][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:49:40,569][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:49:45,570][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:49:50,572][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:49:55,574][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:50:00,578][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:50:05,579][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:50:10,581][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:50:15,582][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:50:20,588][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:50:25,592][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:50:30,593][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:50:35,595][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:50:40,597][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:50:45,600][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:50:50,602][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:50:55,603][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:51:00,604][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:51:05,605][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:51:10,607][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:51:15,613][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:51:20,621][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:51:25,623][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:51:30,627][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:51:35,631][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:51:40,637][ INFO][PID:1258405] Checking for cancel request [2026-02-10 15:51:44,321][ INFO][PID:1258405] Downloading results from builder [2026-02-10 15:51:44,322][ INFO][PID:1258405] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c192]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild started [2026-02-10 15:51:44,326][ INFO][PID:1258405] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c192]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild/ &> /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild/build-10113231.rsync.log [2026-02-10 15:51:45,089][ INFO][PID:1258405] rsyncing finished. [2026-02-10 15:51:45,091][ INFO][PID:1258405] Releasing VM back to pool [2026-02-10 15:51:45,105][ INFO][PID:1258405] Searching for 'success' file in resultdir [2026-02-10 15:51:45,106][ INFO][PID:1258405] Going to sign pkgs from source: 10113231-fedora-42-ppc64le in chroot: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le [2026-02-10 15:51:45,106][ INFO][PID:1258405] Calling '/bin/sign -u @copr#copr-pull-requests@copr.fedorahosted.org -p' (attempt #1) [2026-02-10 15:51:45,290][ INFO][PID:1258405] Calling '/bin/sign -4 -h sha256 -u @copr#copr-pull-requests@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild/copr-builder-1.6.1.post1-1.git.123.a37624b.fc42.ppc64le.rpm' (attempt #1) [2026-02-10 15:51:45,754][ INFO][PID:1258405] signed rpm: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild/copr-builder-1.6.1.post1-1.git.123.a37624b.fc42.ppc64le.rpm [2026-02-10 15:51:45,756][ INFO][PID:1258405] Calling '/bin/sign -4 -h sha256 -u @copr#copr-pull-requests@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild/copr-rpmbuild-1.6.1.post1-1.git.123.a37624b.fc42.src.rpm' (attempt #1) [2026-02-10 15:51:46,394][ INFO][PID:1258405] signed rpm: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild/copr-rpmbuild-1.6.1.post1-1.git.123.a37624b.fc42.src.rpm [2026-02-10 15:51:46,396][ INFO][PID:1258405] Calling '/bin/sign -4 -h sha256 -u @copr#copr-pull-requests@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild/copr-rpmbuild-1.6.1.post1-1.git.123.a37624b.fc42.ppc64le.rpm' (attempt #1) [2026-02-10 15:51:46,947][ INFO][PID:1258405] signed rpm: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild/copr-rpmbuild-1.6.1.post1-1.git.123.a37624b.fc42.ppc64le.rpm [2026-02-10 15:51:46,948][ INFO][PID:1258405] Sign done [2026-02-10 15:51:46,950][ INFO][PID:1258405] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild/copr-builder-1.6.1.post1-1.git.123.a37624b.fc42.ppc64le.rpm [2026-02-10 15:51:47,395][ INFO][PID:1258405] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild/copr-rpmbuild-1.6.1.post1-1.git.123.a37624b.fc42.src.rpm [2026-02-10 15:51:47,396][ INFO][PID:1258405] [1/3] Uploaded to Pulp: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild/copr-builder-1.6.1.post1-1.git.123.a37624b.fc42.ppc64le.rpm [2026-02-10 15:51:48,564][ INFO][PID:1258405] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild/copr-rpmbuild-1.6.1.post1-1.git.123.a37624b.fc42.ppc64le.rpm [2026-02-10 15:51:48,571][ INFO][PID:1258405] [2/3] Uploaded to Pulp: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild/copr-rpmbuild-1.6.1.post1-1.git.123.a37624b.fc42.src.rpm [2026-02-10 15:51:49,165][ INFO][PID:1258405] [3/3] Uploaded to Pulp: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild/copr-rpmbuild-1.6.1.post1-1.git.123.a37624b.fc42.ppc64le.rpm [2026-02-10 15:51:49,195][ INFO][PID:1258405] Pulp: get_repository: /api/v3/repositories/rpm/rpm/?name=%40copr%2Fcopr-pull-requests%3Apr%3A4135%2Ffedora-42-ppc64le&offset=0&limit=1 [2026-02-10 15:51:49,695][ INFO][PID:1258405] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019c4840-7493-7b76-b0bf-1fff229cfdda/ [2026-02-10 15:51:49,697][ INFO][PID:1258405] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019c4840-7493-7b76-b0bf-1fff229cfdda/ [2026-02-10 15:51:54,953][ INFO][PID:1258405] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019c4840-7493-7b76-b0bf-1fff229cfdda/ [2026-02-10 15:51:54,954][ INFO][PID:1258405] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019c4840-7493-7b76-b0bf-1fff229cfdda/ [2026-02-10 15:51:55,117][ INFO][PID:1258405] Successfully modified Pulp repository content /api/pulp/public-copr/api/v3/repositories/rpm/rpm/019bf68a-57fb-7bca-821f-ecb45251ccc8/ [2026-02-10 15:51:55,118][ INFO][PID:1258405] Pulp: publishing /api/v3/publications/rpm/rpm/ /api/pulp/public-copr/api/v3/repositories/rpm/rpm/019bf68a-57fb-7bca-821f-ecb45251ccc8/ [2026-02-10 15:51:55,624][ INFO][PID:1258405] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019c4840-8b01-7c8c-ab87-d919976364d0/ [2026-02-10 15:51:55,628][ INFO][PID:1258405] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019c4840-8b01-7c8c-ab87-d919976364d0/ [2026-02-10 15:52:00,780][ INFO][PID:1258405] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019c4840-8b01-7c8c-ab87-d919976364d0/ [2026-02-10 15:52:00,781][ INFO][PID:1258405] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019c4840-8b01-7c8c-ab87-d919976364d0/ [2026-02-10 15:52:01,253][ INFO][PID:1258405] Successfully created Pulp publication of repository /api/pulp/public-copr/api/v3/repositories/rpm/rpm/019bf68a-57fb-7bca-821f-ecb45251ccc8/ [2026-02-10 15:52:01,255][ INFO][PID:1258405] Pulp: add_content: /api/pulp/public-copr/api/v3/repositories/rpm/rpm/019bf68a-57fb-7bca-821f-ecb45251ccc8/ (['/api/pulp/public-copr/api/v3/content/rpm/packages/019c4840-6b7d-716c-8b7b-8938db4fe33b/', '/api/pulp/public-copr/api/v3/content/rpm/packages/019c4840-6e17-7af0-97f5-599664cb831f/', '/api/pulp/public-copr/api/v3/content/rpm/packages/019c4840-7264-7af3-b222-8404e2b11023/']) [2026-02-10 15:52:01,256][ INFO][PID:1258405] Getting build details [2026-02-10 15:52:01,257][ INFO][PID:1258405] Listing built binary packages in /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild [2026-02-10 15:52:01,257][ INFO][PID:1258405] Built packages: ['copr-builder 1.6.1.post1', 'copr-rpmbuild 1.6.1.post1'] [2026-02-10 15:52:01,258][ INFO][PID:1258405] build details: {'built_packages': 'copr-builder 1.6.1.post1\ncopr-rpmbuild 1.6.1.post1'} [2026-02-10 15:52:01,258][ INFO][PID:1258405] Retrieving pubkey [2026-02-10 15:52:01,259][ INFO][PID:1258405] Calling '/bin/sign -u @copr#copr-pull-requests@copr.fedorahosted.org -p' (attempt #1) [2026-02-10 15:52:01,533][ INFO][PID:1258405] Added pubkey for user @copr project copr-pull-requests into: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/pubkey.gpg [2026-02-10 15:52:01,535][ INFO][PID:1258405] Removing /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild/copr-builder-1.6.1.post1-1.git.123.a37624b.fc42.ppc64le.rpm, it is stored in Pulp [2026-02-10 15:52:01,539][ INFO][PID:1258405] Removing /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild/copr-rpmbuild-1.6.1.post1-1.git.123.a37624b.fc42.src.rpm, it is stored in Pulp [2026-02-10 15:52:01,539][ INFO][PID:1258405] Removing /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild/copr-rpmbuild-1.6.1.post1-1.git.123.a37624b.fc42.ppc64le.rpm, it is stored in Pulp [2026-02-10 15:52:01,540][ INFO][PID:1258405] Finished build: id=10113231 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135 chroot=fedora-42-ppc64le [2026-02-10 15:52:01,542][ INFO][PID:1258405] Worker succeeded build, took 502.26602435112 [2026-02-10 15:52:01,542][ INFO][PID:1258405] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@copr", "project_name": "copr-pull-requests", "project_dirname": "copr-pull-requests:pr:4135", "submitter": null, "ended_on": 1770738721.5422037, "started_on": 1770738219.2761793, "submitted_on": null, "status": 1, "chroot": "fedora-42-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10113231-fedora-42-ppc64le", "build_id": 10113231, "package_name": "copr-rpmbuild", "package_version": "1.6.1.post1-1.git.123.a37624b", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@copr/copr-pull-requests:pr:4135/copr-rpmbuild", "git_hash": "ceb5bad15ad5356a58a75778fd33e1e4c4955bfa", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@copr/copr-pull-requests--e8526841-a343-4054-a58c-25263abad9ce", "results": { "packages": [ { "name": "copr-rpmbuild", "epoch": null, "version": "1.6.1.post1", "release": "1.git.123.a37624b.fc42", "arch": "src" }, { "name": "copr-builder", "epoch": null, "version": "1.6.1.post1", "release": "1.git.123.a37624b.fc42", "arch": "ppc64le" }, { "name": "copr-rpmbuild", "epoch": null, "version": "1.6.1.post1", "release": "1.git.123.a37624b.fc42", "arch": "ppc64le" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests/fedora-42-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/", "id": "copr_coprdir", "name": "Coprdir repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-dev/fedora-42-ppc64le/", "id": "copr_copr_copr_dev", "name": "Additional repo copr_copr_copr_dev" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4135", "result_dir": "10113231-copr-rpmbuild", "built_packages": "copr-builder 1.6.1.post1\ncopr-rpmbuild 1.6.1.post1", "id": 10113231, "mockchain_macros": { "copr_username": "@copr", "copr_projectname": "copr-pull-requests", "vendor": "Fedora Project COPR (@copr/copr-pull-requests)" } } ] } [2026-02-10 15:52:01,601][ INFO][PID:1258405] Sending fedora-messaging bus message in build.end [2026-02-10 15:52:01,631][ INFO][PID:1258405] Compressing /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild/builder-live.log by gzip [2026-02-10 15:52:01,633][ INFO][PID:1258405] Running command 'gzip /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild/builder-live.log' as PID 1423881 [2026-02-10 15:52:01,657][ INFO][PID:1258405] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild/builder-live.log) [2026-02-10 15:52:01,658][ INFO][PID:1258405] Compressing /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild/backend.log by gzip [2026-02-10 15:52:01,659][ INFO][PID:1258405] Running command 'gzip /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4135/fedora-42-ppc64le/10113231-copr-rpmbuild/backend.log' as PID 1423885