[2025-12-11 12:44:02,864][ INFO][PID:2233886] Marking build as starting [2025-12-11 12:44:02,923][ INFO][PID:2233886] Checking that /var/lib/copr/public_html/results/@yggdrasil/latest/fedora-41-ppc64le/repodata/repomd.xml exists [2025-12-11 12:44:02,924][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:44:02,925][ INFO][PID:2233886] VM allocation process starts [2025-12-11 12:44:02,947][ INFO][PID:2233886] Trying to allocate VM: ResallocHost, ticket_id=283016, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-11 12:44:07,949][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:44:08,981][ INFO][PID:2233886] Allocated host ResallocHost, ticket_id=283016, hostname=2620:52:6:1161:dead:beef:cafe:c149, name=vmhost_p09_03_prod_00345569_20251211_123648, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-11 12:44:08,982][ INFO][PID:2233886] Allocating ssh connection to builder [2025-12-11 12:44:08,983][ INFO][PID:2233886] Checking that builder machine is OK [2025-12-11 12:44:10,308][ INFO][PID:2233886] Running remote command: copr-builder-ready fedora-41-ppc64le [2025-12-11 12:44:11,135][ INFO][PID:2233886] Red Hat subscription not needed for fedora-41-ppc64le Builder is ready to be used [2025-12-11 12:44:11,136][ INFO][PID:2233886] Filling build.info file with builder info [2025-12-11 12:44:11,137][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:44:11,138][ INFO][PID:2233886] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@yggdrasil", "project_name": "latest", "project_dirname": "latest", "submitter": "https://api.github.com/users/Peto-RH", "ended_on": null, "started_on": 1765457051.137927, "submitted_on": null, "status": 3, "chroot": "fedora-41-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9899161-fedora-41-ppc64le", "build_id": 9899161, "package_name": "insights-client", "package_version": "3.9.1-0", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@yggdrasil/latest/insights-client", "git_hash": "1fb5a4bace100dd6766db882239ccee3531c1ce5", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@yggdrasil/latest--https://api.github.com/users/Peto-RH", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@yggdrasil/latest/fedora-41-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@yggdrasil/latest", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@yggdrasil/latest", "result_dir": "09899161-insights-client", "built_packages": "", "id": 9899161, "mockchain_macros": { "copr_username": "@yggdrasil", "copr_projectname": "latest", "vendor": "Fedora Project COPR (@yggdrasil/latest)" } } ] } [2025-12-11 12:44:11,180][ INFO][PID:2233886] Sending fedora-messaging bus message in build.start [2025-12-11 12:44:12,198][ INFO][PID:2233886] Sending fedora-messaging bus message in chroot.start [2025-12-11 12:44:12,246][ INFO][PID:2233886] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9899161-fedora-41-ppc64le --chroot fedora-41-ppc64le --detached [2025-12-11 12:44:13,394][ INFO][PID:2233886] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c149' (ED25519) to the list of known hosts. [2025-12-11 12:44:13,395][ INFO][PID:2233886] Downloading the builder-live.log file, attempt 1 [2025-12-11 12:44:13,396][ INFO][PID:2233886] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c149 copr-rpmbuild-log [2025-12-11 12:44:18,401][ INFO][PID:2233886] Periodic builder liveness probe: alive [2025-12-11 12:44:18,402][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:44:23,403][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:44:28,404][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:44:33,405][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:44:38,406][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:44:43,407][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:44:48,408][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:44:53,409][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:44:58,410][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:45:03,411][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:45:08,412][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:45:13,413][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:45:18,414][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:45:23,415][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:45:28,417][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:45:33,418][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:45:38,419][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:45:43,420][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:45:48,421][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:45:53,422][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:45:58,423][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:46:03,423][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:46:08,424][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:46:13,425][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:46:18,427][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:46:23,427][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:46:28,428][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:46:33,430][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:46:38,431][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:46:43,432][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:46:48,433][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:46:53,434][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:46:58,435][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:47:03,436][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:47:08,437][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:47:13,438][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:47:18,439][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:47:23,440][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:47:28,441][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:47:33,441][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:47:38,442][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:47:43,368][ ERROR][PID:2233886] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-11 12:47:43,443][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:47:48,444][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:47:53,369][WARNING][PID:2233886] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-11 12:47:53,445][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:47:58,446][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:48:03,370][ INFO][PID:2233886] Downloading the builder-live.log file, attempt 2 [2025-12-11 12:48:03,371][ INFO][PID:2233886] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c149 copr-rpmbuild-log [2025-12-11 12:48:03,447][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:48:08,448][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:48:13,449][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:48:18,450][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:48:23,451][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:48:28,452][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:48:33,453][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:48:38,454][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:48:43,454][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:48:48,455][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:48:53,456][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:48:58,457][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:49:03,458][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:49:08,459][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:49:13,460][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:49:18,461][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:49:23,462][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:49:28,463][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:49:33,464][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:49:38,465][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:49:43,466][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:49:48,467][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:49:53,470][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:49:58,471][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:50:03,472][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:50:08,473][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:50:13,474][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:50:18,475][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:50:23,477][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:50:28,478][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:50:33,479][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:50:38,480][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:50:43,481][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:50:48,482][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:50:53,483][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:50:58,484][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:51:03,485][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:51:04,370][ ERROR][PID:2233886] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-11 12:51:08,486][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:51:13,487][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:51:14,380][WARNING][PID:2233886] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-11 12:51:18,488][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:51:23,489][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:51:24,381][ INFO][PID:2233886] Downloading the builder-live.log file, attempt 3 [2025-12-11 12:51:24,382][ INFO][PID:2233886] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c149 copr-rpmbuild-log [2025-12-11 12:51:24,572][ ERROR][PID:2233886] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-11 12:51:28,490][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:51:33,491][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:51:34,575][WARNING][PID:2233886] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-11 12:51:38,492][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:51:43,493][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:51:44,576][ INFO][PID:2233886] Downloading the builder-live.log file, attempt 4 [2025-12-11 12:51:44,577][ INFO][PID:2233886] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c149 copr-rpmbuild-log [2025-12-11 12:51:48,494][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:51:53,495][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:51:58,496][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:52:03,497][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:52:08,498][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:52:13,499][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:52:18,501][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:52:23,502][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:52:28,503][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:52:33,504][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:52:38,505][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:52:43,506][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:52:44,646][ ERROR][PID:2233886] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-11 12:52:48,507][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:52:53,508][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:52:54,647][ ERROR][PID:2233886] Giving up for unstable SSH, failures: 1765457273.3694563, 1765457474.380818, 1765457494.5756505, 1765457574.6471398 [2025-12-11 12:52:54,648][ ERROR][PID:2233886] Re-try request for task on 'ResallocHost, ticket_id=283016, hostname=2620:52:6:1161:dead:beef:cafe:c149, name=vmhost_p09_03_prod_00345569_20251211_123648, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-12-11 12:52:54,649][ INFO][PID:2233886] Releasing VM back to pool [2025-12-11 12:52:54,660][ INFO][PID:2233886] Retry #1 (on other host) [2025-12-11 12:52:54,661][ INFO][PID:2233886] Checking that /var/lib/copr/public_html/results/@yggdrasil/latest/fedora-41-ppc64le/repodata/repomd.xml exists [2025-12-11 12:52:54,661][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:52:54,662][ INFO][PID:2233886] VM allocation process starts [2025-12-11 12:52:54,674][ INFO][PID:2233886] Trying to allocate VM: ResallocHost, ticket_id=283096, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-11 12:52:59,676][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:53:00,692][ INFO][PID:2233886] Allocated host ResallocHost, ticket_id=283096, hostname=2620:52:6:1161:dead:beef:cafe:c10d, name=vmhost_p09_02_prod_00345609_20251211_123823, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-11 12:53:00,692][ INFO][PID:2233886] Allocating ssh connection to builder [2025-12-11 12:53:00,693][ INFO][PID:2233886] Checking that builder machine is OK [2025-12-11 12:53:01,595][ INFO][PID:2233886] Running remote command: copr-builder-ready fedora-41-ppc64le [2025-12-11 12:53:02,056][ INFO][PID:2233886] Red Hat subscription not needed for fedora-41-ppc64le Builder is ready to be used [2025-12-11 12:53:02,057][ INFO][PID:2233886] Filling build.info file with builder info [2025-12-11 12:53:02,060][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:53:02,060][ INFO][PID:2233886] Not re-notifying FE and msg buses for the new host. [2025-12-11 12:53:02,061][ INFO][PID:2233886] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9899161-fedora-41-ppc64le --chroot fedora-41-ppc64le --detached [2025-12-11 12:53:02,916][ INFO][PID:2233886] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c10d' (ED25519) to the list of known hosts. [2025-12-11 12:53:02,917][ INFO][PID:2233886] Downloading the builder-live.log file, attempt 1 [2025-12-11 12:53:02,918][ INFO][PID:2233886] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c10d copr-rpmbuild-log [2025-12-11 12:53:07,917][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:53:12,918][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:53:17,920][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:53:22,921][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:53:27,922][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:53:32,924][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:53:37,926][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:53:42,927][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:53:47,928][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:53:52,929][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:53:57,930][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:54:02,931][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:54:07,932][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:54:12,933][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:54:17,934][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:54:22,943][ INFO][PID:2233886] Periodic builder liveness probe: alive [2025-12-11 12:54:22,944][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:54:27,944][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:54:32,946][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:54:37,947][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:54:42,949][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:54:47,954][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:54:52,955][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:54:57,956][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:55:02,957][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:55:07,958][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:55:12,959][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:55:17,960][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:55:22,962][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:55:27,963][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:55:32,964][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:55:37,965][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:55:42,966][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:55:47,967][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:55:52,968][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:55:57,969][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:56:02,970][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:56:07,971][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:56:12,972][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:56:18,247][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:56:23,248][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:56:28,250][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:56:33,251][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:56:38,252][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:56:43,253][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:56:48,254][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:56:53,255][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:56:58,256][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:57:03,258][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:57:08,259][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:57:13,260][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:57:18,261][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:57:23,263][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:57:28,264][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:57:33,265][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:57:38,267][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:57:43,270][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:57:48,271][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:57:53,272][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:57:58,273][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:58:03,274][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:58:08,275][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:58:13,276][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:58:18,277][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:58:23,279][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:58:28,280][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:58:33,282][ INFO][PID:2233886] Checking for cancel request [2025-12-11 12:58:34,695][ INFO][PID:2233886] Downloading results from builder [2025-12-11 12:58:34,696][ INFO][PID:2233886] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c10d]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@yggdrasil/latest/fedora-41-ppc64le/09899161-insights-client started [2025-12-11 12:58:34,697][ INFO][PID:2233886] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c10d]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@yggdrasil/latest/fedora-41-ppc64le/09899161-insights-client/ &> /var/lib/copr/public_html/results/@yggdrasil/latest/fedora-41-ppc64le/09899161-insights-client/build-09899161.rsync.log [2025-12-11 12:58:35,258][ INFO][PID:2233886] rsyncing finished. [2025-12-11 12:58:35,259][ INFO][PID:2233886] Releasing VM back to pool [2025-12-11 12:58:35,271][ INFO][PID:2233886] Searching for 'success' file in resultdir [2025-12-11 12:58:35,272][ INFO][PID:2233886] Going to sign pkgs from source: 9899161-fedora-41-ppc64le in chroot: /var/lib/copr/public_html/results/@yggdrasil/latest/fedora-41-ppc64le [2025-12-11 12:58:35,273][ INFO][PID:2233886] Calling '/bin/sign -u @yggdrasil#latest@copr.fedorahosted.org -p' (attempt #1) [2025-12-11 12:58:35,538][ INFO][PID:2233886] Calling '/bin/sign -4 -h sha256 -u @yggdrasil#latest@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@yggdrasil/latest/fedora-41-ppc64le/09899161-insights-client/insights-client-ros-3.9.1-0.fc41.noarch.rpm' (attempt #1) [2025-12-11 12:58:36,266][ INFO][PID:2233886] signed rpm: /var/lib/copr/public_html/results/@yggdrasil/latest/fedora-41-ppc64le/09899161-insights-client/insights-client-ros-3.9.1-0.fc41.noarch.rpm [2025-12-11 12:58:36,267][ INFO][PID:2233886] Calling '/bin/sign -4 -h sha256 -u @yggdrasil#latest@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@yggdrasil/latest/fedora-41-ppc64le/09899161-insights-client/insights-client-3.9.1-0.fc41.src.rpm' (attempt #1) [2025-12-11 12:58:37,001][ INFO][PID:2233886] signed rpm: /var/lib/copr/public_html/results/@yggdrasil/latest/fedora-41-ppc64le/09899161-insights-client/insights-client-3.9.1-0.fc41.src.rpm [2025-12-11 12:58:37,001][ INFO][PID:2233886] Calling '/bin/sign -4 -h sha256 -u @yggdrasil#latest@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@yggdrasil/latest/fedora-41-ppc64le/09899161-insights-client/insights-client-3.9.1-0.fc41.noarch.rpm' (attempt #1) [2025-12-11 12:58:37,733][ INFO][PID:2233886] signed rpm: /var/lib/copr/public_html/results/@yggdrasil/latest/fedora-41-ppc64le/09899161-insights-client/insights-client-3.9.1-0.fc41.noarch.rpm [2025-12-11 12:58:37,734][ INFO][PID:2233886] Sign done [2025-12-11 12:58:37,735][ INFO][PID:2233886] Incremental createrepo run, adding 09899161-insights-client into https://download.copr.fedorainfracloud.org/results/@yggdrasil/latest/fedora-41-ppc64le, (auto-create-repo=True) [2025-12-11 12:58:37,736][ INFO][PID:2233886] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@yggdrasil/latest/fedora-41-ppc64le --add 09899161-insights-client --no-appstream-metadata' as PID 2306128 [2025-12-11 12:58:38,387][ INFO][PID:2233886] Finished after 0 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@yggdrasil/latest/fedora-41-ppc64le --add 09899161-insights-client --no-appstream-metadata) [2025-12-11 12:58:38,388][ INFO][PID:2233886] Getting build details [2025-12-11 12:58:38,389][ INFO][PID:2233886] Listing built binary packages in /var/lib/copr/public_html/results/@yggdrasil/latest/fedora-41-ppc64le/09899161-insights-client [2025-12-11 12:58:38,389][ INFO][PID:2233886] Built packages: ['insights-client-ros 3.9.1', 'insights-client 3.9.1'] [2025-12-11 12:58:38,390][ INFO][PID:2233886] build details: {'built_packages': 'insights-client-ros 3.9.1\ninsights-client 3.9.1'} [2025-12-11 12:58:38,390][ INFO][PID:2233886] Retrieving pubkey [2025-12-11 12:58:38,390][ INFO][PID:2233886] Calling '/bin/sign -u @yggdrasil#latest@copr.fedorahosted.org -p' (attempt #1) [2025-12-11 12:58:38,655][ INFO][PID:2233886] Added pubkey for user @yggdrasil project latest into: /var/lib/copr/public_html/results/@yggdrasil/latest/pubkey.gpg [2025-12-11 12:58:38,656][ INFO][PID:2233886] Finished build: id=9899161 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@yggdrasil/latest chroot=fedora-41-ppc64le [2025-12-11 12:58:38,657][ INFO][PID:2233886] Worker succeeded build, took 336.5969395637512 [2025-12-11 12:58:38,658][ INFO][PID:2233886] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@yggdrasil", "project_name": "latest", "project_dirname": "latest", "submitter": "https://api.github.com/users/Peto-RH", "ended_on": 1765457918.6576827, "started_on": 1765457582.060743, "submitted_on": null, "status": 1, "chroot": "fedora-41-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9899161-fedora-41-ppc64le", "build_id": 9899161, "package_name": "insights-client", "package_version": "3.9.1-0", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@yggdrasil/latest/insights-client", "git_hash": "1fb5a4bace100dd6766db882239ccee3531c1ce5", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@yggdrasil/latest--https://api.github.com/users/Peto-RH", "results": { "packages": [ { "name": "insights-client-ros", "epoch": null, "version": "3.9.1", "release": "0.fc41", "arch": "noarch" }, { "name": "insights-client", "epoch": null, "version": "3.9.1", "release": "0.fc41", "arch": "noarch" }, { "name": "insights-client", "epoch": null, "version": "3.9.1", "release": "0.fc41", "arch": "src" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@yggdrasil/latest/fedora-41-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@yggdrasil/latest", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@yggdrasil/latest", "result_dir": "09899161-insights-client", "built_packages": "insights-client-ros 3.9.1\ninsights-client 3.9.1", "id": 9899161, "mockchain_macros": { "copr_username": "@yggdrasil", "copr_projectname": "latest", "vendor": "Fedora Project COPR (@yggdrasil/latest)" } } ] } [2025-12-11 12:58:38,706][ INFO][PID:2233886] Sending fedora-messaging bus message in build.end [2025-12-11 12:58:38,735][ INFO][PID:2233886] Compressing /var/lib/copr/public_html/results/@yggdrasil/latest/fedora-41-ppc64le/09899161-insights-client/builder-live.log by gzip [2025-12-11 12:58:38,736][ INFO][PID:2233886] Running command 'gzip /var/lib/copr/public_html/results/@yggdrasil/latest/fedora-41-ppc64le/09899161-insights-client/builder-live.log' as PID 2306217 [2025-12-11 12:58:38,741][ INFO][PID:2233886] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@yggdrasil/latest/fedora-41-ppc64le/09899161-insights-client/builder-live.log) [2025-12-11 12:58:38,742][ INFO][PID:2233886] Compressing /var/lib/copr/public_html/results/@yggdrasil/latest/fedora-41-ppc64le/09899161-insights-client/backend.log by gzip [2025-12-11 12:58:38,743][ INFO][PID:2233886] Running command 'gzip /var/lib/copr/public_html/results/@yggdrasil/latest/fedora-41-ppc64le/09899161-insights-client/backend.log' as PID 2306218