[2025-09-18 18:40:44,965][ INFO][PID:3739051] Marking build as starting [2025-09-18 18:40:45,574][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:40:45,575][ INFO][PID:3739051] VM allocation process starts [2025-09-18 18:40:45,586][ INFO][PID:3739051] Trying to allocate VM: ResallocHost, ticket_id=5125980, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-09-18 18:40:50,588][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:40:51,610][ INFO][PID:3739051] Allocated host ResallocHost, ticket_id=5125980, hostname=2620:52:3:1:dead:beef:cafe:c288, name=copr_p09_01_prod_06820948_20250918_181157, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-09-18 18:40:51,611][ INFO][PID:3739051] Allocating ssh connection to builder [2025-09-18 18:40:51,611][ INFO][PID:3739051] Checking that builder machine is OK [2025-09-18 18:40:52,910][ INFO][PID:3739051] Running remote command: copr-builder-ready centos-stream-9-ppc64le [2025-09-18 18:40:53,391][ INFO][PID:3739051] Red Hat subscription not needed for centos-stream-9-ppc64le Builder is ready to be used [2025-09-18 18:40:53,391][ INFO][PID:3739051] Filling build.info file with builder info [2025-09-18 18:40:53,392][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:40:53,393][ INFO][PID:3739051] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@CoreOS", "project_name": "continuous", "project_dirname": "continuous", "submitter": "https://api.github.com/users/cgwalters", "ended_on": null, "started_on": 1758220853.393318, "submitted_on": null, "status": 3, "chroot": "centos-stream-9-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9571057-centos-stream-9-ppc64le", "build_id": 9571057, "package_name": "ostree", "package_version": "2025.6.7.gaac962c8-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@CoreOS/continuous/ostree", "git_hash": "0442890719de2b079af6c8e5834eb99da8768c08", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@CoreOS/continuous--https://api.github.com/users/cgwalters", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous/centos-stream-9-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/centos-stream-9-ppc64le/", "id": "copr_rhcontainerbot_bootc", "name": "Additional repo copr_rhcontainerbot_bootc" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@CoreOS/continuous", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous", "result_dir": "09571057-ostree", "built_packages": "", "id": 9571057, "mockchain_macros": { "copr_username": "@CoreOS", "copr_projectname": "continuous", "vendor": "Fedora Project COPR (@CoreOS/continuous)" } } ] } [2025-09-18 18:40:53,474][ INFO][PID:3739051] Sending fedora-messaging bus message in build.start [2025-09-18 18:40:54,341][ INFO][PID:3739051] Sending fedora-messaging bus message in chroot.start [2025-09-18 18:40:54,384][ INFO][PID:3739051] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9571057-centos-stream-9-ppc64le --chroot centos-stream-9-ppc64le --detached [2025-09-18 18:40:55,579][ INFO][PID:3739051] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c288' (ED25519) to the list of known hosts. [2025-09-18 18:40:55,580][ INFO][PID:3739051] Downloading the builder-live.log file, attempt 1 [2025-09-18 18:40:55,581][ INFO][PID:3739051] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c288 copr-rpmbuild-log [2025-09-18 18:41:00,591][ INFO][PID:3739051] Periodic builder liveness probe: alive [2025-09-18 18:41:00,592][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:41:05,593][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:41:10,594][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:41:15,595][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:41:20,596][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:41:25,597][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:41:30,598][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:41:35,600][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:41:40,601][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:41:45,601][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:41:50,602][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:41:55,604][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:42:00,605][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:42:05,606][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:42:10,607][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:42:15,609][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:42:20,611][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:42:25,612][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:42:30,613][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:42:35,615][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:42:40,616][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:42:45,619][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:42:50,619][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:42:55,139][ ERROR][PID:3739051] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-09-18 18:42:55,620][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:43:00,621][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:43:05,140][WARNING][PID:3739051] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-09-18 18:43:05,622][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:43:10,623][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:43:15,141][ INFO][PID:3739051] Downloading the builder-live.log file, attempt 2 [2025-09-18 18:43:15,142][ INFO][PID:3739051] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c288 copr-rpmbuild-log [2025-09-18 18:43:15,624][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:43:20,625][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:43:25,626][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:43:30,627][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:43:35,628][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:43:40,629][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:43:45,630][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:43:50,631][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:43:55,633][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:44:00,635][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:44:05,640][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:44:10,641][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:44:15,210][ ERROR][PID:3739051] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-09-18 18:44:15,641][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:44:20,642][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:44:25,211][WARNING][PID:3739051] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-09-18 18:44:25,644][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:44:30,645][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:44:35,211][ INFO][PID:3739051] Downloading the builder-live.log file, attempt 3 [2025-09-18 18:44:35,213][ INFO][PID:3739051] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c288 copr-rpmbuild-log [2025-09-18 18:44:35,646][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:44:40,647][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:44:45,648][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:44:50,649][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:44:55,650][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:45:00,651][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:45:05,652][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:45:10,652][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:45:15,653][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:45:20,655][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:45:25,655][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:45:30,656][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:45:35,281][ ERROR][PID:3739051] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-09-18 18:45:35,657][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:45:40,658][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:45:45,285][WARNING][PID:3739051] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-09-18 18:45:45,659][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:45:50,661][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:45:55,286][ INFO][PID:3739051] Downloading the builder-live.log file, attempt 4 [2025-09-18 18:45:55,287][ INFO][PID:3739051] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c288 copr-rpmbuild-log [2025-09-18 18:45:55,665][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:46:00,666][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:46:05,667][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:46:10,668][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:46:15,669][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:46:20,671][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:46:25,672][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:46:30,673][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:46:35,674][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:46:40,675][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:46:45,676][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:46:50,679][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:46:55,357][ ERROR][PID:3739051] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-09-18 18:46:55,681][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:47:00,682][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:47:05,365][ ERROR][PID:3739051] Giving up for unstable SSH, failures: 1758220985.1403472, 1758221065.211189, 1758221145.2852077, 1758221225.3650782 [2025-09-18 18:47:05,366][ ERROR][PID:3739051] Re-try request for task on 'ResallocHost, ticket_id=5125980, hostname=2620:52:3:1:dead:beef:cafe:c288, name=copr_p09_01_prod_06820948_20250918_181157, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-09-18 18:47:05,366][ INFO][PID:3739051] Releasing VM back to pool [2025-09-18 18:47:05,382][ INFO][PID:3739051] Retry #1 (on other host) [2025-09-18 18:47:05,382][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:47:05,383][ INFO][PID:3739051] VM allocation process starts [2025-09-18 18:47:05,403][ INFO][PID:3739051] Trying to allocate VM: ResallocHost, ticket_id=5126125, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-09-18 18:47:10,404][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:47:15,406][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:47:17,450][ INFO][PID:3739051] Allocated host ResallocHost, ticket_id=5126125, hostname=2620:52:3:1:dead:beef:cafe:c2a6, name=copr_p09_01_prod_06820938_20250918_181131, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-09-18 18:47:17,451][ INFO][PID:3739051] Allocating ssh connection to builder [2025-09-18 18:47:17,451][ INFO][PID:3739051] Checking that builder machine is OK [2025-09-18 18:48:17,520][ ERROR][PID:3739051] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:3:1:dead:beef:cafe:c2a6 port 22: Connection timed out [2025-09-18 18:48:27,521][ ERROR][PID:3739051] Re-try request for task on 'ResallocHost, ticket_id=5126125, hostname=2620:52:3:1:dead:beef:cafe:c2a6, name=copr_p09_01_prod_06820938_20250918_181131, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': Unable to finish after 1 SSH attempts [2025-09-18 18:48:27,522][ INFO][PID:3739051] Releasing VM back to pool [2025-09-18 18:48:27,533][ INFO][PID:3739051] Retry #2 (on other host) [2025-09-18 18:48:27,534][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:48:27,534][ INFO][PID:3739051] VM allocation process starts [2025-09-18 18:48:27,554][ INFO][PID:3739051] Trying to allocate VM: ResallocHost, ticket_id=5126157, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-09-18 18:48:32,555][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:48:37,556][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:48:42,557][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:48:47,558][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:48:52,561][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:48:57,562][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:49:02,563][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:49:05,619][ INFO][PID:3739051] Allocated host ResallocHost, ticket_id=5126157, hostname=2620:52:3:1:dead:beef:cafe:c29c, name=copr_p09_01_prod_06821314_20250918_184710, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-09-18 18:49:05,620][ INFO][PID:3739051] Allocating ssh connection to builder [2025-09-18 18:49:05,620][ INFO][PID:3739051] Checking that builder machine is OK [2025-09-18 18:49:06,342][ INFO][PID:3739051] Running remote command: copr-builder-ready centos-stream-9-ppc64le [2025-09-18 18:49:06,819][ INFO][PID:3739051] Red Hat subscription not needed for centos-stream-9-ppc64le Builder is ready to be used [2025-09-18 18:49:06,820][ INFO][PID:3739051] Filling build.info file with builder info [2025-09-18 18:49:06,823][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:49:06,824][ INFO][PID:3739051] Not re-notifying FE and msg buses for the new host. [2025-09-18 18:49:06,824][ INFO][PID:3739051] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9571057-centos-stream-9-ppc64le --chroot centos-stream-9-ppc64le --detached [2025-09-18 18:49:07,631][ INFO][PID:3739051] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c29c' (ED25519) to the list of known hosts. [2025-09-18 18:49:07,632][ INFO][PID:3739051] Downloading the builder-live.log file, attempt 1 [2025-09-18 18:49:07,634][ INFO][PID:3739051] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c29c copr-rpmbuild-log [2025-09-18 18:49:12,633][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:49:17,635][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:49:22,636][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:49:27,637][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:49:32,638][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:49:37,642][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:49:42,643][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:49:47,644][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:49:52,645][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:49:57,647][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:50:02,648][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:50:07,649][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:50:12,650][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:50:17,651][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:50:22,654][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:50:27,655][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:50:32,656][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:50:37,657][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:50:42,659][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:50:47,660][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:50:52,661][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:50:57,661][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:51:02,671][ INFO][PID:3739051] Periodic builder liveness probe: alive [2025-09-18 18:51:02,671][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:51:07,672][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:51:12,673][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:51:17,674][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:51:22,675][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:51:27,676][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:51:32,678][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:51:37,679][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:51:42,681][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:51:47,682][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:51:52,683][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:51:57,684][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:52:02,685][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:52:07,687][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:52:12,688][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:52:17,689][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:52:22,690][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:52:27,691][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:52:32,692][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:52:37,693][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:52:42,694][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:52:47,695][ INFO][PID:3739051] Checking for cancel request [2025-09-18 18:52:49,849][ INFO][PID:3739051] Downloading results from builder [2025-09-18 18:52:49,850][ INFO][PID:3739051] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c29c]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-ppc64le/09571057-ostree started [2025-09-18 18:52:49,851][ INFO][PID:3739051] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c29c]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-ppc64le/09571057-ostree/ &> /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-ppc64le/09571057-ostree/build-09571057.rsync.log [2025-09-18 18:52:50,510][ INFO][PID:3739051] rsyncing finished. [2025-09-18 18:52:50,511][ INFO][PID:3739051] Releasing VM back to pool [2025-09-18 18:52:50,526][ INFO][PID:3739051] Searching for 'success' file in resultdir [2025-09-18 18:52:50,527][ INFO][PID:3739051] Going to sign pkgs from source: 9571057-centos-stream-9-ppc64le in chroot: /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-ppc64le [2025-09-18 18:52:50,527][ INFO][PID:3739051] Calling '/bin/sign -u @CoreOS#continuous@copr.fedorahosted.org -p' (attempt #1) [2025-09-18 18:52:50,911][ INFO][PID:3739051] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-ppc64le/09571057-ostree/ostree-debugsource-2025.6.7.gaac962c8-1.el9.ppc64le.rpm' (attempt #1) [2025-09-18 18:52:51,377][ INFO][PID:3739051] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-ppc64le/09571057-ostree/ostree-debugsource-2025.6.7.gaac962c8-1.el9.ppc64le.rpm [2025-09-18 18:52:51,378][ INFO][PID:3739051] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-ppc64le/09571057-ostree/ostree-2025.6.7.gaac962c8-1.el9.src.rpm' (attempt #1) [2025-09-18 18:52:52,282][ INFO][PID:3739051] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-ppc64le/09571057-ostree/ostree-2025.6.7.gaac962c8-1.el9.src.rpm [2025-09-18 18:52:52,283][ INFO][PID:3739051] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-ppc64le/09571057-ostree/ostree-debuginfo-2025.6.7.gaac962c8-1.el9.ppc64le.rpm' (attempt #1) [2025-09-18 18:52:52,897][ INFO][PID:3739051] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-ppc64le/09571057-ostree/ostree-debuginfo-2025.6.7.gaac962c8-1.el9.ppc64le.rpm [2025-09-18 18:52:52,898][ INFO][PID:3739051] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-ppc64le/09571057-ostree/ostree-libs-debuginfo-2025.6.7.gaac962c8-1.el9.ppc64le.rpm' (attempt #1) [2025-09-18 18:52:53,597][ INFO][PID:3739051] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-ppc64le/09571057-ostree/ostree-libs-debuginfo-2025.6.7.gaac962c8-1.el9.ppc64le.rpm [2025-09-18 18:52:53,598][ INFO][PID:3739051] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-ppc64le/09571057-ostree/ostree-libs-2025.6.7.gaac962c8-1.el9.ppc64le.rpm' (attempt #1) [2025-09-18 18:52:54,447][ INFO][PID:3739051] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-ppc64le/09571057-ostree/ostree-libs-2025.6.7.gaac962c8-1.el9.ppc64le.rpm [2025-09-18 18:52:54,447][ INFO][PID:3739051] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-ppc64le/09571057-ostree/ostree-grub2-2025.6.7.gaac962c8-1.el9.ppc64le.rpm' (attempt #1) [2025-09-18 18:52:55,535][ INFO][PID:3739051] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-ppc64le/09571057-ostree/ostree-grub2-2025.6.7.gaac962c8-1.el9.ppc64le.rpm [2025-09-18 18:52:55,536][ INFO][PID:3739051] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-ppc64le/09571057-ostree/ostree-devel-2025.6.7.gaac962c8-1.el9.ppc64le.rpm' (attempt #1) [2025-09-18 18:52:56,424][ INFO][PID:3739051] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-ppc64le/09571057-ostree/ostree-devel-2025.6.7.gaac962c8-1.el9.ppc64le.rpm [2025-09-18 18:52:56,425][ INFO][PID:3739051] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-ppc64le/09571057-ostree/ostree-2025.6.7.gaac962c8-1.el9.ppc64le.rpm' (attempt #1) [2025-09-18 18:52:57,478][ INFO][PID:3739051] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-ppc64le/09571057-ostree/ostree-2025.6.7.gaac962c8-1.el9.ppc64le.rpm [2025-09-18 18:52:57,478][ INFO][PID:3739051] Sign done [2025-09-18 18:52:57,479][ INFO][PID:3739051] Incremental createrepo run, adding 09571057-ostree into https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous/centos-stream-9-ppc64le, (auto-create-repo=True) [2025-09-18 18:52:57,480][ INFO][PID:3739051] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-ppc64le --add 09571057-ostree --no-appstream-metadata' as PID 3797900 [2025-09-18 18:52:58,533][ INFO][PID:3739051] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-ppc64le --add 09571057-ostree --no-appstream-metadata) [2025-09-18 18:52:58,534][ INFO][PID:3739051] Getting build details [2025-09-18 18:52:58,534][ INFO][PID:3739051] Listing built binary packages in /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-ppc64le/09571057-ostree [2025-09-18 18:52:58,535][ INFO][PID:3739051] Built packages: ['ostree-grub2 2025.6.7.gaac962c8', 'ostree-libs 2025.6.7.gaac962c8', 'ostree-debugsource 2025.6.7.gaac962c8', 'ostree-debuginfo 2025.6.7.gaac962c8', 'ostree-devel 2025.6.7.gaac962c8', 'ostree-libs-debuginfo 2025.6.7.gaac962c8', 'ostree 2025.6.7.gaac962c8'] [2025-09-18 18:52:58,536][ INFO][PID:3739051] build details: {'built_packages': 'ostree-grub2 2025.6.7.gaac962c8\nostree-libs 2025.6.7.gaac962c8\nostree-debugsource 2025.6.7.gaac962c8\nostree-debuginfo 2025.6.7.gaac962c8\nostree-devel 2025.6.7.gaac962c8\nostree-libs-debuginfo 2025.6.7.gaac962c8\nostree 2025.6.7.gaac962c8'} [2025-09-18 18:52:58,536][ INFO][PID:3739051] Retrieving pubkey [2025-09-18 18:52:58,537][ INFO][PID:3739051] Calling '/bin/sign -u @CoreOS#continuous@copr.fedorahosted.org -p' (attempt #1) [2025-09-18 18:52:58,849][ INFO][PID:3739051] Added pubkey for user @CoreOS project continuous into: /var/lib/copr/public_html/results/@CoreOS/continuous/pubkey.gpg [2025-09-18 18:52:58,850][ INFO][PID:3739051] Finished build: id=9571057 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@CoreOS/continuous chroot=centos-stream-9-ppc64le [2025-09-18 18:52:58,852][ INFO][PID:3739051] Worker succeeded build, took 232.02791833877563 [2025-09-18 18:52:58,853][ INFO][PID:3739051] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@CoreOS", "project_name": "continuous", "project_dirname": "continuous", "submitter": "https://api.github.com/users/cgwalters", "ended_on": 1758221578.8521562, "started_on": 1758221346.8242378, "submitted_on": null, "status": 1, "chroot": "centos-stream-9-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9571057-centos-stream-9-ppc64le", "build_id": 9571057, "package_name": "ostree", "package_version": "2025.6.7.gaac962c8-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@CoreOS/continuous/ostree", "git_hash": "0442890719de2b079af6c8e5834eb99da8768c08", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@CoreOS/continuous--https://api.github.com/users/cgwalters", "results": { "packages": [ { "name": "ostree-grub2", "epoch": null, "version": "2025.6.7.gaac962c8", "release": "1.el9", "arch": "ppc64le" }, { "name": "ostree-libs", "epoch": null, "version": "2025.6.7.gaac962c8", "release": "1.el9", "arch": "ppc64le" }, { "name": "ostree-debugsource", "epoch": null, "version": "2025.6.7.gaac962c8", "release": "1.el9", "arch": "ppc64le" }, { "name": "ostree", "epoch": null, "version": "2025.6.7.gaac962c8", "release": "1.el9", "arch": "src" }, { "name": "ostree-debuginfo", "epoch": null, "version": "2025.6.7.gaac962c8", "release": "1.el9", "arch": "ppc64le" }, { "name": "ostree-devel", "epoch": null, "version": "2025.6.7.gaac962c8", "release": "1.el9", "arch": "ppc64le" }, { "name": "ostree-libs-debuginfo", "epoch": null, "version": "2025.6.7.gaac962c8", "release": "1.el9", "arch": "ppc64le" }, { "name": "ostree", "epoch": null, "version": "2025.6.7.gaac962c8", "release": "1.el9", "arch": "ppc64le" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous/centos-stream-9-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/centos-stream-9-ppc64le/", "id": "copr_rhcontainerbot_bootc", "name": "Additional repo copr_rhcontainerbot_bootc" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@CoreOS/continuous", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous", "result_dir": "09571057-ostree", "built_packages": "ostree-grub2 2025.6.7.gaac962c8\nostree-libs 2025.6.7.gaac962c8\nostree-debugsource 2025.6.7.gaac962c8\nostree-debuginfo 2025.6.7.gaac962c8\nostree-devel 2025.6.7.gaac962c8\nostree-libs-debuginfo 2025.6.7.gaac962c8\nostree 2025.6.7.gaac962c8", "id": 9571057, "mockchain_macros": { "copr_username": "@CoreOS", "copr_projectname": "continuous", "vendor": "Fedora Project COPR (@CoreOS/continuous)" } } ] } [2025-09-18 18:52:58,915][ INFO][PID:3739051] Sending fedora-messaging bus message in build.end [2025-09-18 18:52:58,958][ INFO][PID:3739051] Compressing /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-ppc64le/09571057-ostree/builder-live.log by gzip [2025-09-18 18:52:58,959][ INFO][PID:3739051] Running command 'gzip /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-ppc64le/09571057-ostree/builder-live.log' as PID 3797999 [2025-09-18 18:52:58,977][ INFO][PID:3739051] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-ppc64le/09571057-ostree/builder-live.log) [2025-09-18 18:52:58,978][ INFO][PID:3739051] Compressing /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-ppc64le/09571057-ostree/backend.log by gzip [2025-09-18 18:52:58,979][ INFO][PID:3739051] Running command 'gzip /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-ppc64le/09571057-ostree/backend.log' as PID 3798000