[2025-10-29 16:34:59,899][ INFO][PID:2724744] Marking build as starting [2025-10-29 16:35:00,923][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:35:00,924][ INFO][PID:2724744] VM allocation process starts [2025-10-29 16:35:00,940][ INFO][PID:2724744] Trying to allocate VM: ResallocHost, ticket_id=5915152, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-10-29 16:35:03,963][ INFO][PID:2724744] Allocated host ResallocHost, ticket_id=5915152, hostname=2620:52:3:1:dead:beef:cafe:c288, name=vmhost_p09_01_prod_07718386_20251029_162724, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-10-29 16:35:03,964][ INFO][PID:2724744] Allocating ssh connection to builder [2025-10-29 16:35:03,964][ INFO][PID:2724744] Checking that builder machine is OK [2025-10-29 16:35:04,859][ INFO][PID:2724744] Running remote command: copr-builder-ready epel-10-ppc64le [2025-10-29 16:35:05,276][ INFO][PID:2724744] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2025-10-29 16:35:05,276][ INFO][PID:2724744] Filling build.info file with builder info [2025-10-29 16:35:05,278][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:35:05,280][ INFO][PID:2724744] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "rapier1", "project_name": "hpnssh", "project_dirname": "hpnssh", "submitter": "rapier1", "ended_on": null, "started_on": 1761755705.2801757, "submitted_on": null, "status": 3, "chroot": "epel-10-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9744709-epel-10-ppc64le", "build_id": 9744709, "package_name": "hpnssh", "package_version": "10.2p1_hpn18.8.0-4", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rapier1/hpnssh/hpnssh", "git_hash": "b21ed6036db4244c9d7f050d03214d88028a59c8", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rapier1/hpnssh--rapier1", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rapier1/hpnssh/epel-10-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": true, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rapier1/hpnssh", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rapier1/hpnssh", "result_dir": "09744709-hpnssh", "built_packages": "", "id": 9744709, "mockchain_macros": { "copr_username": "rapier1", "copr_projectname": "hpnssh", "vendor": "Fedora Project COPR (rapier1/hpnssh)" } } ] } [2025-10-29 16:35:05,989][ INFO][PID:2724744] Sending fedora-messaging bus message in build.start [2025-10-29 16:35:06,814][ INFO][PID:2724744] Sending fedora-messaging bus message in chroot.start [2025-10-29 16:35:06,840][ INFO][PID:2724744] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9744709-epel-10-ppc64le --chroot epel-10-ppc64le --detached [2025-10-29 16:35:07,712][ INFO][PID:2724744] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c288' (ED25519) to the list of known hosts. [2025-10-29 16:35:07,713][ INFO][PID:2724744] Downloading the builder-live.log file, attempt 1 [2025-10-29 16:35:07,714][ INFO][PID:2724744] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c288 copr-rpmbuild-log [2025-10-29 16:35:12,721][ INFO][PID:2724744] Periodic builder liveness probe: alive [2025-10-29 16:35:12,722][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:35:17,723][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:35:22,724][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:35:27,725][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:35:32,726][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:35:37,727][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:35:42,728][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:35:47,730][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:35:52,730][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:35:57,731][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:36:02,733][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:36:07,734][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:36:12,735][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:36:17,737][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:36:22,738][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:36:27,739][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:36:32,740][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:36:37,741][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:36:42,744][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:36:47,745][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:36:52,746][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:36:57,747][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:37:02,748][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:37:07,139][ ERROR][PID:2724744] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-10-29 16:37:07,749][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:37:12,750][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:37:17,140][WARNING][PID:2724744] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-10-29 16:37:17,752][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:37:22,753][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:37:27,141][ INFO][PID:2724744] Downloading the builder-live.log file, attempt 2 [2025-10-29 16:37:27,143][ INFO][PID:2724744] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c288 copr-rpmbuild-log [2025-10-29 16:37:27,754][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:37:32,755][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:37:37,756][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:37:42,757][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:37:47,758][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:37:52,759][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:37:57,760][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:38:02,761][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:38:07,762][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:38:12,764][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:38:17,765][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:38:22,766][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:38:27,211][ ERROR][PID:2724744] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-10-29 16:38:27,767][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:38:32,768][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:38:37,212][WARNING][PID:2724744] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-10-29 16:38:37,769][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:38:42,770][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:38:47,213][ INFO][PID:2724744] Downloading the builder-live.log file, attempt 3 [2025-10-29 16:38:47,214][ INFO][PID:2724744] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c288 copr-rpmbuild-log [2025-10-29 16:38:47,772][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:38:52,774][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:38:57,775][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:39:02,776][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:39:07,777][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:39:12,778][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:39:17,779][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:39:22,780][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:39:27,781][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:39:32,782][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:39:37,783][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:39:42,785][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:39:47,285][ ERROR][PID:2724744] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-10-29 16:39:47,786][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:39:52,788][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:39:57,289][WARNING][PID:2724744] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-10-29 16:39:57,790][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:40:02,793][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:40:07,292][ INFO][PID:2724744] Downloading the builder-live.log file, attempt 4 [2025-10-29 16:40:07,293][ INFO][PID:2724744] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c288 copr-rpmbuild-log [2025-10-29 16:40:07,794][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:40:12,795][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:40:17,797][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:40:22,798][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:40:27,799][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:40:32,800][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:40:37,801][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:40:42,802][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:40:47,803][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:40:52,804][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:40:57,805][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:41:02,806][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:41:07,362][ ERROR][PID:2724744] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-10-29 16:41:07,807][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:41:12,808][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:41:17,365][ ERROR][PID:2724744] Giving up for unstable SSH, failures: 1761755837.140805, 1761755917.212304, 1761755997.2895942, 1761756077.3653457 [2025-10-29 16:41:17,366][ ERROR][PID:2724744] Re-try request for task on 'ResallocHost, ticket_id=5915152, hostname=2620:52:3:1:dead:beef:cafe:c288, name=vmhost_p09_01_prod_07718386_20251029_162724, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-10-29 16:41:17,367][ INFO][PID:2724744] Releasing VM back to pool [2025-10-29 16:41:17,402][ INFO][PID:2724744] Retry #1 (on other host) [2025-10-29 16:41:17,403][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:41:17,404][ INFO][PID:2724744] VM allocation process starts [2025-10-29 16:41:17,429][ INFO][PID:2724744] Trying to allocate VM: ResallocHost, ticket_id=5915298, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-10-29 16:41:22,430][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:41:27,432][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:41:32,433][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:41:37,435][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:41:42,438][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:41:47,439][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:41:52,440][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:41:57,444][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:42:02,445][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:42:07,446][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:42:12,447][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:42:17,449][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:42:22,450][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:42:27,453][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:42:32,454][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:42:37,457][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:42:42,462][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:42:47,463][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:42:52,465][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:42:57,466][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:43:02,467][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:43:07,469][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:43:12,470][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:43:17,472][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:43:22,473][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:43:27,474][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:43:32,475][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:43:37,477][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:43:42,478][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:43:47,479][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:43:52,480][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:43:57,481][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:44:02,481][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:44:07,482][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:44:12,483][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:44:17,484][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:44:22,486][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:44:27,486][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:44:32,490][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:44:37,495][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:44:42,496][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:44:47,497][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:44:52,498][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:44:57,499][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:45:02,500][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:45:07,501][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:45:12,501][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:45:17,502][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:45:22,503][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:45:27,504][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:45:32,505][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:45:37,506][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:45:42,507][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:45:47,509][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:45:52,509][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:45:57,510][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:46:02,512][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:46:07,513][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:46:12,514][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:46:17,515][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:46:22,516][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:46:27,517][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:46:32,518][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:46:35,624][ INFO][PID:2724744] Allocated host ResallocHost, ticket_id=5915298, hostname=140.211.168.243, name=copr_osuosl_p09_prod_07718725_20251029_164156, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-10-29 16:46:35,625][ INFO][PID:2724744] Allocating ssh connection to builder [2025-10-29 16:46:35,625][ INFO][PID:2724744] Checking that builder machine is OK [2025-10-29 16:46:36,933][ INFO][PID:2724744] Running remote command: copr-builder-ready epel-10-ppc64le [2025-10-29 16:46:37,931][ INFO][PID:2724744] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2025-10-29 16:46:37,931][ INFO][PID:2724744] Filling build.info file with builder info [2025-10-29 16:46:37,932][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:46:37,932][ INFO][PID:2724744] Not re-notifying FE and msg buses for the new host. [2025-10-29 16:46:37,933][ INFO][PID:2724744] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9744709-epel-10-ppc64le --chroot epel-10-ppc64le --detached [2025-10-29 16:46:39,583][ INFO][PID:2724744] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '140.211.168.243' (ED25519) to the list of known hosts. [2025-10-29 16:46:39,584][ INFO][PID:2724744] Downloading the builder-live.log file, attempt 1 [2025-10-29 16:46:39,586][ INFO][PID:2724744] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.243 copr-rpmbuild-log [2025-10-29 16:46:44,592][ INFO][PID:2724744] Periodic builder liveness probe: alive [2025-10-29 16:46:44,593][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:46:49,593][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:46:54,594][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:46:59,595][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:47:04,596][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:47:09,597][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:47:14,598][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:47:19,599][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:47:24,600][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:47:29,601][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:47:34,602][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:47:39,603][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:47:44,604][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:47:49,605][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:47:54,606][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:47:59,607][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:48:04,608][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:48:09,609][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:48:14,610][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:48:19,611][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:48:24,611][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:48:29,612][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:48:34,614][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:48:39,616][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:48:44,619][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:48:49,622][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:48:54,626][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:48:59,627][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:49:04,628][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:49:09,629][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:49:14,630][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:49:19,631][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:49:24,633][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:49:29,634][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:49:34,634][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:49:39,635][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:49:44,636][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:49:49,637][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:49:54,642][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:49:59,646][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:50:04,647][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:50:09,648][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:50:14,649][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:50:19,652][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:50:24,656][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:50:29,658][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:50:34,659][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:50:39,660][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:50:44,661][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:50:49,662][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:50:54,663][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:50:59,669][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:51:04,671][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:51:09,673][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:51:14,677][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:51:19,678][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:51:24,684][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:51:29,685][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:51:34,689][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:51:39,694][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:51:44,695][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:51:49,696][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:51:54,698][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:51:59,701][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:52:04,702][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:52:09,704][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:52:14,707][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:52:19,711][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:52:24,712][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:52:29,713][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:52:34,716][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:52:39,720][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:52:44,721][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:52:49,726][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:52:54,728][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:52:59,732][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:53:04,735][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:53:09,737][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:53:14,738][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:53:19,739][ INFO][PID:2724744] Checking for cancel request [2025-10-29 16:53:22,054][ INFO][PID:2724744] Downloading results from builder [2025-10-29 16:53:22,054][ INFO][PID:2724744] rsyncing of mockbuilder@140.211.168.243:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh started [2025-10-29 16:53:22,055][ INFO][PID:2724744] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@140.211.168.243:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh/ &> /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh/build-09744709.rsync.log [2025-10-29 16:53:24,543][ INFO][PID:2724744] rsyncing finished. [2025-10-29 16:53:24,543][ INFO][PID:2724744] Releasing VM back to pool [2025-10-29 16:53:24,554][ INFO][PID:2724744] Searching for 'success' file in resultdir [2025-10-29 16:53:24,554][ INFO][PID:2724744] Going to sign pkgs from source: 9744709-epel-10-ppc64le in chroot: /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le [2025-10-29 16:53:24,555][ INFO][PID:2724744] Calling '/bin/sign -u rapier1#hpnssh@copr.fedorahosted.org -p' (attempt #1) [2025-10-29 16:53:24,902][ INFO][PID:2724744] Calling '/bin/sign -4 -h sha256 -u rapier1#hpnssh@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh/hpnssh-debugsource-10.2p1_hpn18.8.0-4.el10.ppc64le.rpm' (attempt #1) [2025-10-29 16:53:25,862][ INFO][PID:2724744] signed rpm: /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh/hpnssh-debugsource-10.2p1_hpn18.8.0-4.el10.ppc64le.rpm [2025-10-29 16:53:25,863][ INFO][PID:2724744] Calling '/bin/sign -4 -h sha256 -u rapier1#hpnssh@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh/hpnssh-askpass-debuginfo-10.2p1_hpn18.8.0-4.el10.ppc64le.rpm' (attempt #1) [2025-10-29 16:53:26,811][ INFO][PID:2724744] signed rpm: /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh/hpnssh-askpass-debuginfo-10.2p1_hpn18.8.0-4.el10.ppc64le.rpm [2025-10-29 16:53:26,812][ INFO][PID:2724744] Calling '/bin/sign -4 -h sha256 -u rapier1#hpnssh@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh/hpnssh-10.2p1_hpn18.8.0-4.el10.src.rpm' (attempt #1) [2025-10-29 16:53:27,640][ INFO][PID:2724744] signed rpm: /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh/hpnssh-10.2p1_hpn18.8.0-4.el10.src.rpm [2025-10-29 16:53:27,641][ INFO][PID:2724744] Calling '/bin/sign -4 -h sha256 -u rapier1#hpnssh@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh/hpnssh-clients-10.2p1_hpn18.8.0-4.el10.ppc64le.rpm' (attempt #1) [2025-10-29 16:53:28,297][ INFO][PID:2724744] signed rpm: /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh/hpnssh-clients-10.2p1_hpn18.8.0-4.el10.ppc64le.rpm [2025-10-29 16:53:28,297][ INFO][PID:2724744] Calling '/bin/sign -4 -h sha256 -u rapier1#hpnssh@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh/hpnssh-server-debuginfo-10.2p1_hpn18.8.0-4.el10.ppc64le.rpm' (attempt #1) [2025-10-29 16:53:28,961][ INFO][PID:2724744] signed rpm: /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh/hpnssh-server-debuginfo-10.2p1_hpn18.8.0-4.el10.ppc64le.rpm [2025-10-29 16:53:28,962][ INFO][PID:2724744] Calling '/bin/sign -4 -h sha256 -u rapier1#hpnssh@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh/hpnssh-debuginfo-10.2p1_hpn18.8.0-4.el10.ppc64le.rpm' (attempt #1) [2025-10-29 16:53:29,803][ INFO][PID:2724744] signed rpm: /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh/hpnssh-debuginfo-10.2p1_hpn18.8.0-4.el10.ppc64le.rpm [2025-10-29 16:53:29,804][ INFO][PID:2724744] Calling '/bin/sign -4 -h sha256 -u rapier1#hpnssh@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh/hpnssh-keycat-10.2p1_hpn18.8.0-4.el10.ppc64le.rpm' (attempt #1) [2025-10-29 16:53:30,463][ INFO][PID:2724744] signed rpm: /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh/hpnssh-keycat-10.2p1_hpn18.8.0-4.el10.ppc64le.rpm [2025-10-29 16:53:30,463][ INFO][PID:2724744] Calling '/bin/sign -4 -h sha256 -u rapier1#hpnssh@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh/hpnssh-keycat-debuginfo-10.2p1_hpn18.8.0-4.el10.ppc64le.rpm' (attempt #1) [2025-10-29 16:53:31,258][ INFO][PID:2724744] signed rpm: /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh/hpnssh-keycat-debuginfo-10.2p1_hpn18.8.0-4.el10.ppc64le.rpm [2025-10-29 16:53:31,259][ INFO][PID:2724744] Calling '/bin/sign -4 -h sha256 -u rapier1#hpnssh@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh/hpnssh-10.2p1_hpn18.8.0-4.el10.ppc64le.rpm' (attempt #1) [2025-10-29 16:53:32,069][ INFO][PID:2724744] signed rpm: /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh/hpnssh-10.2p1_hpn18.8.0-4.el10.ppc64le.rpm [2025-10-29 16:53:32,070][ INFO][PID:2724744] Calling '/bin/sign -4 -h sha256 -u rapier1#hpnssh@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh/hpnssh-askpass-10.2p1_hpn18.8.0-4.el10.ppc64le.rpm' (attempt #1) [2025-10-29 16:53:32,694][ INFO][PID:2724744] signed rpm: /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh/hpnssh-askpass-10.2p1_hpn18.8.0-4.el10.ppc64le.rpm [2025-10-29 16:53:32,694][ INFO][PID:2724744] Calling '/bin/sign -4 -h sha256 -u rapier1#hpnssh@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh/hpnssh-server-10.2p1_hpn18.8.0-4.el10.ppc64le.rpm' (attempt #1) [2025-10-29 16:53:33,316][ INFO][PID:2724744] signed rpm: /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh/hpnssh-server-10.2p1_hpn18.8.0-4.el10.ppc64le.rpm [2025-10-29 16:53:33,317][ INFO][PID:2724744] Calling '/bin/sign -4 -h sha256 -u rapier1#hpnssh@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh/hpnssh-clients-debuginfo-10.2p1_hpn18.8.0-4.el10.ppc64le.rpm' (attempt #1) [2025-10-29 16:53:34,326][ INFO][PID:2724744] signed rpm: /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh/hpnssh-clients-debuginfo-10.2p1_hpn18.8.0-4.el10.ppc64le.rpm [2025-10-29 16:53:34,327][ INFO][PID:2724744] Sign done [2025-10-29 16:53:34,328][ INFO][PID:2724744] Incremental createrepo run, adding 09744709-hpnssh into https://download.copr.fedorainfracloud.org/results/rapier1/hpnssh/epel-10-ppc64le, (auto-create-repo=True) [2025-10-29 16:53:34,329][ INFO][PID:2724744] Running command 'copr-repo --batched /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le --add 09744709-hpnssh --no-appstream-metadata' as PID 2834730 [2025-10-29 16:53:35,267][ INFO][PID:2724744] Finished after 0 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le --add 09744709-hpnssh --no-appstream-metadata) [2025-10-29 16:53:35,268][ INFO][PID:2724744] Getting build details [2025-10-29 16:53:35,269][ INFO][PID:2724744] Listing built binary packages in /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh [2025-10-29 16:53:35,269][ INFO][PID:2724744] Built packages: ['hpnssh-askpass-debuginfo 10.2p1_hpn18.8.0', 'hpnssh-debuginfo 10.2p1_hpn18.8.0', 'hpnssh-server 10.2p1_hpn18.8.0', 'hpnssh-keycat-debuginfo 10.2p1_hpn18.8.0', 'hpnssh-clients 10.2p1_hpn18.8.0', 'hpnssh-server-debuginfo 10.2p1_hpn18.8.0', 'hpnssh 10.2p1_hpn18.8.0', 'hpnssh-debugsource 10.2p1_hpn18.8.0', 'hpnssh-keycat 10.2p1_hpn18.8.0', 'hpnssh-askpass 10.2p1_hpn18.8.0', 'hpnssh-clients-debuginfo 10.2p1_hpn18.8.0'] [2025-10-29 16:53:35,270][ INFO][PID:2724744] build details: {'built_packages': 'hpnssh-askpass-debuginfo 10.2p1_hpn18.8.0\nhpnssh-debuginfo 10.2p1_hpn18.8.0\nhpnssh-server 10.2p1_hpn18.8.0\nhpnssh-keycat-debuginfo 10.2p1_hpn18.8.0\nhpnssh-clients 10.2p1_hpn18.8.0\nhpnssh-server-debuginfo 10.2p1_hpn18.8.0\nhpnssh 10.2p1_hpn18.8.0\nhpnssh-debugsource 10.2p1_hpn18.8.0\nhpnssh-keycat 10.2p1_hpn18.8.0\nhpnssh-askpass 10.2p1_hpn18.8.0\nhpnssh-clients-debuginfo 10.2p1_hpn18.8.0'} [2025-10-29 16:53:35,270][ INFO][PID:2724744] Retrieving pubkey [2025-10-29 16:53:35,271][ INFO][PID:2724744] Calling '/bin/sign -u rapier1#hpnssh@copr.fedorahosted.org -p' (attempt #1) [2025-10-29 16:53:35,627][ INFO][PID:2724744] Added pubkey for user rapier1 project hpnssh into: /var/lib/copr/public_html/results/rapier1/hpnssh/pubkey.gpg [2025-10-29 16:53:35,630][ INFO][PID:2724744] Finished build: id=9744709 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/rapier1/hpnssh chroot=epel-10-ppc64le [2025-10-29 16:53:35,633][ INFO][PID:2724744] Worker succeeded build, took 417.700763463974 [2025-10-29 16:53:35,635][ INFO][PID:2724744] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "rapier1", "project_name": "hpnssh", "project_dirname": "hpnssh", "submitter": "rapier1", "ended_on": 1761756815.6335957, "started_on": 1761756397.9328322, "submitted_on": null, "status": 1, "chroot": "epel-10-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9744709-epel-10-ppc64le", "build_id": 9744709, "package_name": "hpnssh", "package_version": "10.2p1_hpn18.8.0-4", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rapier1/hpnssh/hpnssh", "git_hash": "b21ed6036db4244c9d7f050d03214d88028a59c8", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rapier1/hpnssh--rapier1", "results": { "packages": [ { "name": "hpnssh-askpass-debuginfo", "epoch": null, "version": "10.2p1_hpn18.8.0", "release": "4.el10", "arch": "ppc64le" }, { "name": "hpnssh-debuginfo", "epoch": null, "version": "10.2p1_hpn18.8.0", "release": "4.el10", "arch": "ppc64le" }, { "name": "hpnssh-server", "epoch": null, "version": "10.2p1_hpn18.8.0", "release": "4.el10", "arch": "ppc64le" }, { "name": "hpnssh-keycat-debuginfo", "epoch": null, "version": "10.2p1_hpn18.8.0", "release": "4.el10", "arch": "ppc64le" }, { "name": "hpnssh-clients", "epoch": null, "version": "10.2p1_hpn18.8.0", "release": "4.el10", "arch": "ppc64le" }, { "name": "hpnssh-server-debuginfo", "epoch": null, "version": "10.2p1_hpn18.8.0", "release": "4.el10", "arch": "ppc64le" }, { "name": "hpnssh", "epoch": null, "version": "10.2p1_hpn18.8.0", "release": "4.el10", "arch": "ppc64le" }, { "name": "hpnssh-debugsource", "epoch": null, "version": "10.2p1_hpn18.8.0", "release": "4.el10", "arch": "ppc64le" }, { "name": "hpnssh-keycat", "epoch": null, "version": "10.2p1_hpn18.8.0", "release": "4.el10", "arch": "ppc64le" }, { "name": "hpnssh", "epoch": null, "version": "10.2p1_hpn18.8.0", "release": "4.el10", "arch": "src" }, { "name": "hpnssh-askpass", "epoch": null, "version": "10.2p1_hpn18.8.0", "release": "4.el10", "arch": "ppc64le" }, { "name": "hpnssh-clients-debuginfo", "epoch": null, "version": "10.2p1_hpn18.8.0", "release": "4.el10", "arch": "ppc64le" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rapier1/hpnssh/epel-10-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": true, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rapier1/hpnssh", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rapier1/hpnssh", "result_dir": "09744709-hpnssh", "built_packages": "hpnssh-askpass-debuginfo 10.2p1_hpn18.8.0\nhpnssh-debuginfo 10.2p1_hpn18.8.0\nhpnssh-server 10.2p1_hpn18.8.0\nhpnssh-keycat-debuginfo 10.2p1_hpn18.8.0\nhpnssh-clients 10.2p1_hpn18.8.0\nhpnssh-server-debuginfo 10.2p1_hpn18.8.0\nhpnssh 10.2p1_hpn18.8.0\nhpnssh-debugsource 10.2p1_hpn18.8.0\nhpnssh-keycat 10.2p1_hpn18.8.0\nhpnssh-askpass 10.2p1_hpn18.8.0\nhpnssh-clients-debuginfo 10.2p1_hpn18.8.0", "id": 9744709, "mockchain_macros": { "copr_username": "rapier1", "copr_projectname": "hpnssh", "vendor": "Fedora Project COPR (rapier1/hpnssh)" } } ] } [2025-10-29 16:53:35,815][ INFO][PID:2724744] Sending fedora-messaging bus message in build.end [2025-10-29 16:53:35,841][ INFO][PID:2724744] Compressing /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh/builder-live.log by gzip [2025-10-29 16:53:35,842][ INFO][PID:2724744] Running command 'gzip /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh/builder-live.log' as PID 2834983 [2025-10-29 16:53:35,857][ INFO][PID:2724744] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh/builder-live.log) [2025-10-29 16:53:35,858][ INFO][PID:2724744] Compressing /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh/backend.log by gzip [2025-10-29 16:53:35,859][ INFO][PID:2724744] Running command 'gzip /var/lib/copr/public_html/results/rapier1/hpnssh/epel-10-ppc64le/09744709-hpnssh/backend.log' as PID 2834984