[2025-10-17 04:40:37,383][  INFO][PID:3544919] Marking build as starting
[2025-10-17 04:40:37,641][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:40:37,641][  INFO][PID:3544919] VM allocation process starts
[2025-10-17 04:40:37,656][  INFO][PID:3544919] Trying to allocate VM: ResallocHost, ticket_id=5702372, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-10-17 04:40:42,657][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:40:43,686][  INFO][PID:3544919] Allocated host ResallocHost, ticket_id=5702372, hostname=2620:52:3:1:dead:beef:cafe:c28b, name=copr_p09_01_prod_07435350_20251017_025710, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-10-17 04:40:43,687][  INFO][PID:3544919] Allocating ssh connection to builder
[2025-10-17 04:40:43,687][  INFO][PID:3544919] Checking that builder machine is OK
[2025-10-17 04:40:44,988][  INFO][PID:3544919] Running remote command: copr-builder-ready centos-stream+epel-next-9-ppc64le
[2025-10-17 04:40:45,604][  INFO][PID:3544919] Red Hat subscription not needed for centos-stream+epel-next-9-ppc64le
Builder is ready to be used

[2025-10-17 04:40:45,604][  INFO][PID:3544919] Filling build.info file with builder info
[2025-10-17 04:40:45,605][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:40:45,606][  INFO][PID:3544919] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@meta",
            "project_name": "drgn",
            "project_dirname": "drgn",
            "submitter": "packit",
            "ended_on": null,
            "started_on": 1760676045.6059663,
            "submitted_on": null,
            "status": 3,
            "chroot": "centos-stream+epel-next-9-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9697201-centos-stream+epel-next-9-ppc64le",
            "build_id": 9697201,
            "package_name": "python-drgn",
            "package_version": "0.0.32+293.g32a9e346-1.20251017044011507064.pr554.293.g32a9e346",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@meta/drgn/python-drgn",
            "git_hash": "2e8a59eff750cfca383fa4558492e9aa95cc88ae",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@meta/drgn--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@meta/drgn/centos-stream+epel-next-9-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://kojihub.stream.centos.org/kojifiles/repos/c9s-build/latest/ppc64le/",
                    "id": "https_kojihub_stream_centos_org_kojifiles_repos_c9s_build_latest_ppc64le",
                    "name": "Additional repo https_kojihub_stream_centos_org_kojifiles_repos_c9s_build_latest_ppc64le"
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@meta/drgn",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@meta/drgn",
            "result_dir": "09697201-python-drgn",
            "built_packages": "",
            "id": 9697201,
            "mockchain_macros": {
                "copr_username": "@meta",
                "copr_projectname": "drgn",
                "vendor": "Fedora Project COPR (@meta/drgn)"
            }
        }
    ]
}
[2025-10-17 04:40:45,656][  INFO][PID:3544919] Sending fedora-messaging bus message in build.start
[2025-10-17 04:40:46,691][  INFO][PID:3544919] Sending fedora-messaging bus message in chroot.start
[2025-10-17 04:40:46,749][  INFO][PID:3544919] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9697201-centos-stream+epel-next-9-ppc64le --chroot centos-stream+epel-next-9-ppc64le --detached
[2025-10-17 04:40:49,274][  INFO][PID:3544919] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c28b' (ED25519) to the list of known hosts.


[2025-10-17 04:40:49,275][  INFO][PID:3544919] Downloading the builder-live.log file, attempt 1
[2025-10-17 04:40:49,276][  INFO][PID:3544919] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c28b copr-rpmbuild-log
[2025-10-17 04:40:54,282][  INFO][PID:3544919] Periodic builder liveness probe: alive
[2025-10-17 04:40:54,283][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:40:59,284][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:41:04,285][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:41:09,286][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:41:14,287][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:41:19,288][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:41:24,289][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:41:29,290][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:41:34,291][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:41:39,292][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:41:44,293][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:41:49,294][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:41:54,295][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:41:59,296][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:42:04,298][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:42:09,299][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:42:14,300][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:42:19,301][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:42:24,302][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:42:29,303][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:42:34,304][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:42:39,305][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:42:44,306][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:42:49,307][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:42:54,308][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:42:59,309][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:43:04,310][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:43:09,311][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:43:14,312][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:43:19,313][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:43:24,314][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:43:29,315][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:43:34,317][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:43:39,318][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:43:44,319][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:43:49,320][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:43:54,321][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:43:59,322][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:44:04,323][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:44:09,325][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:44:14,326][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:44:16,139][ ERROR][PID:3544919] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-10-17 04:44:19,327][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:44:24,329][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:44:26,139][WARNING][PID:3544919] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-10-17 04:44:29,330][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:44:34,332][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:44:36,140][  INFO][PID:3544919] Downloading the builder-live.log file, attempt 2
[2025-10-17 04:44:36,142][  INFO][PID:3544919] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c28b copr-rpmbuild-log
[2025-10-17 04:44:39,333][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:44:44,334][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:44:49,335][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:44:54,336][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:44:59,337][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:45:04,338][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:45:09,339][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:45:14,340][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:45:19,341][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:45:24,342][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:45:29,343][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:45:34,345][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:45:36,210][ ERROR][PID:3544919] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-10-17 04:45:39,346][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:45:44,347][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:45:46,214][WARNING][PID:3544919] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-10-17 04:45:49,348][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:45:54,349][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:45:56,215][  INFO][PID:3544919] Downloading the builder-live.log file, attempt 3
[2025-10-17 04:45:56,217][  INFO][PID:3544919] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c28b copr-rpmbuild-log
[2025-10-17 04:45:59,350][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:46:04,351][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:46:09,352][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:46:14,353][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:46:19,355][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:46:24,356][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:46:29,357][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:46:34,358][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:46:39,359][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:46:44,360][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:46:49,360][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:46:54,361][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:46:56,277][ ERROR][PID:3544919] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-10-17 04:46:59,363][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:47:04,363][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:47:06,336][WARNING][PID:3544919] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-10-17 04:47:09,364][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:47:14,365][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:47:16,337][  INFO][PID:3544919] Downloading the builder-live.log file, attempt 4
[2025-10-17 04:47:16,338][  INFO][PID:3544919] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c28b copr-rpmbuild-log
[2025-10-17 04:47:19,366][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:47:24,367][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:47:29,493][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:47:34,494][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:47:39,495][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:47:44,496][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:47:49,497][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:47:54,498][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:47:59,500][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:48:04,501][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:48:09,502][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:48:14,503][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:48:16,405][ ERROR][PID:3544919] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-10-17 04:48:19,504][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:48:24,505][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:48:26,448][ ERROR][PID:3544919] Giving up for unstable SSH, failures: 1760676266.1398816, 1760676346.214522, 1760676426.3363912, 1760676506.4484787
[2025-10-17 04:48:26,449][ ERROR][PID:3544919] Re-try request for task on 'ResallocHost, ticket_id=5702372, hostname=2620:52:3:1:dead:beef:cafe:c28b, name=copr_p09_01_prod_07435350_20251017_025710, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-10-17 04:48:26,450][  INFO][PID:3544919] Releasing VM back to pool
[2025-10-17 04:48:26,458][  INFO][PID:3544919] Retry #1 (on other host)
[2025-10-17 04:48:26,459][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:48:26,459][  INFO][PID:3544919] VM allocation process starts
[2025-10-17 04:48:26,522][  INFO][PID:3544919] Trying to allocate VM: ResallocHost, ticket_id=5702411, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-10-17 04:48:29,553][  INFO][PID:3544919] Allocated host ResallocHost, ticket_id=5702411, hostname=2620:52:3:1:dead:beef:cafe:c299, name=copr_p09_01_prod_07435453_20251017_031421, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-10-17 04:48:29,554][  INFO][PID:3544919] Allocating ssh connection to builder
[2025-10-17 04:48:29,554][  INFO][PID:3544919] Checking that builder machine is OK
[2025-10-17 04:48:30,392][  INFO][PID:3544919] Running remote command: copr-builder-ready centos-stream+epel-next-9-ppc64le
[2025-10-17 04:48:30,926][  INFO][PID:3544919] Red Hat subscription not needed for centos-stream+epel-next-9-ppc64le
Builder is ready to be used

[2025-10-17 04:48:30,927][  INFO][PID:3544919] Filling build.info file with builder info
[2025-10-17 04:48:30,947][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:48:30,948][  INFO][PID:3544919] Not re-notifying FE and msg buses for the new host.
[2025-10-17 04:48:30,948][  INFO][PID:3544919] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9697201-centos-stream+epel-next-9-ppc64le --chroot centos-stream+epel-next-9-ppc64le --detached
[2025-10-17 04:48:32,197][  INFO][PID:3544919] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c299' (ED25519) to the list of known hosts.


[2025-10-17 04:48:32,198][  INFO][PID:3544919] Downloading the builder-live.log file, attempt 1
[2025-10-17 04:48:32,199][  INFO][PID:3544919] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c299 copr-rpmbuild-log
[2025-10-17 04:48:37,198][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:48:42,199][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:48:47,200][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:48:52,201][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:48:57,202][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:49:02,205][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:49:07,210][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:49:12,211][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:49:17,212][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:49:22,214][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:49:27,215][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:49:32,215][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:49:37,216][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:49:42,217][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:49:47,218][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:49:52,219][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:49:57,220][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:50:02,221][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:50:07,222][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:50:12,223][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:50:17,224][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:50:22,311][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:50:27,312][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:50:32,139][ ERROR][PID:3544919] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-10-17 04:50:32,314][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:50:37,315][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:50:42,139][WARNING][PID:3544919] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-10-17 04:50:42,316][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:50:47,317][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:50:52,140][  INFO][PID:3544919] Downloading the builder-live.log file, attempt 2
[2025-10-17 04:50:52,141][  INFO][PID:3544919] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c299 copr-rpmbuild-log
[2025-10-17 04:50:52,318][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:50:57,326][  INFO][PID:3544919] Periodic builder liveness probe: alive
[2025-10-17 04:50:57,327][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:51:02,328][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:51:07,329][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:51:12,330][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:51:17,331][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:51:22,332][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:51:27,333][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:51:32,334][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:51:37,335][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:51:42,336][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:51:47,337][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:51:52,209][ ERROR][PID:3544919] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-10-17 04:51:52,338][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:51:57,339][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:52:02,212][WARNING][PID:3544919] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-10-17 04:52:02,340][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:52:07,340][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:52:12,214][  INFO][PID:3544919] Downloading the builder-live.log file, attempt 3
[2025-10-17 04:52:12,221][  INFO][PID:3544919] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c299 copr-rpmbuild-log
[2025-10-17 04:52:12,343][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:52:17,346][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:52:22,349][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:52:27,350][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:52:32,351][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:52:37,352][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:52:42,354][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:52:47,355][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:52:52,356][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:52:57,357][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:53:02,358][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:53:07,359][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:53:12,298][ ERROR][PID:3544919] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-10-17 04:53:12,360][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:53:17,360][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:53:22,299][WARNING][PID:3544919] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-10-17 04:53:22,361][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:53:27,362][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:53:32,299][  INFO][PID:3544919] Downloading the builder-live.log file, attempt 4
[2025-10-17 04:53:32,301][  INFO][PID:3544919] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c299 copr-rpmbuild-log
[2025-10-17 04:53:32,363][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:53:37,364][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:53:42,365][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:53:47,366][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:53:52,367][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:53:57,369][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:54:02,370][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:54:07,371][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:54:12,372][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:54:17,373][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:54:22,374][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:54:27,375][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:54:32,368][ ERROR][PID:3544919] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-10-17 04:54:32,376][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:54:37,377][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:54:42,378][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:54:42,396][ ERROR][PID:3544919] Giving up for unstable SSH, failures: 1760676642.1397219, 1760676722.2128162, 1760676802.2991333, 1760676882.3966837
[2025-10-17 04:54:42,397][ ERROR][PID:3544919] Re-try request for task on 'ResallocHost, ticket_id=5702411, hostname=2620:52:3:1:dead:beef:cafe:c299, name=copr_p09_01_prod_07435453_20251017_031421, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-10-17 04:54:42,397][  INFO][PID:3544919] Releasing VM back to pool
[2025-10-17 04:54:42,406][  INFO][PID:3544919] Retry #2 (on other host)
[2025-10-17 04:54:42,406][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:54:42,407][  INFO][PID:3544919] VM allocation process starts
[2025-10-17 04:54:42,471][  INFO][PID:3544919] Trying to allocate VM: ResallocHost, ticket_id=5702618, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-10-17 04:54:45,505][  INFO][PID:3544919] Allocated host ResallocHost, ticket_id=5702618, hostname=2620:52:3:1:dead:beef:cafe:c2a6, name=copr_p09_01_prod_07435551_20251017_032307, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-10-17 04:54:45,506][  INFO][PID:3544919] Allocating ssh connection to builder
[2025-10-17 04:54:45,507][  INFO][PID:3544919] Checking that builder machine is OK
[2025-10-17 04:54:46,380][  INFO][PID:3544919] Running remote command: copr-builder-ready centos-stream+epel-next-9-ppc64le
[2025-10-17 04:54:46,888][  INFO][PID:3544919] Red Hat subscription not needed for centos-stream+epel-next-9-ppc64le
Builder is ready to be used

[2025-10-17 04:54:46,889][  INFO][PID:3544919] Filling build.info file with builder info
[2025-10-17 04:54:46,892][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:54:46,893][  INFO][PID:3544919] Not re-notifying FE and msg buses for the new host.
[2025-10-17 04:54:46,893][  INFO][PID:3544919] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9697201-centos-stream+epel-next-9-ppc64le --chroot centos-stream+epel-next-9-ppc64le --detached
[2025-10-17 04:54:48,304][  INFO][PID:3544919] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c2a6' (ED25519) to the list of known hosts.


[2025-10-17 04:54:48,304][  INFO][PID:3544919] Downloading the builder-live.log file, attempt 1
[2025-10-17 04:54:48,306][  INFO][PID:3544919] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c2a6 copr-rpmbuild-log
[2025-10-17 04:54:53,305][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:54:58,306][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:55:03,307][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:55:08,308][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:55:13,309][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:55:18,310][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:55:23,311][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:55:28,312][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:55:33,313][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:55:38,313][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:55:43,316][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:55:48,321][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:55:53,323][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:55:58,324][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:56:03,325][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:56:08,326][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:56:13,327][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:56:18,328][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:56:23,329][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:56:28,330][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:56:33,331][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:56:38,332][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:56:43,333][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:56:48,334][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:56:53,335][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:56:58,336][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:57:03,337][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:57:08,338][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:57:13,342][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:57:18,343][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:57:23,344][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:57:28,345][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:57:33,346][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:57:38,347][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:57:43,348][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:57:48,349][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:57:53,350][  INFO][PID:3544919] Checking for cancel request
[2025-10-17 04:57:56,308][  INFO][PID:3544919] Downloading results from builder
[2025-10-17 04:57:56,308][  INFO][PID:3544919] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c2a6]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@meta/drgn/centos-stream+epel-next-9-ppc64le/09697201-python-drgn started
[2025-10-17 04:57:56,309][  INFO][PID:3544919] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c2a6]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@meta/drgn/centos-stream+epel-next-9-ppc64le/09697201-python-drgn/ &> /var/lib/copr/public_html/results/@meta/drgn/centos-stream+epel-next-9-ppc64le/09697201-python-drgn/build-09697201.rsync.log
[2025-10-17 04:57:56,862][  INFO][PID:3544919] rsyncing finished.
[2025-10-17 04:57:56,863][  INFO][PID:3544919] Releasing VM back to pool
[2025-10-17 04:57:56,897][  INFO][PID:3544919] Searching for 'success' file in resultdir
[2025-10-17 04:57:56,898][  INFO][PID:3544919] Going to sign pkgs from source: 9697201-centos-stream+epel-next-9-ppc64le in chroot: /var/lib/copr/public_html/results/@meta/drgn/centos-stream+epel-next-9-ppc64le
[2025-10-17 04:57:56,899][  INFO][PID:3544919] Calling '/bin/sign -u @meta#drgn@copr.fedorahosted.org -p' (attempt #1)
[2025-10-17 04:57:57,240][  INFO][PID:3544919] Calling '/bin/sign -4 -h sha256 -u @meta#drgn@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@meta/drgn/centos-stream+epel-next-9-ppc64le/09697201-python-drgn/drgn-debuginfo-0.0.32+293.g32a9e346-1.20251017044011507064.pr554.293.g32a9e346.el9.ppc64le.rpm' (attempt #1)
[2025-10-17 04:57:58,029][  INFO][PID:3544919] signed rpm: /var/lib/copr/public_html/results/@meta/drgn/centos-stream+epel-next-9-ppc64le/09697201-python-drgn/drgn-debuginfo-0.0.32+293.g32a9e346-1.20251017044011507064.pr554.293.g32a9e346.el9.ppc64le.rpm
[2025-10-17 04:57:58,030][  INFO][PID:3544919] Calling '/bin/sign -4 -h sha256 -u @meta#drgn@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@meta/drgn/centos-stream+epel-next-9-ppc64le/09697201-python-drgn/python-drgn-debugsource-0.0.32+293.g32a9e346-1.20251017044011507064.pr554.293.g32a9e346.el9.ppc64le.rpm' (attempt #1)
[2025-10-17 04:57:58,956][  INFO][PID:3544919] signed rpm: /var/lib/copr/public_html/results/@meta/drgn/centos-stream+epel-next-9-ppc64le/09697201-python-drgn/python-drgn-debugsource-0.0.32+293.g32a9e346-1.20251017044011507064.pr554.293.g32a9e346.el9.ppc64le.rpm
[2025-10-17 04:57:58,957][  INFO][PID:3544919] Calling '/bin/sign -4 -h sha256 -u @meta#drgn@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@meta/drgn/centos-stream+epel-next-9-ppc64le/09697201-python-drgn/drgn-0.0.32+293.g32a9e346-1.20251017044011507064.pr554.293.g32a9e346.el9.ppc64le.rpm' (attempt #1)
[2025-10-17 04:57:59,739][  INFO][PID:3544919] signed rpm: /var/lib/copr/public_html/results/@meta/drgn/centos-stream+epel-next-9-ppc64le/09697201-python-drgn/drgn-0.0.32+293.g32a9e346-1.20251017044011507064.pr554.293.g32a9e346.el9.ppc64le.rpm
[2025-10-17 04:57:59,740][  INFO][PID:3544919] Calling '/bin/sign -4 -h sha256 -u @meta#drgn@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@meta/drgn/centos-stream+epel-next-9-ppc64le/09697201-python-drgn/python-drgn-0.0.32+293.g32a9e346-1.20251017044011507064.pr554.293.g32a9e346.el9.src.rpm' (attempt #1)
[2025-10-17 04:58:00,364][  INFO][PID:3544919] signed rpm: /var/lib/copr/public_html/results/@meta/drgn/centos-stream+epel-next-9-ppc64le/09697201-python-drgn/python-drgn-0.0.32+293.g32a9e346-1.20251017044011507064.pr554.293.g32a9e346.el9.src.rpm
[2025-10-17 04:58:00,366][  INFO][PID:3544919] Sign done
[2025-10-17 04:58:00,366][  INFO][PID:3544919] Incremental createrepo run, adding 09697201-python-drgn into https://download.copr.fedorainfracloud.org/results/@meta/drgn/centos-stream+epel-next-9-ppc64le, (auto-create-repo=True)
[2025-10-17 04:58:00,368][  INFO][PID:3544919] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@meta/drgn/centos-stream+epel-next-9-ppc64le --add 09697201-python-drgn --no-appstream-metadata' as PID 3643299
[2025-10-17 04:58:01,178][  INFO][PID:3544919] Finished after 0 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@meta/drgn/centos-stream+epel-next-9-ppc64le --add 09697201-python-drgn --no-appstream-metadata)
[2025-10-17 04:58:01,178][  INFO][PID:3544919] Getting build details
[2025-10-17 04:58:01,179][  INFO][PID:3544919] Listing built binary packages in /var/lib/copr/public_html/results/@meta/drgn/centos-stream+epel-next-9-ppc64le/09697201-python-drgn
[2025-10-17 04:58:01,179][  INFO][PID:3544919] Built packages:
['drgn 0.0.32+293.g32a9e346', 'python-drgn-debugsource 0.0.32+293.g32a9e346', 'drgn-debuginfo 0.0.32+293.g32a9e346']
[2025-10-17 04:58:01,180][  INFO][PID:3544919] build details: {'built_packages': 'drgn 0.0.32+293.g32a9e346\npython-drgn-debugsource 0.0.32+293.g32a9e346\ndrgn-debuginfo 0.0.32+293.g32a9e346'}
[2025-10-17 04:58:01,180][  INFO][PID:3544919] Retrieving pubkey
[2025-10-17 04:58:01,181][  INFO][PID:3544919] Calling '/bin/sign -u @meta#drgn@copr.fedorahosted.org -p' (attempt #1)
[2025-10-17 04:58:01,529][  INFO][PID:3544919] Added pubkey for user @meta project drgn into: /var/lib/copr/public_html/results/@meta/drgn/pubkey.gpg
[2025-10-17 04:58:01,530][  INFO][PID:3544919] Finished build: id=9697201 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@meta/drgn chroot=centos-stream+epel-next-9-ppc64le 
[2025-10-17 04:58:01,531][  INFO][PID:3544919] Worker succeeded build, took 194.63845014572144
[2025-10-17 04:58:01,532][  INFO][PID:3544919] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@meta",
            "project_name": "drgn",
            "project_dirname": "drgn",
            "submitter": "packit",
            "ended_on": 1760677081.5316534,
            "started_on": 1760676886.8932033,
            "submitted_on": null,
            "status": 1,
            "chroot": "centos-stream+epel-next-9-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9697201-centos-stream+epel-next-9-ppc64le",
            "build_id": 9697201,
            "package_name": "python-drgn",
            "package_version": "0.0.32+293.g32a9e346-1.20251017044011507064.pr554.293.g32a9e346",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@meta/drgn/python-drgn",
            "git_hash": "2e8a59eff750cfca383fa4558492e9aa95cc88ae",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@meta/drgn--packit",
            "results": {
                "packages": [
                    {
                        "name": "python-drgn",
                        "epoch": null,
                        "version": "0.0.32+293.g32a9e346",
                        "release": "1.20251017044011507064.pr554.293.g32a9e346.el9",
                        "arch": "src"
                    },
                    {
                        "name": "drgn",
                        "epoch": null,
                        "version": "0.0.32+293.g32a9e346",
                        "release": "1.20251017044011507064.pr554.293.g32a9e346.el9",
                        "arch": "ppc64le"
                    },
                    {
                        "name": "python-drgn-debugsource",
                        "epoch": null,
                        "version": "0.0.32+293.g32a9e346",
                        "release": "1.20251017044011507064.pr554.293.g32a9e346.el9",
                        "arch": "ppc64le"
                    },
                    {
                        "name": "drgn-debuginfo",
                        "epoch": null,
                        "version": "0.0.32+293.g32a9e346",
                        "release": "1.20251017044011507064.pr554.293.g32a9e346.el9",
                        "arch": "ppc64le"
                    }
                ]
            },
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@meta/drgn/centos-stream+epel-next-9-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://kojihub.stream.centos.org/kojifiles/repos/c9s-build/latest/ppc64le/",
                    "id": "https_kojihub_stream_centos_org_kojifiles_repos_c9s_build_latest_ppc64le",
                    "name": "Additional repo https_kojihub_stream_centos_org_kojifiles_repos_c9s_build_latest_ppc64le"
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@meta/drgn",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@meta/drgn",
            "result_dir": "09697201-python-drgn",
            "built_packages": "drgn 0.0.32+293.g32a9e346\npython-drgn-debugsource 0.0.32+293.g32a9e346\ndrgn-debuginfo 0.0.32+293.g32a9e346",
            "id": 9697201,
            "mockchain_macros": {
                "copr_username": "@meta",
                "copr_projectname": "drgn",
                "vendor": "Fedora Project COPR (@meta/drgn)"
            }
        }
    ]
}
[2025-10-17 04:58:01,621][  INFO][PID:3544919] Sending fedora-messaging bus message in build.end
[2025-10-17 04:58:01,679][  INFO][PID:3544919] Compressing /var/lib/copr/public_html/results/@meta/drgn/centos-stream+epel-next-9-ppc64le/09697201-python-drgn/builder-live.log by gzip
[2025-10-17 04:58:01,681][  INFO][PID:3544919] Running command 'gzip /var/lib/copr/public_html/results/@meta/drgn/centos-stream+epel-next-9-ppc64le/09697201-python-drgn/builder-live.log' as PID 3643512
[2025-10-17 04:58:01,689][  INFO][PID:3544919] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@meta/drgn/centos-stream+epel-next-9-ppc64le/09697201-python-drgn/builder-live.log)
[2025-10-17 04:58:01,690][  INFO][PID:3544919] Compressing /var/lib/copr/public_html/results/@meta/drgn/centos-stream+epel-next-9-ppc64le/09697201-python-drgn/backend.log by gzip
[2025-10-17 04:58:01,691][  INFO][PID:3544919] Running command 'gzip /var/lib/copr/public_html/results/@meta/drgn/centos-stream+epel-next-9-ppc64le/09697201-python-drgn/backend.log' as PID 3643517