[2025-12-30 01:10:48,467][  INFO][PID:3257097] Marking build as starting
[2025-12-30 01:10:48,589][  INFO][PID:3257097] Checking that /var/lib/copr/public_html/results/keithbowes/deponejo/centos-stream-10-ppc64le/repodata/repomd.xml exists
[2025-12-30 01:10:48,600][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:10:48,601][  INFO][PID:3257097] VM allocation process starts
[2025-12-30 01:10:48,612][  INFO][PID:3257097] Trying to allocate VM: ResallocHost, ticket_id=566680, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-12-30 01:10:51,627][  INFO][PID:3257097] Allocated host ResallocHost, ticket_id=566680, hostname=2620:52:6:1161:dead:beef:cafe:c190, name=vmhost_p09_04_prod_00834523_20251230_010303, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-12-30 01:10:51,627][  INFO][PID:3257097] Allocating ssh connection to builder
[2025-12-30 01:10:51,628][  INFO][PID:3257097] Checking that builder machine is OK
[2025-12-30 01:10:52,587][  INFO][PID:3257097] Running remote command: copr-builder-ready centos-stream-10-ppc64le
[2025-12-30 01:10:53,098][  INFO][PID:3257097] Red Hat subscription not needed for centos-stream-10-ppc64le
Builder is ready to be used

[2025-12-30 01:10:53,098][  INFO][PID:3257097] Filling build.info file with builder info
[2025-12-30 01:10:53,099][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:10:53,100][  INFO][PID:3257097] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "keithbowes",
            "project_name": "deponejo",
            "project_dirname": "deponejo",
            "submitter": "keithbowes",
            "ended_on": null,
            "started_on": 1767057053.1001277,
            "submitted_on": null,
            "status": 3,
            "chroot": "centos-stream-10-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9959559-centos-stream-10-ppc64le",
            "build_id": 9959559,
            "package_name": "pizauth",
            "package_version": "1.0.9-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/keithbowes/deponejo/pizauth",
            "git_hash": "9f380ea46959becf28db871aff7a5ed1b8060b9b",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "keithbowes/deponejo--keithbowes",
            "results": null,
            "appstream": true,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/keithbowes/deponejo/centos-stream-10-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/keithbowes/deponejo",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/keithbowes/deponejo",
            "result_dir": "09959559-pizauth",
            "built_packages": "",
            "id": 9959559,
            "mockchain_macros": {
                "copr_username": "keithbowes",
                "copr_projectname": "deponejo",
                "vendor": "Fedora Project COPR (keithbowes/deponejo)"
            }
        }
    ]
}
[2025-12-30 01:10:53,233][  INFO][PID:3257097] Sending fedora-messaging bus message in build.start
[2025-12-30 01:10:53,746][  INFO][PID:3257097] Sending fedora-messaging bus message in chroot.start
[2025-12-30 01:10:53,773][  INFO][PID:3257097] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9959559-centos-stream-10-ppc64le --chroot centos-stream-10-ppc64le --detached
[2025-12-30 01:10:54,742][  INFO][PID:3257097] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c190' (ED25519) to the list of known hosts.


[2025-12-30 01:10:54,743][  INFO][PID:3257097] Downloading the builder-live.log file, attempt 1
[2025-12-30 01:10:54,745][  INFO][PID:3257097] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c190 copr-rpmbuild-log
[2025-12-30 01:10:59,749][  INFO][PID:3257097] Periodic builder liveness probe: alive
[2025-12-30 01:10:59,750][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:11:04,751][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:11:09,752][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:11:14,753][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:11:19,755][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:11:24,756][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:11:29,757][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:11:34,758][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:11:39,760][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:11:44,763][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:11:49,765][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:11:54,766][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:11:59,767][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:12:04,768][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:12:09,769][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:12:14,770][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:12:19,771][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:12:24,772][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:12:29,773][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:12:34,775][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:12:39,777][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:12:44,778][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:12:49,779][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:12:54,780][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:12:59,781][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:13:04,782][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:13:09,784][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:13:14,785][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:13:19,786][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:13:24,788][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:13:29,789][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:13:34,790][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:13:39,791][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:13:44,792][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:13:49,793][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:13:54,794][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:13:59,795][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:14:04,796][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:14:09,797][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:14:14,798][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:14:18,370][ ERROR][PID:3257097] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-30 01:14:19,799][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:14:24,800][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:14:28,371][WARNING][PID:3257097] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-12-30 01:14:29,801][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:14:34,802][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:14:38,371][  INFO][PID:3257097] Downloading the builder-live.log file, attempt 2
[2025-12-30 01:14:38,375][  INFO][PID:3257097] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c190 copr-rpmbuild-log
[2025-12-30 01:14:39,803][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:14:44,804][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:14:49,806][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:14:54,807][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:14:59,808][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:15:04,810][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:15:09,811][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:15:14,812][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:15:19,813][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:15:24,815][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:15:29,817][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:15:34,819][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:15:38,403][ ERROR][PID:3257097] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-30 01:15:39,821][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:15:44,822][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:15:48,408][WARNING][PID:3257097] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-12-30 01:15:49,823][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:15:54,824][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:15:58,409][  INFO][PID:3257097] Downloading the builder-live.log file, attempt 3
[2025-12-30 01:15:58,410][  INFO][PID:3257097] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c190 copr-rpmbuild-log
[2025-12-30 01:15:59,825][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:16:04,826][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:16:09,828][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:16:14,829][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:16:19,830][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:16:24,832][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:16:29,833][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:16:34,834][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:16:39,835][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:16:44,836][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:16:49,837][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:16:54,838][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:16:58,438][ ERROR][PID:3257097] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-30 01:16:59,839][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:17:04,840][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:17:08,449][WARNING][PID:3257097] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-12-30 01:17:09,841][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:17:14,842][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:17:18,450][  INFO][PID:3257097] Downloading the builder-live.log file, attempt 4
[2025-12-30 01:17:18,451][  INFO][PID:3257097] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c190 copr-rpmbuild-log
[2025-12-30 01:17:19,843][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:17:24,844][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:17:29,846][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:17:34,847][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:17:39,848][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:17:44,848][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:17:49,849][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:17:54,850][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:17:59,851][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:18:04,852][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:18:09,853][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:18:14,854][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:18:18,468][ ERROR][PID:3257097] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-30 01:18:19,858][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:18:24,860][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:18:28,495][ ERROR][PID:3257097] Giving up for unstable SSH, failures: 1767057268.371026, 1767057348.4087696, 1767057428.4495764, 1767057508.495163
[2025-12-30 01:18:28,497][ ERROR][PID:3257097] Re-try request for task on 'ResallocHost, ticket_id=566680, hostname=2620:52:6:1161:dead:beef:cafe:c190, name=vmhost_p09_04_prod_00834523_20251230_010303, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-12-30 01:18:28,498][  INFO][PID:3257097] Releasing VM back to pool
[2025-12-30 01:18:28,534][  INFO][PID:3257097] Retry #1 (on other host)
[2025-12-30 01:18:28,534][  INFO][PID:3257097] Checking that /var/lib/copr/public_html/results/keithbowes/deponejo/centos-stream-10-ppc64le/repodata/repomd.xml exists
[2025-12-30 01:18:28,535][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:18:28,536][  INFO][PID:3257097] VM allocation process starts
[2025-12-30 01:18:28,559][  INFO][PID:3257097] Trying to allocate VM: ResallocHost, ticket_id=566783, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-12-30 01:18:31,581][  INFO][PID:3257097] Allocated host ResallocHost, ticket_id=566783, hostname=2620:52:6:1161:dead:beef:cafe:c18a, name=vmhost_p09_04_prod_00834538_20251230_010453, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-12-30 01:18:31,582][  INFO][PID:3257097] Allocating ssh connection to builder
[2025-12-30 01:18:31,582][  INFO][PID:3257097] Checking that builder machine is OK
[2025-12-30 01:18:32,540][  INFO][PID:3257097] Running remote command: copr-builder-ready centos-stream-10-ppc64le
[2025-12-30 01:18:33,092][  INFO][PID:3257097] Red Hat subscription not needed for centos-stream-10-ppc64le
Builder is ready to be used

[2025-12-30 01:18:33,093][  INFO][PID:3257097] Filling build.info file with builder info
[2025-12-30 01:18:33,098][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:18:33,099][  INFO][PID:3257097] Not re-notifying FE and msg buses for the new host.
[2025-12-30 01:18:33,100][  INFO][PID:3257097] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9959559-centos-stream-10-ppc64le --chroot centos-stream-10-ppc64le --detached
[2025-12-30 01:18:34,090][  INFO][PID:3257097] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c18a' (ED25519) to the list of known hosts.


[2025-12-30 01:18:34,091][  INFO][PID:3257097] Downloading the builder-live.log file, attempt 1
[2025-12-30 01:18:34,092][  INFO][PID:3257097] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c18a copr-rpmbuild-log
[2025-12-30 01:18:39,092][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:18:44,093][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:18:49,094][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:18:54,095][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:18:59,096][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:19:04,101][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:19:09,106][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:19:14,107][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:19:19,108][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:19:24,109][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:19:29,110][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:19:34,111][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:19:34,160][ ERROR][PID:3257097] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-30 01:19:39,112][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:19:44,113][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:19:44,164][WARNING][PID:3257097] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-12-30 01:19:49,114][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:19:54,121][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:19:54,173][  INFO][PID:3257097] Downloading the builder-live.log file, attempt 2
[2025-12-30 01:19:54,182][  INFO][PID:3257097] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c18a copr-rpmbuild-log
[2025-12-30 01:19:59,131][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:20:04,132][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:20:09,137][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:20:14,139][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:20:19,140][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:20:24,141][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:20:29,142][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:20:34,143][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:20:39,153][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:20:44,155][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:20:49,156][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:20:54,159][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:20:59,161][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:21:04,178][  INFO][PID:3257097] Periodic builder liveness probe: alive
[2025-12-30 01:21:04,179][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:21:09,180][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:21:14,185][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:21:19,187][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:21:24,189][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:21:29,192][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:21:34,193][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:21:39,194][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:21:44,196][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:21:49,197][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:21:54,199][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:21:59,201][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:22:04,209][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:22:09,211][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:22:14,213][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:22:19,215][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:22:24,216][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:22:29,217][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:22:34,218][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:22:39,220][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:22:44,221][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:22:49,224][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:22:54,226][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:22:59,228][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:23:04,230][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:23:09,231][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:23:14,232][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:23:19,235][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:23:24,238][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:23:29,239][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:23:34,243][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:23:39,248][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:23:44,253][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:23:49,254][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:23:54,256][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:23:59,258][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:24:04,259][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:24:09,261][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:24:14,262][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:24:19,266][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:24:24,272][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:24:29,273][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:24:34,275][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:24:39,276][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:24:44,278][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:24:49,280][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:24:54,282][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:24:59,283][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:25:04,285][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:25:09,286][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:25:14,288][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:25:19,289][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:25:24,290][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:25:29,291][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:25:34,292][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:25:39,294][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:25:44,295][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:25:49,297][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:25:54,299][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:25:59,303][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:26:04,304][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:26:09,305][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:26:14,307][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:26:19,308][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:26:24,309][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:26:29,310][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:26:34,312][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:26:39,316][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:26:44,317][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:26:49,319][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:26:54,320][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:26:59,326][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:27:04,330][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:27:09,331][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:27:14,332][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:27:19,335][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:27:24,339][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:27:29,340][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:27:34,341][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:27:39,342][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:27:44,346][  INFO][PID:3257097] Checking for cancel request
[2025-12-30 01:27:46,916][  INFO][PID:3257097] Downloading results from builder
[2025-12-30 01:27:46,916][  INFO][PID:3257097] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18a]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/keithbowes/deponejo/centos-stream-10-ppc64le/09959559-pizauth started
[2025-12-30 01:27:46,926][  INFO][PID:3257097] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18a]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/keithbowes/deponejo/centos-stream-10-ppc64le/09959559-pizauth/ &> /var/lib/copr/public_html/results/keithbowes/deponejo/centos-stream-10-ppc64le/09959559-pizauth/build-09959559.rsync.log
[2025-12-30 01:28:47,023][  INFO][PID:3257097] rsyncing finished.
[2025-12-30 01:28:47,066][ ERROR][PID:3257097] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2025-12-30 01:28:47,067][ ERROR][PID:3257097] SSH connection lost on #1 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2025-12-30 01:28:57,068][  INFO][PID:3257097] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18a]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/keithbowes/deponejo/centos-stream-10-ppc64le/09959559-pizauth started
[2025-12-30 01:28:57,069][  INFO][PID:3257097] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18a]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/keithbowes/deponejo/centos-stream-10-ppc64le/09959559-pizauth/ &> /var/lib/copr/public_html/results/keithbowes/deponejo/centos-stream-10-ppc64le/09959559-pizauth/build-09959559.rsync.log
[2025-12-30 01:28:58,429][  INFO][PID:3257097] rsyncing finished.
[2025-12-30 01:28:58,429][  INFO][PID:3257097] Releasing VM back to pool
[2025-12-30 01:28:58,457][  INFO][PID:3257097] Searching for 'success' file in resultdir
[2025-12-30 01:28:58,458][ ERROR][PID:3257097] Build failed: Backend process error: No success file => build failure
[2025-12-30 01:28:58,458][  INFO][PID:3257097] Finished build: id=9959559 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/keithbowes/deponejo chroot=centos-stream-10-ppc64le 
[2025-12-30 01:28:58,460][ ERROR][PID:3257097] Backend process error: No success file => build failure
[2025-12-30 01:28:58,460][  INFO][PID:3257097] Worker failed build, took 625.3614864349365
[2025-12-30 01:28:58,461][  INFO][PID:3257097] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "keithbowes",
            "project_name": "deponejo",
            "project_dirname": "deponejo",
            "submitter": "keithbowes",
            "ended_on": 1767058138.4607708,
            "started_on": 1767057513.0992844,
            "submitted_on": null,
            "status": 0,
            "chroot": "centos-stream-10-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9959559-centos-stream-10-ppc64le",
            "build_id": 9959559,
            "package_name": "pizauth",
            "package_version": "1.0.9-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/keithbowes/deponejo/pizauth",
            "git_hash": "9f380ea46959becf28db871aff7a5ed1b8060b9b",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "keithbowes/deponejo--keithbowes",
            "results": null,
            "appstream": true,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/keithbowes/deponejo/centos-stream-10-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/keithbowes/deponejo",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/keithbowes/deponejo",
            "result_dir": "09959559-pizauth",
            "built_packages": "",
            "id": 9959559,
            "mockchain_macros": {
                "copr_username": "keithbowes",
                "copr_projectname": "deponejo",
                "vendor": "Fedora Project COPR (keithbowes/deponejo)"
            }
        }
    ]
}
[2025-12-30 01:28:58,569][  INFO][PID:3257097] Sending fedora-messaging bus message in build.end
[2025-12-30 01:28:58,602][  INFO][PID:3257097] Compressing /var/lib/copr/public_html/results/keithbowes/deponejo/centos-stream-10-ppc64le/09959559-pizauth/builder-live.log by gzip
[2025-12-30 01:28:58,603][  INFO][PID:3257097] Running command 'gzip /var/lib/copr/public_html/results/keithbowes/deponejo/centos-stream-10-ppc64le/09959559-pizauth/builder-live.log' as PID 3387954
[2025-12-30 01:28:58,663][  INFO][PID:3257097] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/keithbowes/deponejo/centos-stream-10-ppc64le/09959559-pizauth/builder-live.log)
[2025-12-30 01:28:58,664][  INFO][PID:3257097] Compressing /var/lib/copr/public_html/results/keithbowes/deponejo/centos-stream-10-ppc64le/09959559-pizauth/backend.log by gzip
[2025-12-30 01:28:58,666][  INFO][PID:3257097] Running command 'gzip /var/lib/copr/public_html/results/keithbowes/deponejo/centos-stream-10-ppc64le/09959559-pizauth/backend.log' as PID 3387962