[2025-12-09 22:30:37,710][  INFO][PID:1368565] Marking build as starting
[2025-12-09 22:30:37,810][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:30:37,813][  INFO][PID:1368565] VM allocation process starts
[2025-12-09 22:30:37,874][  INFO][PID:1368565] Trying to allocate VM: ResallocHost, ticket_id=247757, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-12-09 22:30:40,911][  INFO][PID:1368565] Allocated host ResallocHost, ticket_id=247757, hostname=2620:52:6:1161:dead:beef:cafe:c115, name=vmhost_p09_02_prod_00289127_20251209_214729, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-12-09 22:30:40,912][  INFO][PID:1368565] Allocating ssh connection to builder
[2025-12-09 22:30:40,912][  INFO][PID:1368565] Checking that builder machine is OK
[2025-12-09 22:30:42,154][  INFO][PID:1368565] Running remote command: copr-builder-ready centos-stream-9-ppc64le
[2025-12-09 22:30:42,694][  INFO][PID:1368565] Red Hat subscription not needed for centos-stream-9-ppc64le
Builder is ready to be used

[2025-12-09 22:30:42,695][  INFO][PID:1368565] Filling build.info file with builder info
[2025-12-09 22:30:42,695][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:30:42,696][  INFO][PID:1368565] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "rhcontainerbot",
            "project_name": "podman-next",
            "project_dirname": "podman-next",
            "submitter": "packit",
            "ended_on": null,
            "started_on": 1765319442.6965566,
            "submitted_on": null,
            "status": 3,
            "chroot": "centos-stream-9-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9892483-centos-stream-9-ppc64le",
            "build_id": 9892483,
            "package_name": "containers-common",
            "package_version": "102:0.67.0~dev-1.20251209222905172811.main.255.g94a2bc0fe1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rhcontainerbot/podman-next/containers-common",
            "git_hash": "5d8e08847529d08b90fa50838e168d19dd65eabb",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rhcontainerbot/podman-next--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/podman-next/centos-stream-9-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://dl.fedoraproject.org/pub/epel/9/Everything/$basearch/",
                    "id": "https_dl_fedoraproject_org_pub_epel_9_Everything_basearch",
                    "name": "Additional repo https_dl_fedoraproject_org_pub_epel_9_Everything_basearch"
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rhcontainerbot/podman-next",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/podman-next",
            "result_dir": "09892483-containers-common",
            "built_packages": "",
            "id": 9892483,
            "mockchain_macros": {
                "copr_username": "rhcontainerbot",
                "copr_projectname": "podman-next",
                "vendor": "Fedora Project COPR (rhcontainerbot/podman-next)"
            }
        }
    ]
}
[2025-12-09 22:30:42,757][  INFO][PID:1368565] Sending fedora-messaging bus message in build.start
[2025-12-09 22:30:43,412][  INFO][PID:1368565] Sending fedora-messaging bus message in chroot.start
[2025-12-09 22:30:43,452][  INFO][PID:1368565] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9892483-centos-stream-9-ppc64le --chroot centos-stream-9-ppc64le --detached
[2025-12-09 22:31:43,526][ ERROR][PID:1368565] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c115 port 22: Connection timed out

[2025-12-09 22:31:53,527][ ERROR][PID:1368565] Re-try request for task on 'ResallocHost, ticket_id=247757, hostname=2620:52:6:1161:dead:beef:cafe:c115, name=vmhost_p09_02_prod_00289127_20251209_214729, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': Unable to finish after 1 SSH attempts
[2025-12-09 22:31:53,528][  INFO][PID:1368565] Releasing VM back to pool
[2025-12-09 22:31:53,543][  INFO][PID:1368565] Retry #1 (on other host)
[2025-12-09 22:31:53,544][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:31:53,545][  INFO][PID:1368565] VM allocation process starts
[2025-12-09 22:31:53,557][  INFO][PID:1368565] Trying to allocate VM: ResallocHost, ticket_id=247794, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-12-09 22:31:56,573][  INFO][PID:1368565] Allocated host ResallocHost, ticket_id=247794, hostname=2620:52:6:1161:dead:beef:cafe:c188, name=vmhost_p09_04_prod_00289134_20251209_214803, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-12-09 22:31:56,573][  INFO][PID:1368565] Allocating ssh connection to builder
[2025-12-09 22:31:56,574][  INFO][PID:1368565] Checking that builder machine is OK
[2025-12-09 22:32:56,641][ ERROR][PID:1368565] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c188 port 22: Connection timed out

[2025-12-09 22:33:06,648][ ERROR][PID:1368565] Re-try request for task on 'ResallocHost, ticket_id=247794, hostname=2620:52:6:1161:dead:beef:cafe:c188, name=vmhost_p09_04_prod_00289134_20251209_214803, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': Unable to finish after 1 SSH attempts
[2025-12-09 22:33:06,648][  INFO][PID:1368565] Releasing VM back to pool
[2025-12-09 22:33:06,658][  INFO][PID:1368565] Retry #2 (on other host)
[2025-12-09 22:33:06,659][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:33:06,660][  INFO][PID:1368565] VM allocation process starts
[2025-12-09 22:33:06,673][  INFO][PID:1368565] Trying to allocate VM: ResallocHost, ticket_id=247825, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-12-09 22:33:09,689][  INFO][PID:1368565] Allocated host ResallocHost, ticket_id=247825, hostname=2620:52:6:1161:dead:beef:cafe:c193, name=vmhost_p09_04_prod_00290040_20251209_220627, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-12-09 22:33:09,690][  INFO][PID:1368565] Allocating ssh connection to builder
[2025-12-09 22:33:09,691][  INFO][PID:1368565] Checking that builder machine is OK
[2025-12-09 22:33:10,651][  INFO][PID:1368565] Running remote command: copr-builder-ready centos-stream-9-ppc64le
[2025-12-09 22:33:11,188][  INFO][PID:1368565] Red Hat subscription not needed for centos-stream-9-ppc64le
Builder is ready to be used

[2025-12-09 22:33:11,189][  INFO][PID:1368565] Filling build.info file with builder info
[2025-12-09 22:33:11,190][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:33:11,190][  INFO][PID:1368565] Not re-notifying FE and msg buses for the new host.
[2025-12-09 22:33:11,191][  INFO][PID:1368565] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9892483-centos-stream-9-ppc64le --chroot centos-stream-9-ppc64le --detached
[2025-12-09 22:33:12,136][  INFO][PID:1368565] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c193' (ED25519) to the list of known hosts.


[2025-12-09 22:33:12,137][  INFO][PID:1368565] Downloading the builder-live.log file, attempt 1
[2025-12-09 22:33:12,138][  INFO][PID:1368565] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c193 copr-rpmbuild-log
[2025-12-09 22:33:17,144][  INFO][PID:1368565] Periodic builder liveness probe: alive
[2025-12-09 22:33:17,144][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:33:22,145][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:33:27,146][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:33:32,147][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:33:37,149][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:33:42,150][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:33:47,151][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:33:52,152][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:33:57,154][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:34:02,155][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:34:07,156][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:34:12,158][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:34:17,159][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:34:22,160][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:34:27,161][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:34:32,163][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:34:37,164][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:34:42,166][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:34:47,173][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:34:52,178][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:34:57,182][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:35:02,184][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:35:07,188][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:35:12,190][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:35:17,194][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:35:22,200][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:35:27,204][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:35:32,205][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:35:37,208][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:35:42,213][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:35:47,214][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:35:52,216][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:35:57,219][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:36:02,220][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:36:07,222][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:36:12,223][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:36:17,225][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:36:22,226][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:36:27,227][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:36:32,228][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:36:37,231][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:36:42,234][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:36:47,236][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:36:52,237][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:36:57,238][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:37:02,240][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:37:07,246][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:37:12,247][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:37:17,249][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:37:22,250][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:37:27,251][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:37:32,252][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:37:37,253][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:37:42,255][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:37:47,256][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:37:52,257][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:37:57,258][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:38:02,259][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:38:07,260][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:38:12,261][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:38:17,262][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:38:22,264][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:38:27,265][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:38:32,266][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:38:37,267][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:38:42,269][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:38:47,270][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:38:52,271][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:38:57,272][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:39:02,273][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:39:07,275][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:39:12,276][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:39:17,277][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:39:22,278][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:39:27,284][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:39:32,285][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:39:37,286][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:39:42,287][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:39:47,288][  INFO][PID:1368565] Checking for cancel request
[2025-12-09 22:39:48,005][  INFO][PID:1368565] Downloading results from builder
[2025-12-09 22:39:48,006][  INFO][PID:1368565] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c193]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-ppc64le/09892483-containers-common started
[2025-12-09 22:39:48,007][  INFO][PID:1368565] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c193]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-ppc64le/09892483-containers-common/ &> /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-ppc64le/09892483-containers-common/build-09892483.rsync.log
[2025-12-09 22:39:48,561][  INFO][PID:1368565] rsyncing finished.
[2025-12-09 22:39:48,562][  INFO][PID:1368565] Releasing VM back to pool
[2025-12-09 22:39:48,612][  INFO][PID:1368565] Searching for 'success' file in resultdir
[2025-12-09 22:39:48,612][ ERROR][PID:1368565] Build failed: Backend process error: No success file => build failure
[2025-12-09 22:39:48,613][  INFO][PID:1368565] Finished build: id=9892483 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/rhcontainerbot/podman-next chroot=centos-stream-9-ppc64le 
[2025-12-09 22:39:48,615][ ERROR][PID:1368565] Backend process error: No success file => build failure
[2025-12-09 22:39:48,615][  INFO][PID:1368565] Worker failed build, took 397.42509937286377
[2025-12-09 22:39:48,616][  INFO][PID:1368565] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "rhcontainerbot",
            "project_name": "podman-next",
            "project_dirname": "podman-next",
            "submitter": "packit",
            "ended_on": 1765319988.615818,
            "started_on": 1765319591.1907187,
            "submitted_on": null,
            "status": 0,
            "chroot": "centos-stream-9-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9892483-centos-stream-9-ppc64le",
            "build_id": 9892483,
            "package_name": "containers-common",
            "package_version": "102:0.67.0~dev-1.20251209222905172811.main.255.g94a2bc0fe1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rhcontainerbot/podman-next/containers-common",
            "git_hash": "5d8e08847529d08b90fa50838e168d19dd65eabb",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rhcontainerbot/podman-next--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/podman-next/centos-stream-9-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://dl.fedoraproject.org/pub/epel/9/Everything/$basearch/",
                    "id": "https_dl_fedoraproject_org_pub_epel_9_Everything_basearch",
                    "name": "Additional repo https_dl_fedoraproject_org_pub_epel_9_Everything_basearch"
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rhcontainerbot/podman-next",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/podman-next",
            "result_dir": "09892483-containers-common",
            "built_packages": "",
            "id": 9892483,
            "mockchain_macros": {
                "copr_username": "rhcontainerbot",
                "copr_projectname": "podman-next",
                "vendor": "Fedora Project COPR (rhcontainerbot/podman-next)"
            }
        }
    ]
}
[2025-12-09 22:39:48,672][  INFO][PID:1368565] Sending fedora-messaging bus message in build.end
[2025-12-09 22:39:48,701][  INFO][PID:1368565] Compressing /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-ppc64le/09892483-containers-common/builder-live.log by gzip
[2025-12-09 22:39:48,702][  INFO][PID:1368565] Running command 'gzip /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-ppc64le/09892483-containers-common/builder-live.log' as PID 1430694
[2025-12-09 22:39:48,709][  INFO][PID:1368565] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-ppc64le/09892483-containers-common/builder-live.log)
[2025-12-09 22:39:48,709][  INFO][PID:1368565] Compressing /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-ppc64le/09892483-containers-common/backend.log by gzip
[2025-12-09 22:39:48,710][  INFO][PID:1368565] Running command 'gzip /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-ppc64le/09892483-containers-common/backend.log' as PID 1430695