[2025-11-07 15:04:24,996][  INFO][PID:1287050] Marking build as starting
[2025-11-07 15:04:25,088][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:04:25,091][  INFO][PID:1287050] VM allocation process starts
[2025-11-07 15:04:25,123][  INFO][PID:1287050] Trying to allocate VM: ResallocHost, ticket_id=6075168, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-11-07 15:04:30,125][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:04:31,157][  INFO][PID:1287050] Allocated host ResallocHost, ticket_id=6075168, hostname=2620:52:6:1161:dead:beef:cafe:c18a, name=vmhost_p09_04_prod_07882962_20251107_135843, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-11-07 15:04:31,158][  INFO][PID:1287050] Allocating ssh connection to builder
[2025-11-07 15:04:31,158][  INFO][PID:1287050] Checking that builder machine is OK
[2025-11-07 15:04:32,080][  INFO][PID:1287050] Running remote command: copr-builder-ready centos-stream-9-ppc64le
[2025-11-07 15:04:32,613][  INFO][PID:1287050] Red Hat subscription not needed for centos-stream-9-ppc64le
Builder is ready to be used

[2025-11-07 15:04:32,614][  INFO][PID:1287050] Filling build.info file with builder info
[2025-11-07 15:04:32,615][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:04:32,617][  INFO][PID:1287050] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "packit",
            "project_name": "osbuild-osbuild-composer-4903",
            "project_dirname": "osbuild-osbuild-composer-4903",
            "submitter": "packit",
            "ended_on": null,
            "started_on": 1762527872.6171286,
            "submitted_on": null,
            "status": 3,
            "chroot": "centos-stream-9-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9776692-centos-stream-9-ppc64le",
            "build_id": 9776692,
            "package_name": "osbuild-composer",
            "package_version": "154-1.20251107150356760915.pr4903.14.gd100b7e42",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/packit/osbuild-osbuild-composer-4903/osbuild-composer",
            "git_hash": "736e429368434ebd8dab76209963362b6dfd077a",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "packit/osbuild-osbuild-composer-4903--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/packit/osbuild-osbuild-composer-4903/centos-stream-9-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4903",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/packit/osbuild-osbuild-composer-4903",
            "result_dir": "09776692-osbuild-composer",
            "built_packages": "",
            "id": 9776692,
            "mockchain_macros": {
                "copr_username": "packit",
                "copr_projectname": "osbuild-osbuild-composer-4903",
                "vendor": "Fedora Project COPR (packit/osbuild-osbuild-composer-4903)"
            }
        }
    ]
}
[2025-11-07 15:04:32,698][  INFO][PID:1287050] Sending fedora-messaging bus message in build.start
[2025-11-07 15:04:33,942][  INFO][PID:1287050] Sending fedora-messaging bus message in chroot.start
[2025-11-07 15:04:33,973][  INFO][PID:1287050] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9776692-centos-stream-9-ppc64le --chroot centos-stream-9-ppc64le --detached
[2025-11-07 15:05:34,048][ ERROR][PID:1287050] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c18a port 22: Connection timed out

[2025-11-07 15:05:44,050][ ERROR][PID:1287050] Re-try request for task on 'ResallocHost, ticket_id=6075168, hostname=2620:52:6:1161:dead:beef:cafe:c18a, name=vmhost_p09_04_prod_07882962_20251107_135843, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': Unable to finish after 1 SSH attempts
[2025-11-07 15:05:44,050][  INFO][PID:1287050] Releasing VM back to pool
[2025-11-07 15:05:44,062][  INFO][PID:1287050] Retry #1 (on other host)
[2025-11-07 15:05:44,063][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:05:44,064][  INFO][PID:1287050] VM allocation process starts
[2025-11-07 15:05:44,076][  INFO][PID:1287050] Trying to allocate VM: ResallocHost, ticket_id=6075211, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-11-07 15:05:47,117][  INFO][PID:1287050] Allocated host ResallocHost, ticket_id=6075211, hostname=2620:52:3:1:dead:beef:cafe:c293, name=vmhost_p09_01_prod_07883029_20251107_140146, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-11-07 15:05:47,120][  INFO][PID:1287050] Allocating ssh connection to builder
[2025-11-07 15:05:47,121][  INFO][PID:1287050] Checking that builder machine is OK
[2025-11-07 15:05:48,007][  INFO][PID:1287050] Running remote command: copr-builder-ready centos-stream-9-ppc64le
[2025-11-07 15:05:48,525][  INFO][PID:1287050] Red Hat subscription not needed for centos-stream-9-ppc64le
Builder is ready to be used

[2025-11-07 15:05:48,525][  INFO][PID:1287050] Filling build.info file with builder info
[2025-11-07 15:05:48,530][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:05:48,535][  INFO][PID:1287050] Not re-notifying FE and msg buses for the new host.
[2025-11-07 15:05:48,536][  INFO][PID:1287050] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9776692-centos-stream-9-ppc64le --chroot centos-stream-9-ppc64le --detached
[2025-11-07 15:05:49,460][  INFO][PID:1287050] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c293' (ED25519) to the list of known hosts.


[2025-11-07 15:05:49,467][  INFO][PID:1287050] Downloading the builder-live.log file, attempt 1
[2025-11-07 15:05:49,474][  INFO][PID:1287050] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c293 copr-rpmbuild-log
[2025-11-07 15:05:54,485][  INFO][PID:1287050] Periodic builder liveness probe: alive
[2025-11-07 15:05:54,486][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:05:59,487][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:06:04,492][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:06:09,494][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:06:14,496][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:06:19,497][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:06:24,498][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:06:29,499][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:06:34,500][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:06:39,504][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:06:44,506][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:06:49,507][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:06:54,510][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:06:59,516][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:07:04,517][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:07:09,518][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:07:14,519][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:07:19,520][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:07:24,524][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:07:29,526][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:07:34,528][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:07:39,529][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:07:44,530][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:07:49,531][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:07:54,532][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:07:59,533][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:08:04,534][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:08:09,535][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:08:14,536][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:08:19,538][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:08:24,540][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:08:29,541][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:08:34,542][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:08:39,543][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:08:44,545][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:08:49,546][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:08:54,547][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:08:59,548][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:09:04,550][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:09:09,553][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:09:14,554][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:09:19,556][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:09:24,558][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:09:29,560][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:09:34,562][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:09:39,565][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:09:44,567][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:09:49,569][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:09:54,571][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:09:59,572][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:10:04,573][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:10:09,578][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:10:14,580][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:10:19,581][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:10:24,582][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:10:29,584][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:10:34,586][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:10:39,588][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:10:44,589][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:10:49,590][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:10:54,592][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:10:59,594][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:11:04,595][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:11:09,597][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:11:14,598][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:11:19,601][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:11:24,606][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:11:29,608][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:11:34,611][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:11:39,612][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:11:44,617][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:11:49,622][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:11:54,623][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:11:59,626][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:12:04,629][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:12:09,633][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:12:14,635][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:12:19,637][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:12:24,640][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:12:29,647][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:12:34,649][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:12:39,654][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:12:44,660][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:12:49,663][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:12:54,666][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:12:59,671][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:13:04,673][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:13:09,674][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:13:14,675][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:13:19,677][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:13:24,681][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:13:29,683][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:13:34,685][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:13:39,690][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:13:44,691][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:13:49,695][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:13:54,697][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:13:59,701][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:14:04,706][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:14:09,713][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:14:14,715][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:14:19,718][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:14:24,721][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:14:29,723][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:14:34,731][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:14:39,732][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:14:44,734][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:14:49,736][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:14:54,738][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:14:59,742][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:15:04,743][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:15:09,747][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:15:14,751][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:15:19,764][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:15:24,767][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:15:29,768][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:15:34,770][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:15:39,784][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:15:44,785][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:15:49,790][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:15:54,808][  INFO][PID:1287050] Periodic builder liveness probe: alive
[2025-11-07 15:15:54,816][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:15:59,819][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:16:04,820][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:16:09,822][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:16:14,827][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:16:19,828][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:16:24,831][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:16:29,835][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:16:34,837][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:16:39,839][  INFO][PID:1287050] Checking for cancel request
[2025-11-07 15:16:39,841][  INFO][PID:1287050] calling cancel callback, and waiting
[2025-11-07 15:16:43,435][  INFO][PID:1287050] Cancel request succeeded
out:
success
err:
Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c293' (ED25519) to the list of known hosts.

[2025-11-07 15:16:43,436][ ERROR][PID:1287050] Build was canceled
[2025-11-07 15:16:43,437][  INFO][PID:1287050] Releasing VM back to pool
[2025-11-07 15:16:43,450][WARNING][PID:1287050] Switching not-finished job state to 'failed'
[2025-11-07 15:16:43,451][  INFO][PID:1287050] Worker failed build, took 654.9147341251373
[2025-11-07 15:16:43,453][  INFO][PID:1287050] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "packit",
            "project_name": "osbuild-osbuild-composer-4903",
            "project_dirname": "osbuild-osbuild-composer-4903",
            "submitter": "packit",
            "ended_on": 1762528603.4505386,
            "started_on": 1762527948.5358045,
            "submitted_on": null,
            "status": 0,
            "chroot": "centos-stream-9-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9776692-centos-stream-9-ppc64le",
            "build_id": 9776692,
            "package_name": "osbuild-composer",
            "package_version": "154-1.20251107150356760915.pr4903.14.gd100b7e42",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/packit/osbuild-osbuild-composer-4903/osbuild-composer",
            "git_hash": "736e429368434ebd8dab76209963362b6dfd077a",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "packit/osbuild-osbuild-composer-4903--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/packit/osbuild-osbuild-composer-4903/centos-stream-9-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4903",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/packit/osbuild-osbuild-composer-4903",
            "result_dir": "09776692-osbuild-composer",
            "built_packages": "",
            "id": 9776692,
            "mockchain_macros": {
                "copr_username": "packit",
                "copr_projectname": "osbuild-osbuild-composer-4903",
                "vendor": "Fedora Project COPR (packit/osbuild-osbuild-composer-4903)"
            }
        }
    ]
}
[2025-11-07 15:16:43,538][  INFO][PID:1287050] Sending fedora-messaging bus message in build.end
[2025-11-07 15:16:43,576][  INFO][PID:1287050] Compressing /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4903/centos-stream-9-ppc64le/09776692-osbuild-composer/builder-live.log by gzip
[2025-11-07 15:16:43,580][  INFO][PID:1287050] Running command 'gzip /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4903/centos-stream-9-ppc64le/09776692-osbuild-composer/builder-live.log' as PID 1392883
[2025-11-07 15:16:43,726][  INFO][PID:1287050] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4903/centos-stream-9-ppc64le/09776692-osbuild-composer/builder-live.log)
[2025-11-07 15:16:43,728][  INFO][PID:1287050] Compressing /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4903/centos-stream-9-ppc64le/09776692-osbuild-composer/backend.log by gzip