[2025-11-26 14:55:10,693][  INFO][PID:1900461] Marking build as starting
[2025-11-26 14:55:10,824][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 14:55:10,825][  INFO][PID:1900461] VM allocation process starts
[2025-11-26 14:55:10,846][  INFO][PID:1900461] Trying to allocate VM: ResallocHost, ticket_id=3976, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-11-26 14:55:15,847][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 14:55:20,848][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 14:55:22,891][  INFO][PID:1900461] Allocated host ResallocHost, ticket_id=3976, hostname=2620:52:6:1161:dead:beef:cafe:c113, name=vmhost_p09_02_prod_00003647_20251126_134200, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-11-26 14:55:22,891][  INFO][PID:1900461] Allocating ssh connection to builder
[2025-11-26 14:55:22,892][  INFO][PID:1900461] Checking that builder machine is OK
[2025-11-26 14:56:22,961][ ERROR][PID:1900461] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c113 port 22: Connection timed out

[2025-11-26 14:56:32,962][ ERROR][PID:1900461] Re-try request for task on 'ResallocHost, ticket_id=3976, hostname=2620:52:6:1161:dead:beef:cafe:c113, name=vmhost_p09_02_prod_00003647_20251126_134200, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts
[2025-11-26 14:56:32,968][  INFO][PID:1900461] Releasing VM back to pool
[2025-11-26 14:56:33,031][  INFO][PID:1900461] Retry #1 (on other host)
[2025-11-26 14:56:33,033][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 14:56:33,037][  INFO][PID:1900461] VM allocation process starts
[2025-11-26 14:56:33,099][  INFO][PID:1900461] Trying to allocate VM: ResallocHost, ticket_id=4002, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-11-26 14:56:38,110][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 14:56:43,113][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 14:56:45,230][  INFO][PID:1900461] Allocated host ResallocHost, ticket_id=4002, hostname=2620:52:6:1161:dead:beef:cafe:c113, name=vmhost_p09_02_prod_00003647_20251126_134200, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-11-26 14:56:45,233][  INFO][PID:1900461] Allocating ssh connection to builder
[2025-11-26 14:56:45,236][  INFO][PID:1900461] Checking that builder machine is OK
[2025-11-26 14:57:45,339][ ERROR][PID:1900461] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c113 port 22: Connection timed out

[2025-11-26 14:57:55,343][ ERROR][PID:1900461] Re-try request for task on 'ResallocHost, ticket_id=4002, hostname=2620:52:6:1161:dead:beef:cafe:c113, name=vmhost_p09_02_prod_00003647_20251126_134200, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts
[2025-11-26 14:57:55,344][  INFO][PID:1900461] Releasing VM back to pool
[2025-11-26 14:57:55,371][  INFO][PID:1900461] Retry #2 (on other host)
[2025-11-26 14:57:55,372][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 14:57:55,375][  INFO][PID:1900461] VM allocation process starts
[2025-11-26 14:57:55,444][  INFO][PID:1900461] Trying to allocate VM: ResallocHost, ticket_id=4063, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-11-26 14:58:00,457][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 14:58:05,464][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 14:58:10,469][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 14:58:13,634][  INFO][PID:1900461] Allocated host ResallocHost, ticket_id=4063, hostname=2620:52:6:1161:dead:beef:cafe:c10a, name=vmhost_p09_02_prod_00004887_20251126_135415, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-11-26 14:58:13,635][  INFO][PID:1900461] Allocating ssh connection to builder
[2025-11-26 14:58:13,637][  INFO][PID:1900461] Checking that builder machine is OK
[2025-11-26 14:59:13,728][ ERROR][PID:1900461] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c10a port 22: Connection timed out

[2025-11-26 14:59:23,732][ ERROR][PID:1900461] Re-try request for task on 'ResallocHost, ticket_id=4063, hostname=2620:52:6:1161:dead:beef:cafe:c10a, name=vmhost_p09_02_prod_00004887_20251126_135415, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts
[2025-11-26 14:59:23,733][  INFO][PID:1900461] Releasing VM back to pool
[2025-11-26 14:59:23,747][  INFO][PID:1900461] Retry #3 (on other host)
[2025-11-26 14:59:23,747][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 14:59:23,748][  INFO][PID:1900461] VM allocation process starts
[2025-11-26 14:59:23,763][  INFO][PID:1900461] Trying to allocate VM: ResallocHost, ticket_id=4099, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-11-26 14:59:26,782][  INFO][PID:1900461] Allocated host ResallocHost, ticket_id=4099, hostname=2620:52:6:1161:dead:beef:cafe:c108, name=vmhost_p09_02_prod_00005540_20251126_135710, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-11-26 14:59:26,783][  INFO][PID:1900461] Allocating ssh connection to builder
[2025-11-26 14:59:26,785][  INFO][PID:1900461] Checking that builder machine is OK
[2025-11-26 14:59:27,793][  INFO][PID:1900461] Running remote command: copr-builder-ready fedora-43-ppc64le
[2025-11-26 14:59:28,289][  INFO][PID:1900461] Red Hat subscription not needed for fedora-43-ppc64le
Builder is ready to be used

[2025-11-26 14:59:28,292][  INFO][PID:1900461] Filling build.info file with builder info
[2025-11-26 14:59:28,293][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 14:59:28,299][  INFO][PID:1900461] Not re-notifying FE and msg buses for the new host.
[2025-11-26 14:59:28,302][  INFO][PID:1900461] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9839558-fedora-43-ppc64le --chroot fedora-43-ppc64le --detached
[2025-11-26 14:59:29,247][  INFO][PID:1900461] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c108' (ED25519) to the list of known hosts.


[2025-11-26 14:59:29,249][  INFO][PID:1900461] Downloading the builder-live.log file, attempt 1
[2025-11-26 14:59:29,250][  INFO][PID:1900461] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c108 copr-rpmbuild-log
[2025-11-26 14:59:34,257][  INFO][PID:1900461] Periodic builder liveness probe: alive
[2025-11-26 14:59:34,258][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 14:59:39,260][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 14:59:44,261][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 14:59:49,265][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 14:59:54,266][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 14:59:59,268][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 15:00:04,271][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 15:00:09,272][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 15:00:14,278][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 15:00:19,281][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 15:00:24,282][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 15:00:29,283][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 15:00:34,285][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 15:00:39,288][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 15:00:44,290][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 15:00:49,291][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 15:00:54,299][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 15:00:59,301][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 15:01:04,304][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 15:01:09,306][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 15:01:14,307][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 15:01:19,318][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 15:01:24,434][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 15:01:29,437][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 15:01:34,441][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 15:01:39,450][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 15:01:44,476][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 15:01:49,479][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 15:01:54,480][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 15:01:59,482][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 15:02:04,485][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 15:02:09,487][  INFO][PID:1900461] Checking for cancel request
[2025-11-26 15:02:09,491][  INFO][PID:1900461] calling cancel callback, and waiting
[2025-11-26 15:02:13,318][  INFO][PID:1900461] Cancel request succeeded
out:
success
err:
Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c108' (ED25519) to the list of known hosts.

[2025-11-26 15:02:13,320][ ERROR][PID:1900461] Build was canceled
[2025-11-26 15:02:13,320][  INFO][PID:1900461] Releasing VM back to pool
[2025-11-26 15:02:13,338][WARNING][PID:1900461] Switching not-finished job state to 'failed'
[2025-11-26 15:02:13,341][  INFO][PID:1900461] Worker failed build, took 165.0390384197235
[2025-11-26 15:02:13,346][  INFO][PID:1900461] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "packit",
            "project_name": "evverx-avahi-3",
            "project_dirname": "evverx-avahi-3",
            "submitter": "packit",
            "ended_on": 1764169333.338703,
            "started_on": 1764169168.2996645,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-43-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9839558-fedora-43-ppc64le",
            "build_id": 9839558,
            "package_name": "avahi",
            "package_version": "0.8-6.20251126145427499577.pr3.337.g640fcce",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/packit/evverx-avahi-3/avahi",
            "git_hash": "a890c89e1dc500737132854432c6c1c753844da8",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "packit/evverx-avahi-3--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/packit/evverx-avahi-3/fedora-43-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/packit/evverx-avahi-3",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/packit/evverx-avahi-3",
            "result_dir": "09839558-avahi",
            "built_packages": "",
            "id": 9839558,
            "mockchain_macros": {
                "copr_username": "packit",
                "copr_projectname": "evverx-avahi-3",
                "vendor": "Fedora Project COPR (packit/evverx-avahi-3)"
            }
        }
    ]
}
[2025-11-26 15:02:13,503][  INFO][PID:1900461] Sending fedora-messaging bus message in build.end
[2025-11-26 15:02:14,749][  INFO][PID:1900461] Compressing /var/lib/copr/public_html/results/packit/evverx-avahi-3/fedora-43-ppc64le/09839558-avahi/builder-live.log by gzip
[2025-11-26 15:02:14,753][  INFO][PID:1900461] Running command 'gzip /var/lib/copr/public_html/results/packit/evverx-avahi-3/fedora-43-ppc64le/09839558-avahi/builder-live.log' as PID 1989093
[2025-11-26 15:02:14,766][  INFO][PID:1900461] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/packit/evverx-avahi-3/fedora-43-ppc64le/09839558-avahi/builder-live.log)
[2025-11-26 15:02:14,776][  INFO][PID:1900461] Compressing /var/lib/copr/public_html/results/packit/evverx-avahi-3/fedora-43-ppc64le/09839558-avahi/backend.log by gzip
[2025-11-26 15:02:14,777][  INFO][PID:1900461] Running command 'gzip /var/lib/copr/public_html/results/packit/evverx-avahi-3/fedora-43-ppc64le/09839558-avahi/backend.log' as PID 1989099