[2026-03-26 13:07:22,329][  INFO][PID:2592727] Marking build as starting
[2026-03-26 13:07:22,464][  INFO][PID:2592727] Checking that https://download.copr.fedorainfracloud.org/results/andersrh/SonicDE-devel/alma+epel-10-x86_64_v2//repodata/repomd.xml exists
[2026-03-26 13:07:22,621][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:07:22,622][  INFO][PID:2592727] VM allocation process starts
[2026-03-26 13:07:22,640][  INFO][PID:2592727] Trying to allocate VM: ResallocHost, ticket_id=2040071, requested_tags=['copr_builder', 'arch_x86_64_v2']
[2026-03-26 13:07:27,642][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:07:28,667][  INFO][PID:2592727] Allocated host ResallocHost, ticket_id=2040071, hostname=44.193.29.66, name=aws_x86_64_spot_prod_04287394_20260326_130059, requested_tags=['copr_builder', 'arch_x86_64_v2']
[2026-03-26 13:07:28,668][  INFO][PID:2592727] Allocating ssh connection to builder
[2026-03-26 13:07:28,668][  INFO][PID:2592727] Checking that builder machine is OK
[2026-03-26 13:07:29,014][  INFO][PID:2592727] Running remote command: copr-builder-ready alma+epel-10-x86_64_v2
[2026-03-26 13:07:29,219][  INFO][PID:2592727] Red Hat subscription not needed for alma+epel-10-x86_64_v2
Builder is ready to be used

[2026-03-26 13:07:29,220][  INFO][PID:2592727] Filling build.info file with builder info
[2026-03-26 13:07:29,221][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:07:29,222][  INFO][PID:2592727] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "andersrh",
            "project_name": "SonicDE-devel",
            "project_dirname": "SonicDE-devel",
            "submitter": "andersrh",
            "ended_on": null,
            "started_on": 1774530449.2222784,
            "submitted_on": null,
            "status": 3,
            "chroot": "alma+epel-10-x86_64_v2",
            "arch": "x86_64_v2",
            "buildroot_pkgs": [],
            "task_id": "10263869-alma+epel-10-x86_64_v2",
            "build_id": 10263869,
            "package_name": "sonic-frameworks-io",
            "package_version": "6.24.0-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/andersrh/SonicDE-devel/sonic-frameworks-io",
            "git_hash": "35f0fdaaee02f7f5b95e0ad7bb258fa2be80d390",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "andersrh/SonicDE-devel--andersrh",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 1,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/andersrh/SonicDE-devel/alma+epel-10-x86_64_v2/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@xlibre/xlibre-xserver/alma+epel-10-x86_64_v2/",
                    "id": "copr_xlibre_xlibre_xserver",
                    "name": "Additional repo copr_xlibre_xlibre_xserver"
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64_v2"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/andersrh/SonicDE-devel",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/andersrh/SonicDE-devel",
            "result_dir": "10263869-sonic-frameworks-io",
            "built_packages": "",
            "id": 10263869,
            "mockchain_macros": {
                "copr_username": "andersrh",
                "copr_projectname": "SonicDE-devel",
                "vendor": "Fedora Project COPR (andersrh/SonicDE-devel)"
            }
        }
    ]
}
[2026-03-26 13:07:29,299][  INFO][PID:2592727] Sending fedora-messaging bus message in build.start
[2026-03-26 13:07:29,938][  INFO][PID:2592727] Sending fedora-messaging bus message in chroot.start
[2026-03-26 13:07:30,117][  INFO][PID:2592727] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10263869-alma+epel-10-x86_64_v2 --chroot alma+epel-10-x86_64_v2 --detached
[2026-03-26 13:07:30,456][  INFO][PID:2592727] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '44.193.29.66' (ED25519) to the list of known hosts.


[2026-03-26 13:07:30,457][  INFO][PID:2592727] Downloading the builder-live.log file, attempt 1
[2026-03-26 13:07:30,528][  INFO][PID:2592727] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.193.29.66 copr-rpmbuild-log
[2026-03-26 13:07:35,462][  INFO][PID:2592727] Periodic builder liveness probe: alive
[2026-03-26 13:07:35,463][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:07:40,464][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:07:45,465][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:07:50,554][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:07:55,702][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:08:00,708][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:08:05,813][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:08:10,984][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:08:15,990][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:08:20,994][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:08:26,160][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:08:31,161][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:08:36,163][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:08:41,167][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:08:46,172][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:08:51,174][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:08:56,175][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:09:01,176][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:09:06,178][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:09:11,183][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:09:16,184][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:09:21,187][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:09:26,188][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:09:31,189][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:09:36,190][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:09:41,424][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:09:46,426][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:09:51,430][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:09:56,434][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:10:01,438][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:10:06,439][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:10:11,441][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:10:16,443][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:10:21,590][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:10:26,598][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:10:31,600][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:10:36,603][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:10:41,608][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:10:46,610][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:10:51,611][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:10:56,612][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:11:01,614][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:11:06,616][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:11:11,617][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:11:16,622][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:11:19,325][ ERROR][PID:2592727] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-03-26 13:11:21,644][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:11:26,646][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:11:29,326][WARNING][PID:2592727] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-03-26 13:11:31,649][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:11:36,651][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:11:39,327][  INFO][PID:2592727] Downloading the builder-live.log file, attempt 2
[2026-03-26 13:11:39,328][  INFO][PID:2592727] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.193.29.66 copr-rpmbuild-log
[2026-03-26 13:11:41,654][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:11:46,655][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:11:51,657][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:11:56,658][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:12:01,659][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:12:06,660][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:12:11,661][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:12:16,662][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:12:21,663][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:12:26,664][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:12:31,665][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:12:36,666][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:12:39,395][ ERROR][PID:2592727] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-03-26 13:12:41,667][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:12:46,669][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:12:49,418][WARNING][PID:2592727] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-03-26 13:12:51,672][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:12:56,673][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:12:59,419][  INFO][PID:2592727] Downloading the builder-live.log file, attempt 3
[2026-03-26 13:12:59,420][  INFO][PID:2592727] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.193.29.66 copr-rpmbuild-log
[2026-03-26 13:13:01,675][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:13:06,676][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:13:11,677][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:13:16,828][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:13:21,830][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:13:26,831][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:13:31,833][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:13:36,834][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:13:42,065][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:13:47,068][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:13:52,070][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:13:57,071][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:13:59,488][ ERROR][PID:2592727] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-03-26 13:14:02,079][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:14:07,080][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:14:09,495][WARNING][PID:2592727] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-03-26 13:14:12,082][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:14:17,083][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:14:19,496][  INFO][PID:2592727] Downloading the builder-live.log file, attempt 4
[2026-03-26 13:14:19,497][  INFO][PID:2592727] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.193.29.66 copr-rpmbuild-log
[2026-03-26 13:14:22,085][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:14:27,111][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:14:32,114][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:14:37,118][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:14:42,123][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:14:47,130][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:14:52,131][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:14:57,133][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:15:02,134][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:15:07,151][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:15:12,153][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:15:17,154][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:15:19,562][ ERROR][PID:2592727] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-03-26 13:15:22,155][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:15:27,156][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:15:29,570][ ERROR][PID:2592727] Giving up for unstable SSH, failures: 1774530689.326398, 1774530769.4181347, 1774530849.4951649, 1774530929.5705464
[2026-03-26 13:15:29,572][ ERROR][PID:2592727] Re-try request for task on 'ResallocHost, ticket_id=2040071, hostname=44.193.29.66, name=aws_x86_64_spot_prod_04287394_20260326_130059, requested_tags=['copr_builder', 'arch_x86_64_v2']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2026-03-26 13:15:29,574][  INFO][PID:2592727] Releasing VM back to pool
[2026-03-26 13:15:29,595][  INFO][PID:2592727] Retry #1 (on other host)
[2026-03-26 13:15:29,597][  INFO][PID:2592727] Checking that https://download.copr.fedorainfracloud.org/results/andersrh/SonicDE-devel/alma+epel-10-x86_64_v2//repodata/repomd.xml exists
[2026-03-26 13:15:30,260][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:15:30,261][  INFO][PID:2592727] VM allocation process starts
[2026-03-26 13:15:30,274][  INFO][PID:2592727] Trying to allocate VM: ResallocHost, ticket_id=2040244, requested_tags=['copr_builder', 'arch_x86_64_v2']
[2026-03-26 13:15:35,276][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:15:40,278][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:15:45,280][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:15:50,282][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:15:55,287][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:16:00,289][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:16:05,291][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:16:10,292][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:16:15,295][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:16:18,387][  INFO][PID:2592727] Allocated host ResallocHost, ticket_id=2040244, hostname=44.202.41.192, name=aws_x86_64_normalreserved_prod_04288238_20260326_131450, requested_tags=['copr_builder', 'arch_x86_64_v2']
[2026-03-26 13:16:18,387][  INFO][PID:2592727] Allocating ssh connection to builder
[2026-03-26 13:16:18,388][  INFO][PID:2592727] Checking that builder machine is OK
[2026-03-26 13:16:18,737][  INFO][PID:2592727] Running remote command: copr-builder-ready alma+epel-10-x86_64_v2
[2026-03-26 13:16:18,952][  INFO][PID:2592727] Red Hat subscription not needed for alma+epel-10-x86_64_v2
Builder is ready to be used

[2026-03-26 13:16:18,953][  INFO][PID:2592727] Filling build.info file with builder info
[2026-03-26 13:16:18,962][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:16:18,963][  INFO][PID:2592727] Not re-notifying FE and msg buses for the new host.
[2026-03-26 13:16:18,964][  INFO][PID:2592727] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10263869-alma+epel-10-x86_64_v2 --chroot alma+epel-10-x86_64_v2 --detached
[2026-03-26 13:16:19,315][  INFO][PID:2592727] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '44.202.41.192' (ED25519) to the list of known hosts.


[2026-03-26 13:16:19,316][  INFO][PID:2592727] Downloading the builder-live.log file, attempt 1
[2026-03-26 13:16:19,325][  INFO][PID:2592727] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.202.41.192 copr-rpmbuild-log
[2026-03-26 13:16:24,316][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:16:29,318][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:16:34,320][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:16:39,322][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:16:44,325][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:16:49,326][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:16:54,327][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:16:59,328][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:17:04,329][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:17:09,330][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:17:14,331][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:17:19,332][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:17:24,334][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:17:29,335][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:17:34,339][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:17:39,354][  INFO][PID:2592727] Periodic builder liveness probe: alive
[2026-03-26 13:17:39,393][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:17:44,395][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:17:49,396][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:17:54,399][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:17:59,402][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:18:04,408][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:18:09,409][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:18:14,410][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:18:19,411][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:18:24,412][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:18:29,414][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:18:34,417][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:18:39,422][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:18:44,424][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:18:49,425][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:18:54,434][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:18:59,435][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:19:04,437][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:19:09,594][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:19:14,600][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:19:19,602][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:19:24,607][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:19:29,610][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:19:34,612][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:19:39,614][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:19:44,621][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:19:49,622][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:19:54,623][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:19:59,628][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:20:04,635][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:20:09,638][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:20:14,640][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:20:19,648][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:20:24,653][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:20:29,661][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:20:34,664][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:20:39,670][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:20:44,676][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:20:49,687][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:20:54,693][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:20:59,697][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:21:04,702][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:21:09,705][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:21:14,710][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:21:19,716][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:21:24,718][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:21:29,721][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:21:34,723][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:21:39,724][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:21:44,726][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:21:49,739][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:21:54,743][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:21:59,746][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:22:04,748][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:22:09,751][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:22:14,754][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:22:19,755][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:22:24,756][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:22:29,757][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:22:34,758][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:22:39,759][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:22:44,760][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:22:49,761][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:22:54,763][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:22:59,764][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:23:04,766][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:23:09,788][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:23:14,789][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:23:19,790][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:23:24,791][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:23:29,803][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:23:34,809][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:23:39,811][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:23:44,814][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:23:49,864][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:23:54,872][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:23:59,877][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:24:04,883][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:24:09,884][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:24:14,911][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:24:20,007][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:24:25,023][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:24:30,083][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:24:35,093][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:24:40,095][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:24:45,121][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:24:50,135][  INFO][PID:2592727] Checking for cancel request
[2026-03-26 13:24:52,095][  INFO][PID:2592727] Downloading results from builder
[2026-03-26 13:24:52,096][  INFO][PID:2592727] rsyncing of mockbuilder@44.202.41.192:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/andersrh/SonicDE-devel/alma+epel-10-x86_64_v2/10263869-sonic-frameworks-io started
[2026-03-26 13:24:52,098][  INFO][PID:2592727] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@44.202.41.192:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/andersrh/SonicDE-devel/alma+epel-10-x86_64_v2/10263869-sonic-frameworks-io/ &> /var/lib/copr/public_html/results/andersrh/SonicDE-devel/alma+epel-10-x86_64_v2/10263869-sonic-frameworks-io/build-10263869.rsync.log
[2026-03-26 13:24:52,662][  INFO][PID:2592727] rsyncing finished.
[2026-03-26 13:24:52,663][  INFO][PID:2592727] Releasing VM back to pool
[2026-03-26 13:24:52,698][  INFO][PID:2592727] Searching for 'success' file in resultdir
[2026-03-26 13:24:52,701][ ERROR][PID:2592727] Build failed: Backend process error: No success file => build failure
[2026-03-26 13:24:52,706][  INFO][PID:2592727] Finished build: id=10263869 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/andersrh/SonicDE-devel chroot=alma+epel-10-x86_64_v2 
[2026-03-26 13:24:52,716][ ERROR][PID:2592727] Backend process error: No success file => build failure
[2026-03-26 13:24:52,722][  INFO][PID:2592727] Worker failed build, took 513.7588536739349
[2026-03-26 13:24:52,735][  INFO][PID:2592727] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "andersrh",
            "project_name": "SonicDE-devel",
            "project_dirname": "SonicDE-devel",
            "submitter": "andersrh",
            "ended_on": 1774531492.7227688,
            "started_on": 1774530978.963915,
            "submitted_on": null,
            "status": 0,
            "chroot": "alma+epel-10-x86_64_v2",
            "arch": "x86_64_v2",
            "buildroot_pkgs": [],
            "task_id": "10263869-alma+epel-10-x86_64_v2",
            "build_id": 10263869,
            "package_name": "sonic-frameworks-io",
            "package_version": "6.24.0-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/andersrh/SonicDE-devel/sonic-frameworks-io",
            "git_hash": "35f0fdaaee02f7f5b95e0ad7bb258fa2be80d390",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "andersrh/SonicDE-devel--andersrh",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 1,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/andersrh/SonicDE-devel/alma+epel-10-x86_64_v2/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@xlibre/xlibre-xserver/alma+epel-10-x86_64_v2/",
                    "id": "copr_xlibre_xlibre_xserver",
                    "name": "Additional repo copr_xlibre_xlibre_xserver"
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64_v2"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/andersrh/SonicDE-devel",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/andersrh/SonicDE-devel",
            "result_dir": "10263869-sonic-frameworks-io",
            "built_packages": "",
            "id": 10263869,
            "mockchain_macros": {
                "copr_username": "andersrh",
                "copr_projectname": "SonicDE-devel",
                "vendor": "Fedora Project COPR (andersrh/SonicDE-devel)"
            }
        }
    ]
}
[2026-03-26 13:24:52,863][  INFO][PID:2592727] Sending fedora-messaging bus message in build.end
[2026-03-26 13:24:52,906][  INFO][PID:2592727] Compressing /var/lib/copr/public_html/results/andersrh/SonicDE-devel/alma+epel-10-x86_64_v2/10263869-sonic-frameworks-io/builder-live.log by gzip
[2026-03-26 13:24:52,912][  INFO][PID:2592727] Running command 'gzip /var/lib/copr/public_html/results/andersrh/SonicDE-devel/alma+epel-10-x86_64_v2/10263869-sonic-frameworks-io/builder-live.log' as PID 2732839
[2026-03-26 13:24:53,208][  INFO][PID:2592727] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/andersrh/SonicDE-devel/alma+epel-10-x86_64_v2/10263869-sonic-frameworks-io/builder-live.log)
[2026-03-26 13:24:53,209][  INFO][PID:2592727] Compressing /var/lib/copr/public_html/results/andersrh/SonicDE-devel/alma+epel-10-x86_64_v2/10263869-sonic-frameworks-io/backend.log by gzip
[2026-03-26 13:24:53,210][  INFO][PID:2592727] Running command 'gzip /var/lib/copr/public_html/results/andersrh/SonicDE-devel/alma+epel-10-x86_64_v2/10263869-sonic-frameworks-io/backend.log' as PID 2732883