[2025-09-08 17:03:32,013][  INFO][PID:80861] Marking build as starting
[2025-09-08 17:03:32,051][  INFO][PID:80861] Checking for cancel request
[2025-09-08 17:03:32,052][  INFO][PID:80861] VM allocation process starts
[2025-09-08 17:03:32,064][  INFO][PID:80861] Trying to allocate VM: ResallocHost, ticket_id=4964640, requested_tags=['copr_builder', 'arch_noarch']
[2025-09-08 17:03:35,078][  INFO][PID:80861] Allocated host ResallocHost, ticket_id=4964640, hostname=54.147.89.127, name=aws_x86_64_spot_prod_06669916_20250908_165305, requested_tags=['copr_builder', 'arch_noarch']
[2025-09-08 17:03:35,079][  INFO][PID:80861] Allocating ssh connection to builder
[2025-09-08 17:03:35,079][  INFO][PID:80861] Checking that builder machine is OK
[2025-09-08 17:03:35,573][  INFO][PID:80861] Running remote command: copr-builder-ready srpm-builds
[2025-09-08 17:03:35,761][  INFO][PID:80861] Red Hat subscription not needed for srpm-builds
Builder is ready to be used

[2025-09-08 17:03:35,762][  INFO][PID:80861] Filling build.info file with builder info
[2025-09-08 17:03:35,762][  INFO][PID:80861] Checking for cancel request
[2025-09-08 17:03:35,763][  INFO][PID:80861] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 108000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": null,
            "enable_net": true,
            "project_owner": "@kicad",
            "project_name": "kicad-testing",
            "project_dirname": "kicad-testing",
            "submitter": "stevenfalco",
            "ended_on": null,
            "started_on": 1757351015.7636216,
            "submitted_on": null,
            "status": 3,
            "chroot": "srpm-builds",
            "arch": null,
            "buildroot_pkgs": null,
            "task_id": "9535400",
            "build_id": 9535400,
            "package_name": null,
            "package_version": null,
            "git_repo": null,
            "git_hash": null,
            "git_branch": null,
            "source_type": 2,
            "source_json": "{\"url\": \"https://copr.fedorainfracloud.org/tmp/tmp8n0w004w/kicad-testing.spec\", \"pkg\": \"kicad-testing.spec\", \"tmp\": \"tmp8n0w004w\"}",
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": null,
            "sandbox": "@kicad/kicad-testing--stevenfalco",
            "results": null,
            "appstream": false,
            "allow_user_ssh": null,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [],
            "background": false,
            "destdir": "/var/lib/copr/public_html/results/@kicad/kicad-testing",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@kicad/kicad-testing",
            "result_dir": "09535400",
            "built_packages": "",
            "tags": [
                "arch_noarch"
            ],
            "id": 9535400,
            "mockchain_macros": {
                "copr_username": "@kicad",
                "copr_projectname": "kicad-testing",
                "vendor": "Fedora Project COPR (@kicad/kicad-testing)"
            }
        }
    ]
}
[2025-09-08 17:03:35,781][  INFO][PID:80861] Sending fedora-messaging bus message in build.start
[2025-09-08 17:03:36,427][  INFO][PID:80861] Sending fedora-messaging bus message in chroot.start
[2025-09-08 17:03:36,451][  INFO][PID:80861] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --srpm --task-url https://copr.fedorainfracloud.org/backend/get-srpm-build-task/9535400 --detached
[2025-09-08 17:03:36,758][  INFO][PID:80861] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '54.147.89.127' (ED25519) to the list of known hosts.


[2025-09-08 17:03:36,759][  INFO][PID:80861] Downloading the builder-live.log file, attempt 1
[2025-09-08 17:03:36,760][  INFO][PID:80861] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.147.89.127 copr-rpmbuild-log
[2025-09-08 17:03:41,764][  INFO][PID:80861] Periodic builder liveness probe: alive
[2025-09-08 17:03:41,765][  INFO][PID:80861] Checking for cancel request
[2025-09-08 17:03:46,766][  INFO][PID:80861] Checking for cancel request
[2025-09-08 17:03:51,767][  INFO][PID:80861] Checking for cancel request
[2025-09-08 17:03:56,768][  INFO][PID:80861] Checking for cancel request
[2025-09-08 17:04:01,769][  INFO][PID:80861] Checking for cancel request
[2025-09-08 17:04:06,770][  INFO][PID:80861] Checking for cancel request
[2025-09-08 17:04:11,771][  INFO][PID:80861] Checking for cancel request
[2025-09-08 17:04:16,772][  INFO][PID:80861] Checking for cancel request
[2025-09-08 17:04:21,773][  INFO][PID:80861] Checking for cancel request
[2025-09-08 17:04:26,774][  INFO][PID:80861] Checking for cancel request
[2025-09-08 17:04:31,775][  INFO][PID:80861] Checking for cancel request
[2025-09-08 17:04:36,776][  INFO][PID:80861] Checking for cancel request
[2025-09-08 17:04:41,777][  INFO][PID:80861] Checking for cancel request
[2025-09-08 17:04:46,778][  INFO][PID:80861] Checking for cancel request
[2025-09-08 17:04:51,780][  INFO][PID:80861] Checking for cancel request
[2025-09-08 17:04:56,781][  INFO][PID:80861] Checking for cancel request
[2025-09-08 17:05:01,782][  INFO][PID:80861] Checking for cancel request
[2025-09-08 17:05:06,783][  INFO][PID:80861] Checking for cancel request
[2025-09-08 17:05:09,143][  INFO][PID:80861] Downloading results from builder
[2025-09-08 17:05:09,144][  INFO][PID:80861] rsyncing of mockbuilder@54.147.89.127:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@kicad/kicad-testing/srpm-builds/09535400 started
[2025-09-08 17:05:09,145][  INFO][PID:80861] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@54.147.89.127:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@kicad/kicad-testing/srpm-builds/09535400/ &> /var/lib/copr/public_html/results/@kicad/kicad-testing/srpm-builds/09535400/build-09535400.rsync.log
[2025-09-08 17:58:49,889][  INFO][PID:80861] rsyncing finished.
[2025-09-08 17:58:49,890][ ERROR][PID:80861] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2025-09-08 17:58:49,890][ ERROR][PID:80861] SSH connection lost on #1 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2025-09-08 17:58:59,891][  INFO][PID:80861] rsyncing of mockbuilder@54.147.89.127:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@kicad/kicad-testing/srpm-builds/09535400 started
[2025-09-08 17:58:59,892][  INFO][PID:80861] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@54.147.89.127:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@kicad/kicad-testing/srpm-builds/09535400/ &> /var/lib/copr/public_html/results/@kicad/kicad-testing/srpm-builds/09535400/build-09535400.rsync.log
[2025-09-08 17:59:59,970][  INFO][PID:80861] rsyncing finished.
[2025-09-08 17:59:59,970][ ERROR][PID:80861] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2025-09-08 17:59:59,971][ ERROR][PID:80861] SSH connection lost on #2 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2025-09-08 18:00:09,971][  INFO][PID:80861] rsyncing of mockbuilder@54.147.89.127:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@kicad/kicad-testing/srpm-builds/09535400 started
[2025-09-08 18:00:09,972][  INFO][PID:80861] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@54.147.89.127:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@kicad/kicad-testing/srpm-builds/09535400/ &> /var/lib/copr/public_html/results/@kicad/kicad-testing/srpm-builds/09535400/build-09535400.rsync.log
[2025-09-08 18:01:10,051][  INFO][PID:80861] rsyncing finished.
[2025-09-08 18:01:10,052][ ERROR][PID:80861] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2025-09-08 18:01:10,052][ ERROR][PID:80861] SSH connection lost on #3 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2025-09-08 18:01:20,053][ ERROR][PID:80861] Re-try request for task on 'ResallocHost, ticket_id=4964640, hostname=54.147.89.127, name=aws_x86_64_spot_prod_06669916_20250908_165305, requested_tags=['copr_builder', 'arch_noarch']': Unable to finish after 3 SSH attempts
[2025-09-08 18:01:20,053][  INFO][PID:80861] Releasing VM back to pool
[2025-09-08 18:01:20,062][  INFO][PID:80861] Retry #1 (on other host)
[2025-09-08 18:01:20,063][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:01:20,064][  INFO][PID:80861] VM allocation process starts
[2025-09-08 18:01:20,115][  INFO][PID:80861] Trying to allocate VM: ResallocHost, ticket_id=4964833, requested_tags=['copr_builder', 'arch_noarch']
[2025-09-08 18:01:23,169][  INFO][PID:80861] Allocated host ResallocHost, ticket_id=4964833, hostname=140.211.168.81, name=copr_osuosl_p09_prod_06669321_20250908_152204, requested_tags=['copr_builder', 'arch_noarch']
[2025-09-08 18:01:23,170][  INFO][PID:80861] Allocating ssh connection to builder
[2025-09-08 18:01:23,170][  INFO][PID:80861] Checking that builder machine is OK
[2025-09-08 18:01:24,497][  INFO][PID:80861] Running remote command: copr-builder-ready srpm-builds
[2025-09-08 18:01:25,476][  INFO][PID:80861] Red Hat subscription not needed for srpm-builds
Builder is ready to be used

[2025-09-08 18:01:25,477][  INFO][PID:80861] Filling build.info file with builder info
[2025-09-08 18:01:25,481][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:01:25,482][  INFO][PID:80861] Not re-notifying FE and msg buses for the new host.
[2025-09-08 18:01:25,482][  INFO][PID:80861] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --srpm --task-url https://copr.fedorainfracloud.org/backend/get-srpm-build-task/9535400 --detached
[2025-09-08 18:01:26,731][  INFO][PID:80861] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '140.211.168.81' (ED25519) to the list of known hosts.


[2025-09-08 18:01:26,731][  INFO][PID:80861] Downloading the builder-live.log file, attempt 1
[2025-09-08 18:01:26,733][  INFO][PID:80861] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.81 copr-rpmbuild-log
[2025-09-08 18:01:31,737][  INFO][PID:80861] Periodic builder liveness probe: alive
[2025-09-08 18:01:31,737][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:01:36,738][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:01:41,739][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:01:46,740][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:01:51,741][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:01:56,743][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:02:01,744][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:02:06,745][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:02:11,746][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:02:16,747][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:02:21,748][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:02:26,749][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:02:31,750][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:03:55,375][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:04:00,376][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:04:09,326][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:04:21,814][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:04:27,022][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:04:32,023][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:04:39,935][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:04:45,558][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:05:05,118][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:05:10,119][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:05:16,366][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:05:21,367][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:05:40,926][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:05:45,927][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:05:50,928][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:05:55,929][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:06:00,930][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:06:05,931][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:06:43,998][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:07:25,190][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:07:30,191][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:08:01,398][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:08:41,342][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:08:47,383][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:09:06,526][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:09:11,719][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:09:16,751][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:09:23,103][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:09:28,104][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:09:34,351][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:09:41,223][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:10:10,350][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:10:15,558][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:10:21,391][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:10:26,393][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:10:31,394][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:11:04,054][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:11:09,057][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:11:14,058][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:11:59,622][  INFO][PID:80861] Periodic builder liveness probe: alive
[2025-09-08 18:11:59,623][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:12:04,624][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:12:31,462][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:12:36,463][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:12:41,464][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:12:46,465][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:12:54,998][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:13:01,246][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:13:06,248][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:13:13,534][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:13:18,536][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:14:21,567][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:14:26,568][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:14:40,095][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:14:46,344][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:14:51,346][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:14:56,551][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:15:02,382][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:15:10,295][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:15:15,299][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:15:20,300][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:15:25,302][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:15:40,511][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:15:45,697][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:15:50,788][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:16:14,294][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:16:19,296][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:16:24,297][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:16:29,298][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:16:42,616][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:16:47,617][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:16:52,619][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:16:57,620][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:17:02,621][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:18:53,286][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:19:58,398][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:20:15,670][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:20:20,672][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:20:25,673][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:20:34,831][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:20:39,833][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:20:48,782][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:20:54,198][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:21:03,358][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:21:07,139][ ERROR][PID:80861] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-08 18:21:10,022][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:21:15,024][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:21:17,141][WARNING][PID:80861] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-09-08 18:21:20,025][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:21:25,026][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:21:27,142][  INFO][PID:80861] Downloading the builder-live.log file, attempt 2
[2025-09-08 18:21:28,351][  INFO][PID:80861] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.81 copr-rpmbuild-log
[2025-09-08 18:21:33,351][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:21:50,415][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:21:55,416][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:22:00,422][  INFO][PID:80861] Periodic builder liveness probe: dead
[2025-09-08 18:22:28,547][ ERROR][PID:80861] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-08 18:22:35,782][  INFO][PID:80861] calling cancel callback, and waiting
[2025-09-08 18:22:45,786][WARNING][PID:80861] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-09-08 18:22:55,787][  INFO][PID:80861] Downloading the builder-live.log file, attempt 3
[2025-09-08 18:22:55,788][  INFO][PID:80861] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.81 copr-rpmbuild-log
[2025-09-08 18:23:35,851][ ERROR][PID:80861] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.81 port 22: Connection timed out

[2025-09-08 18:23:55,857][ ERROR][PID:80861] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-08 18:24:05,860][WARNING][PID:80861] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-09-08 18:24:15,861][  INFO][PID:80861] Downloading the builder-live.log file, attempt 4
[2025-09-08 18:24:15,862][  INFO][PID:80861] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.81 copr-rpmbuild-log
[2025-09-08 18:24:45,918][ ERROR][PID:80861] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.81 port 22: Connection timed out

[2025-09-08 18:25:15,930][ ERROR][PID:80861] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-08 18:25:25,935][ ERROR][PID:80861] Giving up for unstable SSH, failures: 1757355677.1419263, 1757355765.7866058, 1757355845.8605952, 1757355925.9348803
[2025-09-08 18:26:08,259][ ERROR][PID:80861] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.81 port 22: Connection timed out

[2025-09-08 18:27:43,906][ ERROR][PID:80861] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.81 port 22: Connection timed out

[2025-09-08 18:27:54,526][ ERROR][PID:80861] Can't ssh to cancel build.
[2025-09-08 18:27:57,023][ ERROR][PID:80861] Re-try request for task on 'ResallocHost, ticket_id=4964833, hostname=140.211.168.81, name=copr_osuosl_p09_prod_06669321_20250908_152204, requested_tags=['copr_builder', 'arch_noarch']': SSH problems when downloading live log: Resalloc ticket FAILED
[2025-09-08 18:27:57,023][  INFO][PID:80861] Releasing VM back to pool
[2025-09-08 18:27:57,033][  INFO][PID:80861] Retry #2 (on other host)
[2025-09-08 18:27:57,034][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:27:57,035][  INFO][PID:80861] VM allocation process starts
[2025-09-08 18:27:57,046][  INFO][PID:80861] Trying to allocate VM: ResallocHost, ticket_id=4964908, requested_tags=['copr_builder', 'arch_noarch']
[2025-09-08 18:28:00,060][  INFO][PID:80861] Allocated host ResallocHost, ticket_id=4964908, hostname=2620:52:3:1:dead:beef:cafe:c194, name=copr_hv_x86_64_03_prod_06670333_20250908_182603, requested_tags=['copr_builder', 'arch_noarch']
[2025-09-08 18:28:05,462][  INFO][PID:80861] Allocating ssh connection to builder
[2025-09-08 18:28:05,462][  INFO][PID:80861] Checking that builder machine is OK
[2025-09-08 18:28:05,965][  INFO][PID:80861] Running remote command: copr-builder-ready srpm-builds
[2025-09-08 18:28:06,898][  INFO][PID:80861] Red Hat subscription not needed for srpm-builds
Builder is ready to be used

[2025-09-08 18:28:06,898][  INFO][PID:80861] Filling build.info file with builder info
[2025-09-08 18:28:06,900][  INFO][PID:80861] Checking for cancel request
[2025-09-08 18:28:07,102][  INFO][PID:80861] Not re-notifying FE and msg buses for the new host.
[2025-09-08 18:28:07,934][  INFO][PID:80861] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --srpm --task-url https://copr.fedorainfracloud.org/backend/get-srpm-build-task/9535400 --detached
[2025-09-08 18:28:08,502][  INFO][PID:80861] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c194' (ED25519) to the list of known hosts.


[2025-09-08 18:28:08,503][  INFO][PID:80861] Downloading the builder-live.log file, attempt 1
[2025-09-08 18:28:08,504][  INFO][PID:80861] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c194 copr-rpmbuild-log
[2025-09-08 18:28:13,503][  INFO][PID:80861] calling cancel callback, and waiting
[2025-09-08 18:28:17,663][  INFO][PID:80861] Cancel request succeeded
out:
success
err:
Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c194' (ED25519) to the list of known hosts.

[2025-09-08 18:28:20,158][  INFO][PID:80861] Downloading results from builder
[2025-09-08 18:28:20,158][  INFO][PID:80861] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c194]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@kicad/kicad-testing/srpm-builds/09535400 started
[2025-09-08 18:28:20,159][  INFO][PID:80861] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c194]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@kicad/kicad-testing/srpm-builds/09535400/ &> /var/lib/copr/public_html/results/@kicad/kicad-testing/srpm-builds/09535400/build-09535400.rsync.log
[2025-09-08 18:28:20,568][  INFO][PID:80861] rsyncing finished.
[2025-09-08 18:28:20,569][  INFO][PID:80861] Releasing VM back to pool
[2025-09-08 18:28:20,578][  INFO][PID:80861] Searching for 'success' file in resultdir
[2025-09-08 18:28:20,782][ ERROR][PID:80861] Build failed: Backend process error: No success file => build failure
[2025-09-08 18:28:20,783][  INFO][PID:80861] Finished build: id=9535400 failed=True timeout=108000 destdir=/var/lib/copr/public_html/results/@kicad/kicad-testing chroot=srpm-builds 
[2025-09-08 18:28:20,784][ ERROR][PID:80861] Backend process error: No success file => build failure
[2025-09-08 18:28:20,785][  INFO][PID:80861] Worker failed build, took 13.683010578155518
[2025-09-08 18:28:20,786][  INFO][PID:80861] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 108000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": null,
            "enable_net": true,
            "project_owner": "@kicad",
            "project_name": "kicad-testing",
            "project_dirname": "kicad-testing",
            "submitter": "stevenfalco",
            "ended_on": 1757356100.7854538,
            "started_on": 1757356087.1024432,
            "submitted_on": null,
            "status": 0,
            "chroot": "srpm-builds",
            "arch": null,
            "buildroot_pkgs": null,
            "task_id": "9535400",
            "build_id": 9535400,
            "package_name": null,
            "package_version": null,
            "git_repo": null,
            "git_hash": null,
            "git_branch": null,
            "source_type": 2,
            "source_json": "{\"url\": \"https://copr.fedorainfracloud.org/tmp/tmp8n0w004w/kicad-testing.spec\", \"pkg\": \"kicad-testing.spec\", \"tmp\": \"tmp8n0w004w\"}",
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": null,
            "sandbox": "@kicad/kicad-testing--stevenfalco",
            "results": null,
            "appstream": false,
            "allow_user_ssh": null,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [],
            "background": false,
            "destdir": "/var/lib/copr/public_html/results/@kicad/kicad-testing",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@kicad/kicad-testing",
            "result_dir": "09535400",
            "built_packages": "",
            "tags": [
                "arch_noarch"
            ],
            "id": 9535400,
            "mockchain_macros": {
                "copr_username": "@kicad",
                "copr_projectname": "kicad-testing",
                "vendor": "Fedora Project COPR (@kicad/kicad-testing)"
            }
        }
    ]
}
[2025-09-08 18:28:20,810][  INFO][PID:80861] Sending fedora-messaging bus message in build.end
[2025-09-08 18:28:20,833][  INFO][PID:80861] Compressing /var/lib/copr/public_html/results/@kicad/kicad-testing/srpm-builds/09535400/builder-live.log by gzip
[2025-09-08 18:28:20,834][  INFO][PID:80861] Running command 'gzip /var/lib/copr/public_html/results/@kicad/kicad-testing/srpm-builds/09535400/builder-live.log' as PID 309958
[2025-09-08 18:28:20,841][  INFO][PID:80861] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@kicad/kicad-testing/srpm-builds/09535400/builder-live.log)
[2025-09-08 18:28:20,842][  INFO][PID:80861] Compressing /var/lib/copr/public_html/results/@kicad/kicad-testing/srpm-builds/09535400/backend.log by gzip
[2025-09-08 18:28:20,843][  INFO][PID:80861] Running command 'gzip /var/lib/copr/public_html/results/@kicad/kicad-testing/srpm-builds/09535400/backend.log' as PID 309959