[2025-10-01 19:05:07,972][  INFO][PID:2959292] Marking build as starting
[2025-10-01 19:05:08,156][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:05:08,158][  INFO][PID:2959292] VM allocation process starts
[2025-10-01 19:05:08,183][  INFO][PID:2959292] Trying to allocate VM: ResallocHost, ticket_id=5424853, requested_tags=['copr_builder', 'arch_x86_64']
[2025-10-01 19:05:13,188][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:05:18,192][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:05:23,193][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:05:28,198][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:05:33,201][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:05:38,201][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:05:43,209][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:05:48,210][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:05:53,211][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:05:58,214][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:06:03,220][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:06:08,221][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:06:13,230][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:06:18,233][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:06:23,234][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:06:28,238][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:06:33,242][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:06:38,243][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:06:43,247][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:06:48,252][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:06:53,254][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:06:58,264][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:07:03,265][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:07:08,272][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:07:13,273][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:07:18,274][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:07:23,279][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:07:28,285][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:07:33,286][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:07:38,289][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:07:43,290][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:07:48,292][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:07:53,293][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:07:58,298][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:08:03,299][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:08:08,300][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:08:13,301][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:08:18,384][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:08:23,393][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:08:28,396][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:08:33,397][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:08:38,400][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:08:43,412][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:08:48,413][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:08:53,420][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:08:58,425][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:09:03,426][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:09:08,432][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:09:13,440][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:09:18,442][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:09:23,445][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:09:28,446][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:09:33,458][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:09:38,461][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:09:43,463][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:09:48,465][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:09:53,469][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:09:58,477][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:10:03,478][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:10:08,486][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:10:13,488][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:10:18,492][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:10:23,495][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:10:28,504][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:10:33,505][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:10:38,506][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:10:43,508][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:10:48,509][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:10:53,515][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:10:58,519][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:11:03,520][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:11:08,524][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:11:13,526][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:11:18,534][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:11:23,538][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:11:26,625][  INFO][PID:2959292] Allocated host ResallocHost, ticket_id=5424853, hostname=2620:52:3:1:dead:beef:cafe:c14f, name=copr_hv_x86_64_02_prod_07097068_20251001_190329, requested_tags=['copr_builder', 'arch_x86_64']
[2025-10-01 19:11:26,626][  INFO][PID:2959292] Allocating ssh connection to builder
[2025-10-01 19:11:26,627][  INFO][PID:2959292] Checking that builder machine is OK
[2025-10-01 19:11:27,232][  INFO][PID:2959292] Running remote command: copr-builder-ready opensuse-tumbleweed-x86_64
[2025-10-01 19:11:27,668][  INFO][PID:2959292] Red Hat subscription not needed for opensuse-tumbleweed-x86_64
Builder is ready to be used

[2025-10-01 19:11:27,672][  INFO][PID:2959292] Filling build.info file with builder info
[2025-10-01 19:11:27,673][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:11:27,674][  INFO][PID:2959292] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "osalbahr",
            "project_name": "mirafetch",
            "project_dirname": "mirafetch",
            "submitter": "osalbahr",
            "ended_on": null,
            "started_on": 1759345887.6739225,
            "submitted_on": null,
            "status": 3,
            "chroot": "opensuse-tumbleweed-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "9637226-opensuse-tumbleweed-x86_64",
            "build_id": 9637226,
            "package_name": "mirafetch",
            "package_version": "0.1.0-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/osalbahr/mirafetch/mirafetch",
            "git_hash": "3c23b2c71cdab6bab43b0db64235a356c8598732",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "osalbahr/mirafetch--osalbahr",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/osalbahr/mirafetch/opensuse-tumbleweed-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/osalbahr/mirafetch",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/osalbahr/mirafetch",
            "result_dir": "09637226-mirafetch",
            "built_packages": "",
            "id": 9637226,
            "mockchain_macros": {
                "copr_username": "osalbahr",
                "copr_projectname": "mirafetch",
                "vendor": "Fedora Project COPR (osalbahr/mirafetch)"
            }
        }
    ]
}
[2025-10-01 19:11:27,811][  INFO][PID:2959292] Sending fedora-messaging bus message in build.start
[2025-10-01 19:11:31,528][  INFO][PID:2959292] Sending fedora-messaging bus message in chroot.start
[2025-10-01 19:11:31,572][  INFO][PID:2959292] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9637226-opensuse-tumbleweed-x86_64 --chroot opensuse-tumbleweed-x86_64 --detached
[2025-10-01 19:11:32,215][  INFO][PID:2959292] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c14f' (ED25519) to the list of known hosts.


[2025-10-01 19:11:32,220][  INFO][PID:2959292] Downloading the builder-live.log file, attempt 1
[2025-10-01 19:11:32,227][  INFO][PID:2959292] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c14f copr-rpmbuild-log
[2025-10-01 19:11:37,233][  INFO][PID:2959292] Periodic builder liveness probe: alive
[2025-10-01 19:11:37,234][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:11:42,242][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:11:47,254][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:11:52,255][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:11:57,259][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:12:02,260][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:12:07,266][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:12:12,268][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:12:17,269][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:12:22,278][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:12:27,283][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:12:32,287][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:12:37,290][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:12:42,292][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:12:47,293][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:12:52,295][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:12:57,300][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:13:02,307][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:13:07,308][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:13:12,311][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:13:17,313][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:13:22,314][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:13:27,316][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:13:32,319][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:13:37,328][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:13:42,336][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:13:47,337][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:13:52,343][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:13:57,350][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:14:02,351][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:14:07,358][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:14:12,362][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:14:17,363][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:14:22,370][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:14:27,374][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:14:32,383][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:14:37,393][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:14:42,394][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:14:47,397][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:14:52,398][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:14:57,402][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:15:01,140][ ERROR][PID:2959292] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-10-01 19:15:02,406][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:15:07,407][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:15:11,149][WARNING][PID:2959292] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-10-01 19:15:12,409][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:15:17,414][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:15:21,150][  INFO][PID:2959292] Downloading the builder-live.log file, attempt 2
[2025-10-01 19:15:21,151][  INFO][PID:2959292] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c14f copr-rpmbuild-log
[2025-10-01 19:15:22,415][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:15:27,420][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:15:32,431][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:15:37,434][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:15:42,435][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:15:47,439][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:15:52,445][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:15:57,455][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:16:02,456][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:16:07,462][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:16:12,466][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:16:17,478][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:16:21,224][ ERROR][PID:2959292] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-10-01 19:16:22,482][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:16:27,487][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:16:31,228][WARNING][PID:2959292] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-10-01 19:16:32,490][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:16:37,497][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:16:41,230][  INFO][PID:2959292] Downloading the builder-live.log file, attempt 3
[2025-10-01 19:16:41,235][  INFO][PID:2959292] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c14f copr-rpmbuild-log
[2025-10-01 19:16:42,500][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:16:47,501][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:16:52,507][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:16:57,508][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:17:02,509][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:17:07,511][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:17:12,512][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:17:17,521][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:17:22,524][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:17:27,525][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:17:32,529][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:17:37,530][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:17:41,322][ ERROR][PID:2959292] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-10-01 19:17:42,531][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:17:47,534][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:17:51,323][WARNING][PID:2959292] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-10-01 19:17:52,547][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:17:57,548][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:18:01,334][  INFO][PID:2959292] Downloading the builder-live.log file, attempt 4
[2025-10-01 19:18:01,344][  INFO][PID:2959292] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c14f copr-rpmbuild-log
[2025-10-01 19:18:02,549][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:18:07,559][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:18:12,561][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:18:17,565][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:18:22,571][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:18:27,572][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:18:32,574][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:18:37,584][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:18:42,585][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:18:47,589][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:18:52,590][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:18:57,594][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:19:01,454][ ERROR][PID:2959292] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-10-01 19:19:02,594][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:19:07,598][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:19:11,455][ ERROR][PID:2959292] Giving up for unstable SSH, failures: 1759346111.1496027, 1759346191.2286098, 1759346271.3233538, 1759346351.4556718
[2025-10-01 19:19:11,456][ ERROR][PID:2959292] Re-try request for task on 'ResallocHost, ticket_id=5424853, hostname=2620:52:3:1:dead:beef:cafe:c14f, name=copr_hv_x86_64_02_prod_07097068_20251001_190329, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-10-01 19:19:11,457][  INFO][PID:2959292] Releasing VM back to pool
[2025-10-01 19:19:11,480][  INFO][PID:2959292] Retry #1 (on other host)
[2025-10-01 19:19:11,481][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:19:11,482][  INFO][PID:2959292] VM allocation process starts
[2025-10-01 19:19:11,508][  INFO][PID:2959292] Trying to allocate VM: ResallocHost, ticket_id=5425095, requested_tags=['copr_builder', 'arch_x86_64']
[2025-10-01 19:19:16,509][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:19:21,510][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:19:26,516][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:19:31,524][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:19:36,525][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:19:39,605][  INFO][PID:2959292] Allocated host ResallocHost, ticket_id=5425095, hostname=2620:52:3:1:dead:beef:cafe:c1c8, name=copr_hv_x86_64_04_prod_07097402_20251001_190523, requested_tags=['copr_builder', 'arch_x86_64']
[2025-10-01 19:19:39,605][  INFO][PID:2959292] Allocating ssh connection to builder
[2025-10-01 19:19:39,606][  INFO][PID:2959292] Checking that builder machine is OK
[2025-10-01 19:19:40,282][  INFO][PID:2959292] Running remote command: copr-builder-ready opensuse-tumbleweed-x86_64
[2025-10-01 19:19:40,662][  INFO][PID:2959292] Red Hat subscription not needed for opensuse-tumbleweed-x86_64
Builder is ready to be used

[2025-10-01 19:19:40,664][  INFO][PID:2959292] Filling build.info file with builder info
[2025-10-01 19:19:40,667][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:19:40,668][  INFO][PID:2959292] Not re-notifying FE and msg buses for the new host.
[2025-10-01 19:19:40,671][  INFO][PID:2959292] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9637226-opensuse-tumbleweed-x86_64 --chroot opensuse-tumbleweed-x86_64 --detached
[2025-10-01 19:19:41,312][  INFO][PID:2959292] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c1c8' (ED25519) to the list of known hosts.


[2025-10-01 19:19:41,315][  INFO][PID:2959292] Downloading the builder-live.log file, attempt 1
[2025-10-01 19:19:41,320][  INFO][PID:2959292] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c1c8 copr-rpmbuild-log
[2025-10-01 19:19:46,315][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:19:51,317][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:19:56,317][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:20:01,325][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:20:06,329][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:20:11,330][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:20:16,331][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:20:21,340][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:20:26,346][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:20:31,347][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:20:36,353][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:20:41,358][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:20:46,359][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:20:51,361][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:20:56,368][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:21:01,370][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:21:06,371][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:21:11,374][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:21:16,381][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:21:21,382][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:21:26,383][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:21:31,394][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:21:36,396][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:21:41,406][  INFO][PID:2959292] Periodic builder liveness probe: alive
[2025-10-01 19:21:41,406][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:21:46,409][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:21:51,414][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:21:56,416][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:22:01,417][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:22:06,420][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:22:11,423][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:22:16,424][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:22:21,428][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:22:26,436][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:22:31,438][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:22:36,439][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:22:41,450][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:22:46,457][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:22:51,458][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:22:56,465][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:23:01,474][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:23:06,478][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:23:11,479][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:23:16,483][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:23:21,491][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:23:26,492][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:23:27,139][ ERROR][PID:2959292] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-10-01 19:23:31,502][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:23:36,504][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:23:37,140][WARNING][PID:2959292] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-10-01 19:23:41,506][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:23:46,508][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:23:47,144][  INFO][PID:2959292] Downloading the builder-live.log file, attempt 2
[2025-10-01 19:23:47,149][  INFO][PID:2959292] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c1c8 copr-rpmbuild-log
[2025-10-01 19:23:51,512][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:23:56,521][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:24:01,522][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:24:06,526][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:24:11,528][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:24:16,529][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:24:21,532][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:24:26,535][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:24:31,541][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:24:36,542][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:24:41,545][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:24:46,547][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:24:47,223][ ERROR][PID:2959292] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-10-01 19:24:51,548][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:24:56,552][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:24:57,227][WARNING][PID:2959292] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-10-01 19:25:01,557][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:25:06,561][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:25:07,228][  INFO][PID:2959292] Downloading the builder-live.log file, attempt 3
[2025-10-01 19:25:07,229][  INFO][PID:2959292] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c1c8 copr-rpmbuild-log
[2025-10-01 19:25:11,562][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:25:16,563][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:25:21,568][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:25:26,572][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:25:31,573][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:25:36,574][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:25:41,577][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:25:46,581][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:25:51,582][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:25:56,583][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:26:01,592][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:26:06,595][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:26:07,298][ ERROR][PID:2959292] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-10-01 19:26:11,597][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:26:16,598][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:26:17,299][WARNING][PID:2959292] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-10-01 19:26:21,599][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:26:26,601][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:26:27,301][  INFO][PID:2959292] Downloading the builder-live.log file, attempt 4
[2025-10-01 19:26:27,306][  INFO][PID:2959292] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c1c8 copr-rpmbuild-log
[2025-10-01 19:26:31,604][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:26:36,605][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:26:41,606][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:26:46,610][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:26:51,611][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:26:56,612][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:27:01,613][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:27:06,614][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:27:11,616][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:27:16,620][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:27:21,621][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:27:26,622][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:27:27,382][ ERROR][PID:2959292] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-10-01 19:27:31,623][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:27:36,631][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:27:37,398][ ERROR][PID:2959292] Giving up for unstable SSH, failures: 1759346617.1401246, 1759346697.2272537, 1759346777.2995486, 1759346857.398212
[2025-10-01 19:27:37,401][ ERROR][PID:2959292] Re-try request for task on 'ResallocHost, ticket_id=5425095, hostname=2620:52:3:1:dead:beef:cafe:c1c8, name=copr_hv_x86_64_04_prod_07097402_20251001_190523, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-10-01 19:27:37,402][  INFO][PID:2959292] Releasing VM back to pool
[2025-10-01 19:27:37,441][  INFO][PID:2959292] Retry #2 (on other host)
[2025-10-01 19:27:37,450][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:27:37,455][  INFO][PID:2959292] VM allocation process starts
[2025-10-01 19:27:37,523][  INFO][PID:2959292] Trying to allocate VM: ResallocHost, ticket_id=5425177, requested_tags=['copr_builder', 'arch_x86_64']
[2025-10-01 19:27:42,533][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:27:47,534][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:27:52,535][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:27:57,538][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:28:02,543][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:28:07,544][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:28:12,545][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:28:17,553][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:28:22,554][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:28:27,557][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:28:32,557][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:28:37,559][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:28:42,569][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:28:47,570][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:28:52,571][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:28:57,572][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:29:02,580][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:29:07,583][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:29:12,585][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:29:17,586][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:29:22,587][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:29:27,592][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:29:32,603][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:29:37,604][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:29:42,605][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:29:47,607][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:29:52,608][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:29:57,609][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:30:02,610][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:30:07,613][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:30:12,620][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:30:17,621][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:30:22,622][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:30:27,628][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:30:32,629][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:30:37,636][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:30:42,637][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:30:47,638][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:30:52,650][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:30:57,659][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:31:02,660][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:31:07,661][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:31:12,671][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:31:17,673][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:31:22,674][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:31:27,675][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:31:32,679][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:31:37,681][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:31:42,682][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:31:47,683][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:31:52,695][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:31:57,702][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:32:02,704][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:32:07,705][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:32:12,706][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:32:17,711][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:32:22,714][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:32:27,717][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:32:32,721][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:32:37,722][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:32:42,731][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:32:47,734][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:32:52,739][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:32:57,740][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:33:02,741][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:33:07,746][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:33:12,749][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:33:17,750][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:33:22,751][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:33:27,757][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:33:32,761][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:33:37,762][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:33:42,763][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:33:47,764][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:33:52,770][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:33:57,772][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:34:02,773][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:34:07,775][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:34:12,778][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:34:17,783][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:34:22,785][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:34:27,786][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:34:32,790][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:34:37,802][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:34:42,804][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:34:47,806][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:34:52,808][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:34:57,810][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:35:02,815][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:35:07,817][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:35:12,823][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:35:17,826][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:35:22,830][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:35:27,832][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:35:32,837][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:35:37,844][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:35:42,848][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:35:47,851][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:35:52,854][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:35:57,856][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:36:02,857][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:36:07,858][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:36:12,863][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:36:17,871][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:36:22,872][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:36:27,873][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:36:32,874][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:36:37,876][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:36:42,880][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:36:47,881][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:36:52,882][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:36:57,887][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:37:02,891][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:37:07,899][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:37:12,900][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:37:17,903][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:37:22,907][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:37:27,909][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:37:32,910][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:37:37,916][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:37:42,917][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:37:47,918][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:37:52,921][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:37:57,931][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:38:02,933][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:38:07,934][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:38:12,939][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:38:17,940][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:38:22,943][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:38:27,945][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:38:32,951][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:38:37,956][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:38:42,957][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:38:47,958][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:38:52,960][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:38:57,964][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:39:02,970][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:39:07,983][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:39:12,985][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:39:17,987][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:39:22,988][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:39:27,993][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:39:33,000][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:39:38,018][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:39:43,022][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:39:48,032][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:39:53,033][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:39:58,034][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:40:03,045][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:40:08,048][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:40:13,054][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:40:18,055][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:40:23,056][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:40:28,066][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:40:33,069][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:40:38,078][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:40:43,080][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:40:48,090][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:40:53,091][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:40:58,092][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:41:03,100][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:41:08,102][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:41:13,103][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:41:18,113][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:41:23,115][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:41:28,118][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:41:33,129][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:41:38,130][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:41:43,131][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:41:48,138][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:41:53,146][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:41:58,147][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:42:03,154][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:42:08,155][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:42:13,156][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:42:18,163][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:42:23,166][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:42:28,172][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:42:33,173][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:42:38,178][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:42:43,185][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:42:48,194][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:42:53,198][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:42:58,202][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:43:03,213][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:43:08,214][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:43:13,216][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:43:18,224][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:43:23,225][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:43:28,229][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:43:33,233][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:43:38,237][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:43:43,251][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:43:48,254][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:43:53,262][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:43:58,265][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:44:03,267][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:44:08,273][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:44:13,274][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:44:18,278][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:44:23,290][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:44:28,297][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:44:33,305][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:44:38,311][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:44:43,322][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:44:48,329][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:44:53,337][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:44:58,343][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:45:03,349][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:45:08,352][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:45:13,358][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:45:18,361][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:45:23,368][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:45:28,373][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:45:33,376][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:45:38,380][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:45:43,384][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:45:48,396][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:45:53,401][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:45:58,406][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:46:03,418][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:46:08,421][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:46:13,430][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:46:18,443][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:46:23,455][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:46:28,460][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:46:33,461][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:46:38,474][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:46:43,479][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:46:48,480][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:46:53,481][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:46:58,486][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:47:03,493][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:47:08,495][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:47:13,496][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:47:18,502][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:47:23,503][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:47:28,507][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:47:33,518][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:47:38,523][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:47:43,525][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:47:48,526][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:47:53,533][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:47:56,028][  INFO][PID:2959292] Allocated host ResallocHost, ticket_id=5425177, hostname=2620:52:3:1:dead:beef:cafe:c1d8, name=copr_hv_x86_64_04_prod_07104549_20251001_194535, requested_tags=['copr_builder', 'arch_x86_64']
[2025-10-01 19:47:56,036][  INFO][PID:2959292] Allocating ssh connection to builder
[2025-10-01 19:47:56,037][  INFO][PID:2959292] Checking that builder machine is OK
[2025-10-01 19:47:56,753][  INFO][PID:2959292] Running remote command: copr-builder-ready opensuse-tumbleweed-x86_64
[2025-10-01 19:47:57,265][  INFO][PID:2959292] Red Hat subscription not needed for opensuse-tumbleweed-x86_64
Builder is ready to be used

[2025-10-01 19:47:57,266][  INFO][PID:2959292] Filling build.info file with builder info
[2025-10-01 19:47:57,273][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:47:57,279][  INFO][PID:2959292] Not re-notifying FE and msg buses for the new host.
[2025-10-01 19:47:57,280][  INFO][PID:2959292] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9637226-opensuse-tumbleweed-x86_64 --chroot opensuse-tumbleweed-x86_64 --detached
[2025-10-01 19:47:57,960][  INFO][PID:2959292] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c1d8' (ED25519) to the list of known hosts.


[2025-10-01 19:47:57,961][  INFO][PID:2959292] Downloading the builder-live.log file, attempt 1
[2025-10-01 19:47:57,966][  INFO][PID:2959292] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c1d8 copr-rpmbuild-log
[2025-10-01 19:48:02,970][  INFO][PID:2959292] Periodic builder liveness probe: alive
[2025-10-01 19:48:02,971][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:48:07,973][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:48:12,975][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:48:17,988][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:48:22,991][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:48:27,992][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:48:32,995][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:48:37,996][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:48:43,011][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:48:48,018][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:48:53,021][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:48:58,024][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:49:03,029][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:49:08,030][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:49:13,035][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:49:18,039][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:49:23,050][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:49:28,051][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:49:33,054][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:49:38,058][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:49:43,060][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:49:48,072][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:49:53,075][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:49:58,076][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:50:03,083][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:50:08,085][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:50:13,093][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:50:18,098][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:50:23,103][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:50:28,110][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:50:33,114][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:50:38,122][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:50:43,129][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:50:48,132][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:50:53,134][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:50:58,144][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:51:03,153][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:51:08,158][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:51:13,162][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:51:18,165][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:51:23,183][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:51:28,185][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:51:33,193][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:51:38,200][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:51:43,201][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:51:48,211][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:51:53,213][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:51:58,215][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:52:03,219][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:52:08,223][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:52:13,225][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:52:18,236][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:52:23,241][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:52:28,249][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:52:33,255][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:52:38,260][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:52:43,263][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:52:48,270][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:52:53,272][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:52:58,275][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:53:03,277][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:53:08,283][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:53:13,285][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:53:18,289][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:53:23,293][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:53:28,296][  INFO][PID:2959292] Checking for cancel request
[2025-10-01 19:53:30,666][  INFO][PID:2959292] Downloading results from builder
[2025-10-01 19:53:30,667][  INFO][PID:2959292] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c1d8]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/osalbahr/mirafetch/opensuse-tumbleweed-x86_64/09637226-mirafetch started
[2025-10-01 19:53:30,674][  INFO][PID:2959292] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c1d8]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/osalbahr/mirafetch/opensuse-tumbleweed-x86_64/09637226-mirafetch/ &> /var/lib/copr/public_html/results/osalbahr/mirafetch/opensuse-tumbleweed-x86_64/09637226-mirafetch/build-09637226.rsync.log
[2025-10-01 19:53:31,264][  INFO][PID:2959292] rsyncing finished.
[2025-10-01 19:53:31,265][  INFO][PID:2959292] Releasing VM back to pool
[2025-10-01 19:53:31,311][  INFO][PID:2959292] Searching for 'success' file in resultdir
[2025-10-01 19:53:31,315][ ERROR][PID:2959292] Build failed: Backend process error: No success file => build failure
[2025-10-01 19:53:31,318][  INFO][PID:2959292] Finished build: id=9637226 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/osalbahr/mirafetch chroot=opensuse-tumbleweed-x86_64 
[2025-10-01 19:53:31,334][ ERROR][PID:2959292] Backend process error: No success file => build failure
[2025-10-01 19:53:31,336][  INFO][PID:2959292] Worker failed build, took 334.05700516700745
[2025-10-01 19:53:31,341][  INFO][PID:2959292] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "osalbahr",
            "project_name": "mirafetch",
            "project_dirname": "mirafetch",
            "submitter": "osalbahr",
            "ended_on": 1759348411.3361979,
            "started_on": 1759348077.2791927,
            "submitted_on": null,
            "status": 0,
            "chroot": "opensuse-tumbleweed-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "9637226-opensuse-tumbleweed-x86_64",
            "build_id": 9637226,
            "package_name": "mirafetch",
            "package_version": "0.1.0-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/osalbahr/mirafetch/mirafetch",
            "git_hash": "3c23b2c71cdab6bab43b0db64235a356c8598732",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "osalbahr/mirafetch--osalbahr",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/osalbahr/mirafetch/opensuse-tumbleweed-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/osalbahr/mirafetch",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/osalbahr/mirafetch",
            "result_dir": "09637226-mirafetch",
            "built_packages": "",
            "id": 9637226,
            "mockchain_macros": {
                "copr_username": "osalbahr",
                "copr_projectname": "mirafetch",
                "vendor": "Fedora Project COPR (osalbahr/mirafetch)"
            }
        }
    ]
}
[2025-10-01 19:53:31,568][  INFO][PID:2959292] Sending fedora-messaging bus message in build.end
[2025-10-01 19:53:31,607][  INFO][PID:2959292] Compressing /var/lib/copr/public_html/results/osalbahr/mirafetch/opensuse-tumbleweed-x86_64/09637226-mirafetch/builder-live.log by gzip
[2025-10-01 19:53:31,609][  INFO][PID:2959292] Running command 'gzip /var/lib/copr/public_html/results/osalbahr/mirafetch/opensuse-tumbleweed-x86_64/09637226-mirafetch/builder-live.log' as PID 3303117
[2025-10-01 19:53:31,641][  INFO][PID:2959292] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/osalbahr/mirafetch/opensuse-tumbleweed-x86_64/09637226-mirafetch/builder-live.log)
[2025-10-01 19:53:31,643][  INFO][PID:2959292] Compressing /var/lib/copr/public_html/results/osalbahr/mirafetch/opensuse-tumbleweed-x86_64/09637226-mirafetch/backend.log by gzip
[2025-10-01 19:53:31,649][  INFO][PID:2959292] Running command 'gzip /var/lib/copr/public_html/results/osalbahr/mirafetch/opensuse-tumbleweed-x86_64/09637226-mirafetch/backend.log' as PID 3303120