[2025-09-10 03:53:07,401][  INFO][PID:2240451] Marking build as starting
[2025-09-10 03:53:07,479][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:53:07,484][  INFO][PID:2240451] VM allocation process starts
[2025-09-10 03:53:07,844][  INFO][PID:2240451] Trying to allocate VM: ResallocHost, ticket_id=4989692, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-09-10 03:53:12,858][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:53:18,071][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:53:23,794][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:53:28,797][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:53:33,803][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:53:38,849][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:53:44,160][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:53:49,248][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:53:54,673][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:53:59,756][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:54:05,226][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:54:10,235][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:54:15,427][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:54:20,555][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:54:25,563][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:54:30,581][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:54:35,774][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:54:40,925][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:54:45,954][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:54:52,061][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:54:56,228][  INFO][PID:2240451] Allocated host ResallocHost, ticket_id=4989692, hostname=140.211.168.171, name=copr_osuosl_p09_prod_06688489_20250910_034622, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-09-10 03:54:56,353][  INFO][PID:2240451] Allocating ssh connection to builder
[2025-09-10 03:54:56,363][  INFO][PID:2240451] Checking that builder machine is OK
[2025-09-10 03:54:57,835][  INFO][PID:2240451] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-09-10 03:54:58,851][  INFO][PID:2240451] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-09-10 03:54:58,854][  INFO][PID:2240451] Filling build.info file with builder info
[2025-09-10 03:54:58,855][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:54:58,863][  INFO][PID:2240451] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "psimovec",
            "project_name": "openblas-0.3.23",
            "project_dirname": "openblas-0.3.23",
            "submitter": "https://src.fedoraproject.org/user/music",
            "ended_on": null,
            "started_on": 1757476498.863193,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9541537-fedora-rawhide-ppc64le",
            "build_id": 9541537,
            "package_name": "snakemake",
            "package_version": "9.11.2-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/snakemake",
            "git_hash": "1d88a8d88727eb822e31522aecb856665ab61e3c",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/music",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/",
                    "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch",
                    "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23",
            "result_dir": "09541537-snakemake",
            "built_packages": "",
            "id": 9541537,
            "mockchain_macros": {
                "copr_username": "psimovec",
                "copr_projectname": "openblas-0.3.23",
                "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)"
            }
        }
    ]
}
[2025-09-10 03:54:58,961][  INFO][PID:2240451] Sending fedora-messaging bus message in build.start
[2025-09-10 03:55:00,188][  INFO][PID:2240451] Sending fedora-messaging bus message in chroot.start
[2025-09-10 03:55:00,229][  INFO][PID:2240451] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9541537-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-09-10 03:55:01,499][  INFO][PID:2240451] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '140.211.168.171' (ED25519) to the list of known hosts.


[2025-09-10 03:55:03,900][  INFO][PID:2240451] Downloading the builder-live.log file, attempt 1
[2025-09-10 03:55:03,908][  INFO][PID:2240451] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.171 copr-rpmbuild-log
[2025-09-10 03:55:08,956][  INFO][PID:2240451] Periodic builder liveness probe: alive
[2025-09-10 03:55:08,976][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:55:13,994][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:55:19,057][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:55:24,075][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:55:29,089][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:55:34,100][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:55:39,116][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:55:44,147][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:55:49,153][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:55:54,154][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:55:59,948][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:56:05,025][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:56:10,042][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:56:15,064][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:56:20,084][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:56:25,123][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:56:30,125][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:56:35,254][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:56:40,271][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:56:45,289][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:56:50,316][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:56:55,321][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:57:00,329][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:57:05,341][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:57:10,345][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:57:15,366][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:57:20,371][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:57:25,381][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:57:30,397][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:57:35,699][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:57:42,216][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:57:48,182][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:57:53,208][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:57:58,221][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:58:03,225][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:58:08,253][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:58:13,268][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:58:18,278][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:58:23,302][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:58:28,312][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:58:33,325][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:58:38,331][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:58:43,336][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:58:48,341][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:58:53,355][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:58:58,381][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:59:03,518][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:59:08,605][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:59:13,680][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:59:18,742][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:59:24,040][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:59:29,153][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:59:34,202][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:59:39,261][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:59:44,296][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:59:49,315][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:59:54,347][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 03:59:59,351][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:00:04,359][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:00:09,360][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:00:14,364][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:00:19,375][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:00:24,380][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:00:29,392][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:00:34,403][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:00:39,421][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:00:44,443][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:00:49,446][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:00:54,462][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:00:59,491][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:01:04,504][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:01:09,534][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:01:14,539][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:01:19,571][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:01:24,631][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:01:29,694][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:01:34,766][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:01:39,801][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:01:44,844][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:01:49,867][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:01:54,874][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:01:59,884][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:02:04,931][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:02:09,967][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:02:14,995][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:02:20,013][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:02:25,019][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:02:30,029][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:02:35,081][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:02:40,083][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:02:45,084][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:02:50,087][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:02:55,093][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:03:00,158][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:03:05,546][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:03:10,552][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:03:15,563][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:03:20,572][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:03:25,578][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:03:30,582][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:03:35,583][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:03:40,585][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:03:45,587][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:03:50,730][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:03:55,737][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:04:00,911][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:04:05,955][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:04:11,197][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:04:16,421][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:04:21,426][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:04:26,453][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:04:31,648][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:04:36,727][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:04:41,840][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:04:46,988][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:04:52,072][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:04:57,111][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:05:02,454][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:05:07,465][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:05:12,663][  INFO][PID:2240451] Periodic builder liveness probe: alive
[2025-09-10 04:05:12,664][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:05:17,667][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:05:22,716][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:05:27,722][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:05:32,833][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:05:37,866][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:05:42,938][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:05:48,153][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:05:53,358][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:05:58,374][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:06:03,412][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:06:08,471][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:06:13,498][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:06:18,701][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:06:23,778][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:06:28,861][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:06:33,929][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:06:38,971][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:06:44,465][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:06:49,910][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:06:55,017][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:07:00,499][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:07:05,542][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:07:10,657][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:07:15,741][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:07:21,194][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:07:26,250][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:07:31,295][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:07:36,401][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:07:41,736][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:07:46,859][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:07:51,965][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:07:57,001][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:08:02,071][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:08:07,241][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:08:12,263][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:08:17,334][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:08:22,417][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:08:27,486][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:08:32,527][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:08:37,706][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:08:42,819][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:08:47,833][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:08:52,838][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:08:58,068][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:09:03,152][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:09:08,161][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:09:13,241][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:09:18,300][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:09:23,319][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:09:28,537][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:09:33,668][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:09:38,671][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:09:44,167][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:09:49,822][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:09:58,210][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:10:03,631][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:10:08,745][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:10:15,026][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:10:20,129][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:10:25,718][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:10:31,891][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:10:36,992][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:10:42,111][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:10:47,212][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:10:53,684][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:10:58,737][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:11:03,820][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:11:08,995][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:11:14,033][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:11:19,086][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:11:24,091][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:11:29,930][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:11:36,565][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:11:41,912][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:11:48,028][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:11:53,142][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:11:58,309][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:12:03,479][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:12:08,859][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:12:14,009][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:12:19,128][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:12:24,211][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:12:29,222][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:12:34,225][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:12:39,238][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:12:44,246][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:12:49,277][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:12:54,283][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:12:59,300][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:13:04,315][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:13:09,337][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:13:14,343][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:13:19,354][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:13:24,377][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:13:29,437][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:13:34,460][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:13:39,467][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:13:44,480][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:13:49,492][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:13:54,506][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:13:59,515][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:14:04,530][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:14:09,543][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:14:14,547][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:14:19,554][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:14:24,557][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:14:29,560][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:14:34,563][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:14:39,570][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:14:44,585][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:14:49,591][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:14:54,593][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:14:59,598][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:15:04,602][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:15:09,607][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:15:14,665][  INFO][PID:2240451] Periodic builder liveness probe: alive
[2025-09-10 04:15:14,671][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:15:19,683][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:15:24,685][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:15:29,760][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:15:34,778][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:15:39,784][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:15:44,793][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:15:49,810][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:15:54,829][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:15:59,838][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:16:04,842][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:16:09,844][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:16:14,853][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:16:19,860][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:16:24,868][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:16:29,876][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:16:34,877][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:16:39,885][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:16:44,900][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:16:49,906][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:16:54,920][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:16:59,925][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:17:04,936][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:17:09,943][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:17:14,946][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:17:19,956][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:17:24,958][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:17:29,960][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:17:34,962][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:17:39,966][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:17:44,970][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:17:49,972][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:17:54,977][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:18:00,003][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:18:05,006][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:18:10,012][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:18:15,014][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:18:20,016][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:18:25,022][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:18:30,024][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:18:35,032][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:18:40,035][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:18:45,038][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:18:50,047][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:18:55,056][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:19:00,059][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:19:05,064][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:19:10,124][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:19:15,175][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:19:20,192][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:19:25,224][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:19:30,387][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:19:35,394][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:19:40,409][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:19:45,451][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:19:50,492][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:19:55,542][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:20:00,610][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:20:05,637][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:20:11,111][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:20:16,133][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:20:21,145][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:20:26,212][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:20:31,239][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:20:36,345][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:20:41,579][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:20:46,731][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:20:51,918][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:20:56,998][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:21:02,067][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:21:07,107][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:21:12,136][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:21:17,163][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:21:22,244][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:21:28,451][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:21:33,484][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:21:38,505][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:21:43,935][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:21:48,991][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:21:54,029][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:21:59,215][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:22:04,221][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:22:09,247][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:22:14,325][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:22:19,396][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:22:24,475][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:22:29,503][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:22:34,543][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:22:39,574][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:22:44,648][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:22:49,701][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:22:55,384][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:23:00,562][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:23:05,645][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:23:11,346][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:23:16,550][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:23:21,562][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:23:26,671][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:23:31,829][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:23:36,834][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:23:42,147][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:23:47,223][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:23:52,308][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:23:57,389][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:24:02,528][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:24:07,636][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:24:12,810][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:24:17,813][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:24:22,816][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:24:27,819][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:24:32,826][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:24:37,844][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:24:42,854][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:24:47,869][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:24:52,908][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:24:57,980][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:25:03,259][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:25:09,112][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:25:14,799][  INFO][PID:2240451] Periodic builder liveness probe: alive
[2025-09-10 04:25:15,740][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:25:20,776][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:25:26,886][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:25:33,059][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:25:39,248][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:25:44,814][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:25:50,040][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:25:55,046][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:26:00,874][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:26:06,205][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:26:11,336][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:26:16,716][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:26:22,849][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:26:27,970][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:26:33,102][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:26:38,479][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:26:43,499][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:26:48,618][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:26:53,706][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:26:58,952][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:27:04,227][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:27:09,374][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:27:14,426][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:27:19,534][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:27:24,589][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:27:29,767][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:27:34,877][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:27:39,967][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:27:45,342][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:27:50,435][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:27:55,672][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:28:01,224][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:28:06,510][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:28:12,092][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:28:17,146][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:28:22,161][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:28:27,399][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:28:32,474][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:28:37,687][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:28:42,716][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:28:47,831][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:28:52,866][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:28:57,895][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:29:02,909][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:29:07,925][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:29:12,959][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:29:17,960][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:29:22,963][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:29:27,967][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:29:32,971][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:29:37,973][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:29:42,977][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:29:48,186][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:29:53,222][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:29:58,251][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:30:03,289][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:30:08,325][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:30:13,652][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:30:18,751][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:30:23,763][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:30:28,771][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:30:33,863][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:30:39,266][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:30:44,305][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:30:49,355][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:30:54,374][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:30:59,549][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:31:04,723][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:31:09,921][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:31:14,943][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:31:19,954][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:31:25,020][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:31:30,025][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:31:35,027][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:31:40,066][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:31:45,159][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:31:50,227][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:31:55,287][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:32:00,294][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:32:05,309][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:32:10,368][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:32:15,548][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:32:20,872][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:32:26,022][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:32:31,073][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:32:36,217][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:32:41,460][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:32:46,526][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:32:51,554][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:32:56,588][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:33:01,603][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:33:06,896][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:33:12,001][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:33:13,161][ ERROR][PID:2240451] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-10 04:33:17,047][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:33:22,151][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:33:23,162][WARNING][PID:2240451] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-09-10 04:33:27,200][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:33:32,212][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:33:33,163][  INFO][PID:2240451] Downloading the builder-live.log file, attempt 2
[2025-09-10 04:33:33,164][  INFO][PID:2240451] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.171 copr-rpmbuild-log
[2025-09-10 04:33:37,225][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:33:42,307][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:33:47,369][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:33:52,432][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:33:57,463][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:34:02,479][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:34:07,487][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:34:12,496][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:34:17,536][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:34:22,613][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:34:27,681][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:34:32,869][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:34:33,247][ ERROR][PID:2240451] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-10 04:34:38,007][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:34:43,097][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:34:43,410][WARNING][PID:2240451] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-09-10 04:34:48,440][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:34:53,434][  INFO][PID:2240451] Downloading the builder-live.log file, attempt 3
[2025-09-10 04:34:53,488][  INFO][PID:2240451] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.171 copr-rpmbuild-log
[2025-09-10 04:34:53,593][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:34:58,629][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:35:03,793][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:35:08,808][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:35:13,814][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:35:18,877][  INFO][PID:2240451] Periodic builder liveness probe: dead
[2025-09-10 04:35:18,885][  INFO][PID:2240451] calling cancel callback, and waiting
[2025-09-10 04:35:53,575][ ERROR][PID:2240451] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-10 04:36:03,659][WARNING][PID:2240451] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-09-10 04:36:13,661][  INFO][PID:2240451] Downloading the builder-live.log file, attempt 4
[2025-09-10 04:36:13,663][  INFO][PID:2240451] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.171 copr-rpmbuild-log
[2025-09-10 04:36:18,965][ ERROR][PID:2240451] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.171 port 22: Connection timed out

[2025-09-10 04:37:13,736][ ERROR][PID:2240451] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-10 04:37:23,744][ ERROR][PID:2240451] Giving up for unstable SSH, failures: 1757478803.1621354, 1757478883.4107049, 1757478963.6590812, 1757479043.7441013
[2025-09-10 04:37:29,077][ ERROR][PID:2240451] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.171 port 22: Connection timed out

[2025-09-10 04:38:39,153][ ERROR][PID:2240451] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.171 port 22: Connection timed out

[2025-09-10 04:39:49,234][ ERROR][PID:2240451] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.171 port 22: Connection timed out

[2025-09-10 04:39:59,235][ ERROR][PID:2240451] Can't ssh to cancel build.
[2025-09-10 04:39:59,236][ ERROR][PID:2240451] Re-try request for task on 'ResallocHost, ticket_id=4989692, hostname=140.211.168.171, name=copr_osuosl_p09_prod_06688489_20250910_034622, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED
[2025-09-10 04:39:59,237][  INFO][PID:2240451] Releasing VM back to pool
[2025-09-10 04:39:59,288][  INFO][PID:2240451] Retry #1 (on other host)
[2025-09-10 04:39:59,320][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:39:59,323][  INFO][PID:2240451] VM allocation process starts
[2025-09-10 04:39:59,361][  INFO][PID:2240451] Trying to allocate VM: ResallocHost, ticket_id=4990672, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-09-10 04:40:04,364][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:40:09,366][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:40:14,371][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:40:17,537][  INFO][PID:2240451] Allocated host ResallocHost, ticket_id=4990672, hostname=2620:52:3:1:dead:beef:cafe:c24d, name=copr_hv_ppc64le_02_prod_06689009_20250910_042924, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-09-10 04:40:17,538][  INFO][PID:2240451] Allocating ssh connection to builder
[2025-09-10 04:40:17,539][  INFO][PID:2240451] Checking that builder machine is OK
[2025-09-10 04:40:18,317][  INFO][PID:2240451] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-09-10 04:40:18,719][  INFO][PID:2240451] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-09-10 04:40:18,720][  INFO][PID:2240451] Filling build.info file with builder info
[2025-09-10 04:40:18,727][  INFO][PID:2240451] Checking for cancel request
[2025-09-10 04:40:18,728][  INFO][PID:2240451] Not re-notifying FE and msg buses for the new host.
[2025-09-10 04:40:18,730][  INFO][PID:2240451] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9541537-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-09-10 04:40:19,397][  INFO][PID:2240451] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c24d' (ED25519) to the list of known hosts.


[2025-09-10 04:40:19,398][  INFO][PID:2240451] Downloading the builder-live.log file, attempt 1
[2025-09-10 04:40:19,400][  INFO][PID:2240451] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c24d copr-rpmbuild-log
[2025-09-10 04:40:24,399][  INFO][PID:2240451] calling cancel callback, and waiting
[2025-09-10 04:40:27,961][  INFO][PID:2240451] Cancel request succeeded
out:
success
err:
Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c24d' (ED25519) to the list of known hosts.

[2025-09-10 04:40:27,962][  INFO][PID:2240451] Downloading results from builder
[2025-09-10 04:40:27,963][  INFO][PID:2240451] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c24d]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09541537-snakemake started
[2025-09-10 04:40:27,964][  INFO][PID:2240451] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c24d]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09541537-snakemake/ &> /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09541537-snakemake/build-09541537.rsync.log
[2025-09-10 04:40:28,399][  INFO][PID:2240451] rsyncing finished.
[2025-09-10 04:40:28,400][  INFO][PID:2240451] Releasing VM back to pool
[2025-09-10 04:40:28,436][  INFO][PID:2240451] Searching for 'success' file in resultdir
[2025-09-10 04:40:28,439][ ERROR][PID:2240451] Build failed: Backend process error: No success file => build failure
[2025-09-10 04:40:28,440][  INFO][PID:2240451] Finished build: id=9541537 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/openblas-0.3.23 chroot=fedora-rawhide-ppc64le 
[2025-09-10 04:40:28,448][ ERROR][PID:2240451] Backend process error: No success file => build failure
[2025-09-10 04:40:28,452][  INFO][PID:2240451] Worker failed build, took 9.723859310150146
[2025-09-10 04:40:28,456][  INFO][PID:2240451] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "psimovec",
            "project_name": "openblas-0.3.23",
            "project_dirname": "openblas-0.3.23",
            "submitter": "https://src.fedoraproject.org/user/music",
            "ended_on": 1757479228.4525607,
            "started_on": 1757479218.7287014,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9541537-fedora-rawhide-ppc64le",
            "build_id": 9541537,
            "package_name": "snakemake",
            "package_version": "9.11.2-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/snakemake",
            "git_hash": "1d88a8d88727eb822e31522aecb856665ab61e3c",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/music",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/",
                    "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch",
                    "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23",
            "result_dir": "09541537-snakemake",
            "built_packages": "",
            "id": 9541537,
            "mockchain_macros": {
                "copr_username": "psimovec",
                "copr_projectname": "openblas-0.3.23",
                "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)"
            }
        }
    ]
}
[2025-09-10 04:40:28,537][  INFO][PID:2240451] Sending fedora-messaging bus message in build.end
[2025-09-10 04:40:28,578][  INFO][PID:2240451] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09541537-snakemake/builder-live.log by gzip
[2025-09-10 04:40:28,582][  INFO][PID:2240451] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09541537-snakemake/builder-live.log' as PID 2666514
[2025-09-10 04:40:28,585][  INFO][PID:2240451] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09541537-snakemake/builder-live.log)
[2025-09-10 04:40:28,589][  INFO][PID:2240451] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09541537-snakemake/backend.log by gzip
[2025-09-10 04:40:28,595][  INFO][PID:2240451] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09541537-snakemake/backend.log' as PID 2666516