[2025-08-21 04:14:20,654][  INFO][PID:2681950] Marking build as starting
[2025-08-21 04:14:20,722][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:14:20,726][  INFO][PID:2681950] VM allocation process starts
[2025-08-21 04:14:20,753][  INFO][PID:2681950] Trying to allocate VM: ResallocHost, ticket_id=4641074, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-08-21 04:14:25,765][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:14:26,852][  INFO][PID:2681950] Allocated host ResallocHost, ticket_id=4641074, hostname=140.211.168.163, name=copr_osuosl_p09_prod_06356496_20250821_040731, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-08-21 04:14:26,857][  INFO][PID:2681950] Allocating ssh connection to builder
[2025-08-21 04:14:26,859][  INFO][PID:2681950] Checking that builder machine is OK
[2025-08-21 04:14:28,392][  INFO][PID:2681950] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-08-21 04:14:29,504][  INFO][PID:2681950] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-08-21 04:14:29,505][  INFO][PID:2681950] Filling build.info file with builder info
[2025-08-21 04:14:29,507][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:14:29,511][  INFO][PID:2681950] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 90000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@fedora-llvm-team",
            "project_name": "clang-monthly-fedora-rebuild",
            "project_dirname": "clang-monthly-fedora-rebuild",
            "submitter": "tstellar",
            "ended_on": null,
            "started_on": 1755749669.5113277,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [
                "fedora-clang-default-cc"
            ],
            "task_id": "9452243-fedora-rawhide-ppc64le",
            "build_id": 9452243,
            "package_name": "at",
            "package_version": "3.2.5-17",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/clang-monthly-fedora-rebuild/at",
            "git_hash": "b243648c152bc4c417c1adefc878bef304374db0",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@fedora-llvm-team/clang-monthly-fedora-rebuild--tstellar",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/tstellar/fedora-clang-default-cc/fedora-rawhide-ppc64le/",
                    "id": "copr_tstellar_fedora_clang_default_cc",
                    "name": "Additional repo copr_tstellar_fedora_clang_default_cc"
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250813/fedora-rawhide-ppc64le/",
                    "id": "copr_fedora_llvm_team_llvm_snapshots_big_merge_20250813",
                    "module_hotfixes": true,
                    "name": "Additional repo copr_fedora_llvm_team_llvm_snapshots_big_merge_20250813"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [
                "toolchain_clang",
                "clang_lto"
            ],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-monthly-fedora-rebuild",
            "result_dir": "09452243-at",
            "built_packages": "",
            "id": 9452243,
            "mockchain_macros": {
                "copr_username": "@fedora-llvm-team",
                "copr_projectname": "clang-monthly-fedora-rebuild",
                "vendor": "Fedora Project COPR (@fedora-llvm-team/clang-monthly-fedora-rebuild)"
            }
        }
    ]
}
[2025-08-21 04:14:29,554][  INFO][PID:2681950] Sending fedora-messaging bus message in build.start
[2025-08-21 04:14:31,296][  INFO][PID:2681950] Sending fedora-messaging bus message in chroot.start
[2025-08-21 04:14:31,365][  INFO][PID:2681950] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9452243-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-08-21 04:14:32,833][  INFO][PID:2681950] Downloading the builder-live.log file, attempt 1
[2025-08-21 04:14:32,839][  INFO][PID:2681950] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.163 copr-rpmbuild-log
[2025-08-21 04:14:37,854][  INFO][PID:2681950] Periodic builder liveness probe: alive
[2025-08-21 04:14:37,861][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:14:42,874][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:14:47,881][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:14:52,883][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:14:57,887][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:15:02,890][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:15:07,902][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:15:12,907][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:15:17,920][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:15:22,923][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:15:27,925][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:15:32,929][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:15:37,932][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:15:42,936][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:15:47,939][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:15:52,942][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:15:57,948][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:16:02,952][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:16:07,955][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:16:12,957][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:16:17,962][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:16:22,964][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:16:27,970][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:16:32,977][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:16:37,992][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:16:43,007][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:16:48,011][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:16:53,024][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:16:58,029][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:17:03,040][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:17:08,054][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:17:13,072][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:17:18,081][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:17:23,090][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:17:28,091][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:17:33,107][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:17:38,110][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:17:43,121][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:17:48,129][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:17:53,133][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:17:58,135][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:18:03,150][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:18:08,153][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:18:13,155][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:18:18,161][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:18:23,162][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:18:28,171][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:18:33,172][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:18:38,175][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:18:43,187][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:18:48,189][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:18:53,195][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:18:58,199][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:19:03,208][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:19:08,210][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:19:13,214][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:19:18,216][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:19:23,222][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:19:28,224][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:19:33,225][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:19:38,227][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:19:43,230][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:19:48,231][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:19:53,232][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:19:58,235][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:20:03,236][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:20:08,237][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:20:13,238][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:20:18,244][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:20:23,246][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:20:28,248][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:20:33,249][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:20:38,250][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:20:43,251][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:20:48,252][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:20:53,253][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:20:58,254][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:21:03,256][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:21:08,257][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:21:13,259][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:21:18,263][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:21:23,264][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:21:28,268][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:21:33,271][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:21:38,273][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:21:43,276][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:21:48,277][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:21:53,279][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:21:58,281][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:22:03,282][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:22:08,284][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:22:13,285][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:22:18,286][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:22:23,287][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:22:28,289][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:22:33,290][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:22:38,292][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:22:43,293][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:22:48,295][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:22:53,296][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:22:58,297][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:23:03,298][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:23:08,299][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:23:13,302][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:23:18,303][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:23:23,304][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:23:28,307][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:23:33,309][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:23:38,311][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:23:43,313][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:23:48,314][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:23:53,315][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:23:58,316][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:24:03,317][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:24:08,318][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:24:13,319][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:24:18,320][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:24:23,322][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:24:28,323][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:24:33,325][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:24:38,336][  INFO][PID:2681950] Periodic builder liveness probe: alive
[2025-08-21 04:24:38,337][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:24:43,338][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:24:48,339][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:24:53,342][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:24:58,343][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:25:03,345][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:25:08,346][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:25:13,348][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:25:18,349][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:25:23,350][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:25:28,351][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:25:33,354][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:25:38,355][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:25:43,356][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:25:48,357][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:25:53,358][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:25:58,360][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:26:03,361][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:26:08,362][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:26:13,365][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:26:18,367][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:26:23,369][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:26:28,371][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:26:33,372][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:26:38,374][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:26:43,376][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:26:48,377][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:26:53,379][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:26:58,383][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:27:03,386][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:27:08,388][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:27:13,390][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:27:18,392][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:27:23,395][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:27:28,396][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:27:33,398][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:27:38,400][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:27:43,402][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:27:48,404][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:27:53,405][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:27:58,406][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:28:03,407][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:28:08,408][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:28:13,409][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:28:18,411][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:28:23,413][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:28:28,414][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:28:33,416][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:28:38,417][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:28:43,419][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:28:48,420][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:28:53,421][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:28:58,422][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:29:03,423][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:29:08,425][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:29:13,426][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:29:18,427][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:29:23,428][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:29:28,429][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:29:33,430][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:29:38,433][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:29:43,435][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:29:48,437][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:29:53,438][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:29:58,443][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:30:03,444][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:30:08,452][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:30:13,453][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:30:18,455][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:30:23,456][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:30:28,459][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:30:33,460][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:30:38,461][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:30:43,463][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:30:48,464][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:30:53,465][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:30:58,466][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:31:03,468][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:31:08,470][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:31:13,471][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:31:18,473][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:31:23,475][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:31:28,476][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:31:33,477][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:31:38,479][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:31:43,480][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:31:48,481][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:31:53,484][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:31:58,486][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:32:03,487][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:32:08,488][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:32:13,490][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:32:18,491][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:32:23,493][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:32:28,494][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:32:33,495][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:32:38,497][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:32:43,498][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:32:48,499][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:32:53,500][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:32:58,502][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:33:03,503][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:33:08,504][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:33:13,505][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:33:18,507][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:33:23,508][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:33:28,509][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:33:33,510][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:33:38,511][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:33:43,513][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:33:48,514][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:33:53,515][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:33:58,517][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:34:03,518][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:34:08,519][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:34:13,520][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:34:18,521][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:34:23,522][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:34:28,523][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:34:33,525][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:34:38,534][  INFO][PID:2681950] Periodic builder liveness probe: alive
[2025-08-21 04:34:38,535][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:34:43,536][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:34:48,537][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:34:53,538][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:34:58,539][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:35:03,541][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:35:08,542][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:35:13,543][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:35:18,544][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:35:23,545][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:35:28,547][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:35:33,548][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:35:38,549][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:35:43,550][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:35:48,553][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:35:53,554][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:35:58,556][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:36:03,561][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:36:08,562][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:36:13,563][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:36:18,566][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:36:23,567][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:36:28,568][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:36:33,571][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:36:38,573][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:36:43,574][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:36:48,576][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:36:53,577][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:36:58,579][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:37:03,580][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:37:08,584][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:37:13,589][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:37:18,590][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:37:23,592][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:37:28,597][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:37:33,600][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:37:38,602][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:37:43,605][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:37:48,610][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:37:53,611][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:37:58,613][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:38:03,614][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:38:08,618][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:38:13,619][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:38:18,621][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:38:23,622][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:38:28,623][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:38:33,624][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:38:38,626][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:38:43,627][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:38:48,629][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:38:53,630][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:38:58,631][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:39:03,634][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:39:08,638][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:39:13,639][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:39:18,640][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:39:23,641][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:39:28,645][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:39:33,646][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:39:38,647][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:39:43,648][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:39:48,650][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:39:53,651][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:39:58,652][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:40:03,653][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:40:08,655][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:40:13,658][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:40:18,660][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:40:23,661][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:40:28,663][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:40:33,664][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:40:38,665][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:40:43,666][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:40:48,668][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:40:53,669][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:40:58,670][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:41:03,673][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:41:08,675][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:41:13,676][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:41:18,677][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:41:23,682][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:41:28,683][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:41:33,685][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:41:38,687][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:41:43,688][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:41:48,689][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:41:53,690][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:41:58,691][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:42:03,692][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:42:08,693][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:42:13,695][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:42:18,696][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:42:23,697][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:42:28,698][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:42:33,699][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:42:38,700][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:42:43,701][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:42:48,702][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:42:53,703][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:42:58,704][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:43:03,706][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:43:08,707][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:43:13,708][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:43:18,710][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:43:23,711][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:43:28,712][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:43:33,713][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:43:38,714][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:43:43,715][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:43:48,717][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:43:53,718][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:43:58,719][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:44:03,720][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:44:08,721][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:44:13,723][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:44:18,725][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:44:23,726][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:44:28,727][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:44:33,728][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:44:38,735][  INFO][PID:2681950] Periodic builder liveness probe: alive
[2025-08-21 04:44:38,735][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:44:43,736][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:44:48,738][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:44:53,739][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:44:58,741][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:45:03,743][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:45:08,744][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:45:13,746][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:45:18,748][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:45:23,749][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:45:28,750][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:45:33,751][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:45:38,754][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:45:43,756][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:45:48,757][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:45:53,758][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:45:58,759][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:46:03,760][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:46:08,761][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:46:13,762][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:46:18,764][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:46:23,767][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:46:28,770][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:46:33,772][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:46:38,773][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:46:43,774][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:46:48,775][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:46:53,776][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:46:58,777][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:47:03,778][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:47:08,780][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:47:13,781][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:47:18,782][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:47:23,784][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:47:28,785][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:47:33,786][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:47:38,788][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:47:43,792][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:47:48,798][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:47:53,802][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:47:58,807][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:48:03,808][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:48:08,811][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:48:13,813][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:48:18,816][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:48:23,819][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:48:28,822][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:48:33,824][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:48:38,825][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:48:43,828][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:48:48,829][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:48:53,831][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:48:58,833][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:49:03,836][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:49:08,838][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:49:13,844][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:49:18,845][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:49:23,847][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:49:28,848][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:49:33,851][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:49:38,852][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:49:43,854][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:49:48,856][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:49:53,857][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:49:58,859][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:50:03,861][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:50:08,863][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:50:13,868][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:50:18,869][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:50:23,870][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:50:28,872][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:50:33,875][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:50:38,878][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:50:43,949][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:50:48,955][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:50:53,959][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:50:58,961][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:51:03,963][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:51:08,964][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:51:13,965][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:51:18,966][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:51:23,968][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:51:28,969][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:51:33,970][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:51:38,971][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:51:43,972][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:51:48,973][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:51:53,974][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:51:58,976][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:52:03,978][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:52:08,979][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:52:13,981][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:52:18,983][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:52:23,985][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:52:28,988][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:52:33,990][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:52:38,992][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:52:43,993][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:52:48,994][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:52:53,995][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:52:58,998][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:53:03,999][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:53:09,002][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:53:14,003][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:53:19,006][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:53:24,033][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:53:29,038][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:53:34,039][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:53:39,044][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:53:44,048][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:53:49,050][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:53:54,051][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:53:59,052][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:54:04,053][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:54:09,055][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:54:14,056][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:54:19,057][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:54:24,059][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:54:29,060][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:54:34,061][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:54:39,074][  INFO][PID:2681950] Periodic builder liveness probe: dead
[2025-08-21 04:55:28,144][ ERROR][PID:2681950] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-08-21 04:55:38,145][WARNING][PID:2681950] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-08-21 04:55:39,144][ ERROR][PID:2681950] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.163 port 22: Connection timed out

[2025-08-21 04:55:48,145][  INFO][PID:2681950] Downloading the builder-live.log file, attempt 2
[2025-08-21 04:55:48,147][  INFO][PID:2681950] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.163 copr-rpmbuild-log
[2025-08-21 04:56:48,215][ ERROR][PID:2681950] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-08-21 04:56:49,217][ ERROR][PID:2681950] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.163 port 22: Connection timed out

[2025-08-21 04:56:58,219][WARNING][PID:2681950] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-08-21 04:57:08,220][  INFO][PID:2681950] Downloading the builder-live.log file, attempt 3
[2025-08-21 04:57:08,221][  INFO][PID:2681950] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.163 copr-rpmbuild-log
[2025-08-21 04:57:59,290][ ERROR][PID:2681950] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.163 port 22: Connection timed out

[2025-08-21 04:58:08,292][ ERROR][PID:2681950] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-08-21 04:58:18,306][WARNING][PID:2681950] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-08-21 04:58:28,307][  INFO][PID:2681950] Downloading the builder-live.log file, attempt 4
[2025-08-21 04:58:28,308][  INFO][PID:2681950] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.163 copr-rpmbuild-log
[2025-08-21 04:59:09,364][ ERROR][PID:2681950] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.163 port 22: Connection timed out

[2025-08-21 04:59:19,365][ ERROR][PID:2681950] Can't ssh to cancel build.
[2025-08-21 04:59:28,377][ ERROR][PID:2681950] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-08-21 04:59:38,379][ ERROR][PID:2681950] Giving up for unstable SSH, failures: 1755752138.145109, 1755752218.2193294, 1755752298.306183, 1755752378.3793466
[2025-08-21 04:59:38,381][ ERROR][PID:2681950] Re-try request for task on 'ResallocHost, ticket_id=4641074, hostname=140.211.168.163, name=copr_osuosl_p09_prod_06356496_20250821_040731, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED
[2025-08-21 04:59:38,382][  INFO][PID:2681950] Releasing VM back to pool
[2025-08-21 04:59:38,406][  INFO][PID:2681950] Retry #1 (on other host)
[2025-08-21 04:59:38,407][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:59:38,407][  INFO][PID:2681950] VM allocation process starts
[2025-08-21 04:59:38,434][  INFO][PID:2681950] Trying to allocate VM: ResallocHost, ticket_id=4641898, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-08-21 04:59:41,458][  INFO][PID:2681950] Allocated host ResallocHost, ticket_id=4641898, hostname=140.211.168.156, name=copr_osuosl_p09_prod_06356800_20250821_042405, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-08-21 04:59:41,461][  INFO][PID:2681950] Allocating ssh connection to builder
[2025-08-21 04:59:41,461][  INFO][PID:2681950] Checking that builder machine is OK
[2025-08-21 04:59:42,891][  INFO][PID:2681950] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-08-21 04:59:43,935][  INFO][PID:2681950] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-08-21 04:59:43,936][  INFO][PID:2681950] Filling build.info file with builder info
[2025-08-21 04:59:43,937][  INFO][PID:2681950] Checking for cancel request
[2025-08-21 04:59:43,940][  INFO][PID:2681950] Not re-notifying FE and msg buses for the new host.
[2025-08-21 04:59:43,941][  INFO][PID:2681950] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9452243-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-08-21 04:59:45,290][  INFO][PID:2681950] Downloading the builder-live.log file, attempt 1
[2025-08-21 04:59:45,294][  INFO][PID:2681950] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.156 copr-rpmbuild-log
[2025-08-21 04:59:54,523][  INFO][PID:2681950] Cancel request succeeded
out:
success
err:
Warning: Permanently added '140.211.168.156' (ED25519) to the list of known hosts.

[2025-08-21 04:59:54,523][  INFO][PID:2681950] Downloading results from builder
[2025-08-21 04:59:54,525][  INFO][PID:2681950] rsyncing of mockbuilder@140.211.168.156:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-ppc64le/09452243-at started
[2025-08-21 04:59:54,526][  INFO][PID:2681950] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@140.211.168.156:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-ppc64le/09452243-at/ &> /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-ppc64le/09452243-at/build-09452243.rsync.log
[2025-08-21 04:59:56,137][  INFO][PID:2681950] rsyncing finished.
[2025-08-21 04:59:56,139][  INFO][PID:2681950] Releasing VM back to pool
[2025-08-21 04:59:56,156][  INFO][PID:2681950] Searching for 'success' file in resultdir
[2025-08-21 04:59:56,158][ ERROR][PID:2681950] Build failed: Backend process error: No success file => build failure
[2025-08-21 04:59:56,159][  INFO][PID:2681950] Finished build: id=9452243 failed=True timeout=90000 destdir=/var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild chroot=fedora-rawhide-ppc64le 
[2025-08-21 04:59:56,165][ ERROR][PID:2681950] Backend process error: No success file => build failure
[2025-08-21 04:59:56,166][  INFO][PID:2681950] Worker failed build, took 12.226396322250366
[2025-08-21 04:59:56,167][  INFO][PID:2681950] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 90000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@fedora-llvm-team",
            "project_name": "clang-monthly-fedora-rebuild",
            "project_dirname": "clang-monthly-fedora-rebuild",
            "submitter": "tstellar",
            "ended_on": 1755752396.166587,
            "started_on": 1755752383.9401908,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [
                "fedora-clang-default-cc"
            ],
            "task_id": "9452243-fedora-rawhide-ppc64le",
            "build_id": 9452243,
            "package_name": "at",
            "package_version": "3.2.5-17",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/clang-monthly-fedora-rebuild/at",
            "git_hash": "b243648c152bc4c417c1adefc878bef304374db0",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@fedora-llvm-team/clang-monthly-fedora-rebuild--tstellar",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/tstellar/fedora-clang-default-cc/fedora-rawhide-ppc64le/",
                    "id": "copr_tstellar_fedora_clang_default_cc",
                    "name": "Additional repo copr_tstellar_fedora_clang_default_cc"
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250813/fedora-rawhide-ppc64le/",
                    "id": "copr_fedora_llvm_team_llvm_snapshots_big_merge_20250813",
                    "module_hotfixes": true,
                    "name": "Additional repo copr_fedora_llvm_team_llvm_snapshots_big_merge_20250813"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [
                "toolchain_clang",
                "clang_lto"
            ],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-monthly-fedora-rebuild",
            "result_dir": "09452243-at",
            "built_packages": "",
            "id": 9452243,
            "mockchain_macros": {
                "copr_username": "@fedora-llvm-team",
                "copr_projectname": "clang-monthly-fedora-rebuild",
                "vendor": "Fedora Project COPR (@fedora-llvm-team/clang-monthly-fedora-rebuild)"
            }
        }
    ]
}
[2025-08-21 04:59:56,196][  INFO][PID:2681950] Sending fedora-messaging bus message in build.end
[2025-08-21 04:59:56,231][  INFO][PID:2681950] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-ppc64le/09452243-at/builder-live.log by gzip
[2025-08-21 04:59:56,233][  INFO][PID:2681950] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-ppc64le/09452243-at/builder-live.log' as PID 3005413
[2025-08-21 04:59:56,235][  INFO][PID:2681950] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-ppc64le/09452243-at/builder-live.log)
[2025-08-21 04:59:56,236][  INFO][PID:2681950] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-ppc64le/09452243-at/backend.log by gzip
[2025-08-21 04:59:56,237][  INFO][PID:2681950] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-ppc64le/09452243-at/backend.log' as PID 3005416