[2025-09-01 07:31:21,411][  INFO][PID:1865057] Marking build as starting
[2025-09-01 07:31:21,437][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:31:21,438][  INFO][PID:1865057] VM allocation process starts
[2025-09-01 07:31:21,462][  INFO][PID:1865057] Trying to allocate VM: ResallocHost, ticket_id=4853337, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-09-01 07:31:24,475][  INFO][PID:1865057] Allocated host ResallocHost, ticket_id=4853337, hostname=140.211.168.5, name=copr_osuosl_p09_prod_06521980_20250901_071211, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-09-01 07:31:24,476][  INFO][PID:1865057] Allocating ssh connection to builder
[2025-09-01 07:31:24,476][  INFO][PID:1865057] Checking that builder machine is OK
[2025-09-01 07:31:25,884][  INFO][PID:1865057] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-09-01 07:31:26,914][  INFO][PID:1865057] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-09-01 07:31:26,915][  INFO][PID:1865057] Filling build.info file with builder info
[2025-09-01 07:31:26,915][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:31:26,916][  INFO][PID:1865057] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@fedora-llvm-team",
            "project_name": "clang-monthly-fedora-rebuild",
            "project_dirname": "clang-monthly-fedora-rebuild",
            "submitter": "kkleine",
            "ended_on": null,
            "started_on": 1756711886.91648,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [
                "fedora-clang-default-cc"
            ],
            "task_id": "9510964-fedora-rawhide-ppc64le",
            "build_id": 9510964,
            "package_name": "composefs",
            "package_version": "1.0.8-3",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/clang-monthly-fedora-rebuild/composefs",
            "git_hash": "57da12440edfc91b27088c809329da9e29257c13",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@fedora-llvm-team/clang-monthly-fedora-rebuild--kkleine",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/tstellar/fedora-clang-default-cc/fedora-rawhide-ppc64le/",
                    "id": "copr_tstellar_fedora_clang_default_cc",
                    "name": "Additional repo copr_tstellar_fedora_clang_default_cc"
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250821/fedora-rawhide-ppc64le/",
                    "id": "copr_fedora_llvm_team_llvm_snapshots_big_merge_20250821",
                    "module_hotfixes": true,
                    "name": "Additional repo copr_fedora_llvm_team_llvm_snapshots_big_merge_20250821"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [
                "toolchain_clang",
                "clang_lto"
            ],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-monthly-fedora-rebuild",
            "result_dir": "09510964-composefs",
            "built_packages": "",
            "id": 9510964,
            "mockchain_macros": {
                "copr_username": "@fedora-llvm-team",
                "copr_projectname": "clang-monthly-fedora-rebuild",
                "vendor": "Fedora Project COPR (@fedora-llvm-team/clang-monthly-fedora-rebuild)"
            }
        }
    ]
}
[2025-09-01 07:31:26,941][  INFO][PID:1865057] Sending fedora-messaging bus message in build.start
[2025-09-01 07:31:27,554][  INFO][PID:1865057] Sending fedora-messaging bus message in chroot.start
[2025-09-01 07:31:27,579][  INFO][PID:1865057] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9510964-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-09-01 07:31:28,882][  INFO][PID:1865057] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '140.211.168.5' (ED25519) to the list of known hosts.


[2025-09-01 07:31:28,882][  INFO][PID:1865057] Downloading the builder-live.log file, attempt 1
[2025-09-01 07:31:28,884][  INFO][PID:1865057] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.5 copr-rpmbuild-log
[2025-09-01 07:31:33,887][  INFO][PID:1865057] Periodic builder liveness probe: alive
[2025-09-01 07:31:33,888][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:31:38,889][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:31:43,890][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:31:48,891][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:31:53,892][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:31:58,893][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:32:03,895][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:32:08,897][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:32:13,899][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:32:18,900][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:32:23,901][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:32:28,902][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:32:33,903][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:32:38,904][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:32:43,905][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:32:48,907][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:32:53,912][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:32:58,913][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:33:03,914][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:33:08,915][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:33:13,916][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:33:18,917][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:33:23,918][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:33:28,919][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:33:33,920][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:33:38,921][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:33:43,922][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:33:48,924][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:33:53,926][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:33:58,928][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:34:03,929][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:34:08,930][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:34:13,931][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:34:18,933][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:34:23,934][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:34:28,935][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:34:33,937][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:34:38,939][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:34:43,940][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:34:48,941][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:34:53,943][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:34:58,945][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:35:03,947][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:35:08,948][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:35:13,950][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:35:18,951][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:35:23,955][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:35:28,961][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:35:33,962][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:35:38,963][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:35:43,966][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:35:48,967][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:35:53,968][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:35:58,969][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:36:03,970][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:36:08,972][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:36:13,975][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:36:18,985][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:36:23,986][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:36:28,987][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:36:33,989][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:36:38,991][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:36:43,993][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:36:48,995][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:36:53,997][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:36:58,999][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:37:04,004][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:37:09,010][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:37:14,011][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:37:19,012][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:37:24,013][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:37:29,016][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:37:34,018][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:37:39,020][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:37:44,022][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:37:49,024][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:37:54,027][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:37:59,028][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:38:04,030][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:38:09,032][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:38:14,034][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:38:19,035][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:38:24,036][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:38:29,037][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:38:34,039][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:38:39,040][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:38:44,041][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:38:49,042][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:38:54,043][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:38:59,044][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:39:04,046][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:39:09,047][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:39:14,049][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:39:19,050][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:39:24,051][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:39:29,053][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:39:34,055][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:39:39,057][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:39:44,060][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:39:49,061][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:39:54,062][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:39:59,063][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:40:04,064][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:40:09,065][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:40:14,067][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:40:19,070][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:40:24,072][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:40:29,074][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:40:34,075][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:40:39,076][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:40:44,077][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:40:49,078][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:40:54,080][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:40:59,081][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:41:04,082][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:41:09,084][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:41:14,085][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:41:19,086][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:41:24,087][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:41:29,088][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:41:34,094][  INFO][PID:1865057] Periodic builder liveness probe: alive
[2025-09-01 07:41:34,095][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:41:39,096][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:41:44,097][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:41:49,098][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:41:54,099][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:41:59,100][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:42:04,101][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:42:09,102][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:42:14,103][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:42:19,104][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:42:24,106][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:42:29,107][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:42:34,108][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:42:39,109][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:42:44,110][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:42:49,111][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:42:54,114][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:42:59,116][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:43:04,117][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:43:09,119][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:43:14,119][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:43:19,121][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:43:24,122][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:43:29,124][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:43:34,127][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:43:39,128][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:43:44,129][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:43:49,130][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:43:54,131][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:43:59,133][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:44:04,134][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:44:09,135][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:44:14,136][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:44:19,138][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:44:24,139][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:44:29,140][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:44:34,141][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:44:39,142][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:44:44,143][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:44:49,144][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:44:54,145][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:44:59,146][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:45:04,147][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:45:09,148][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:45:14,149][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:45:19,150][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:45:24,151][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:45:29,152][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:45:34,153][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:45:39,155][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:45:44,156][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:45:49,157][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:45:54,158][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:45:59,159][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:46:04,160][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:46:09,161][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:46:14,162][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:46:19,163][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:46:24,164][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:46:29,165][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:46:34,166][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:46:39,167][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:46:44,168][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:46:49,169][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:46:54,170][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:46:59,171][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:47:04,172][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:47:09,173][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:47:14,174][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:47:19,175][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:47:24,176][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:47:29,177][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:47:34,178][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:47:39,179][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:47:44,180][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:47:49,181][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:47:54,182][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:47:59,183][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:48:04,184][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:48:09,185][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:48:14,186][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:48:19,186][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:48:24,187][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:48:29,188][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:48:34,189][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:48:39,190][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:48:44,191][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:48:49,192][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:48:54,193][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:48:59,194][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:49:04,195][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:49:09,196][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:49:14,197][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:49:19,198][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:49:24,199][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:49:29,201][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:49:34,202][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:49:39,203][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:49:44,204][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:49:49,205][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:49:54,206][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:49:59,207][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:50:04,208][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:50:09,209][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:50:14,209][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:50:19,210][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:50:24,211][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:50:29,212][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:50:34,214][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:50:39,215][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:50:44,215][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:50:49,216][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:50:54,217][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:50:59,218][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:51:04,219][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:51:09,220][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:51:14,221][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:51:19,222][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:51:24,223][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:51:29,224][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:51:34,231][  INFO][PID:1865057] Periodic builder liveness probe: dead
[2025-09-01 07:51:34,232][  INFO][PID:1865057] calling cancel callback, and waiting
[2025-09-01 07:51:58,142][ ERROR][PID:1865057] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-01 07:52:08,142][WARNING][PID:1865057] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-09-01 07:52:18,143][  INFO][PID:1865057] Downloading the builder-live.log file, attempt 2
[2025-09-01 07:52:18,144][  INFO][PID:1865057] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.5 copr-rpmbuild-log
[2025-09-01 07:52:34,300][ ERROR][PID:1865057] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.5 port 22: Connection timed out

[2025-09-01 07:53:18,212][ ERROR][PID:1865057] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-01 07:53:28,216][WARNING][PID:1865057] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-09-01 07:53:38,217][  INFO][PID:1865057] Downloading the builder-live.log file, attempt 3
[2025-09-01 07:53:38,218][  INFO][PID:1865057] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.5 copr-rpmbuild-log
[2025-09-01 07:53:44,369][ ERROR][PID:1865057] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.5 port 22: Connection timed out

[2025-09-01 07:54:38,286][ ERROR][PID:1865057] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-01 07:54:48,287][WARNING][PID:1865057] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-09-01 07:54:54,437][ ERROR][PID:1865057] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.5 port 22: Connection timed out

[2025-09-01 07:54:58,288][  INFO][PID:1865057] Downloading the builder-live.log file, attempt 4
[2025-09-01 07:54:58,289][  INFO][PID:1865057] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.5 copr-rpmbuild-log
[2025-09-01 07:55:58,361][ ERROR][PID:1865057] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-01 07:56:04,507][ ERROR][PID:1865057] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.5 port 22: Connection timed out

[2025-09-01 07:56:08,368][ ERROR][PID:1865057] Giving up for unstable SSH, failures: 1756713128.1427844, 1756713208.2168121, 1756713288.287534, 1756713368.368604
[2025-09-01 07:56:14,508][ ERROR][PID:1865057] Can't ssh to cancel build.
[2025-09-01 07:56:14,508][ ERROR][PID:1865057] Re-try request for task on 'ResallocHost, ticket_id=4853337, hostname=140.211.168.5, name=copr_osuosl_p09_prod_06521980_20250901_071211, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED
[2025-09-01 07:56:14,508][  INFO][PID:1865057] Releasing VM back to pool
[2025-09-01 07:56:14,517][  INFO][PID:1865057] Retry #1 (on other host)
[2025-09-01 07:56:14,517][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:56:14,518][  INFO][PID:1865057] VM allocation process starts
[2025-09-01 07:56:14,586][  INFO][PID:1865057] Trying to allocate VM: ResallocHost, ticket_id=4853658, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-09-01 07:56:17,613][  INFO][PID:1865057] Allocated host ResallocHost, ticket_id=4853658, hostname=2620:52:3:1:dead:beef:cafe:c2a6, name=copr_p09_01_prod_06522186_20250901_073935, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-09-01 07:56:17,614][  INFO][PID:1865057] Allocating ssh connection to builder
[2025-09-01 07:56:17,614][  INFO][PID:1865057] Checking that builder machine is OK
[2025-09-01 07:56:18,486][  INFO][PID:1865057] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-09-01 07:56:18,904][  INFO][PID:1865057] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-09-01 07:56:18,904][  INFO][PID:1865057] Filling build.info file with builder info
[2025-09-01 07:56:18,905][  INFO][PID:1865057] Checking for cancel request
[2025-09-01 07:56:18,906][  INFO][PID:1865057] Not re-notifying FE and msg buses for the new host.
[2025-09-01 07:56:18,906][  INFO][PID:1865057] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9510964-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-09-01 07:56:19,694][  INFO][PID:1865057] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c2a6' (ED25519) to the list of known hosts.


[2025-09-01 07:56:19,695][  INFO][PID:1865057] Downloading the builder-live.log file, attempt 1
[2025-09-01 07:56:19,697][  INFO][PID:1865057] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c2a6 copr-rpmbuild-log
[2025-09-01 07:56:24,696][  INFO][PID:1865057] calling cancel callback, and waiting
[2025-09-01 07:56:28,339][  INFO][PID:1865057] Cancel request succeeded
out:
success
err:
Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c2a6' (ED25519) to the list of known hosts.

[2025-09-01 07:56:28,340][  INFO][PID:1865057] Downloading results from builder
[2025-09-01 07:56:28,340][  INFO][PID:1865057] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c2a6]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-ppc64le/09510964-composefs started
[2025-09-01 07:56:28,341][  INFO][PID:1865057] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c2a6]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-ppc64le/09510964-composefs/ &> /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-ppc64le/09510964-composefs/build-09510964.rsync.log
[2025-09-01 07:56:28,794][  INFO][PID:1865057] rsyncing finished.
[2025-09-01 07:56:28,795][  INFO][PID:1865057] Releasing VM back to pool
[2025-09-01 07:56:28,804][  INFO][PID:1865057] Searching for 'success' file in resultdir
[2025-09-01 07:56:28,805][ ERROR][PID:1865057] Build failed: Backend process error: No success file => build failure
[2025-09-01 07:56:28,805][  INFO][PID:1865057] Finished build: id=9510964 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild chroot=fedora-rawhide-ppc64le 
[2025-09-01 07:56:28,807][ ERROR][PID:1865057] Backend process error: No success file => build failure
[2025-09-01 07:56:28,807][  INFO][PID:1865057] Worker failed build, took 9.901680946350098
[2025-09-01 07:56:28,808][  INFO][PID:1865057] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@fedora-llvm-team",
            "project_name": "clang-monthly-fedora-rebuild",
            "project_dirname": "clang-monthly-fedora-rebuild",
            "submitter": "kkleine",
            "ended_on": 1756713388.8077254,
            "started_on": 1756713378.9060445,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [
                "fedora-clang-default-cc"
            ],
            "task_id": "9510964-fedora-rawhide-ppc64le",
            "build_id": 9510964,
            "package_name": "composefs",
            "package_version": "1.0.8-3",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/clang-monthly-fedora-rebuild/composefs",
            "git_hash": "57da12440edfc91b27088c809329da9e29257c13",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@fedora-llvm-team/clang-monthly-fedora-rebuild--kkleine",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/tstellar/fedora-clang-default-cc/fedora-rawhide-ppc64le/",
                    "id": "copr_tstellar_fedora_clang_default_cc",
                    "name": "Additional repo copr_tstellar_fedora_clang_default_cc"
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250821/fedora-rawhide-ppc64le/",
                    "id": "copr_fedora_llvm_team_llvm_snapshots_big_merge_20250821",
                    "module_hotfixes": true,
                    "name": "Additional repo copr_fedora_llvm_team_llvm_snapshots_big_merge_20250821"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [
                "toolchain_clang",
                "clang_lto"
            ],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-monthly-fedora-rebuild",
            "result_dir": "09510964-composefs",
            "built_packages": "",
            "id": 9510964,
            "mockchain_macros": {
                "copr_username": "@fedora-llvm-team",
                "copr_projectname": "clang-monthly-fedora-rebuild",
                "vendor": "Fedora Project COPR (@fedora-llvm-team/clang-monthly-fedora-rebuild)"
            }
        }
    ]
}
[2025-09-01 07:56:28,837][  INFO][PID:1865057] Sending fedora-messaging bus message in build.end
[2025-09-01 07:56:28,861][  INFO][PID:1865057] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-ppc64le/09510964-composefs/builder-live.log by gzip
[2025-09-01 07:56:28,862][  INFO][PID:1865057] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-ppc64le/09510964-composefs/builder-live.log' as PID 2001545
[2025-09-01 07:56:28,864][  INFO][PID:1865057] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-ppc64le/09510964-composefs/builder-live.log)
[2025-09-01 07:56:28,865][  INFO][PID:1865057] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-ppc64le/09510964-composefs/backend.log by gzip
[2025-09-01 07:56:28,866][  INFO][PID:1865057] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-ppc64le/09510964-composefs/backend.log' as PID 2001547