[2025-10-22 02:27:00,095][  INFO][PID:3305434] Marking build as starting
[2025-10-22 02:27:00,129][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:27:00,130][  INFO][PID:3305434] VM allocation process starts
[2025-10-22 02:27:00,162][  INFO][PID:3305434] Trying to allocate VM: ResallocHost, ticket_id=5780569, requested_tags=['copr_builder', 'arch_ppc64le', 'on_demand_powerful']
[2025-10-22 02:27:05,163][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:27:10,164][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:27:15,165][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:27:20,166][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:27:25,167][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:27:30,168][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:27:35,169][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:27:40,170][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:27:45,170][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:27:50,171][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:27:55,172][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:28:00,176][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:28:05,177][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:28:10,179][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:28:15,180][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:28:20,183][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:28:25,184][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:28:30,185][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:28:35,186][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:28:40,187][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:28:45,188][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:28:50,190][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:28:55,191][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:29:00,192][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:29:05,193][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:29:10,194][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:29:15,196][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:29:20,197][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:29:25,198][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:29:30,200][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:29:35,201][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:29:40,202][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:29:45,203][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:29:50,205][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:29:55,206][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:30:00,206][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:30:05,207][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:30:10,208][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:30:15,209][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:30:20,210][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:30:25,211][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:30:30,212][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:30:35,213][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:30:40,214][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:30:45,215][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:30:50,216][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:30:55,217][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:31:00,218][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:31:05,219][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:31:10,219][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:31:15,220][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:31:20,221][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:31:25,222][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:31:30,223][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:31:35,224][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:31:40,225][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:31:45,226][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:31:50,227][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:31:55,228][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:32:00,229][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:32:05,229][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:32:10,230][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:32:15,231][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:32:18,349][  INFO][PID:3305434] Allocated host ResallocHost, ticket_id=5780569, hostname=140.211.168.156, name=copr_osuosl_p10_powerful_prod_07588348_20251022_022913, requested_tags=['copr_builder', 'arch_ppc64le', 'on_demand_powerful']
[2025-10-22 02:32:18,350][  INFO][PID:3305434] Allocating ssh connection to builder
[2025-10-22 02:32:18,350][  INFO][PID:3305434] Checking that builder machine is OK
[2025-10-22 02:32:19,513][  INFO][PID:3305434] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-10-22 02:32:20,598][  INFO][PID:3305434] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-10-22 02:32:20,599][  INFO][PID:3305434] Filling build.info file with builder info
[2025-10-22 02:32:20,599][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:32:20,600][  INFO][PID:3305434] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 108000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "@fedora-llvm-team",
            "project_name": "llvm-snapshots-with-flang-20251022",
            "project_dirname": "llvm-snapshots-with-flang-20251022",
            "submitter": "kkleine",
            "ended_on": null,
            "started_on": 1761100340.6001375,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9714231-fedora-rawhide-ppc64le",
            "build_id": 9714231,
            "package_name": "llvm",
            "package_version": "21.1.3-33",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/llvm-snapshots-with-flang-20251022/llvm",
            "git_hash": "979159280a801571fdcd2b30b720f33d52d0e397",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@fedora-llvm-team/llvm-snapshots-with-flang-20251022--kkleine",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-with-flang-20251022/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "module_hotfixes": true,
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-test-suite/fedora-rawhide-ppc64le/",
                    "id": "copr_fedora_llvm_team_llvm_test_suite",
                    "name": "Additional repo copr_fedora_llvm_team_llvm_test_suite"
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "on_demand_powerful"
            ],
            "with_opts": [
                "snapshot_build"
            ],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-with-flang-20251022",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-with-flang-20251022",
            "result_dir": "09714231-llvm",
            "built_packages": "",
            "id": 9714231,
            "mockchain_macros": {
                "copr_username": "@fedora-llvm-team",
                "copr_projectname": "llvm-snapshots-with-flang-20251022",
                "vendor": "Fedora Project COPR (@fedora-llvm-team/llvm-snapshots-with-flang-20251022)"
            }
        }
    ]
}
[2025-10-22 02:32:20,657][  INFO][PID:3305434] Sending fedora-messaging bus message in build.start
[2025-10-22 02:32:21,258][  INFO][PID:3305434] Sending fedora-messaging bus message in chroot.start
[2025-10-22 02:32:21,282][  INFO][PID:3305434] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9714231-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-10-22 02:32:22,552][  INFO][PID:3305434] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '140.211.168.156' (ED25519) to the list of known hosts.


[2025-10-22 02:32:22,553][  INFO][PID:3305434] Downloading the builder-live.log file, attempt 1
[2025-10-22 02:32:22,554][  INFO][PID:3305434] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.156 copr-rpmbuild-log
[2025-10-22 02:32:27,558][  INFO][PID:3305434] Periodic builder liveness probe: alive
[2025-10-22 02:32:27,558][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:32:32,559][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:32:37,560][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:32:42,561][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:32:47,562][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:32:52,563][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:32:57,564][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:33:02,565][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:33:07,566][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:33:12,567][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:33:17,568][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:33:22,569][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:33:27,570][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:33:32,571][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:33:37,572][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:33:42,572][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:33:47,573][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:33:52,574][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:33:57,575][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:34:02,576][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:34:07,577][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:34:12,578][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:34:17,579][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:34:22,580][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:34:27,581][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:34:32,582][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:34:37,583][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:34:42,584][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:34:47,585][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:34:52,586][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:34:57,587][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:35:02,588][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:35:07,589][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:35:12,590][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:35:17,591][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:35:22,592][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:35:27,593][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:35:32,594][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:35:37,595][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:35:42,596][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:35:47,597][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:35:52,598][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:35:57,599][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:36:02,600][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:36:07,601][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:36:12,602][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:36:17,602][  INFO][PID:3305434] Checking for cancel request
[2025-10-22 02:36:20,989][  INFO][PID:3305434] Downloading results from builder
[2025-10-22 02:36:20,990][  INFO][PID:3305434] rsyncing of mockbuilder@140.211.168.156:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-with-flang-20251022/fedora-rawhide-ppc64le/09714231-llvm started
[2025-10-22 02:36:20,991][  INFO][PID:3305434] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@140.211.168.156:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-with-flang-20251022/fedora-rawhide-ppc64le/09714231-llvm/ &> /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-with-flang-20251022/fedora-rawhide-ppc64le/09714231-llvm/build-09714231.rsync.log
[2025-10-22 02:37:14,840][  INFO][PID:3305434] rsyncing finished.
[2025-10-22 02:37:14,841][  INFO][PID:3305434] Releasing VM back to pool
[2025-10-22 02:37:14,854][  INFO][PID:3305434] Searching for 'success' file in resultdir
[2025-10-22 02:37:14,854][ ERROR][PID:3305434] Build failed: Backend process error: No success file => build failure
[2025-10-22 02:37:14,855][  INFO][PID:3305434] Finished build: id=9714231 failed=True timeout=108000 destdir=/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-with-flang-20251022 chroot=fedora-rawhide-ppc64le 
[2025-10-22 02:37:14,857][ ERROR][PID:3305434] Backend process error: No success file => build failure
[2025-10-22 02:37:14,857][  INFO][PID:3305434] Worker failed build, took 294.25774335861206
[2025-10-22 02:37:14,858][  INFO][PID:3305434] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 108000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "@fedora-llvm-team",
            "project_name": "llvm-snapshots-with-flang-20251022",
            "project_dirname": "llvm-snapshots-with-flang-20251022",
            "submitter": "kkleine",
            "ended_on": 1761100634.8578808,
            "started_on": 1761100340.6001375,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9714231-fedora-rawhide-ppc64le",
            "build_id": 9714231,
            "package_name": "llvm",
            "package_version": "21.1.3-33",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/llvm-snapshots-with-flang-20251022/llvm",
            "git_hash": "979159280a801571fdcd2b30b720f33d52d0e397",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@fedora-llvm-team/llvm-snapshots-with-flang-20251022--kkleine",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-with-flang-20251022/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "module_hotfixes": true,
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-test-suite/fedora-rawhide-ppc64le/",
                    "id": "copr_fedora_llvm_team_llvm_test_suite",
                    "name": "Additional repo copr_fedora_llvm_team_llvm_test_suite"
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "on_demand_powerful"
            ],
            "with_opts": [
                "snapshot_build"
            ],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-with-flang-20251022",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-with-flang-20251022",
            "result_dir": "09714231-llvm",
            "built_packages": "",
            "id": 9714231,
            "mockchain_macros": {
                "copr_username": "@fedora-llvm-team",
                "copr_projectname": "llvm-snapshots-with-flang-20251022",
                "vendor": "Fedora Project COPR (@fedora-llvm-team/llvm-snapshots-with-flang-20251022)"
            }
        }
    ]
}
[2025-10-22 02:37:14,883][  INFO][PID:3305434] Sending fedora-messaging bus message in build.end
[2025-10-22 02:37:14,907][  INFO][PID:3305434] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-with-flang-20251022/fedora-rawhide-ppc64le/09714231-llvm/builder-live.log by gzip
[2025-10-22 02:37:14,909][  INFO][PID:3305434] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-with-flang-20251022/fedora-rawhide-ppc64le/09714231-llvm/builder-live.log' as PID 3353391
[2025-10-22 02:37:14,919][  INFO][PID:3305434] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-with-flang-20251022/fedora-rawhide-ppc64le/09714231-llvm/builder-live.log)
[2025-10-22 02:37:14,920][  INFO][PID:3305434] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-with-flang-20251022/fedora-rawhide-ppc64le/09714231-llvm/backend.log by gzip
[2025-10-22 02:37:14,921][  INFO][PID:3305434] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-with-flang-20251022/fedora-rawhide-ppc64le/09714231-llvm/backend.log' as PID 3353392