[2026-02-08 03:49:39,737][ INFO][PID:3421883] Marking build as starting [2026-02-08 03:49:39,799][ INFO][PID:3421883] Checking that /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260208/centos-stream-9-ppc64le/repodata/repomd.xml exists [2026-02-08 03:49:39,849][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:49:39,853][ INFO][PID:3421883] VM allocation process starts [2026-02-08 03:49:39,907][ INFO][PID:3421883] Trying to allocate VM: ResallocHost, ticket_id=1216939, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9', 'on_demand_powerful'] [2026-02-08 03:49:44,909][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:49:49,911][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:49:54,912][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:49:59,913][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:50:04,914][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:50:09,915][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:50:14,916][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:50:19,917][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:50:24,942][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:50:29,943][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:50:34,944][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:50:39,946][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:50:44,947][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:50:49,948][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:50:54,995][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:50:59,996][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:51:04,997][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:51:09,999][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:51:15,000][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:51:20,001][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:51:25,002][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:51:30,003][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:51:35,004][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:51:40,005][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:51:45,006][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:51:50,007][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:51:55,008][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:52:00,009][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:52:05,117][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:52:10,118][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:52:15,119][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:52:20,120][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:52:25,126][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:52:30,127][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:52:35,129][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:52:40,130][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:52:45,130][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:52:50,131][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:52:55,132][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:53:00,133][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:53:05,134][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:53:10,135][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:53:15,136][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:53:20,137][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:53:25,138][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:53:30,139][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:53:35,139][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:53:40,140][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:53:45,141][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:53:50,142][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:53:55,144][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:54:00,145][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:54:05,146][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:54:10,147][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:54:15,148][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:54:20,149][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:54:25,150][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:54:30,151][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:54:35,152][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:54:40,153][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:54:45,154][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:54:50,155][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:54:55,156][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:54:58,050][ INFO][PID:3421883] Allocated host ResallocHost, ticket_id=1216939, hostname=140.211.168.155, name=copr_osuosl_p10_powerful_prod_01998490_20260208_035214, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9', 'on_demand_powerful'] [2026-02-08 03:54:58,052][ INFO][PID:3421883] Allocating ssh connection to builder [2026-02-08 03:54:58,052][ INFO][PID:3421883] Checking that builder machine is OK [2026-02-08 03:54:59,425][ INFO][PID:3421883] Running remote command: copr-builder-ready centos-stream-9-ppc64le [2026-02-08 03:55:01,452][ INFO][PID:3421883] Red Hat subscription not needed for centos-stream-9-ppc64le Builder is ready to be used [2026-02-08 03:55:01,453][ INFO][PID:3421883] Filling build.info file with builder info [2026-02-08 03:55:01,468][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:55:01,469][ INFO][PID:3421883] Sending build state back to frontend: { "builds": [ { "timeout": 108000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "@fedora-llvm-team", "project_name": "llvm-snapshots-big-merge-20260208", "project_dirname": "llvm-snapshots-big-merge-20260208", "submitter": "nikic", "ended_on": null, "started_on": 1770522901.4691665, "submitted_on": null, "status": 3, "chroot": "centos-stream-9-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10103149-centos-stream-9-ppc64le", "build_id": 10103149, "package_name": "llvm", "package_version": "21.1.8-18", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/llvm-snapshots-big-merge-20260208/llvm", "git_hash": "3d6beddd4f673fa5550fa7fcee33cba0f8e4dbd1", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@fedora-llvm-team/llvm-snapshots-big-merge-20260208--nikic", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260208/centos-stream-9-ppc64le/", "id": "copr_base", "module_hotfixes": true, "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-test-suite/centos-stream-9-ppc64le/", "id": "copr_fedora_llvm_team_llvm_test_suite", "name": "Additional repo copr_fedora_llvm_team_llvm_test_suite" } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9", "on_demand_powerful" ], "with_opts": [ "snapshot_build" ], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260208", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260208", "result_dir": "10103149-llvm", "built_packages": "", "id": 10103149, "mockchain_macros": { "copr_username": "@fedora-llvm-team", "copr_projectname": "llvm-snapshots-big-merge-20260208", "vendor": "Fedora Project COPR (@fedora-llvm-team/llvm-snapshots-big-merge-20260208)" } } ] } [2026-02-08 03:55:01,515][ INFO][PID:3421883] Sending fedora-messaging bus message in build.start [2026-02-08 03:55:02,049][ INFO][PID:3421883] Sending fedora-messaging bus message in chroot.start [2026-02-08 03:55:02,079][ INFO][PID:3421883] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10103149-centos-stream-9-ppc64le --chroot centos-stream-9-ppc64le --detached [2026-02-08 03:55:03,489][ INFO][PID:3421883] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '140.211.168.155' (ED25519) to the list of known hosts. [2026-02-08 03:55:03,490][ INFO][PID:3421883] Downloading the builder-live.log file, attempt 1 [2026-02-08 03:55:03,492][ INFO][PID:3421883] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.155 copr-rpmbuild-log [2026-02-08 03:55:08,496][ INFO][PID:3421883] Periodic builder liveness probe: alive [2026-02-08 03:55:08,497][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:55:13,498][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:55:18,499][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:55:23,500][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:55:28,501][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:55:33,502][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:55:38,503][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:55:43,505][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:55:48,506][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:55:53,508][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:55:58,512][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:56:03,513][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:56:08,514][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:56:13,515][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:56:18,516][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:56:23,517][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:56:28,518][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:56:33,520][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:56:38,521][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:56:43,535][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:56:48,536][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:56:53,538][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:56:58,539][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:57:03,540][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:57:08,541][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:57:13,542][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:57:18,543][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:57:23,544][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:57:28,545][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:57:33,546][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:57:38,547][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:57:43,548][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:57:48,549][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:57:53,550][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:57:58,552][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:58:03,553][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:58:08,554][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:58:13,555][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:58:18,556][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:58:23,557][ INFO][PID:3421883] Checking for cancel request [2026-02-08 03:58:24,936][ INFO][PID:3421883] Downloading results from builder [2026-02-08 03:58:24,936][ INFO][PID:3421883] rsyncing of mockbuilder@140.211.168.155:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260208/centos-stream-9-ppc64le/10103149-llvm started [2026-02-08 03:58:24,937][ INFO][PID:3421883] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@140.211.168.155:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260208/centos-stream-9-ppc64le/10103149-llvm/ &> /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260208/centos-stream-9-ppc64le/10103149-llvm/build-10103149.rsync.log [2026-02-08 03:59:11,815][ INFO][PID:3421883] rsyncing finished. [2026-02-08 03:59:11,822][ INFO][PID:3421883] Releasing VM back to pool [2026-02-08 03:59:11,833][ INFO][PID:3421883] Searching for 'success' file in resultdir [2026-02-08 03:59:11,834][ ERROR][PID:3421883] Build failed: Backend process error: No success file => build failure [2026-02-08 03:59:11,834][ INFO][PID:3421883] Finished build: id=10103149 failed=True timeout=108000 destdir=/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260208 chroot=centos-stream-9-ppc64le [2026-02-08 03:59:11,836][ ERROR][PID:3421883] Backend process error: No success file => build failure [2026-02-08 03:59:11,837][ INFO][PID:3421883] Worker failed build, took 250.3679473400116 [2026-02-08 03:59:11,837][ INFO][PID:3421883] Sending build state back to frontend: { "builds": [ { "timeout": 108000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "@fedora-llvm-team", "project_name": "llvm-snapshots-big-merge-20260208", "project_dirname": "llvm-snapshots-big-merge-20260208", "submitter": "nikic", "ended_on": 1770523151.8371139, "started_on": 1770522901.4691665, "submitted_on": null, "status": 0, "chroot": "centos-stream-9-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10103149-centos-stream-9-ppc64le", "build_id": 10103149, "package_name": "llvm", "package_version": "21.1.8-18", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/llvm-snapshots-big-merge-20260208/llvm", "git_hash": "3d6beddd4f673fa5550fa7fcee33cba0f8e4dbd1", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@fedora-llvm-team/llvm-snapshots-big-merge-20260208--nikic", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260208/centos-stream-9-ppc64le/", "id": "copr_base", "module_hotfixes": true, "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-test-suite/centos-stream-9-ppc64le/", "id": "copr_fedora_llvm_team_llvm_test_suite", "name": "Additional repo copr_fedora_llvm_team_llvm_test_suite" } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9", "on_demand_powerful" ], "with_opts": [ "snapshot_build" ], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260208", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260208", "result_dir": "10103149-llvm", "built_packages": "", "id": 10103149, "mockchain_macros": { "copr_username": "@fedora-llvm-team", "copr_projectname": "llvm-snapshots-big-merge-20260208", "vendor": "Fedora Project COPR (@fedora-llvm-team/llvm-snapshots-big-merge-20260208)" } } ] } [2026-02-08 03:59:11,879][ INFO][PID:3421883] Sending fedora-messaging bus message in build.end [2026-02-08 03:59:11,909][ INFO][PID:3421883] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260208/centos-stream-9-ppc64le/10103149-llvm/builder-live.log by gzip [2026-02-08 03:59:11,910][ INFO][PID:3421883] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260208/centos-stream-9-ppc64le/10103149-llvm/builder-live.log' as PID 3470603 [2026-02-08 03:59:11,940][ INFO][PID:3421883] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260208/centos-stream-9-ppc64le/10103149-llvm/builder-live.log) [2026-02-08 03:59:11,941][ INFO][PID:3421883] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260208/centos-stream-9-ppc64le/10103149-llvm/backend.log by gzip [2026-02-08 03:59:11,942][ INFO][PID:3421883] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260208/centos-stream-9-ppc64le/10103149-llvm/backend.log' as PID 3470606