[2026-06-25 21:10:46,820][ INFO][PID:1369504] Marking build as starting [2026-06-25 21:10:46,890][ INFO][PID:1369504] Checking that https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-ppc64le//repodata/repomd.xml exists [2026-06-25 21:10:47,293][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:10:47,336][ INFO][PID:1369504] rpmeta: predicted 476 min for firefox on centos-stream-9-ppc64le -> recommends powerful builder (no build promotion) [2026-06-25 21:10:47,339][ INFO][PID:1369504] VM allocation process starts [2026-06-25 21:10:47,373][ INFO][PID:1369504] Trying to allocate VM: ResallocHost, ticket_id=3624635, requested_tags=['arch_power9', 'arch_ppc64le', 'copr_builder', 'on_demand_powerful'] [2026-06-25 21:10:52,376][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:10:57,383][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:11:02,384][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:11:07,410][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:11:12,413][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:11:15,440][ INFO][PID:1369504] Allocated host ResallocHost, ticket_id=3624635, hostname=2620:52:6:1161:dead:beef:cafe:c18d, name=vmhost_p_p09_02_prod_12726565_20260625_210350, requested_tags=['arch_power9', 'arch_ppc64le', 'copr_builder', 'on_demand_powerful'] [2026-06-25 21:11:15,441][ INFO][PID:1369504] Allocating ssh connection to builder [2026-06-25 21:11:15,441][ INFO][PID:1369504] Checking that builder machine is OK [2026-06-25 21:11:16,488][ INFO][PID:1369504] Installed copr-rpmbuild version: 1.8 [2026-06-25 21:11:16,489][ INFO][PID:1369504] Running remote command: copr-builder-ready centos-stream-9-ppc64le [2026-06-25 21:11:17,097][ INFO][PID:1369504] Red Hat subscription not needed for centos-stream-9-ppc64le Builder is ready to be used [2026-06-25 21:11:17,098][ INFO][PID:1369504] Filling build.info file with builder info [2026-06-25 21:11:17,099][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:11:17,101][ INFO][PID:1369504] Sending build state back to frontend: { "builds": [ { "timeout": 90000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@fedora-llvm-team", "project_name": "clang-fedora-centos-testing", "project_dirname": "clang-fedora-centos-testing", "submitter": "tstellar", "ended_on": null, "started_on": 1782421877.100896, "submitted_on": null, "status": 3, "chroot": "centos-stream-9-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10650783-centos-stream-9-ppc64le", "build_id": 10650783, "package_name": "firefox", "package_version": "140.12.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/clang-fedora-centos-testing/firefox", "git_hash": "69f315056496be2145dbf27fb1e59fb5445faf1b", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@fedora-llvm-team/clang-fedora-centos-testing--tstellar", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": 1000 }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-compat-packages/centos-stream-9-ppc64le/", "id": "copr_fedora_llvm_team_llvm_compat_packages", "name": "Additional repo copr_fedora_llvm_team_llvm_compat_packages" }, { "baseurl": "https://kojihub.stream.centos.org/kojifiles/repos/c9s-build/latest/ppc64le/", "id": "https_kojihub_stream_centos_org_kojifiles_repos_c9s_build_latest_ppc64le", "name": "Additional repo https_kojihub_stream_centos_org_kojifiles_repos_c9s_build_latest_ppc64le" }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260625/centos-stream-9-ppc64le/", "id": "copr_fedora_llvm_team_llvm_snapshots_big_merge_20260625", "module_hotfixes": true, "name": "Additional repo copr_fedora_llvm_team_llvm_snapshots_big_merge_20260625" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": 1000, "tags": [ "arch_ppc64le", "arch_power9", "on_demand_powerful" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-fedora-centos-testing", "result_dir": "10650783-firefox", "built_packages": "", "rpmeta_prediction": 476, "id": 10650783, "mockchain_macros": { "copr_username": "@fedora-llvm-team", "copr_projectname": "clang-fedora-centos-testing", "vendor": "Fedora Project COPR (@fedora-llvm-team/clang-fedora-centos-testing)" } } ] } [2026-06-25 21:11:17,147][ INFO][PID:1369504] Sending fedora-messaging bus message in build.start [2026-06-25 21:11:17,706][ INFO][PID:1369504] Sending fedora-messaging bus message in chroot.start [2026-06-25 21:11:17,734][ INFO][PID:1369504] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10650783-centos-stream-9-ppc64le --chroot centos-stream-9-ppc64le --detached [2026-06-25 21:11:18,832][ INFO][PID:1369504] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c18d' (ED25519) to the list of known hosts. [2026-06-25 21:11:18,833][ INFO][PID:1369504] Downloading the builder-live.log file, attempt 1 [2026-06-25 21:11:18,835][ INFO][PID:1369504] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c18d copr-rpmbuild-log [2026-06-25 21:11:23,845][ INFO][PID:1369504] Periodic builder liveness probe: alive [2026-06-25 21:11:23,846][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:11:28,848][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:11:33,851][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:11:38,852][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:11:43,853][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:11:48,855][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:11:53,880][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:11:58,882][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:12:03,898][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:12:08,900][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:12:13,911][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:12:18,912][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:12:23,914][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:12:28,915][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:12:33,918][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:12:38,919][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:12:43,920][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:12:48,922][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:12:53,947][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:12:58,949][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:13:03,951][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:13:08,985][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:13:13,987][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:13:19,032][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:13:24,034][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:13:29,035][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:13:34,045][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:13:39,053][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:13:44,086][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:13:49,093][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:13:54,095][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:13:59,096][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:14:04,098][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:14:09,100][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:14:14,101][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:14:19,105][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:14:24,107][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:14:29,109][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:14:34,111][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:14:39,113][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:14:44,215][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:14:49,217][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:14:54,224][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:14:59,227][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:15:04,230][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:15:09,231][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:15:14,233][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:15:19,235][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:15:24,237][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:15:29,238][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:15:34,255][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:15:39,257][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:15:44,258][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:15:49,260][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:15:54,262][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:15:59,267][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:16:04,268][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:16:09,271][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:16:14,275][ INFO][PID:1369504] Checking for cancel request [2026-06-25 21:16:15,550][ INFO][PID:1369504] Downloading results from builder [2026-06-25 21:16:15,630][ INFO][PID:1369504] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18d]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-ppc64le/10650783-firefox started [2026-06-25 21:16:15,754][ INFO][PID:1369504] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18d]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-ppc64le/10650783-firefox/ &> /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-ppc64le/10650783-firefox/build-10650783.rsync.log [2026-06-25 21:16:32,096][ INFO][PID:1369504] rsyncing finished. [2026-06-25 21:16:32,108][ INFO][PID:1369504] VM Release request [2026-06-25 21:17:01,692][ INFO][PID:1369504] Searching for 'success' file in resultdir [2026-06-25 21:17:01,717][ ERROR][PID:1369504] Build failed: Backend process error: No success file => build failure [2026-06-25 21:17:02,764][ INFO][PID:1369504] Finished build: id=10650783 failed=True timeout=90000 destdir=/var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing chroot=centos-stream-9-ppc64le [2026-06-25 21:17:03,331][ ERROR][PID:1369504] Backend process error: No success file => build failure [2026-06-25 21:17:03,392][ INFO][PID:1369504] Worker failed build, took 346.2913649082184 [2026-06-25 21:17:03,393][ INFO][PID:1369504] Sending build state back to frontend: { "builds": [ { "timeout": 90000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@fedora-llvm-team", "project_name": "clang-fedora-centos-testing", "project_dirname": "clang-fedora-centos-testing", "submitter": "tstellar", "ended_on": 1782422223.3922608, "started_on": 1782421877.100896, "submitted_on": null, "status": 0, "chroot": "centos-stream-9-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10650783-centos-stream-9-ppc64le", "build_id": 10650783, "package_name": "firefox", "package_version": "140.12.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/clang-fedora-centos-testing/firefox", "git_hash": "69f315056496be2145dbf27fb1e59fb5445faf1b", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@fedora-llvm-team/clang-fedora-centos-testing--tstellar", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": 1000 }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-compat-packages/centos-stream-9-ppc64le/", "id": "copr_fedora_llvm_team_llvm_compat_packages", "name": "Additional repo copr_fedora_llvm_team_llvm_compat_packages" }, { "baseurl": "https://kojihub.stream.centos.org/kojifiles/repos/c9s-build/latest/ppc64le/", "id": "https_kojihub_stream_centos_org_kojifiles_repos_c9s_build_latest_ppc64le", "name": "Additional repo https_kojihub_stream_centos_org_kojifiles_repos_c9s_build_latest_ppc64le" }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260625/centos-stream-9-ppc64le/", "id": "copr_fedora_llvm_team_llvm_snapshots_big_merge_20260625", "module_hotfixes": true, "name": "Additional repo copr_fedora_llvm_team_llvm_snapshots_big_merge_20260625" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": 1000, "tags": [ "arch_ppc64le", "arch_power9", "on_demand_powerful" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-fedora-centos-testing", "result_dir": "10650783-firefox", "built_packages": "", "rpmeta_prediction": 476, "id": 10650783, "mockchain_macros": { "copr_username": "@fedora-llvm-team", "copr_projectname": "clang-fedora-centos-testing", "vendor": "Fedora Project COPR (@fedora-llvm-team/clang-fedora-centos-testing)" } } ] } [2026-06-25 21:17:03,546][ INFO][PID:1369504] Sending fedora-messaging bus message in build.end [2026-06-25 21:17:04,719][ INFO][PID:1369504] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-ppc64le/10650783-firefox/builder-live.log by gzip [2026-06-25 21:17:04,781][ INFO][PID:1369504] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-ppc64le/10650783-firefox/builder-live.log' as PID 1421087 [2026-06-25 21:17:04,877][ INFO][PID:1369504] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-ppc64le/10650783-firefox/builder-live.log) [2026-06-25 21:17:04,886][ INFO][PID:1369504] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-ppc64le/10650783-firefox/backend.log by gzip [2026-06-25 21:17:04,889][ INFO][PID:1369504] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-ppc64le/10650783-firefox/backend.log' as PID 1421122