[2026-05-02 04:11:15,057][ INFO][PID:672285] Marking build as starting [2026-05-02 04:11:15,220][ INFO][PID:672285] Checking that https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260502/fedora-rawhide-aarch64//repodata/repomd.xml exists [2026-05-02 04:11:16,073][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:11:16,119][ INFO][PID:672285] VM allocation process starts [2026-05-02 04:11:16,249][ INFO][PID:672285] Trying to allocate VM: ResallocHost, ticket_id=2694116, requested_tags=['arch_aarch64', 'copr_builder', 'on_demand_powerful'] [2026-05-02 04:11:21,264][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:11:26,267][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:11:31,272][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:11:36,276][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:11:41,290][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:11:46,292][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:11:51,311][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:11:56,317][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:12:01,325][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:12:06,329][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:12:11,337][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:12:16,339][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:12:21,343][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:12:26,346][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:12:31,349][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:12:36,357][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:12:41,360][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:12:46,367][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:12:51,380][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:12:56,396][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:13:01,400][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:13:06,404][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:13:11,421][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:13:16,424][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:13:21,431][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:13:26,439][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:13:31,448][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:13:36,459][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:13:41,479][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:13:46,481][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:13:51,508][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:13:56,516][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:14:01,522][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:14:06,531][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:14:11,533][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:14:16,546][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:14:21,552][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:14:26,557][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:14:31,561][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:14:34,612][ INFO][PID:672285] Allocated host ResallocHost, ticket_id=2694116, hostname=54.87.133.158, name=aws_aarch64_powerful_spot_prod_08512935_20260502_041148, requested_tags=['arch_aarch64', 'copr_builder', 'on_demand_powerful'] [2026-05-02 04:14:34,613][ INFO][PID:672285] Allocating ssh connection to builder [2026-05-02 04:14:34,614][ INFO][PID:672285] Checking that builder machine is OK [2026-05-02 04:14:35,119][ INFO][PID:672285] Installed copr-rpmbuild version: 1.8 [2026-05-02 04:14:35,120][ INFO][PID:672285] Running remote command: copr-builder-ready fedora-rawhide-aarch64 [2026-05-02 04:14:35,412][ INFO][PID:672285] Red Hat subscription not needed for fedora-rawhide-aarch64 Builder is ready to be used [2026-05-02 04:14:35,413][ INFO][PID:672285] Filling build.info file with builder info [2026-05-02 04:14:35,414][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:14:35,416][ INFO][PID:672285] Sending build state back to frontend: { "builds": [ { "timeout": 108000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "@fedora-llvm-team", "project_name": "llvm-snapshots-big-merge-20260502", "project_dirname": "llvm-snapshots-big-merge-20260502", "submitter": "kkleine", "ended_on": null, "started_on": 1777695275.4161992, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-aarch64", "arch": "aarch64", "buildroot_pkgs": [], "task_id": "10416944-fedora-rawhide-aarch64", "build_id": 10416944, "package_name": "llvm", "package_version": "22.1.4-3", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/llvm-snapshots-big-merge-20260502/llvm", "git_hash": "95857963b9cbf51f1fd23bce9e9aabe2071ca6cc", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@fedora-llvm-team/llvm-snapshots-big-merge-20260502--kkleine", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260502/fedora-rawhide-aarch64/", "id": "copr_base", "module_hotfixes": true, "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-test-suite/fedora-rawhide-aarch64/", "id": "copr_fedora_llvm_team_llvm_test_suite", "name": "Additional repo copr_fedora_llvm_team_llvm_test_suite" } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_aarch64", "on_demand_powerful" ], "with_opts": [ "snapshot_build" ], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260502", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260502", "result_dir": "10416944-llvm", "built_packages": "", "id": 10416944, "mockchain_macros": { "copr_username": "@fedora-llvm-team", "copr_projectname": "llvm-snapshots-big-merge-20260502", "vendor": "Fedora Project COPR (@fedora-llvm-team/llvm-snapshots-big-merge-20260502)" } } ] } [2026-05-02 04:14:35,467][ INFO][PID:672285] Sending fedora-messaging bus message in build.start [2026-05-02 04:14:36,196][ INFO][PID:672285] Sending fedora-messaging bus message in chroot.start [2026-05-02 04:14:36,231][ INFO][PID:672285] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10416944-fedora-rawhide-aarch64 --chroot fedora-rawhide-aarch64 --detached [2026-05-02 04:14:36,808][ INFO][PID:672285] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '54.87.133.158' (ED25519) to the list of known hosts. [2026-05-02 04:14:36,809][ INFO][PID:672285] Downloading the builder-live.log file, attempt 1 [2026-05-02 04:14:37,031][ INFO][PID:672285] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.87.133.158 copr-rpmbuild-log [2026-05-02 04:14:41,821][ INFO][PID:672285] Periodic builder liveness probe: alive [2026-05-02 04:14:41,823][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:14:46,825][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:14:51,827][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:14:56,830][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:15:01,834][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:15:06,838][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:15:11,840][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:15:16,841][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:15:21,843][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:15:26,845][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:15:31,849][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:15:36,851][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:15:41,853][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:15:46,854][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:15:51,856][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:15:56,859][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:16:01,863][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:16:06,865][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:16:11,866][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:16:16,868][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:16:21,871][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:16:26,873][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:16:31,957][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:16:36,958][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:16:41,960][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:16:46,962][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:16:51,964][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:16:56,969][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:17:02,074][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:17:07,078][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:17:12,080][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:17:17,082][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:17:22,083][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:17:27,085][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:17:32,087][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:17:37,088][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:17:42,090][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:17:47,094][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:17:52,096][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:17:57,098][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:18:02,099][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:18:07,101][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:18:12,102][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:18:17,103][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:18:22,105][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:18:27,106][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:18:32,107][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:18:37,109][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:18:42,111][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:18:47,113][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:18:52,115][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:18:57,116][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:19:02,120][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:19:07,127][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:19:12,128][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:19:17,130][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:19:22,132][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:19:27,134][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:19:32,135][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:19:37,137][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:19:42,139][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:19:47,141][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:19:52,143][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:19:57,145][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:20:02,147][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:20:07,149][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:20:12,150][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:20:17,154][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:20:22,161][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:20:27,163][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:20:32,165][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:20:37,168][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:20:42,170][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:20:47,171][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:20:52,173][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:20:57,175][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:21:02,181][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:21:07,183][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:21:12,184][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:21:17,186][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:21:22,276][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:21:27,278][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:21:32,279][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:21:37,281][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:21:42,282][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:21:47,283][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:21:52,285][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:21:57,287][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:22:02,288][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:22:07,290][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:22:12,293][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:22:17,295][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:22:22,296][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:22:27,298][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:22:32,300][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:22:37,302][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:22:42,303][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:22:47,305][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:22:52,306][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:22:57,307][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:23:02,309][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:23:07,310][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:23:12,311][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:23:17,313][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:23:22,316][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:23:27,318][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:23:32,321][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:23:37,322][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:23:42,323][ INFO][PID:672285] Checking for cancel request [2026-05-02 04:23:43,534][ INFO][PID:672285] Downloading results from builder [2026-05-02 04:23:43,534][ INFO][PID:672285] rsyncing of mockbuilder@54.87.133.158:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260502/fedora-rawhide-aarch64/10416944-llvm started [2026-05-02 04:23:43,535][ INFO][PID:672285] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@54.87.133.158:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260502/fedora-rawhide-aarch64/10416944-llvm/ &> /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260502/fedora-rawhide-aarch64/10416944-llvm/build-10416944.rsync.log [2026-05-02 04:23:45,176][ INFO][PID:672285] rsyncing finished. [2026-05-02 04:23:45,177][ INFO][PID:672285] VM Release request [2026-05-02 04:23:45,229][ INFO][PID:672285] Searching for 'success' file in resultdir [2026-05-02 04:23:45,230][ ERROR][PID:672285] Build failed: Backend process error: No success file => build failure [2026-05-02 04:23:45,245][ INFO][PID:672285] Finished build: id=10416944 failed=True timeout=108000 destdir=/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260502 chroot=fedora-rawhide-aarch64 [2026-05-02 04:23:45,249][ ERROR][PID:672285] Backend process error: No success file => build failure [2026-05-02 04:23:45,264][ INFO][PID:672285] Worker failed build, took 549.8481366634369 [2026-05-02 04:23:45,265][ INFO][PID:672285] Sending build state back to frontend: { "builds": [ { "timeout": 108000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "@fedora-llvm-team", "project_name": "llvm-snapshots-big-merge-20260502", "project_dirname": "llvm-snapshots-big-merge-20260502", "submitter": "kkleine", "ended_on": 1777695825.2643359, "started_on": 1777695275.4161992, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-aarch64", "arch": "aarch64", "buildroot_pkgs": [], "task_id": "10416944-fedora-rawhide-aarch64", "build_id": 10416944, "package_name": "llvm", "package_version": "22.1.4-3", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/llvm-snapshots-big-merge-20260502/llvm", "git_hash": "95857963b9cbf51f1fd23bce9e9aabe2071ca6cc", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@fedora-llvm-team/llvm-snapshots-big-merge-20260502--kkleine", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260502/fedora-rawhide-aarch64/", "id": "copr_base", "module_hotfixes": true, "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-test-suite/fedora-rawhide-aarch64/", "id": "copr_fedora_llvm_team_llvm_test_suite", "name": "Additional repo copr_fedora_llvm_team_llvm_test_suite" } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_aarch64", "on_demand_powerful" ], "with_opts": [ "snapshot_build" ], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260502", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260502", "result_dir": "10416944-llvm", "built_packages": "", "id": 10416944, "mockchain_macros": { "copr_username": "@fedora-llvm-team", "copr_projectname": "llvm-snapshots-big-merge-20260502", "vendor": "Fedora Project COPR (@fedora-llvm-team/llvm-snapshots-big-merge-20260502)" } } ] } [2026-05-02 04:23:45,304][ INFO][PID:672285] Sending fedora-messaging bus message in build.end [2026-05-02 04:23:45,332][ INFO][PID:672285] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260502/fedora-rawhide-aarch64/10416944-llvm/builder-live.log by gzip [2026-05-02 04:23:45,333][ INFO][PID:672285] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260502/fedora-rawhide-aarch64/10416944-llvm/builder-live.log' as PID 820258 [2026-05-02 04:23:45,520][ INFO][PID:672285] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260502/fedora-rawhide-aarch64/10416944-llvm/builder-live.log) [2026-05-02 04:23:45,521][ INFO][PID:672285] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260502/fedora-rawhide-aarch64/10416944-llvm/backend.log by gzip [2026-05-02 04:23:45,522][ INFO][PID:672285] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260502/fedora-rawhide-aarch64/10416944-llvm/backend.log' as PID 820276