[2025-10-02 19:05:32,914][ INFO][PID:472211] Marking build as starting [2025-10-02 19:05:32,983][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:05:32,985][ INFO][PID:472211] VM allocation process starts [2025-10-02 19:05:33,010][ INFO][PID:472211] Trying to allocate VM: ResallocHost, ticket_id=5449078, requested_tags=['copr_builder', 'arch_x86_64'] [2025-10-02 19:05:36,038][ INFO][PID:472211] Allocated host ResallocHost, ticket_id=5449078, hostname=52.7.225.195, name=aws_x86_64_normalreserved_prod_07195045_20251002_190243, requested_tags=['copr_builder', 'arch_x86_64'] [2025-10-02 19:05:36,039][ INFO][PID:472211] Allocating ssh connection to builder [2025-10-02 19:05:36,039][ INFO][PID:472211] Checking that builder machine is OK [2025-10-02 19:05:36,398][ INFO][PID:472211] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2025-10-02 19:05:36,665][ INFO][PID:472211] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2025-10-02 19:05:36,666][ INFO][PID:472211] Filling build.info file with builder info [2025-10-02 19:05:36,666][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:05:36,667][ INFO][PID:472211] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "fachep", "project_name": "ollama", "project_dirname": "ollama", "submitter": "fachep", "ended_on": null, "started_on": 1759431936.6675527, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9640816-fedora-rawhide-x86_64", "build_id": 9640816, "package_name": "ollama-ggml-cuda", "package_version": "0.12.3-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/fachep/ollama/ollama-ggml-cuda", "git_hash": "5d72c48471d21c1f7fb3d0668409134ef3a08855", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "fachep/ollama--fachep", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/fachep/ollama/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://developer.download.nvidia.cn/compute/cuda/repos/fedora42/x86_64/", "id": "https_developer_download_nvidia_cn_compute_cuda_repos_fedora42_x86_64", "name": "Additional repo https_developer_download_nvidia_cn_compute_cuda_repos_fedora42_x86_64" }, { "baseurl": "https://developer.download.nvidia.cn/compute/cuda/repos/fedora41/x86_64/", "id": "https_developer_download_nvidia_cn_compute_cuda_repos_fedora41_x86_64", "name": "Additional repo https_developer_download_nvidia_cn_compute_cuda_repos_fedora41_x86_64" } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/fachep/ollama", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/fachep/ollama", "result_dir": "09640816-ollama-ggml-cuda", "built_packages": "", "id": 9640816, "mockchain_macros": { "copr_username": "fachep", "copr_projectname": "ollama", "vendor": "Fedora Project COPR (fachep/ollama)" } } ] } [2025-10-02 19:05:36,708][ INFO][PID:472211] Sending fedora-messaging bus message in build.start [2025-10-02 19:05:38,153][ INFO][PID:472211] Sending fedora-messaging bus message in chroot.start [2025-10-02 19:05:38,179][ INFO][PID:472211] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9640816-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2025-10-02 19:05:38,537][ INFO][PID:472211] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '52.7.225.195' (ED25519) to the list of known hosts. [2025-10-02 19:05:38,538][ INFO][PID:472211] Downloading the builder-live.log file, attempt 1 [2025-10-02 19:05:38,540][ INFO][PID:472211] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@52.7.225.195 copr-rpmbuild-log [2025-10-02 19:05:43,543][ INFO][PID:472211] Periodic builder liveness probe: alive [2025-10-02 19:05:43,543][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:05:48,544][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:05:53,545][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:05:58,546][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:06:03,547][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:06:08,548][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:06:13,552][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:06:18,554][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:06:23,556][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:06:28,557][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:06:33,558][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:06:38,559][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:06:43,560][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:06:48,561][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:06:53,562][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:06:58,563][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:07:03,564][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:07:08,565][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:07:13,567][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:07:18,568][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:07:23,570][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:07:28,572][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:07:33,574][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:07:38,582][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:07:43,583][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:07:48,587][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:07:53,592][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:07:58,594][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:08:03,596][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:08:08,597][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:08:13,600][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:08:18,602][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:08:23,603][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:08:28,613][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:08:33,616][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:08:38,617][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:08:43,620][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:08:48,628][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:08:53,639][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:08:58,642][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:09:03,647][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:09:08,661][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:09:13,663][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:09:18,665][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:09:23,670][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:09:28,676][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:09:33,678][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:09:38,679][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:09:43,681][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:09:48,683][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:09:53,685][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:09:58,686][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:10:03,687][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:10:08,689][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:10:13,690][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:10:18,692][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:10:23,693][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:10:28,695][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:10:33,697][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:10:38,699][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:10:43,700][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:10:48,701][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:10:53,702][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:10:58,703][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:11:03,705][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:11:08,706][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:11:13,707][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:11:18,708][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:11:23,709][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:11:28,710][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:11:33,713][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:11:38,714][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:11:43,715][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:11:48,716][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:11:53,717][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:11:58,722][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:12:03,723][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:12:08,724][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:12:13,725][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:12:18,727][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:12:23,728][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:12:28,729][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:12:33,730][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:12:38,731][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:12:43,732][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:12:48,733][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:12:53,734][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:12:58,735][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:13:03,736][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:13:08,737][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:13:13,738][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:13:18,739][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:13:23,740][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:13:28,741][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:13:33,741][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:13:38,742][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:13:43,743][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:13:48,744][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:13:53,745][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:13:58,746][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:14:03,747][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:14:08,748][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:14:13,749][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:14:18,750][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:14:23,751][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:14:28,752][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:14:33,753][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:14:38,754][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:14:43,755][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:14:48,756][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:14:53,757][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:14:58,758][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:15:03,760][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:15:08,761][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:15:13,762][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:15:18,763][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:15:23,765][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:15:28,766][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:15:33,767][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:15:38,768][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:15:43,776][ INFO][PID:472211] Periodic builder liveness probe: alive [2025-10-02 19:15:43,777][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:15:48,778][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:15:53,782][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:15:58,783][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:16:03,784][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:16:08,785][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:16:13,787][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:16:18,788][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:16:23,789][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:16:28,791][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:16:33,792][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:16:38,793][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:16:43,794][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:16:48,795][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:16:53,796][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:16:58,797][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:17:03,798][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:17:08,799][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:17:13,800][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:17:18,801][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:17:23,802][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:17:28,803][ INFO][PID:472211] Checking for cancel request [2025-10-02 19:17:29,907][ INFO][PID:472211] Downloading results from builder [2025-10-02 19:17:29,908][ INFO][PID:472211] rsyncing of mockbuilder@52.7.225.195:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/fachep/ollama/fedora-rawhide-x86_64/09640816-ollama-ggml-cuda started [2025-10-02 19:17:29,909][ INFO][PID:472211] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@52.7.225.195:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/fachep/ollama/fedora-rawhide-x86_64/09640816-ollama-ggml-cuda/ &> /var/lib/copr/public_html/results/fachep/ollama/fedora-rawhide-x86_64/09640816-ollama-ggml-cuda/build-09640816.rsync.log [2025-10-02 19:17:30,483][ INFO][PID:472211] rsyncing finished. [2025-10-02 19:17:30,483][ INFO][PID:472211] Releasing VM back to pool [2025-10-02 19:17:30,492][ INFO][PID:472211] Searching for 'success' file in resultdir [2025-10-02 19:17:30,492][ ERROR][PID:472211] Build failed: Backend process error: No success file => build failure [2025-10-02 19:17:30,493][ INFO][PID:472211] Finished build: id=9640816 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/fachep/ollama chroot=fedora-rawhide-x86_64 [2025-10-02 19:17:30,495][ ERROR][PID:472211] Backend process error: No success file => build failure [2025-10-02 19:17:30,495][ INFO][PID:472211] Worker failed build, took 713.8280265331268 [2025-10-02 19:17:30,496][ INFO][PID:472211] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "fachep", "project_name": "ollama", "project_dirname": "ollama", "submitter": "fachep", "ended_on": 1759432650.4955792, "started_on": 1759431936.6675527, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9640816-fedora-rawhide-x86_64", "build_id": 9640816, "package_name": "ollama-ggml-cuda", "package_version": "0.12.3-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/fachep/ollama/ollama-ggml-cuda", "git_hash": "5d72c48471d21c1f7fb3d0668409134ef3a08855", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "fachep/ollama--fachep", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/fachep/ollama/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://developer.download.nvidia.cn/compute/cuda/repos/fedora42/x86_64/", "id": "https_developer_download_nvidia_cn_compute_cuda_repos_fedora42_x86_64", "name": "Additional repo https_developer_download_nvidia_cn_compute_cuda_repos_fedora42_x86_64" }, { "baseurl": "https://developer.download.nvidia.cn/compute/cuda/repos/fedora41/x86_64/", "id": "https_developer_download_nvidia_cn_compute_cuda_repos_fedora41_x86_64", "name": "Additional repo https_developer_download_nvidia_cn_compute_cuda_repos_fedora41_x86_64" } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/fachep/ollama", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/fachep/ollama", "result_dir": "09640816-ollama-ggml-cuda", "built_packages": "", "id": 9640816, "mockchain_macros": { "copr_username": "fachep", "copr_projectname": "ollama", "vendor": "Fedora Project COPR (fachep/ollama)" } } ] } [2025-10-02 19:17:30,520][ INFO][PID:472211] Sending fedora-messaging bus message in build.end [2025-10-02 19:17:30,544][ INFO][PID:472211] Compressing /var/lib/copr/public_html/results/fachep/ollama/fedora-rawhide-x86_64/09640816-ollama-ggml-cuda/builder-live.log by gzip [2025-10-02 19:17:30,545][ INFO][PID:472211] Running command 'gzip /var/lib/copr/public_html/results/fachep/ollama/fedora-rawhide-x86_64/09640816-ollama-ggml-cuda/builder-live.log' as PID 544714 [2025-10-02 19:17:30,551][ INFO][PID:472211] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/fachep/ollama/fedora-rawhide-x86_64/09640816-ollama-ggml-cuda/builder-live.log) [2025-10-02 19:17:30,552][ INFO][PID:472211] Compressing /var/lib/copr/public_html/results/fachep/ollama/fedora-rawhide-x86_64/09640816-ollama-ggml-cuda/backend.log by gzip [2025-10-02 19:17:30,553][ INFO][PID:472211] Running command 'gzip /var/lib/copr/public_html/results/fachep/ollama/fedora-rawhide-x86_64/09640816-ollama-ggml-cuda/backend.log' as PID 544715