[2026-05-27 05:04:47,912][ INFO][PID:3530468] Marking build as starting [2026-05-27 05:04:47,958][ INFO][PID:3530468] Checking that /var/lib/copr/public_html/results/lunar-rover/kernel-ml/rhel-9-x86_64/repodata/repomd.xml exists [2026-05-27 05:04:48,107][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:04:48,112][ INFO][PID:3530468] VM allocation process starts [2026-05-27 05:04:48,126][ INFO][PID:3530468] Trying to allocate VM: ResallocHost, ticket_id=3096761, requested_tags=['arch_x86_64', 'copr_builder', 'on_demand_powerful'] [2026-05-27 05:04:53,129][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:04:58,132][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:05:03,134][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:05:08,136][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:05:13,140][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:05:18,142][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:05:23,143][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:05:28,145][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:05:33,146][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:05:38,148][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:05:43,152][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:05:48,155][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:05:53,157][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:05:58,158][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:06:03,160][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:06:08,163][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:06:13,178][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:06:18,180][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:06:23,181][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:06:28,183][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:06:33,188][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:06:36,242][ INFO][PID:3530468] Allocated host ResallocHost, ticket_id=3096761, hostname=3.82.5.1, name=aws_x86_64_powerful_reserved_prod_10290243_20260527_050452, requested_tags=['arch_x86_64', 'copr_builder', 'on_demand_powerful'] [2026-05-27 05:06:36,243][ INFO][PID:3530468] Allocating ssh connection to builder [2026-05-27 05:06:36,245][ INFO][PID:3530468] Checking that builder machine is OK [2026-05-27 05:06:36,717][ INFO][PID:3530468] Installed copr-rpmbuild version: 1.8 [2026-05-27 05:06:36,718][ INFO][PID:3530468] Running remote command: copr-builder-ready rhel-9-x86_64 [2026-05-27 05:06:36,984][ INFO][PID:3530468] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2026-05-27 05:06:36,985][ INFO][PID:3530468] Filling build.info file with builder info [2026-05-27 05:06:36,986][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:06:36,989][ INFO][PID:3530468] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "lunar-rover", "project_name": "kernel-ml", "project_dirname": "kernel-ml", "submitter": "lunar-rover", "ended_on": null, "started_on": 1779858396.9889605, "submitted_on": null, "status": 3, "chroot": "rhel-9-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10515290-rhel-9-x86_64", "build_id": 10515290, "package_name": "kernel", "package_version": "6.12.91-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/lunar-rover/kernel-ml/kernel", "git_hash": "c0802642219f9a6c980384fa018677d7b8903ac4", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "lunar-rover/kernel-ml--lunar-rover", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/lunar-rover/kernel-ml/rhel-9-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64", "on_demand_powerful" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/lunar-rover/kernel-ml", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/lunar-rover/kernel-ml", "result_dir": "10515290-kernel", "built_packages": "", "id": 10515290, "mockchain_macros": { "copr_username": "lunar-rover", "copr_projectname": "kernel-ml", "vendor": "Fedora Project COPR (lunar-rover/kernel-ml)" } } ] } [2026-05-27 05:06:37,042][ INFO][PID:3530468] Sending fedora-messaging bus message in build.start [2026-05-27 05:06:37,700][ INFO][PID:3530468] Sending fedora-messaging bus message in chroot.start [2026-05-27 05:06:37,736][ INFO][PID:3530468] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10515290-rhel-9-x86_64 --chroot rhel-9-x86_64 --detached [2026-05-27 05:06:38,267][ INFO][PID:3530468] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '3.82.5.1' (ED25519) to the list of known hosts. [2026-05-27 05:06:38,270][ INFO][PID:3530468] Downloading the builder-live.log file, attempt 1 [2026-05-27 05:06:38,285][ INFO][PID:3530468] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.82.5.1 copr-rpmbuild-log [2026-05-27 05:06:43,279][ INFO][PID:3530468] Periodic builder liveness probe: alive [2026-05-27 05:06:43,280][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:06:48,281][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:06:53,282][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:06:58,284][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:07:03,285][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:07:08,287][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:07:13,289][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:07:18,290][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:07:23,293][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:07:28,294][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:07:33,296][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:07:38,298][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:07:43,299][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:07:48,302][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:07:53,305][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:07:58,309][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:08:03,310][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:08:08,320][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:08:13,394][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:08:18,406][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:08:23,428][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:08:28,434][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:08:33,439][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:08:38,461][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:08:43,462][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:08:48,592][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:08:53,594][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:08:58,605][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:09:03,608][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:09:08,614][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:09:13,619][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:09:18,626][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:09:23,635][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:09:28,639][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:09:33,644][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:09:38,646][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:09:43,648][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:09:48,650][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:09:53,656][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:09:58,659][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:10:03,661][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:10:08,662][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:10:13,666][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:10:18,670][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:10:23,674][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:10:28,675][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:10:33,677][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:10:38,680][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:10:43,684][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:10:48,685][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:10:53,686][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:10:58,688][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:11:03,689][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:11:08,691][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:11:13,692][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:11:18,694][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:11:23,695][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:11:28,697][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:11:33,698][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:11:38,700][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:11:43,715][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:11:48,717][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:11:53,718][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:11:58,719][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:12:03,721][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:12:08,722][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:12:13,723][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:12:18,725][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:12:23,726][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:12:28,727][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:12:33,729][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:12:38,730][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:12:43,731][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:12:48,733][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:12:53,734][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:12:58,738][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:13:03,744][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:13:08,745][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:13:13,747][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:13:18,748][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:13:23,750][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:13:28,751][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:13:33,752][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:13:38,761][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:13:43,768][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:13:48,770][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:13:53,775][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:13:58,776][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:14:03,778][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:14:08,780][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:14:13,781][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:14:18,792][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:14:23,892][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:14:28,974][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:14:34,014][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:14:39,092][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:14:44,108][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:14:49,170][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:14:54,174][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:14:59,176][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:15:04,181][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:15:09,182][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:15:14,303][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:15:19,661][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:15:24,667][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:15:33,721][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:15:38,955][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:15:43,959][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:15:48,971][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:15:53,990][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:15:58,996][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:16:03,999][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:16:09,008][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:16:14,016][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:16:19,049][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:16:24,051][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:16:29,054][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:16:34,058][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:16:39,087][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:16:45,763][ INFO][PID:3530468] Periodic builder liveness probe: alive [2026-05-27 05:16:46,009][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:16:51,011][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:16:56,047][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:17:01,049][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:17:06,053][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:17:11,055][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:17:16,056][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:17:21,074][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:17:26,136][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:17:31,140][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:17:36,143][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:17:41,150][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:17:46,192][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:17:51,222][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:17:56,223][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:18:01,237][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:18:06,255][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:18:11,257][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:18:16,258][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:18:21,260][ INFO][PID:3530468] Checking for cancel request [2026-05-27 05:18:26,472][ INFO][PID:3530468] Downloading results from builder [2026-05-27 05:18:26,917][ INFO][PID:3530468] rsyncing of mockbuilder@3.82.5.1:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/lunar-rover/kernel-ml/rhel-9-x86_64/10515290-kernel started [2026-05-27 05:18:27,773][ INFO][PID:3530468] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@3.82.5.1:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/lunar-rover/kernel-ml/rhel-9-x86_64/10515290-kernel/ &> /var/lib/copr/public_html/results/lunar-rover/kernel-ml/rhel-9-x86_64/10515290-kernel/build-10515290.rsync.log [2026-05-27 05:18:29,408][ INFO][PID:3530468] rsyncing finished. [2026-05-27 05:18:29,446][ INFO][PID:3530468] VM Release request [2026-05-27 05:18:38,003][ INFO][PID:3530468] Searching for 'success' file in resultdir [2026-05-27 05:18:38,076][ ERROR][PID:3530468] Build failed: Backend process error: No success file => build failure [2026-05-27 05:18:43,798][ INFO][PID:3530468] Finished build: id=10515290 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/lunar-rover/kernel-ml chroot=rhel-9-x86_64 [2026-05-27 05:18:45,492][ ERROR][PID:3530468] Backend process error: No success file => build failure [2026-05-27 05:18:46,161][ INFO][PID:3530468] Worker failed build, took 729.1607341766357 [2026-05-27 05:18:46,387][ INFO][PID:3530468] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "lunar-rover", "project_name": "kernel-ml", "project_dirname": "kernel-ml", "submitter": "lunar-rover", "ended_on": 1779859126.1496947, "started_on": 1779858396.9889605, "submitted_on": null, "status": 0, "chroot": "rhel-9-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10515290-rhel-9-x86_64", "build_id": 10515290, "package_name": "kernel", "package_version": "6.12.91-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/lunar-rover/kernel-ml/kernel", "git_hash": "c0802642219f9a6c980384fa018677d7b8903ac4", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "lunar-rover/kernel-ml--lunar-rover", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/lunar-rover/kernel-ml/rhel-9-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64", "on_demand_powerful" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/lunar-rover/kernel-ml", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/lunar-rover/kernel-ml", "result_dir": "10515290-kernel", "built_packages": "", "id": 10515290, "mockchain_macros": { "copr_username": "lunar-rover", "copr_projectname": "kernel-ml", "vendor": "Fedora Project COPR (lunar-rover/kernel-ml)" } } ] } [2026-05-27 05:18:51,309][ INFO][PID:3530468] Sending fedora-messaging bus message in build.end [2026-05-27 05:18:57,147][ INFO][PID:3530468] Compressing /var/lib/copr/public_html/results/lunar-rover/kernel-ml/rhel-9-x86_64/10515290-kernel/builder-live.log by gzip [2026-05-27 05:18:57,519][ INFO][PID:3530468] Running command 'gzip /var/lib/copr/public_html/results/lunar-rover/kernel-ml/rhel-9-x86_64/10515290-kernel/builder-live.log' as PID 3651631 [2026-05-27 05:18:57,879][ INFO][PID:3530468] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/lunar-rover/kernel-ml/rhel-9-x86_64/10515290-kernel/builder-live.log) [2026-05-27 05:18:57,960][ INFO][PID:3530468] Compressing /var/lib/copr/public_html/results/lunar-rover/kernel-ml/rhel-9-x86_64/10515290-kernel/backend.log by gzip [2026-05-27 05:18:57,962][ INFO][PID:3530468] Running command 'gzip /var/lib/copr/public_html/results/lunar-rover/kernel-ml/rhel-9-x86_64/10515290-kernel/backend.log' as PID 3651682