[2025-10-02 00:27:29,513][ INFO][PID:1122892] Marking build as starting [2025-10-02 00:27:29,537][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:27:29,538][ INFO][PID:1122892] VM allocation process starts [2025-10-02 00:27:29,550][ INFO][PID:1122892] Trying to allocate VM: ResallocHost, ticket_id=5427719, requested_tags=['copr_builder', 'arch_aarch64'] [2025-10-02 00:27:34,556][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:27:39,557][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:27:44,558][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:27:49,559][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:27:54,560][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:27:59,561][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:28:04,561][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:28:09,562][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:28:14,563][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:28:19,564][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:28:24,565][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:28:29,566][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:28:34,567][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:28:39,568][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:28:44,569][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:28:49,570][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:28:54,571][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:28:59,572][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:29:04,573][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:29:09,574][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:29:14,575][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:29:19,576][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:29:24,576][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:29:29,577][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:29:34,578][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:29:39,579][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:29:44,582][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:29:49,583][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:29:54,585][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:29:59,585][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:30:04,586][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:30:09,587][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:30:14,589][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:30:19,591][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:30:24,592][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:30:29,593][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:30:34,594][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:30:39,595][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:30:44,596][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:30:49,597][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:30:54,598][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:30:59,599][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:31:04,600][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:31:09,601][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:31:14,602][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:31:19,603][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:31:24,604][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:31:29,605][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:31:34,608][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:31:39,608][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:31:44,609][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:31:49,611][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:31:54,612][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:31:59,613][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:32:04,614][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:32:09,614][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:32:14,616][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:32:19,617][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:32:24,618][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:32:29,619][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:32:34,620][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:32:39,621][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:32:44,622][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:32:49,623][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:32:54,624][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:32:59,625][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:33:04,626][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:33:09,627][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:33:14,628][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:33:19,629][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:33:24,630][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:33:29,631][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:33:34,632][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:33:39,633][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:33:44,634][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:33:49,635][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:33:54,636][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:33:59,637][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:34:04,638][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:34:09,639][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:34:14,640][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:34:19,641][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:34:24,642][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:34:29,643][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:34:34,644][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:34:39,645][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:34:44,646][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:34:49,647][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:34:54,648][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:34:59,649][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:35:04,650][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:35:09,651][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:35:14,652][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:35:19,653][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:35:24,654][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:35:29,655][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:35:34,656][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:35:39,657][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:35:44,658][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:35:49,659][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:35:54,660][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:35:59,660][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:36:04,661][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:36:09,662][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:36:14,663][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:36:19,664][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:36:24,665][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:36:29,666][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:36:34,667][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:36:39,668][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:36:44,669][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:36:47,680][ INFO][PID:1122892] Allocated host ResallocHost, ticket_id=5427719, hostname=13.220.92.109, name=aws_aarch64_normalreserved_prod_07178255_20251002_003512, requested_tags=['copr_builder', 'arch_aarch64'] [2025-10-02 00:36:47,680][ INFO][PID:1122892] Allocating ssh connection to builder [2025-10-02 00:36:47,681][ INFO][PID:1122892] Checking that builder machine is OK [2025-10-02 00:36:48,084][ INFO][PID:1122892] Running remote command: copr-builder-ready epel-10-aarch64 [2025-10-02 00:36:48,303][ INFO][PID:1122892] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2025-10-02 00:36:48,304][ INFO][PID:1122892] Filling build.info file with builder info [2025-10-02 00:36:48,304][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:36:48,305][ INFO][PID:1122892] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@centoshyperscale", "project_name": "asahi", "project_dirname": "asahi:pr:fork-pbrobinson-rpms-mesa-89", "submitter": "https://src.fedoraproject.org/user/pbrobinson", "ended_on": null, "started_on": 1759365408.3056192, "submitted_on": null, "status": 3, "chroot": "epel-10-aarch64", "arch": "aarch64", "buildroot_pkgs": [], "task_id": "9637063-epel-10-aarch64", "build_id": 9637063, "package_name": "mesa", "package_version": "25.2.4-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@centoshyperscale/asahi:pr:fork-pbrobinson-rpms-mesa-89/mesa", "git_hash": "87f81cd442181dfac7660e5a156ab143a2f83d15", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@centoshyperscale/asahi--https://src.fedoraproject.org/user/pbrobinson", "results": null, "appstream": true, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@centoshyperscale/asahi/epel-10-aarch64/", "id": "copr_base", "name": "Copr repository", "priority": 50 }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@centoshyperscale/asahi:pr:fork-pbrobinson-rpms-mesa-89/epel-10-aarch64/", "id": "copr_coprdir", "name": "Coprdir repository", "priority": 50 }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@asahi/u-boot/epel-10-aarch64/", "id": "copr_asahi_u_boot", "name": "Additional repo copr_asahi_u_boot" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": 50, "tags": [ "arch_aarch64" ], "with_opts": [ "asahi" ], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@centoshyperscale/asahi:pr:fork-pbrobinson-rpms-mesa-89", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@centoshyperscale/asahi:pr:fork-pbrobinson-rpms-mesa-89", "result_dir": "09637063-mesa", "built_packages": "", "id": 9637063, "mockchain_macros": { "copr_username": "@centoshyperscale", "copr_projectname": "asahi", "vendor": "Fedora Project COPR (@centoshyperscale/asahi)" } } ] } [2025-10-02 00:36:48,336][ INFO][PID:1122892] Sending fedora-messaging bus message in build.start [2025-10-02 00:36:48,950][ INFO][PID:1122892] Sending fedora-messaging bus message in chroot.start [2025-10-02 00:36:48,974][ INFO][PID:1122892] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9637063-epel-10-aarch64 --chroot epel-10-aarch64 --detached [2025-10-02 00:36:49,364][ INFO][PID:1122892] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '13.220.92.109' (ED25519) to the list of known hosts. [2025-10-02 00:36:49,365][ INFO][PID:1122892] Downloading the builder-live.log file, attempt 1 [2025-10-02 00:36:49,366][ INFO][PID:1122892] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.220.92.109 copr-rpmbuild-log [2025-10-02 00:36:54,372][ INFO][PID:1122892] Periodic builder liveness probe: alive [2025-10-02 00:36:54,372][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:36:59,373][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:37:04,374][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:37:09,375][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:37:14,376][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:37:19,377][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:37:24,378][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:37:29,379][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:37:34,380][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:37:39,382][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:37:44,382][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:37:49,383][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:37:54,384][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:37:59,385][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:38:04,387][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:38:09,388][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:38:14,388][ INFO][PID:1122892] Checking for cancel request [2025-10-02 00:38:16,822][ INFO][PID:1122892] Downloading results from builder [2025-10-02 00:38:16,822][ INFO][PID:1122892] rsyncing of mockbuilder@13.220.92.109:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@centoshyperscale/asahi:pr:fork-pbrobinson-rpms-mesa-89/epel-10-aarch64/09637063-mesa started [2025-10-02 00:38:16,823][ INFO][PID:1122892] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@13.220.92.109:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@centoshyperscale/asahi:pr:fork-pbrobinson-rpms-mesa-89/epel-10-aarch64/09637063-mesa/ &> /var/lib/copr/public_html/results/@centoshyperscale/asahi:pr:fork-pbrobinson-rpms-mesa-89/epel-10-aarch64/09637063-mesa/build-09637063.rsync.log [2025-10-02 00:38:17,320][ INFO][PID:1122892] rsyncing finished. [2025-10-02 00:38:17,321][ INFO][PID:1122892] Releasing VM back to pool [2025-10-02 00:38:17,329][ INFO][PID:1122892] Searching for 'success' file in resultdir [2025-10-02 00:38:17,330][ ERROR][PID:1122892] Build failed: Backend process error: No success file => build failure [2025-10-02 00:38:17,330][ INFO][PID:1122892] Finished build: id=9637063 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/@centoshyperscale/asahi:pr:fork-pbrobinson-rpms-mesa-89 chroot=epel-10-aarch64 [2025-10-02 00:38:17,332][ ERROR][PID:1122892] Backend process error: No success file => build failure [2025-10-02 00:38:17,332][ INFO][PID:1122892] Worker failed build, took 89.02719783782959 [2025-10-02 00:38:17,333][ INFO][PID:1122892] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@centoshyperscale", "project_name": "asahi", "project_dirname": "asahi:pr:fork-pbrobinson-rpms-mesa-89", "submitter": "https://src.fedoraproject.org/user/pbrobinson", "ended_on": 1759365497.332817, "started_on": 1759365408.3056192, "submitted_on": null, "status": 0, "chroot": "epel-10-aarch64", "arch": "aarch64", "buildroot_pkgs": [], "task_id": "9637063-epel-10-aarch64", "build_id": 9637063, "package_name": "mesa", "package_version": "25.2.4-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@centoshyperscale/asahi:pr:fork-pbrobinson-rpms-mesa-89/mesa", "git_hash": "87f81cd442181dfac7660e5a156ab143a2f83d15", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@centoshyperscale/asahi--https://src.fedoraproject.org/user/pbrobinson", "results": null, "appstream": true, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@centoshyperscale/asahi/epel-10-aarch64/", "id": "copr_base", "name": "Copr repository", "priority": 50 }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@centoshyperscale/asahi:pr:fork-pbrobinson-rpms-mesa-89/epel-10-aarch64/", "id": "copr_coprdir", "name": "Coprdir repository", "priority": 50 }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@asahi/u-boot/epel-10-aarch64/", "id": "copr_asahi_u_boot", "name": "Additional repo copr_asahi_u_boot" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": 50, "tags": [ "arch_aarch64" ], "with_opts": [ "asahi" ], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@centoshyperscale/asahi:pr:fork-pbrobinson-rpms-mesa-89", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@centoshyperscale/asahi:pr:fork-pbrobinson-rpms-mesa-89", "result_dir": "09637063-mesa", "built_packages": "", "id": 9637063, "mockchain_macros": { "copr_username": "@centoshyperscale", "copr_projectname": "asahi", "vendor": "Fedora Project COPR (@centoshyperscale/asahi)" } } ] } [2025-10-02 00:38:17,382][ INFO][PID:1122892] Sending fedora-messaging bus message in build.end [2025-10-02 00:38:17,407][ INFO][PID:1122892] Compressing /var/lib/copr/public_html/results/@centoshyperscale/asahi:pr:fork-pbrobinson-rpms-mesa-89/epel-10-aarch64/09637063-mesa/builder-live.log by gzip [2025-10-02 00:38:17,408][ INFO][PID:1122892] Running command 'gzip /var/lib/copr/public_html/results/@centoshyperscale/asahi:pr:fork-pbrobinson-rpms-mesa-89/epel-10-aarch64/09637063-mesa/builder-live.log' as PID 1167945 [2025-10-02 00:38:17,412][ INFO][PID:1122892] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@centoshyperscale/asahi:pr:fork-pbrobinson-rpms-mesa-89/epel-10-aarch64/09637063-mesa/builder-live.log) [2025-10-02 00:38:17,413][ INFO][PID:1122892] Compressing /var/lib/copr/public_html/results/@centoshyperscale/asahi:pr:fork-pbrobinson-rpms-mesa-89/epel-10-aarch64/09637063-mesa/backend.log by gzip [2025-10-02 00:38:17,413][ INFO][PID:1122892] Running command 'gzip /var/lib/copr/public_html/results/@centoshyperscale/asahi:pr:fork-pbrobinson-rpms-mesa-89/epel-10-aarch64/09637063-mesa/backend.log' as PID 1167946