[2025-11-15 02:31:56,169][ INFO][PID:491076] Marking build as starting [2025-11-15 02:31:56,269][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:31:56,270][ INFO][PID:491076] VM allocation process starts [2025-11-15 02:31:56,293][ INFO][PID:491076] Trying to allocate VM: ResallocHost, ticket_id=6191040, requested_tags=['copr_builder', 'arch_aarch64'] [2025-11-15 02:32:01,295][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:32:06,296][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:32:08,328][ INFO][PID:491076] Allocated host ResallocHost, ticket_id=6191040, hostname=98.93.125.140, name=aws_aarch64_normalreserved_prod_08004945_20251115_022136, requested_tags=['copr_builder', 'arch_aarch64'] [2025-11-15 02:32:08,329][ INFO][PID:491076] Allocating ssh connection to builder [2025-11-15 02:32:08,330][ INFO][PID:491076] Checking that builder machine is OK [2025-11-15 02:32:08,700][ INFO][PID:491076] Running remote command: copr-builder-ready epel-9-aarch64 [2025-11-15 02:32:08,917][ INFO][PID:491076] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2025-11-15 02:32:08,918][ INFO][PID:491076] Filling build.info file with builder info [2025-11-15 02:32:08,919][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:32:08,920][ INFO][PID:491076] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "@meshtastic", "project_name": "daily", "project_dirname": "daily", "submitter": "vidplace7", "ended_on": null, "started_on": 1763173928.9197621, "submitted_on": null, "status": 3, "chroot": "epel-9-aarch64", "arch": "aarch64", "buildroot_pkgs": [], "task_id": "9800054-epel-9-aarch64", "build_id": 9800054, "package_name": "meshtasticd", "package_version": "2.7.14-12066.daily.git0aa11d810", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@meshtastic/daily/meshtasticd", "git_hash": "3800e6efb6b761e39814c8a3ab176cc42f4be6a4", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@meshtastic/daily--vidplace7", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@meshtastic/daily/epel-9-aarch64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@meshtastic/build-tools/epel-9-aarch64/", "id": "copr_meshtastic_build_tools", "name": "Additional repo copr_meshtastic_build_tools" }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@meshtastic/platformio-epel9/epel-9-aarch64/", "id": "copr_meshtastic_platformio_epel9", "name": "Additional repo copr_meshtastic_platformio_epel9" } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_aarch64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@meshtastic/daily", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@meshtastic/daily", "result_dir": "09800054-meshtasticd", "built_packages": "", "id": 9800054, "mockchain_macros": { "copr_username": "@meshtastic", "copr_projectname": "daily", "vendor": "Fedora Project COPR (@meshtastic/daily)" } } ] } [2025-11-15 02:32:08,959][ INFO][PID:491076] Sending fedora-messaging bus message in build.start [2025-11-15 02:32:09,647][ INFO][PID:491076] Sending fedora-messaging bus message in chroot.start [2025-11-15 02:32:09,671][ INFO][PID:491076] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9800054-epel-9-aarch64 --chroot epel-9-aarch64 --detached [2025-11-15 02:32:10,059][ INFO][PID:491076] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '98.93.125.140' (ED25519) to the list of known hosts. [2025-11-15 02:32:10,060][ INFO][PID:491076] Downloading the builder-live.log file, attempt 1 [2025-11-15 02:32:10,061][ INFO][PID:491076] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.93.125.140 copr-rpmbuild-log [2025-11-15 02:32:15,064][ INFO][PID:491076] Periodic builder liveness probe: alive [2025-11-15 02:32:15,065][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:32:20,066][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:32:25,067][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:32:30,068][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:32:35,069][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:32:40,070][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:32:45,071][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:32:50,072][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:32:55,073][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:33:00,074][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:33:05,075][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:33:10,076][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:33:15,077][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:33:20,078][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:33:25,079][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:33:30,080][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:33:35,081][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:33:40,082][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:33:45,083][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:33:50,084][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:33:55,085][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:34:00,086][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:34:05,087][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:34:10,088][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:34:15,089][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:34:20,090][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:34:25,091][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:34:30,092][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:34:35,093][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:34:40,094][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:34:45,095][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:34:50,096][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:34:55,097][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:35:00,102][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:35:05,103][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:35:10,104][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:35:15,105][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:35:20,105][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:35:25,107][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:35:30,107][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:35:35,108][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:35:40,109][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:35:45,110][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:35:50,111][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:35:55,112][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:36:00,113][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:36:05,114][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:36:10,115][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:36:15,116][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:36:20,117][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:36:25,118][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:36:30,120][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:36:35,121][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:36:40,122][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:36:45,123][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:36:50,124][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:36:55,125][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:37:00,126][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:37:05,127][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:37:10,128][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:37:15,128][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:37:20,129][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:37:25,130][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:37:30,131][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:37:35,132][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:37:40,133][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:37:45,134][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:37:50,136][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:37:55,137][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:38:00,138][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:38:05,139][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:38:10,140][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:38:15,141][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:38:20,142][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:38:25,143][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:38:30,144][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:38:35,145][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:38:40,146][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:38:45,147][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:38:50,148][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:38:55,149][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:39:00,150][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:39:05,151][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:39:10,152][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:39:15,153][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:39:20,154][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:39:25,155][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:39:30,156][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:39:35,157][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:39:40,158][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:39:45,160][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:39:50,161][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:39:55,162][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:40:00,163][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:40:05,164][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:40:10,164][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:40:15,165][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:40:20,166][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:40:25,167][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:40:30,169][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:40:35,170][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:40:40,171][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:40:45,172][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:40:50,173][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:40:55,174][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:41:00,175][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:41:05,176][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:41:10,177][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:41:15,178][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:41:20,179][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:41:25,180][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:41:30,182][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:41:35,183][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:41:40,184][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:41:45,185][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:41:50,186][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:41:55,187][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:42:00,188][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:42:05,189][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:42:10,190][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:42:15,196][ INFO][PID:491076] Periodic builder liveness probe: alive [2025-11-15 02:42:15,197][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:42:20,198][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:42:25,199][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:42:30,200][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:42:35,200][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:42:40,202][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:42:45,203][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:42:50,204][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:42:55,205][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:43:00,206][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:43:05,207][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:43:10,208][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:43:15,209][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:43:20,210][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:43:25,211][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:43:30,212][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:43:35,213][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:43:40,214][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:43:45,215][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:43:50,216][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:43:55,217][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:44:00,217][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:44:05,219][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:44:10,220][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:44:15,221][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:44:20,222][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:44:25,223][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:44:30,224][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:44:35,225][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:44:40,226][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:44:45,227][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:44:50,228][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:44:55,229][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:45:00,230][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:45:05,231][ INFO][PID:491076] Checking for cancel request [2025-11-15 02:45:05,597][ INFO][PID:491076] Downloading results from builder [2025-11-15 02:45:05,598][ INFO][PID:491076] rsyncing of mockbuilder@98.93.125.140:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@meshtastic/daily/epel-9-aarch64/09800054-meshtasticd started [2025-11-15 02:45:05,599][ INFO][PID:491076] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@98.93.125.140:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@meshtastic/daily/epel-9-aarch64/09800054-meshtasticd/ &> /var/lib/copr/public_html/results/@meshtastic/daily/epel-9-aarch64/09800054-meshtasticd/build-09800054.rsync.log [2025-11-15 02:45:05,857][ INFO][PID:491076] rsyncing finished. [2025-11-15 02:45:05,857][ INFO][PID:491076] Releasing VM back to pool [2025-11-15 02:45:05,866][ INFO][PID:491076] Searching for 'success' file in resultdir [2025-11-15 02:45:05,867][ ERROR][PID:491076] Build failed: Backend process error: No success file => build failure [2025-11-15 02:45:05,868][ INFO][PID:491076] Finished build: id=9800054 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/@meshtastic/daily chroot=epel-9-aarch64 [2025-11-15 02:45:05,869][ ERROR][PID:491076] Backend process error: No success file => build failure [2025-11-15 02:45:05,870][ INFO][PID:491076] Worker failed build, took 776.9503688812256 [2025-11-15 02:45:05,870][ INFO][PID:491076] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "@meshtastic", "project_name": "daily", "project_dirname": "daily", "submitter": "vidplace7", "ended_on": 1763174705.870131, "started_on": 1763173928.9197621, "submitted_on": null, "status": 0, "chroot": "epel-9-aarch64", "arch": "aarch64", "buildroot_pkgs": [], "task_id": "9800054-epel-9-aarch64", "build_id": 9800054, "package_name": "meshtasticd", "package_version": "2.7.14-12066.daily.git0aa11d810", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@meshtastic/daily/meshtasticd", "git_hash": "3800e6efb6b761e39814c8a3ab176cc42f4be6a4", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@meshtastic/daily--vidplace7", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@meshtastic/daily/epel-9-aarch64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@meshtastic/build-tools/epel-9-aarch64/", "id": "copr_meshtastic_build_tools", "name": "Additional repo copr_meshtastic_build_tools" }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@meshtastic/platformio-epel9/epel-9-aarch64/", "id": "copr_meshtastic_platformio_epel9", "name": "Additional repo copr_meshtastic_platformio_epel9" } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_aarch64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@meshtastic/daily", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@meshtastic/daily", "result_dir": "09800054-meshtasticd", "built_packages": "", "id": 9800054, "mockchain_macros": { "copr_username": "@meshtastic", "copr_projectname": "daily", "vendor": "Fedora Project COPR (@meshtastic/daily)" } } ] } [2025-11-15 02:45:05,910][ INFO][PID:491076] Sending fedora-messaging bus message in build.end [2025-11-15 02:45:05,946][ INFO][PID:491076] Compressing /var/lib/copr/public_html/results/@meshtastic/daily/epel-9-aarch64/09800054-meshtasticd/builder-live.log by gzip [2025-11-15 02:45:05,947][ INFO][PID:491076] Running command 'gzip /var/lib/copr/public_html/results/@meshtastic/daily/epel-9-aarch64/09800054-meshtasticd/builder-live.log' as PID 537827 [2025-11-15 02:45:05,956][ INFO][PID:491076] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@meshtastic/daily/epel-9-aarch64/09800054-meshtasticd/builder-live.log) [2025-11-15 02:45:05,957][ INFO][PID:491076] Compressing /var/lib/copr/public_html/results/@meshtastic/daily/epel-9-aarch64/09800054-meshtasticd/backend.log by gzip [2025-11-15 02:45:05,958][ INFO][PID:491076] Running command 'gzip /var/lib/copr/public_html/results/@meshtastic/daily/epel-9-aarch64/09800054-meshtasticd/backend.log' as PID 537831