[2025-10-16 14:26:36,258][ INFO][PID:3389891] Marking build as starting [2025-10-16 14:26:36,303][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:26:36,304][ INFO][PID:3389891] VM allocation process starts [2025-10-16 14:26:36,321][ INFO][PID:3389891] Trying to allocate VM: ResallocHost, ticket_id=5691206, requested_tags=['copr_builder', 'arch_x86_64'] [2025-10-16 14:26:41,322][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:26:46,324][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:26:51,325][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:26:56,326][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:27:01,327][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:27:06,328][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:27:11,329][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:27:16,330][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:27:21,331][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:27:26,332][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:27:31,333][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:27:36,335][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:27:41,336][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:27:46,337][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:27:51,338][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:27:56,341][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:28:01,342][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:28:06,343][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:28:11,345][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:28:16,346][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:28:21,347][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:28:26,348][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:28:31,350][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:28:36,352][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:28:41,355][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:28:46,357][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:28:51,361][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:28:56,364][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:29:01,368][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:29:06,370][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:29:11,373][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:29:16,375][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:29:21,376][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:29:26,377][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:29:31,379][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:29:36,380][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:29:41,381][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:29:46,383][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:29:51,384][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:29:56,385][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:30:01,386][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:30:06,387][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:30:11,388][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:30:16,389][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:30:21,390][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:30:26,391][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:30:31,392][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:30:36,393][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:30:41,395][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:30:46,396][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:30:51,397][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:30:56,398][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:31:01,400][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:31:06,401][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:31:11,401][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:31:16,403][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:31:21,405][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:31:26,407][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:31:31,408][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:31:36,409][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:31:41,410][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:31:46,411][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:31:51,413][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:31:56,416][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:32:01,417][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:32:06,418][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:32:11,420][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:32:16,421][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:32:21,422][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:32:26,423][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:32:31,424][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:32:36,429][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:32:41,430][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:32:46,432][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:32:51,437][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:32:56,438][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:33:01,440][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:33:06,441][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:33:11,442][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:33:16,444][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:33:21,446][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:33:26,447][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:33:31,448][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:33:36,449][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:33:41,450][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:33:46,451][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:33:51,452][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:33:56,454][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:34:01,456][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:34:06,458][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:34:11,459][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:34:16,460][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:34:21,465][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:34:26,466][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:34:31,467][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:34:36,468][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:34:41,469][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:34:46,471][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:34:51,472][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:34:56,473][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:35:01,474][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:35:06,475][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:35:11,477][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:35:16,481][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:35:21,501][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:35:26,518][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:35:31,519][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:35:36,522][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:35:41,523][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:35:46,524][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:35:51,581][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:35:56,583][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:36:01,584][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:36:06,586][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:36:11,588][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:36:16,590][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:36:21,591][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:36:26,593][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:36:31,594][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:36:36,595][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:36:41,596][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:36:46,597][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:36:51,598][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:36:56,600][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:37:01,601][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:37:06,602][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:37:11,603][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:37:16,606][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:37:21,607][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:37:26,608][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:37:31,609][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:37:36,611][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:37:41,612][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:37:46,613][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:37:51,614][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:37:54,570][ INFO][PID:3389891] Allocated host ResallocHost, ticket_id=5691206, hostname=2620:52:3:1:dead:beef:cafe:c1d7, name=copr_hv_x86_64_04_prod_07427444_20251016_143526, requested_tags=['copr_builder', 'arch_x86_64'] [2025-10-16 14:37:54,571][ INFO][PID:3389891] Allocating ssh connection to builder [2025-10-16 14:37:54,574][ INFO][PID:3389891] Checking that builder machine is OK [2025-10-16 14:37:55,241][ INFO][PID:3389891] Running remote command: copr-builder-ready fedora-42-x86_64 [2025-10-16 14:37:55,594][ INFO][PID:3389891] Red Hat subscription not needed for fedora-42-x86_64 Builder is ready to be used [2025-10-16 14:37:55,595][ INFO][PID:3389891] Filling build.info file with builder info [2025-10-16 14:37:55,596][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:37:55,597][ INFO][PID:3389891] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "xxmitsu", "project_name": "llvm", "project_dirname": "llvm", "submitter": null, "ended_on": null, "started_on": 1760625475.5975122, "submitted_on": null, "status": 3, "chroot": "fedora-42-x86_64", "arch": "x86_64", "buildroot_pkgs": [ "git" ], "task_id": "9695094-fedora-42-x86_64", "build_id": 9695094, "package_name": "compiler-rt", "package_version": "19.0.0-0.1.20240309.git0d6f9bf", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/xxmitsu/llvm/compiler-rt", "git_hash": "2db2bba69ba7d285de2ec6b606c0271208328fec", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "xxmitsu/llvm--bf11e6bc-bcc8-431b-98bd-395baf3542bc", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/xxmitsu/llvm/fedora-42-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "bootstrap": "off", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/xxmitsu/llvm", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/xxmitsu/llvm", "result_dir": "09695094-compiler-rt", "built_packages": "", "id": 9695094, "mockchain_macros": { "copr_username": "xxmitsu", "copr_projectname": "llvm", "vendor": "Fedora Project COPR (xxmitsu/llvm)" } } ] } [2025-10-16 14:37:55,631][ INFO][PID:3389891] Sending fedora-messaging bus message in build.start [2025-10-16 14:37:56,411][ INFO][PID:3389891] Sending fedora-messaging bus message in chroot.start [2025-10-16 14:37:56,439][ INFO][PID:3389891] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9695094-fedora-42-x86_64 --chroot fedora-42-x86_64 --detached [2025-10-16 14:37:57,056][ INFO][PID:3389891] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c1d7' (ED25519) to the list of known hosts. [2025-10-16 14:37:57,057][ INFO][PID:3389891] Downloading the builder-live.log file, attempt 1 [2025-10-16 14:37:57,059][ INFO][PID:3389891] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c1d7 copr-rpmbuild-log [2025-10-16 14:38:02,069][ INFO][PID:3389891] Periodic builder liveness probe: alive [2025-10-16 14:38:02,070][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:38:07,071][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:38:12,074][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:38:17,076][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:38:22,077][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:38:27,079][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:38:32,080][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:38:37,081][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:38:42,082][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:38:47,083][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:38:52,084][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:38:57,085][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:39:02,086][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:39:07,087][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:39:12,088][ INFO][PID:3389891] Checking for cancel request [2025-10-16 14:39:16,282][ INFO][PID:3389891] Downloading results from builder [2025-10-16 14:39:16,282][ INFO][PID:3389891] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c1d7]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/xxmitsu/llvm/fedora-42-x86_64/09695094-compiler-rt started [2025-10-16 14:39:16,283][ INFO][PID:3389891] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c1d7]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/xxmitsu/llvm/fedora-42-x86_64/09695094-compiler-rt/ &> /var/lib/copr/public_html/results/xxmitsu/llvm/fedora-42-x86_64/09695094-compiler-rt/build-09695094.rsync.log [2025-10-16 14:39:19,663][ INFO][PID:3389891] rsyncing finished. [2025-10-16 14:39:19,664][ INFO][PID:3389891] Releasing VM back to pool [2025-10-16 14:39:19,676][ INFO][PID:3389891] Searching for 'success' file in resultdir [2025-10-16 14:39:19,677][ ERROR][PID:3389891] Build failed: Backend process error: No success file => build failure [2025-10-16 14:39:19,678][ INFO][PID:3389891] Finished build: id=9695094 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/xxmitsu/llvm chroot=fedora-42-x86_64 [2025-10-16 14:39:19,680][ ERROR][PID:3389891] Backend process error: No success file => build failure [2025-10-16 14:39:19,681][ INFO][PID:3389891] Worker failed build, took 84.08345246315002 [2025-10-16 14:39:19,681][ INFO][PID:3389891] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "xxmitsu", "project_name": "llvm", "project_dirname": "llvm", "submitter": null, "ended_on": 1760625559.6809647, "started_on": 1760625475.5975122, "submitted_on": null, "status": 0, "chroot": "fedora-42-x86_64", "arch": "x86_64", "buildroot_pkgs": [ "git" ], "task_id": "9695094-fedora-42-x86_64", "build_id": 9695094, "package_name": "compiler-rt", "package_version": "19.0.0-0.1.20240309.git0d6f9bf", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/xxmitsu/llvm/compiler-rt", "git_hash": "2db2bba69ba7d285de2ec6b606c0271208328fec", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "xxmitsu/llvm--bf11e6bc-bcc8-431b-98bd-395baf3542bc", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/xxmitsu/llvm/fedora-42-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "bootstrap": "off", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/xxmitsu/llvm", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/xxmitsu/llvm", "result_dir": "09695094-compiler-rt", "built_packages": "", "id": 9695094, "mockchain_macros": { "copr_username": "xxmitsu", "copr_projectname": "llvm", "vendor": "Fedora Project COPR (xxmitsu/llvm)" } } ] } [2025-10-16 14:39:19,717][ INFO][PID:3389891] Sending fedora-messaging bus message in build.end [2025-10-16 14:39:19,744][ INFO][PID:3389891] Compressing /var/lib/copr/public_html/results/xxmitsu/llvm/fedora-42-x86_64/09695094-compiler-rt/builder-live.log by gzip [2025-10-16 14:39:19,746][ INFO][PID:3389891] Running command 'gzip /var/lib/copr/public_html/results/xxmitsu/llvm/fedora-42-x86_64/09695094-compiler-rt/builder-live.log' as PID 3494452 [2025-10-16 14:39:19,751][ INFO][PID:3389891] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/xxmitsu/llvm/fedora-42-x86_64/09695094-compiler-rt/builder-live.log) [2025-10-16 14:39:19,752][ INFO][PID:3389891] Compressing /var/lib/copr/public_html/results/xxmitsu/llvm/fedora-42-x86_64/09695094-compiler-rt/backend.log by gzip [2025-10-16 14:39:19,755][ INFO][PID:3389891] Running command 'gzip /var/lib/copr/public_html/results/xxmitsu/llvm/fedora-42-x86_64/09695094-compiler-rt/backend.log' as PID 3494454