[2025-09-09 07:18:23,549][ INFO][PID:3927763] Marking build as starting [2025-09-09 07:18:23,610][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:18:23,614][ INFO][PID:3927763] VM allocation process starts [2025-09-09 07:18:23,643][ INFO][PID:3927763] Trying to allocate VM: ResallocHost, ticket_id=4972510, requested_tags=['copr_builder', 'arch_x86_64'] [2025-09-09 07:18:28,646][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:18:33,647][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:18:38,649][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:18:43,651][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:18:48,655][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:18:53,665][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:18:58,668][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:19:03,670][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:19:08,672][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:19:13,673][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:19:18,677][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:19:23,682][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:19:28,683][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:19:33,687][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:19:38,696][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:19:43,701][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:19:48,704][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:19:53,706][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:19:58,710][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:20:03,711][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:20:08,715][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:20:13,716][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:20:18,717][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:20:23,719][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:20:28,722][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:20:33,723][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:20:38,724][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:20:43,735][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:20:48,736][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:20:53,737][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:20:58,738][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:21:03,740][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:21:08,741][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:21:13,745][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:21:18,749][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:21:23,751][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:21:28,755][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:21:33,756][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:21:38,759][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:21:43,765][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:21:48,769][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:21:53,771][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:21:58,772][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:22:03,775][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:22:08,776][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:22:13,777][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:22:18,783][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:22:23,787][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:22:28,788][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:22:33,790][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:22:38,795][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:22:43,797][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:22:48,799][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:22:53,801][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:22:58,807][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:23:03,809][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:23:08,810][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:23:13,811][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:23:18,813][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:23:23,814][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:23:29,873][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:23:34,882][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:23:39,889][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:23:41,874][ INFO][PID:3927763] Allocated host ResallocHost, ticket_id=4972510, hostname=2620:52:3:1:dead:beef:cafe:c10e, name=copr_hv_x86_64_01_prod_06675813_20250909_071844, requested_tags=['copr_builder', 'arch_x86_64'] [2025-09-09 07:23:41,875][ INFO][PID:3927763] Allocating ssh connection to builder [2025-09-09 07:23:41,875][ INFO][PID:3927763] Checking that builder machine is OK [2025-09-09 07:23:42,510][ INFO][PID:3927763] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2025-09-09 07:23:42,854][ INFO][PID:3927763] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2025-09-09 07:23:42,932][ INFO][PID:3927763] Filling build.info file with builder info [2025-09-09 07:23:42,942][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:23:42,951][ INFO][PID:3927763] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "mochaa", "project_name": "protobuf", "project_dirname": "protobuf", "submitter": "https://src.fedoraproject.org/user/music", "ended_on": null, "started_on": 1757402622.951519, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9535789-fedora-rawhide-x86_64", "build_id": 9535789, "package_name": "onnxruntime", "package_version": "1.20.1-22", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/mochaa/protobuf/onnxruntime", "git_hash": "16383ff8a6b52730f8d61d747d73070936d84ca7", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "mochaa/protobuf--https://src.fedoraproject.org/user/music", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/mochaa/protobuf/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/mochaa/protobuf", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/mochaa/protobuf", "result_dir": "09535789-onnxruntime", "built_packages": "", "id": 9535789, "mockchain_macros": { "copr_username": "mochaa", "copr_projectname": "protobuf", "vendor": "Fedora Project COPR (mochaa/protobuf)" } } ] } [2025-09-09 07:23:43,036][ INFO][PID:3927763] Sending fedora-messaging bus message in build.start [2025-09-09 07:23:44,039][ INFO][PID:3927763] Sending fedora-messaging bus message in chroot.start [2025-09-09 07:23:44,086][ INFO][PID:3927763] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9535789-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2025-09-09 07:23:44,680][ INFO][PID:3927763] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c10e' (ED25519) to the list of known hosts. [2025-09-09 07:23:44,682][ INFO][PID:3927763] Downloading the builder-live.log file, attempt 1 [2025-09-09 07:23:44,684][ INFO][PID:3927763] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c10e copr-rpmbuild-log [2025-09-09 07:23:49,692][ INFO][PID:3927763] Periodic builder liveness probe: alive [2025-09-09 07:23:49,693][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:23:54,694][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:23:59,695][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:24:04,696][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:24:09,697][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:24:14,764][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:24:19,768][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:24:24,778][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:24:29,779][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:24:34,780][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:24:39,782][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:24:44,784][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:24:49,787][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:24:54,788][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:24:59,789][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:25:04,791][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:25:09,793][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:25:14,794][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:25:19,795][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:25:24,796][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:25:29,798][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:25:34,799][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:25:39,801][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:25:44,803][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:25:49,805][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:25:54,807][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:25:59,809][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:26:04,810][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:26:09,812][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:26:14,817][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:26:19,819][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:26:24,821][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:26:29,822][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:26:34,824][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:26:39,825][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:26:44,826][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:26:49,827][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:26:54,828][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:26:59,830][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:27:04,831][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:27:09,832][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:27:14,833][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:27:19,834][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:27:24,835][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:27:29,837][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:27:34,841][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:27:39,847][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:27:44,849][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:27:49,852][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:27:54,855][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:27:59,856][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:28:04,857][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:28:09,858][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:28:14,859][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:28:19,860][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:28:24,862][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:28:29,863][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:28:34,865][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:28:39,945][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:28:44,947][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:28:49,950][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:28:54,951][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:28:59,953][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:29:04,976][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:29:09,992][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:29:15,128][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:29:20,221][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:29:25,582][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:29:30,601][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:29:35,607][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:29:40,611][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:29:45,613][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:29:50,614][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:29:55,615][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:30:00,617][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:30:05,620][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:30:10,622][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:30:15,623][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:30:20,864][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:30:25,868][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:30:30,870][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:30:35,875][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:30:40,877][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:30:45,879][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:30:50,889][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:30:55,890][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:31:00,891][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:31:05,892][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:31:10,893][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:31:15,894][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:31:20,895][ INFO][PID:3927763] Checking for cancel request [2025-09-09 07:31:21,881][ INFO][PID:3927763] Downloading results from builder [2025-09-09 07:31:21,881][ INFO][PID:3927763] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c10e]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/mochaa/protobuf/fedora-rawhide-x86_64/09535789-onnxruntime started [2025-09-09 07:31:21,882][ INFO][PID:3927763] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c10e]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/mochaa/protobuf/fedora-rawhide-x86_64/09535789-onnxruntime/ &> /var/lib/copr/public_html/results/mochaa/protobuf/fedora-rawhide-x86_64/09535789-onnxruntime/build-09535789.rsync.log [2025-09-09 07:31:24,531][ INFO][PID:3927763] rsyncing finished. [2025-09-09 07:31:24,532][ INFO][PID:3927763] Releasing VM back to pool [2025-09-09 07:31:24,550][ INFO][PID:3927763] Searching for 'success' file in resultdir [2025-09-09 07:31:24,551][ ERROR][PID:3927763] Build failed: Backend process error: No success file => build failure [2025-09-09 07:31:24,552][ INFO][PID:3927763] Finished build: id=9535789 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/mochaa/protobuf chroot=fedora-rawhide-x86_64 [2025-09-09 07:31:24,554][ ERROR][PID:3927763] Backend process error: No success file => build failure [2025-09-09 07:31:24,554][ INFO][PID:3927763] Worker failed build, took 461.6032021045685 [2025-09-09 07:31:24,555][ INFO][PID:3927763] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "mochaa", "project_name": "protobuf", "project_dirname": "protobuf", "submitter": "https://src.fedoraproject.org/user/music", "ended_on": 1757403084.554721, "started_on": 1757402622.951519, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9535789-fedora-rawhide-x86_64", "build_id": 9535789, "package_name": "onnxruntime", "package_version": "1.20.1-22", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/mochaa/protobuf/onnxruntime", "git_hash": "16383ff8a6b52730f8d61d747d73070936d84ca7", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "mochaa/protobuf--https://src.fedoraproject.org/user/music", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/mochaa/protobuf/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/mochaa/protobuf", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/mochaa/protobuf", "result_dir": "09535789-onnxruntime", "built_packages": "", "id": 9535789, "mockchain_macros": { "copr_username": "mochaa", "copr_projectname": "protobuf", "vendor": "Fedora Project COPR (mochaa/protobuf)" } } ] } [2025-09-09 07:31:24,613][ INFO][PID:3927763] Sending fedora-messaging bus message in build.end [2025-09-09 07:31:24,663][ INFO][PID:3927763] Compressing /var/lib/copr/public_html/results/mochaa/protobuf/fedora-rawhide-x86_64/09535789-onnxruntime/builder-live.log by gzip [2025-09-09 07:31:24,665][ INFO][PID:3927763] Running command 'gzip /var/lib/copr/public_html/results/mochaa/protobuf/fedora-rawhide-x86_64/09535789-onnxruntime/builder-live.log' as PID 4046265 [2025-09-09 07:31:24,677][ INFO][PID:3927763] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/mochaa/protobuf/fedora-rawhide-x86_64/09535789-onnxruntime/builder-live.log) [2025-09-09 07:31:24,679][ INFO][PID:3927763] Compressing /var/lib/copr/public_html/results/mochaa/protobuf/fedora-rawhide-x86_64/09535789-onnxruntime/backend.log by gzip [2025-09-09 07:31:24,680][ INFO][PID:3927763] Running command 'gzip /var/lib/copr/public_html/results/mochaa/protobuf/fedora-rawhide-x86_64/09535789-onnxruntime/backend.log' as PID 4046267