[2025-10-17 18:09:44,094][ INFO][PID:4116354] Marking build as starting [2025-10-17 18:09:44,166][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:09:44,167][ INFO][PID:4116354] VM allocation process starts [2025-10-17 18:09:44,186][ INFO][PID:4116354] Trying to allocate VM: ResallocHost, ticket_id=5715914, requested_tags=['copr_builder', 'arch_aarch64'] [2025-10-17 18:09:49,188][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:09:54,188][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:09:59,190][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:10:04,191][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:10:09,191][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:10:14,192][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:10:19,193][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:10:22,233][ INFO][PID:4116354] Allocated host ResallocHost, ticket_id=5715914, hostname=44.208.27.254, name=aws_aarch64_normalreserved_prod_07446410_20251017_180841, requested_tags=['copr_builder', 'arch_aarch64'] [2025-10-17 18:10:22,234][ INFO][PID:4116354] Allocating ssh connection to builder [2025-10-17 18:10:22,234][ INFO][PID:4116354] Checking that builder machine is OK [2025-10-17 18:10:22,675][ INFO][PID:4116354] Running remote command: copr-builder-ready fedora-rawhide-aarch64 [2025-10-17 18:10:22,902][ INFO][PID:4116354] Red Hat subscription not needed for fedora-rawhide-aarch64 Builder is ready to be used [2025-10-17 18:10:22,903][ INFO][PID:4116354] Filling build.info file with builder info [2025-10-17 18:10:22,904][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:10:22,904][ INFO][PID:4116354] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "openblas-0.3.23", "project_dirname": "openblas-0.3.23:pr:fork-yselkowitz-rpms-cantata-5", "submitter": "https://src.fedoraproject.org/user/yselkowitz", "ended_on": null, "started_on": 1760724622.9046223, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-aarch64", "arch": "aarch64", "buildroot_pkgs": [], "task_id": "9700560-fedora-rawhide-aarch64", "build_id": 9700560, "package_name": "cantata", "package_version": "3.3.1-6", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23:pr:fork-yselkowitz-rpms-cantata-5/cantata", "git_hash": "9e7c394b2274bc6f60af02243fd2e773c5df7b00", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/yselkowitz", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-rawhide-aarch64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23:pr:fork-yselkowitz-rpms-cantata-5/fedora-rawhide-aarch64/", "id": "copr_coprdir", "name": "Coprdir repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_aarch64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-yselkowitz-rpms-cantata-5", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23:pr:fork-yselkowitz-rpms-cantata-5", "result_dir": "09700560-cantata", "built_packages": "", "id": 9700560, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "openblas-0.3.23", "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)" } } ] } [2025-10-17 18:10:22,955][ INFO][PID:4116354] Sending fedora-messaging bus message in build.start [2025-10-17 18:10:53,499][ ERROR][PID:4116354] Attempt 1 to publish a message failed (in /usr/lib/python3.13/site-packages/fedora_messaging/api.py:321) [2025-10-17 18:10:56,880][ INFO][PID:4116354] Sending fedora-messaging bus message in chroot.start [2025-10-17 18:10:56,909][ INFO][PID:4116354] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9700560-fedora-rawhide-aarch64 --chroot fedora-rawhide-aarch64 --detached [2025-10-17 18:10:57,480][ INFO][PID:4116354] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '44.208.27.254' (ED25519) to the list of known hosts. [2025-10-17 18:10:57,481][ INFO][PID:4116354] Downloading the builder-live.log file, attempt 1 [2025-10-17 18:10:57,483][ INFO][PID:4116354] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.208.27.254 copr-rpmbuild-log [2025-10-17 18:11:02,487][ INFO][PID:4116354] Periodic builder liveness probe: alive [2025-10-17 18:11:02,488][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:11:07,490][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:11:12,492][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:11:17,493][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:11:22,494][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:11:27,496][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:11:32,497][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:11:37,498][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:11:42,499][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:11:47,500][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:11:52,502][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:11:57,503][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:12:02,504][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:12:07,505][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:12:12,506][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:12:17,507][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:12:22,508][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:12:27,509][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:12:32,511][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:12:37,512][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:12:42,513][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:12:47,514][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:12:52,516][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:12:57,517][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:13:02,518][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:13:07,519][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:13:12,520][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:13:17,521][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:13:22,522][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:13:27,523][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:13:32,524][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:13:37,525][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:13:42,526][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:13:47,527][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:13:52,529][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:13:57,530][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:14:02,533][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:14:07,535][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:14:12,538][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:14:17,539][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:14:22,541][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:14:27,542][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:14:32,544][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:14:37,545][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:14:42,546][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:14:47,550][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:14:52,551][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:14:57,553][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:15:02,554][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:15:07,557][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:15:12,559][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:15:17,560][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:15:22,562][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:15:27,563][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:15:32,564][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:15:37,565][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:15:42,567][ INFO][PID:4116354] Checking for cancel request [2025-10-17 18:15:42,639][ INFO][PID:4116354] Downloading results from builder [2025-10-17 18:15:42,640][ INFO][PID:4116354] rsyncing of mockbuilder@44.208.27.254:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-yselkowitz-rpms-cantata-5/fedora-rawhide-aarch64/09700560-cantata started [2025-10-17 18:15:42,642][ INFO][PID:4116354] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@44.208.27.254:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-yselkowitz-rpms-cantata-5/fedora-rawhide-aarch64/09700560-cantata/ &> /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-yselkowitz-rpms-cantata-5/fedora-rawhide-aarch64/09700560-cantata/build-09700560.rsync.log [2025-10-17 18:15:43,002][ INFO][PID:4116354] rsyncing finished. [2025-10-17 18:15:43,003][ INFO][PID:4116354] Releasing VM back to pool [2025-10-17 18:15:43,023][ INFO][PID:4116354] Searching for 'success' file in resultdir [2025-10-17 18:15:43,024][ ERROR][PID:4116354] Build failed: Backend process error: No success file => build failure [2025-10-17 18:15:43,025][ INFO][PID:4116354] Finished build: id=9700560 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-yselkowitz-rpms-cantata-5 chroot=fedora-rawhide-aarch64 [2025-10-17 18:15:43,027][ ERROR][PID:4116354] Backend process error: No success file => build failure [2025-10-17 18:15:43,027][ INFO][PID:4116354] Worker failed build, took 320.123309135437 [2025-10-17 18:15:43,028][ INFO][PID:4116354] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "openblas-0.3.23", "project_dirname": "openblas-0.3.23:pr:fork-yselkowitz-rpms-cantata-5", "submitter": "https://src.fedoraproject.org/user/yselkowitz", "ended_on": 1760724943.0279315, "started_on": 1760724622.9046223, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-aarch64", "arch": "aarch64", "buildroot_pkgs": [], "task_id": "9700560-fedora-rawhide-aarch64", "build_id": 9700560, "package_name": "cantata", "package_version": "3.3.1-6", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23:pr:fork-yselkowitz-rpms-cantata-5/cantata", "git_hash": "9e7c394b2274bc6f60af02243fd2e773c5df7b00", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/yselkowitz", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-rawhide-aarch64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23:pr:fork-yselkowitz-rpms-cantata-5/fedora-rawhide-aarch64/", "id": "copr_coprdir", "name": "Coprdir repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_aarch64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-yselkowitz-rpms-cantata-5", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23:pr:fork-yselkowitz-rpms-cantata-5", "result_dir": "09700560-cantata", "built_packages": "", "id": 9700560, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "openblas-0.3.23", "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)" } } ] } [2025-10-17 18:15:43,068][ INFO][PID:4116354] Sending fedora-messaging bus message in build.end [2025-10-17 18:15:43,095][ INFO][PID:4116354] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-yselkowitz-rpms-cantata-5/fedora-rawhide-aarch64/09700560-cantata/builder-live.log by gzip [2025-10-17 18:15:43,097][ INFO][PID:4116354] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-yselkowitz-rpms-cantata-5/fedora-rawhide-aarch64/09700560-cantata/builder-live.log' as PID 4156860 [2025-10-17 18:15:43,120][ INFO][PID:4116354] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-yselkowitz-rpms-cantata-5/fedora-rawhide-aarch64/09700560-cantata/builder-live.log) [2025-10-17 18:15:43,121][ INFO][PID:4116354] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-yselkowitz-rpms-cantata-5/fedora-rawhide-aarch64/09700560-cantata/backend.log by gzip [2025-10-17 18:15:43,122][ INFO][PID:4116354] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-yselkowitz-rpms-cantata-5/fedora-rawhide-aarch64/09700560-cantata/backend.log' as PID 4156865