[2025-11-05 00:14:40,078][ INFO][PID:4026798] Marking build as starting [2025-11-05 00:14:40,178][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:14:40,182][ INFO][PID:4026798] VM allocation process starts [2025-11-05 00:14:40,222][ INFO][PID:4026798] Trying to allocate VM: ResallocHost, ticket_id=6022120, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-11-05 00:14:45,228][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:14:50,236][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:14:52,307][ INFO][PID:4026798] Allocated host ResallocHost, ticket_id=6022120, hostname=2620:52:6:1161:dead:beef:cafe:c114, name=vmhost_p09_02_prod_07827998_20251104_223722, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-11-05 00:14:52,308][ INFO][PID:4026798] Allocating ssh connection to builder [2025-11-05 00:14:52,309][ INFO][PID:4026798] Checking that builder machine is OK [2025-11-05 00:14:53,310][ INFO][PID:4026798] Running remote command: copr-builder-ready fedora-43-ppc64le [2025-11-05 00:14:53,874][ INFO][PID:4026798] Red Hat subscription not needed for fedora-43-ppc64le Builder is ready to be used [2025-11-05 00:14:53,875][ INFO][PID:4026798] Filling build.info file with builder info [2025-11-05 00:14:53,876][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:14:53,878][ INFO][PID:4026798] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "openblas-0.3.23", "project_dirname": "openblas-0.3.23", "submitter": "https://src.fedoraproject.org/user/farchord", "ended_on": null, "started_on": 1762301693.8780684, "submitted_on": null, "status": 3, "chroot": "fedora-43-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9765727-fedora-43-ppc64le", "build_id": 9765727, "package_name": "plasma-mobile", "package_version": "6.5.2-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/plasma-mobile", "git_hash": "523941a672c227fb3ef1b104c1eb64540108125a", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/farchord", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-43-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23", "result_dir": "09765727-plasma-mobile", "built_packages": "", "id": 9765727, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "openblas-0.3.23", "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)" } } ] } [2025-11-05 00:14:53,982][ INFO][PID:4026798] Sending fedora-messaging bus message in build.start [2025-11-05 00:14:55,299][ INFO][PID:4026798] Sending fedora-messaging bus message in chroot.start [2025-11-05 00:14:55,343][ INFO][PID:4026798] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9765727-fedora-43-ppc64le --chroot fedora-43-ppc64le --detached [2025-11-05 00:14:56,307][ INFO][PID:4026798] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c114' (ED25519) to the list of known hosts. [2025-11-05 00:14:56,309][ INFO][PID:4026798] Downloading the builder-live.log file, attempt 1 [2025-11-05 00:14:56,320][ INFO][PID:4026798] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c114 copr-rpmbuild-log [2025-11-05 00:15:01,356][ INFO][PID:4026798] Periodic builder liveness probe: alive [2025-11-05 00:15:01,362][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:15:06,368][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:15:11,371][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:15:16,374][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:15:21,380][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:15:26,385][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:15:31,391][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:15:36,394][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:15:41,398][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:15:46,410][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:15:51,413][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:15:56,415][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:16:01,419][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:16:06,421][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:16:11,424][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:16:16,428][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:16:21,434][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:16:26,436][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:16:31,444][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:16:36,448][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:16:41,457][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:16:46,463][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:16:51,465][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:16:56,478][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:17:01,479][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:17:06,489][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:17:11,490][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:17:16,494][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:17:21,504][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:17:26,510][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:17:31,511][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:17:36,518][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:17:41,534][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:17:46,541][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:17:51,553][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:17:56,557][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:18:01,566][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:18:06,581][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:18:11,584][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:18:16,586][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:18:21,597][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:18:26,604][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:18:31,627][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:18:36,628][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:18:41,631][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:18:46,144][ ERROR][PID:4026798] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-11-05 00:18:46,637][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:18:51,648][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:18:56,152][WARNING][PID:4026798] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-11-05 00:18:56,672][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:19:01,679][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:19:06,159][ INFO][PID:4026798] Downloading the builder-live.log file, attempt 2 [2025-11-05 00:19:06,166][ INFO][PID:4026798] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c114 copr-rpmbuild-log [2025-11-05 00:19:06,685][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:19:11,691][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:19:16,698][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:19:21,699][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:19:26,704][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:19:31,712][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:19:36,716][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:19:41,720][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:19:46,723][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:19:51,727][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:19:56,733][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:20:01,740][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:20:06,267][ ERROR][PID:4026798] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-11-05 00:20:06,744][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:20:11,745][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:20:16,270][WARNING][PID:4026798] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-11-05 00:20:16,747][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:20:21,748][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:20:26,272][ INFO][PID:4026798] Downloading the builder-live.log file, attempt 3 [2025-11-05 00:20:26,273][ INFO][PID:4026798] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c114 copr-rpmbuild-log [2025-11-05 00:20:26,749][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:20:31,750][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:20:36,751][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:20:41,755][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:20:46,757][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:20:51,758][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:20:56,759][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:21:01,761][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:21:06,763][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:21:11,764][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:21:16,765][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:21:21,766][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:21:26,342][ ERROR][PID:4026798] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-11-05 00:21:26,767][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:21:31,768][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:21:36,346][WARNING][PID:4026798] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-11-05 00:21:36,769][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:21:41,770][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:21:46,347][ INFO][PID:4026798] Downloading the builder-live.log file, attempt 4 [2025-11-05 00:21:46,348][ INFO][PID:4026798] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c114 copr-rpmbuild-log [2025-11-05 00:21:46,771][ INFO][PID:4026798] Checking for cancel request [2025-11-05 00:21:47,053][ INFO][PID:4026798] Downloading results from builder [2025-11-05 00:21:47,054][ INFO][PID:4026798] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c114]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-43-ppc64le/09765727-plasma-mobile started [2025-11-05 00:21:47,055][ INFO][PID:4026798] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c114]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-43-ppc64le/09765727-plasma-mobile/ &> /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-43-ppc64le/09765727-plasma-mobile/build-09765727.rsync.log [2025-11-05 00:21:47,704][ INFO][PID:4026798] rsyncing finished. [2025-11-05 00:21:47,705][ INFO][PID:4026798] Releasing VM back to pool [2025-11-05 00:21:47,717][ INFO][PID:4026798] Searching for 'success' file in resultdir [2025-11-05 00:21:47,719][ ERROR][PID:4026798] Build failed: Backend process error: No success file => build failure [2025-11-05 00:21:47,720][ INFO][PID:4026798] Finished build: id=9765727 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/openblas-0.3.23 chroot=fedora-43-ppc64le [2025-11-05 00:21:47,726][ ERROR][PID:4026798] Backend process error: No success file => build failure [2025-11-05 00:21:47,726][ INFO][PID:4026798] Worker failed build, took 413.8487148284912 [2025-11-05 00:21:47,727][ INFO][PID:4026798] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "openblas-0.3.23", "project_dirname": "openblas-0.3.23", "submitter": "https://src.fedoraproject.org/user/farchord", "ended_on": 1762302107.7267833, "started_on": 1762301693.8780684, "submitted_on": null, "status": 0, "chroot": "fedora-43-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9765727-fedora-43-ppc64le", "build_id": 9765727, "package_name": "plasma-mobile", "package_version": "6.5.2-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/plasma-mobile", "git_hash": "523941a672c227fb3ef1b104c1eb64540108125a", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/farchord", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-43-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23", "result_dir": "09765727-plasma-mobile", "built_packages": "", "id": 9765727, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "openblas-0.3.23", "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)" } } ] } [2025-11-05 00:21:47,808][ INFO][PID:4026798] Sending fedora-messaging bus message in build.end [2025-11-05 00:21:47,835][ INFO][PID:4026798] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-43-ppc64le/09765727-plasma-mobile/builder-live.log by gzip [2025-11-05 00:21:47,838][ INFO][PID:4026798] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-43-ppc64le/09765727-plasma-mobile/builder-live.log' as PID 4091440 [2025-11-05 00:21:47,856][ INFO][PID:4026798] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-43-ppc64le/09765727-plasma-mobile/builder-live.log) [2025-11-05 00:21:47,857][ INFO][PID:4026798] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-43-ppc64le/09765727-plasma-mobile/backend.log by gzip [2025-11-05 00:21:47,859][ INFO][PID:4026798] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-43-ppc64le/09765727-plasma-mobile/backend.log' as PID 4091444