[2026-01-12 18:43:39,134][ INFO][PID:2027876] Marking build as starting [2026-01-12 18:43:39,227][ INFO][PID:2027876] Checking that /var/lib/copr/public_html/results/psimovec/python3-scipy-1.11.1/fedora-43-x86_64/repodata/repomd.xml exists [2026-01-12 18:43:39,372][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:43:39,377][ INFO][PID:2027876] VM allocation process starts [2026-01-12 18:43:39,430][ INFO][PID:2027876] Trying to allocate VM: ResallocHost, ticket_id=781741, requested_tags=['copr_builder', 'arch_x86_64'] [2026-01-12 18:43:44,435][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:43:49,437][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:43:54,441][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:43:59,443][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:44:04,446][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:44:09,448][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:44:14,450][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:44:19,452][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:44:24,454][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:44:29,455][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:44:34,456][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:44:39,459][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:44:44,462][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:44:49,496][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:44:54,555][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:44:59,557][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:45:04,559][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:45:09,560][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:45:14,561][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:45:19,904][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:45:24,906][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:45:27,669][ INFO][PID:2027876] Allocated host ResallocHost, ticket_id=781741, hostname=54.89.105.68, name=aws_x86_64_spot_prod_01162626_20260112_184355, requested_tags=['copr_builder', 'arch_x86_64'] [2026-01-12 18:45:27,670][ INFO][PID:2027876] Allocating ssh connection to builder [2026-01-12 18:45:27,670][ INFO][PID:2027876] Checking that builder machine is OK [2026-01-12 18:45:27,990][ INFO][PID:2027876] Running remote command: copr-builder-ready fedora-43-x86_64 [2026-01-12 18:45:28,185][ INFO][PID:2027876] Red Hat subscription not needed for fedora-43-x86_64 Builder is ready to be used [2026-01-12 18:45:28,186][ INFO][PID:2027876] Filling build.info file with builder info [2026-01-12 18:45:28,186][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:45:28,187][ INFO][PID:2027876] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "python3-scipy-1.11.1", "project_dirname": "python3-scipy-1.11.1", "submitter": "https://src.fedoraproject.org/user/jwakely", "ended_on": null, "started_on": 1768243528.187522, "submitted_on": null, "status": 3, "chroot": "fedora-43-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10001724-fedora-43-x86_64", "build_id": 10001724, "package_name": "espresso", "package_version": "4.2.2-16", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/python3-scipy-1.11.1/espresso", "git_hash": "2691c919b842a01001181e894b18abd3dc07e7b9", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/python3-scipy-1.11.1--https://src.fedoraproject.org/user/jwakely", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.11.1/fedora-43-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/python3-scipy-1.11.1", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.11.1", "result_dir": "10001724-espresso", "built_packages": "", "id": 10001724, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "python3-scipy-1.11.1", "vendor": "Fedora Project COPR (psimovec/python3-scipy-1.11.1)" } } ] } [2026-01-12 18:45:28,244][ INFO][PID:2027876] Sending fedora-messaging bus message in build.start [2026-01-12 18:45:28,817][ INFO][PID:2027876] Sending fedora-messaging bus message in chroot.start [2026-01-12 18:45:28,846][ INFO][PID:2027876] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10001724-fedora-43-x86_64 --chroot fedora-43-x86_64 --detached [2026-01-12 18:45:29,166][ INFO][PID:2027876] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '54.89.105.68' (ED25519) to the list of known hosts. [2026-01-12 18:45:29,167][ INFO][PID:2027876] Downloading the builder-live.log file, attempt 1 [2026-01-12 18:45:29,169][ INFO][PID:2027876] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.89.105.68 copr-rpmbuild-log [2026-01-12 18:45:34,175][ INFO][PID:2027876] Periodic builder liveness probe: alive [2026-01-12 18:45:34,176][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:45:39,177][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:45:44,178][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:45:49,179][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:45:54,181][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:45:59,182][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:46:04,183][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:46:09,186][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:46:14,187][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:46:19,188][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:46:24,189][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:46:29,193][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:46:34,194][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:46:39,198][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:46:44,200][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:46:49,201][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:46:54,202][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:46:59,203][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:47:04,205][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:47:09,207][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:47:14,208][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:47:19,209][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:47:24,210][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:47:29,212][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:47:34,213][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:47:39,214][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:47:44,215][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:47:49,216][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:47:54,217][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:47:59,221][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:48:04,222][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:48:09,223][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:48:14,224][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:48:19,225][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:48:24,226][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:48:29,227][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:48:34,228][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:48:39,230][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:48:44,231][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:48:49,233][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:48:54,235][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:48:59,236][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:49:04,237][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:49:09,241][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:49:14,246][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:49:19,252][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:49:24,253][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:49:29,254][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:49:34,255][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:49:39,256][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:49:44,258][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:49:49,259][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:49:54,260][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:49:59,261][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:50:04,262][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:50:09,263][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:50:14,265][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:50:19,268][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:50:24,271][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:50:29,277][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:50:34,279][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:50:39,280][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:50:44,282][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:50:49,283][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:50:54,285][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:50:59,287][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:51:04,289][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:51:09,291][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:51:14,298][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:51:19,303][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:51:24,304][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:51:29,306][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:51:34,310][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:51:39,311][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:51:44,312][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:51:49,313][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:51:54,314][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:51:59,315][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:52:04,319][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:52:09,320][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:52:14,323][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:52:19,327][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:52:24,330][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:52:29,332][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:52:34,334][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:52:39,338][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:52:44,340][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:52:49,341][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:52:54,342][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:52:59,344][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:53:04,345][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:53:09,347][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:53:14,348][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:53:19,349][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:53:24,350][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:53:29,352][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:53:34,354][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:53:39,355][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:53:44,356][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:53:49,360][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:53:51,836][ ERROR][PID:2027876] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-12 18:53:54,361][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:53:59,362][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:54:01,837][WARNING][PID:2027876] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-12 18:54:04,368][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:54:09,369][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:54:11,837][ INFO][PID:2027876] Downloading the builder-live.log file, attempt 2 [2026-01-12 18:54:11,840][ INFO][PID:2027876] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.89.105.68 copr-rpmbuild-log [2026-01-12 18:54:14,370][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:54:19,371][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:54:24,373][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:54:29,375][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:54:34,376][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:54:39,377][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:54:44,380][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:54:49,381][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:54:54,384][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:54:59,385][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:55:04,386][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:55:09,387][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:55:11,907][ ERROR][PID:2027876] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-12 18:55:14,388][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:55:19,390][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:55:21,910][WARNING][PID:2027876] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-12 18:55:24,397][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:55:29,398][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:55:31,911][ INFO][PID:2027876] Downloading the builder-live.log file, attempt 3 [2026-01-12 18:55:31,913][ INFO][PID:2027876] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.89.105.68 copr-rpmbuild-log [2026-01-12 18:55:34,411][ INFO][PID:2027876] Periodic builder liveness probe: alive [2026-01-12 18:55:34,412][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:55:39,413][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:55:44,414][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:55:49,417][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:55:54,418][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:55:59,419][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:56:04,421][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:56:09,425][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:56:14,427][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:56:19,427][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:56:24,428][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:56:29,430][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:56:32,204][ ERROR][PID:2027876] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-12 18:56:34,431][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:56:39,432][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:56:42,214][WARNING][PID:2027876] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-12 18:56:44,433][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:56:49,434][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:56:52,216][ INFO][PID:2027876] Downloading the builder-live.log file, attempt 4 [2026-01-12 18:56:52,218][ INFO][PID:2027876] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.89.105.68 copr-rpmbuild-log [2026-01-12 18:56:54,435][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:56:59,439][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:57:04,440][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:57:09,441][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:57:14,443][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:57:19,444][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:57:24,445][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:57:29,445][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:57:34,446][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:57:39,448][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:57:44,449][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:57:49,451][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:57:52,285][ ERROR][PID:2027876] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-12 18:57:54,451][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:57:59,453][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:58:02,305][ ERROR][PID:2027876] Giving up for unstable SSH, failures: 1768244041.8372192, 1768244121.9107103, 1768244202.21478, 1768244282.3056655 [2026-01-12 18:58:02,306][ ERROR][PID:2027876] Re-try request for task on 'ResallocHost, ticket_id=781741, hostname=54.89.105.68, name=aws_x86_64_spot_prod_01162626_20260112_184355, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-01-12 18:58:02,307][ INFO][PID:2027876] Releasing VM back to pool [2026-01-12 18:58:02,322][ INFO][PID:2027876] Retry #1 (on other host) [2026-01-12 18:58:02,322][ INFO][PID:2027876] Checking that /var/lib/copr/public_html/results/psimovec/python3-scipy-1.11.1/fedora-43-x86_64/repodata/repomd.xml exists [2026-01-12 18:58:02,323][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:58:02,324][ INFO][PID:2027876] VM allocation process starts [2026-01-12 18:58:02,346][ INFO][PID:2027876] Trying to allocate VM: ResallocHost, ticket_id=781967, requested_tags=['copr_builder', 'arch_x86_64'] [2026-01-12 18:58:05,366][ INFO][PID:2027876] Allocated host ResallocHost, ticket_id=781967, hostname=3.86.38.10, name=aws_x86_64_normalreserved_prod_01163419_20260112_185644, requested_tags=['copr_builder', 'arch_x86_64'] [2026-01-12 18:58:05,366][ INFO][PID:2027876] Allocating ssh connection to builder [2026-01-12 18:58:05,367][ INFO][PID:2027876] Checking that builder machine is OK [2026-01-12 18:58:05,683][ INFO][PID:2027876] Running remote command: copr-builder-ready fedora-43-x86_64 [2026-01-12 18:58:05,879][ INFO][PID:2027876] Red Hat subscription not needed for fedora-43-x86_64 Builder is ready to be used [2026-01-12 18:58:05,879][ INFO][PID:2027876] Filling build.info file with builder info [2026-01-12 18:58:05,899][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:58:05,900][ INFO][PID:2027876] Not re-notifying FE and msg buses for the new host. [2026-01-12 18:58:05,900][ INFO][PID:2027876] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10001724-fedora-43-x86_64 --chroot fedora-43-x86_64 --detached [2026-01-12 18:58:06,216][ INFO][PID:2027876] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '3.86.38.10' (ED25519) to the list of known hosts. [2026-01-12 18:58:06,217][ INFO][PID:2027876] Downloading the builder-live.log file, attempt 1 [2026-01-12 18:58:06,219][ INFO][PID:2027876] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.86.38.10 copr-rpmbuild-log [2026-01-12 18:58:11,217][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:58:16,219][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:58:21,220][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:58:26,223][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:58:31,224][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:58:36,225][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:58:41,226][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:58:46,227][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:58:51,228][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:58:56,229][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:59:01,230][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:59:06,232][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:59:11,233][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:59:16,235][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:59:21,236][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:59:26,237][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:59:31,238][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:59:36,240][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:59:41,241][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:59:46,242][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:59:51,245][ INFO][PID:2027876] Checking for cancel request [2026-01-12 18:59:56,247][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:00:01,250][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:00:06,252][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:00:11,253][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:00:16,254][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:00:21,256][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:00:26,257][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:00:31,258][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:00:36,259][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:00:41,260][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:00:46,261][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:00:51,262][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:00:56,263][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:01:01,264][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:01:06,266][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:01:11,267][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:01:16,270][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:01:21,271][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:01:26,273][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:01:31,274][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:01:36,275][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:01:41,276][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:01:46,277][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:01:51,278][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:01:56,279][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:02:01,280][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:02:06,281][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:02:11,282][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:02:16,284][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:02:21,285][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:02:26,286][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:02:31,287][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:02:36,288][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:02:41,289][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:02:46,290][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:02:51,292][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:02:56,293][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:03:01,294][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:03:06,295][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:03:11,296][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:03:16,297][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:03:21,298][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:03:26,299][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:03:31,300][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:03:36,301][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:03:41,303][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:03:46,304][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:03:51,305][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:03:56,306][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:04:01,307][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:04:06,308][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:04:11,309][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:04:16,310][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:04:21,311][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:04:26,312][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:04:31,313][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:04:36,314][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:04:41,315][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:04:46,317][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:04:51,318][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:04:56,319][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:05:01,332][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:05:06,334][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:05:11,336][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:05:16,339][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:05:21,346][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:05:26,347][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:05:31,348][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:05:36,359][ INFO][PID:2027876] Periodic builder liveness probe: alive [2026-01-12 19:05:36,360][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:05:41,361][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:05:46,363][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:05:51,364][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:05:56,367][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:06:01,370][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:06:06,371][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:06:11,373][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:06:16,374][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:06:21,375][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:06:26,378][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:06:31,381][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:06:36,383][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:06:41,385][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:06:46,388][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:06:51,392][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:06:56,393][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:07:01,394][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:07:06,395][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:07:11,398][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:07:16,400][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:07:21,401][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:07:26,403][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:07:31,405][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:07:36,408][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:07:41,409][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:07:46,410][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:07:51,412][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:07:56,414][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:08:01,415][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:08:06,421][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:08:11,436][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:08:16,437][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:08:21,441][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:08:26,444][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:08:31,449][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:08:36,454][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:08:41,459][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:08:46,466][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:08:51,467][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:08:56,471][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:09:01,484][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:09:06,487][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:09:11,489][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:09:16,492][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:09:21,494][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:09:26,497][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:09:31,500][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:09:36,504][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:09:41,508][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:09:46,513][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:09:51,515][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:09:56,521][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:10:01,530][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:10:06,535][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:10:11,539][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:10:16,574][ INFO][PID:2027876] Checking for cancel request [2026-01-12 19:10:18,876][ INFO][PID:2027876] Downloading results from builder [2026-01-12 19:10:18,877][ INFO][PID:2027876] rsyncing of mockbuilder@3.86.38.10:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/python3-scipy-1.11.1/fedora-43-x86_64/10001724-espresso started [2026-01-12 19:10:18,882][ INFO][PID:2027876] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@3.86.38.10:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/python3-scipy-1.11.1/fedora-43-x86_64/10001724-espresso/ &> /var/lib/copr/public_html/results/psimovec/python3-scipy-1.11.1/fedora-43-x86_64/10001724-espresso/build-10001724.rsync.log [2026-01-12 19:10:19,480][ INFO][PID:2027876] rsyncing finished. [2026-01-12 19:10:19,481][ INFO][PID:2027876] Releasing VM back to pool [2026-01-12 19:10:19,506][ INFO][PID:2027876] Searching for 'success' file in resultdir [2026-01-12 19:10:19,507][ ERROR][PID:2027876] Build failed: Backend process error: No success file => build failure [2026-01-12 19:10:19,508][ INFO][PID:2027876] Finished build: id=10001724 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/python3-scipy-1.11.1 chroot=fedora-43-x86_64 [2026-01-12 19:10:19,522][ ERROR][PID:2027876] Backend process error: No success file => build failure [2026-01-12 19:10:19,527][ INFO][PID:2027876] Worker failed build, took 733.6270177364349 [2026-01-12 19:10:19,529][ INFO][PID:2027876] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "python3-scipy-1.11.1", "project_dirname": "python3-scipy-1.11.1", "submitter": "https://src.fedoraproject.org/user/jwakely", "ended_on": 1768245019.5274498, "started_on": 1768244285.900432, "submitted_on": null, "status": 0, "chroot": "fedora-43-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10001724-fedora-43-x86_64", "build_id": 10001724, "package_name": "espresso", "package_version": "4.2.2-16", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/python3-scipy-1.11.1/espresso", "git_hash": "2691c919b842a01001181e894b18abd3dc07e7b9", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/python3-scipy-1.11.1--https://src.fedoraproject.org/user/jwakely", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.11.1/fedora-43-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/python3-scipy-1.11.1", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.11.1", "result_dir": "10001724-espresso", "built_packages": "", "id": 10001724, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "python3-scipy-1.11.1", "vendor": "Fedora Project COPR (psimovec/python3-scipy-1.11.1)" } } ] } [2026-01-12 19:10:19,651][ INFO][PID:2027876] Sending fedora-messaging bus message in build.end [2026-01-12 19:10:19,684][ INFO][PID:2027876] Compressing /var/lib/copr/public_html/results/psimovec/python3-scipy-1.11.1/fedora-43-x86_64/10001724-espresso/builder-live.log by gzip [2026-01-12 19:10:19,688][ INFO][PID:2027876] Running command 'gzip /var/lib/copr/public_html/results/psimovec/python3-scipy-1.11.1/fedora-43-x86_64/10001724-espresso/builder-live.log' as PID 2206372 [2026-01-12 19:10:19,836][ INFO][PID:2027876] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/python3-scipy-1.11.1/fedora-43-x86_64/10001724-espresso/builder-live.log) [2026-01-12 19:10:19,838][ INFO][PID:2027876] Compressing /var/lib/copr/public_html/results/psimovec/python3-scipy-1.11.1/fedora-43-x86_64/10001724-espresso/backend.log by gzip [2026-01-12 19:10:19,843][ INFO][PID:2027876] Running command 'gzip /var/lib/copr/public_html/results/psimovec/python3-scipy-1.11.1/fedora-43-x86_64/10001724-espresso/backend.log' as PID 2206385