[2025-12-15 15:29:53,361][ INFO][PID:901408] Marking build as starting [2025-12-15 15:29:53,489][ INFO][PID:901408] Checking that /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-x86_64/repodata/repomd.xml exists [2025-12-15 15:29:53,493][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:29:53,496][ INFO][PID:901408] VM allocation process starts [2025-12-15 15:29:53,537][ INFO][PID:901408] Trying to allocate VM: ResallocHost, ticket_id=351176, requested_tags=['copr_builder', 'arch_x86_64'] [2025-12-15 15:29:58,546][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:30:03,550][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:30:05,632][ INFO][PID:901408] Allocated host ResallocHost, ticket_id=351176, hostname=54.198.15.106, name=aws_x86_64_spot_prod_00566862_20251215_152033, requested_tags=['copr_builder', 'arch_x86_64'] [2025-12-15 15:30:05,636][ INFO][PID:901408] Allocating ssh connection to builder [2025-12-15 15:30:05,637][ INFO][PID:901408] Checking that builder machine is OK [2025-12-15 15:30:06,002][ INFO][PID:901408] Running remote command: copr-builder-ready centos-stream-10-x86_64 [2025-12-15 15:30:06,239][ INFO][PID:901408] Red Hat subscription not needed for centos-stream-10-x86_64 Builder is ready to be used [2025-12-15 15:30:06,240][ INFO][PID:901408] Filling build.info file with builder info [2025-12-15 15:30:06,242][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:30:06,248][ INFO][PID:901408] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@python", "project_name": "python3.14-c10s", "project_dirname": "python3.14-c10s", "submitter": "thrnciar", "ended_on": null, "started_on": 1765812606.2478, "submitted_on": null, "status": 3, "chroot": "centos-stream-10-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9911566-centos-stream-10-x86_64", "build_id": 9911566, "package_name": "python3.14-scipy", "package_version": "1.16.2-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@python/python3.14-c10s/python3.14-scipy", "git_hash": "a551b59d318d5e03484104d338c48a1105f182f6", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@python/python3.14-c10s--thrnciar", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@python/python3.14-c10s/centos-stream-10-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@python/python3.14-c10s", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@python/python3.14-c10s", "result_dir": "09911566-python3.14-scipy", "built_packages": "", "id": 9911566, "mockchain_macros": { "copr_username": "@python", "copr_projectname": "python3.14-c10s", "vendor": "Fedora Project COPR (@python/python3.14-c10s)" } } ] } [2025-12-15 15:30:06,324][ INFO][PID:901408] Sending fedora-messaging bus message in build.start [2025-12-15 15:30:07,239][ INFO][PID:901408] Sending fedora-messaging bus message in chroot.start [2025-12-15 15:30:07,291][ INFO][PID:901408] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9911566-centos-stream-10-x86_64 --chroot centos-stream-10-x86_64 --detached [2025-12-15 15:30:07,643][ INFO][PID:901408] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '54.198.15.106' (ED25519) to the list of known hosts. [2025-12-15 15:30:07,644][ INFO][PID:901408] Downloading the builder-live.log file, attempt 1 [2025-12-15 15:30:07,648][ INFO][PID:901408] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.198.15.106 copr-rpmbuild-log [2025-12-15 15:30:12,687][ INFO][PID:901408] Periodic builder liveness probe: alive [2025-12-15 15:30:12,689][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:30:17,694][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:30:22,703][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:30:27,705][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:30:32,711][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:30:37,719][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:30:42,720][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:30:47,723][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:30:52,725][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:30:57,727][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:31:02,728][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:31:07,729][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:31:12,730][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:31:17,731][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:31:22,732][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:31:27,734][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:31:32,736][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:31:37,737][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:31:42,738][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:31:47,740][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:31:52,741][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:31:57,743][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:32:02,747][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:32:07,749][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:32:12,750][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:32:17,752][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:32:22,755][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:32:27,757][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:32:32,759][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:32:37,761][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:32:42,764][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:32:47,765][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:32:52,766][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:32:57,768][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:33:02,769][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:33:07,770][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:33:12,773][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:33:17,774][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:33:22,775][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:33:27,777][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:33:32,779][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:33:37,780][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:33:42,781][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:33:47,783][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:33:52,784][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:33:57,786][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:34:02,787][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:34:07,791][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:34:12,793][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:34:17,794][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:34:22,798][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:34:27,799][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:34:32,801][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:34:37,803][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:34:42,805][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:34:47,807][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:34:52,808][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:34:57,810][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:35:02,812][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:35:07,817][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:35:12,819][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:35:17,820][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:35:21,912][ ERROR][PID:901408] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-15 15:35:22,822][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:35:27,823][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:35:31,913][WARNING][PID:901408] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-15 15:35:32,825][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:35:37,829][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:35:41,915][ INFO][PID:901408] Downloading the builder-live.log file, attempt 2 [2025-12-15 15:35:41,916][ INFO][PID:901408] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.198.15.106 copr-rpmbuild-log [2025-12-15 15:35:41,925][ ERROR][PID:901408] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-15 15:35:42,830][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:35:47,831][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:35:51,925][WARNING][PID:901408] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-15 15:35:52,832][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:35:57,833][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:36:01,926][ INFO][PID:901408] Downloading the builder-live.log file, attempt 3 [2025-12-15 15:36:01,928][ INFO][PID:901408] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.198.15.106 copr-rpmbuild-log [2025-12-15 15:36:01,936][ ERROR][PID:901408] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-15 15:36:02,834][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:36:07,836][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:36:11,937][WARNING][PID:901408] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-15 15:36:12,841][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:36:17,843][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:36:21,938][ INFO][PID:901408] Downloading the builder-live.log file, attempt 4 [2025-12-15 15:36:21,939][ INFO][PID:901408] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.198.15.106 copr-rpmbuild-log [2025-12-15 15:36:22,844][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:36:27,846][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:36:32,852][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:36:37,860][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:36:42,861][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:36:47,862][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:36:52,863][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:36:57,866][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:37:02,868][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:37:07,870][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:37:12,871][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:37:17,872][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:37:22,008][ ERROR][PID:901408] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-15 15:37:22,874][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:37:27,875][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:37:32,024][ ERROR][PID:901408] Giving up for unstable SSH, failures: 1765812931.9135966, 1765812951.9259043, 1765812971.9375596, 1765813052.024398 [2025-12-15 15:37:32,026][ ERROR][PID:901408] Re-try request for task on 'ResallocHost, ticket_id=351176, hostname=54.198.15.106, name=aws_x86_64_spot_prod_00566862_20251215_152033, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-12-15 15:37:32,026][ INFO][PID:901408] Releasing VM back to pool [2025-12-15 15:37:32,041][ INFO][PID:901408] Retry #1 (on other host) [2025-12-15 15:37:32,043][ INFO][PID:901408] Checking that /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-x86_64/repodata/repomd.xml exists [2025-12-15 15:37:32,044][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:37:32,046][ INFO][PID:901408] VM allocation process starts [2025-12-15 15:37:32,058][ INFO][PID:901408] Trying to allocate VM: ResallocHost, ticket_id=351327, requested_tags=['copr_builder', 'arch_x86_64'] [2025-12-15 15:37:37,060][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:37:38,089][ INFO][PID:901408] Allocated host ResallocHost, ticket_id=351327, hostname=54.237.6.213, name=aws_x86_64_normalreserved_prod_00567082_20251215_152457, requested_tags=['copr_builder', 'arch_x86_64'] [2025-12-15 15:37:38,090][ INFO][PID:901408] Allocating ssh connection to builder [2025-12-15 15:37:38,091][ INFO][PID:901408] Checking that builder machine is OK [2025-12-15 15:37:38,452][ INFO][PID:901408] Running remote command: copr-builder-ready centos-stream-10-x86_64 [2025-12-15 15:37:38,661][ INFO][PID:901408] Red Hat subscription not needed for centos-stream-10-x86_64 Builder is ready to be used [2025-12-15 15:37:38,662][ INFO][PID:901408] Filling build.info file with builder info [2025-12-15 15:37:38,681][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:37:38,682][ INFO][PID:901408] Not re-notifying FE and msg buses for the new host. [2025-12-15 15:37:38,682][ INFO][PID:901408] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9911566-centos-stream-10-x86_64 --chroot centos-stream-10-x86_64 --detached [2025-12-15 15:37:39,013][ INFO][PID:901408] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '54.237.6.213' (ED25519) to the list of known hosts. [2025-12-15 15:37:39,014][ INFO][PID:901408] Downloading the builder-live.log file, attempt 1 [2025-12-15 15:37:39,015][ INFO][PID:901408] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.237.6.213 copr-rpmbuild-log [2025-12-15 15:37:44,014][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:37:49,016][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:37:54,017][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:37:59,018][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:38:04,029][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:38:09,031][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:38:14,033][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:38:19,034][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:38:24,035][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:38:29,037][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:38:34,040][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:38:39,042][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:38:44,043][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:38:49,047][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:38:54,048][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:38:59,049][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:39:04,053][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:39:09,055][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:39:14,056][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:39:19,057][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:39:24,059][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:39:29,060][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:39:34,061][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:39:39,062][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:39:44,063][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:39:49,064][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:39:54,065][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:39:59,066][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:40:04,067][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:40:09,068][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:40:14,078][ INFO][PID:901408] Periodic builder liveness probe: alive [2025-12-15 15:40:14,079][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:40:19,080][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:40:24,081][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:40:29,082][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:40:34,083][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:40:39,084][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:40:44,085][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:40:49,086][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:40:54,087][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:40:59,088][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:41:04,089][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:41:09,090][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:41:14,092][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:41:19,096][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:41:24,097][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:41:29,098][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:41:34,099][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:41:39,100][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:41:44,101][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:41:49,102][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:41:54,103][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:41:59,104][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:42:04,105][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:42:09,106][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:42:14,107][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:42:19,108][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:42:24,109][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:42:29,110][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:42:34,111][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:42:39,112][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:42:44,113][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:42:49,114][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:42:54,115][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:42:59,116][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:43:04,117][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:43:09,119][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:43:14,120][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:43:19,121][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:43:24,122][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:43:29,123][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:43:34,124][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:43:39,126][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:43:44,127][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:43:49,129][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:43:54,130][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:43:59,131][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:44:04,132][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:44:09,133][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:44:14,134][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:44:19,135][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:44:24,137][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:44:29,138][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:44:34,139][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:44:39,140][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:44:44,141][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:44:49,143][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:44:54,144][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:44:59,145][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:45:04,147][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:45:09,148][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:45:14,150][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:45:19,151][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:45:24,152][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:45:29,153][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:45:34,154][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:45:39,155][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:45:44,156][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:45:49,157][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:45:54,158][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:45:59,159][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:46:04,160][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:46:09,161][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:46:14,163][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:46:19,164][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:46:24,165][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:46:29,165][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:46:34,167][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:46:39,168][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:46:44,169][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:46:49,170][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:46:54,171][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:46:59,172][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:47:04,174][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:47:09,175][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:47:14,176][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:47:19,177][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:47:24,180][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:47:29,186][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:47:34,188][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:47:39,189][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:47:44,190][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:47:49,191][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:47:54,192][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:47:59,194][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:48:04,195][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:48:09,196][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:48:14,197][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:48:19,198][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:48:24,199][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:48:29,200][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:48:34,201][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:48:39,202][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:48:44,203][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:48:49,204][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:48:54,205][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:48:59,205][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:49:04,207][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:49:09,208][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:49:14,209][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:49:19,210][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:49:24,211][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:49:29,212][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:49:34,213][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:49:39,214][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:49:44,215][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:49:49,216][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:49:54,217][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:49:59,218][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:50:04,219][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:50:09,220][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:50:14,228][ INFO][PID:901408] Periodic builder liveness probe: alive [2025-12-15 15:50:14,229][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:50:19,230][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:50:24,232][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:50:29,233][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:50:34,234][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:50:39,235][ INFO][PID:901408] Checking for cancel request [2025-12-15 15:50:44,171][ INFO][PID:901408] Downloading results from builder [2025-12-15 15:50:44,172][ INFO][PID:901408] rsyncing of mockbuilder@54.237.6.213:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-x86_64/09911566-python3.14-scipy started [2025-12-15 15:50:44,172][ INFO][PID:901408] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@54.237.6.213:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-x86_64/09911566-python3.14-scipy/ &> /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-x86_64/09911566-python3.14-scipy/build-09911566.rsync.log [2025-12-15 15:50:45,099][ INFO][PID:901408] rsyncing finished. [2025-12-15 15:50:45,100][ INFO][PID:901408] Releasing VM back to pool [2025-12-15 15:50:45,109][ INFO][PID:901408] Searching for 'success' file in resultdir [2025-12-15 15:50:45,109][ INFO][PID:901408] Going to sign pkgs from source: 9911566-centos-stream-10-x86_64 in chroot: /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-x86_64 [2025-12-15 15:50:45,110][ INFO][PID:901408] Calling '/bin/sign -u @python#python3.14-c10s@copr.fedorahosted.org -p' (attempt #1) [2025-12-15 15:50:45,365][ INFO][PID:901408] Calling '/bin/sign -4 -h sha256 -u @python#python3.14-c10s@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-x86_64/09911566-python3.14-scipy/python3.14-scipy-debugsource-1.16.2-1.el10.x86_64.rpm' (attempt #1) [2025-12-15 15:50:46,235][ INFO][PID:901408] signed rpm: /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-x86_64/09911566-python3.14-scipy/python3.14-scipy-debugsource-1.16.2-1.el10.x86_64.rpm [2025-12-15 15:50:46,236][ INFO][PID:901408] Calling '/bin/sign -4 -h sha256 -u @python#python3.14-c10s@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-x86_64/09911566-python3.14-scipy/python3.14-scipy-debuginfo-1.16.2-1.el10.x86_64.rpm' (attempt #1) [2025-12-15 15:50:49,289][ INFO][PID:901408] signed rpm: /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-x86_64/09911566-python3.14-scipy/python3.14-scipy-debuginfo-1.16.2-1.el10.x86_64.rpm [2025-12-15 15:50:49,289][ INFO][PID:901408] Calling '/bin/sign -4 -h sha256 -u @python#python3.14-c10s@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-x86_64/09911566-python3.14-scipy/python3.14-scipy-1.16.2-1.el10.x86_64.rpm' (attempt #1) [2025-12-15 15:50:50,556][ INFO][PID:901408] signed rpm: /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-x86_64/09911566-python3.14-scipy/python3.14-scipy-1.16.2-1.el10.x86_64.rpm [2025-12-15 15:50:50,557][ INFO][PID:901408] Calling '/bin/sign -4 -h sha256 -u @python#python3.14-c10s@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-x86_64/09911566-python3.14-scipy/python3.14-scipy-1.16.2-1.el10.src.rpm' (attempt #1) [2025-12-15 15:50:52,306][ INFO][PID:901408] signed rpm: /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-x86_64/09911566-python3.14-scipy/python3.14-scipy-1.16.2-1.el10.src.rpm [2025-12-15 15:50:52,306][ INFO][PID:901408] Sign done [2025-12-15 15:50:52,307][ INFO][PID:901408] Incremental createrepo run, adding 09911566-python3.14-scipy into https://download.copr.fedorainfracloud.org/results/@python/python3.14-c10s/centos-stream-10-x86_64, (auto-create-repo=True) [2025-12-15 15:50:52,308][ INFO][PID:901408] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-x86_64 --add 09911566-python3.14-scipy --no-appstream-metadata' as PID 1057978 [2025-12-15 15:50:53,664][ INFO][PID:901408] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-x86_64 --add 09911566-python3.14-scipy --no-appstream-metadata) [2025-12-15 15:50:53,665][ INFO][PID:901408] Getting build details [2025-12-15 15:50:53,665][ INFO][PID:901408] Listing built binary packages in /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-x86_64/09911566-python3.14-scipy [2025-12-15 15:50:53,665][ INFO][PID:901408] Built packages: ['python3.14-scipy-debugsource 1.16.2', 'python3.14-scipy 1.16.2', 'python3.14-scipy-debuginfo 1.16.2'] [2025-12-15 15:50:53,666][ INFO][PID:901408] build details: {'built_packages': 'python3.14-scipy-debugsource 1.16.2\npython3.14-scipy 1.16.2\npython3.14-scipy-debuginfo 1.16.2'} [2025-12-15 15:50:53,666][ INFO][PID:901408] Retrieving pubkey [2025-12-15 15:50:53,666][ INFO][PID:901408] Calling '/bin/sign -u @python#python3.14-c10s@copr.fedorahosted.org -p' (attempt #1) [2025-12-15 15:50:53,939][ INFO][PID:901408] Added pubkey for user @python project python3.14-c10s into: /var/lib/copr/public_html/results/@python/python3.14-c10s/pubkey.gpg [2025-12-15 15:50:53,940][ INFO][PID:901408] Finished build: id=9911566 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@python/python3.14-c10s chroot=centos-stream-10-x86_64 [2025-12-15 15:50:53,942][ INFO][PID:901408] Worker succeeded build, took 795.2600636482239 [2025-12-15 15:50:53,942][ INFO][PID:901408] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@python", "project_name": "python3.14-c10s", "project_dirname": "python3.14-c10s", "submitter": "thrnciar", "ended_on": 1765813853.9422107, "started_on": 1765813058.682147, "submitted_on": null, "status": 1, "chroot": "centos-stream-10-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9911566-centos-stream-10-x86_64", "build_id": 9911566, "package_name": "python3.14-scipy", "package_version": "1.16.2-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@python/python3.14-c10s/python3.14-scipy", "git_hash": "a551b59d318d5e03484104d338c48a1105f182f6", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@python/python3.14-c10s--thrnciar", "results": { "packages": [ { "name": "python3.14-scipy-debugsource", "epoch": null, "version": "1.16.2", "release": "1.el10", "arch": "x86_64" }, { "name": "python3.14-scipy", "epoch": null, "version": "1.16.2", "release": "1.el10", "arch": "x86_64" }, { "name": "python3.14-scipy", "epoch": null, "version": "1.16.2", "release": "1.el10", "arch": "src" }, { "name": "python3.14-scipy-debuginfo", "epoch": null, "version": "1.16.2", "release": "1.el10", "arch": "x86_64" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@python/python3.14-c10s/centos-stream-10-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@python/python3.14-c10s", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@python/python3.14-c10s", "result_dir": "09911566-python3.14-scipy", "built_packages": "python3.14-scipy-debugsource 1.16.2\npython3.14-scipy 1.16.2\npython3.14-scipy-debuginfo 1.16.2", "id": 9911566, "mockchain_macros": { "copr_username": "@python", "copr_projectname": "python3.14-c10s", "vendor": "Fedora Project COPR (@python/python3.14-c10s)" } } ] } [2025-12-15 15:50:53,989][ INFO][PID:901408] Sending fedora-messaging bus message in build.end [2025-12-15 15:50:54,015][ INFO][PID:901408] Compressing /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-x86_64/09911566-python3.14-scipy/builder-live.log by gzip [2025-12-15 15:50:54,016][ INFO][PID:901408] Running command 'gzip /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-x86_64/09911566-python3.14-scipy/builder-live.log' as PID 1058148 [2025-12-15 15:50:54,031][ INFO][PID:901408] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-x86_64/09911566-python3.14-scipy/builder-live.log) [2025-12-15 15:50:54,031][ INFO][PID:901408] Compressing /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-x86_64/09911566-python3.14-scipy/backend.log by gzip [2025-12-15 15:50:54,032][ INFO][PID:901408] Running command 'gzip /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-x86_64/09911566-python3.14-scipy/backend.log' as PID 1058150