[2025-09-25 10:46:40,838][ INFO][PID:2913851] Marking build as starting [2025-09-25 10:46:40,864][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:46:40,865][ INFO][PID:2913851] VM allocation process starts [2025-09-25 10:46:40,874][ INFO][PID:2913851] Trying to allocate VM: ResallocHost, ticket_id=5260154, requested_tags=['copr_builder', 'arch_s390x'] [2025-09-25 10:46:43,914][ INFO][PID:2913851] Allocated host ResallocHost, ticket_id=5260154, hostname=13.116.88.74, name=copr_ic_s390x_br_sao_1_prod_06928675_20250925_104126, requested_tags=['copr_builder', 'arch_s390x'] [2025-09-25 10:46:43,914][ INFO][PID:2913851] Allocating ssh connection to builder [2025-09-25 10:46:43,914][ INFO][PID:2913851] Checking that builder machine is OK [2025-09-25 10:46:45,662][ INFO][PID:2913851] Running remote command: copr-builder-ready centos-stream-10-s390x [2025-09-25 10:46:47,211][ INFO][PID:2913851] Red Hat subscription not needed for centos-stream-10-s390x Builder is ready to be used [2025-09-25 10:46:47,211][ INFO][PID:2913851] Filling build.info file with builder info [2025-09-25 10:46:47,212][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:46:47,212][ INFO][PID:2913851] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@python", "project_name": "python3.14-c10s", "project_dirname": "python3.14-c10s", "submitter": "thrnciar", "ended_on": null, "started_on": 1758797207.2127383, "submitted_on": null, "status": 3, "chroot": "centos-stream-10-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9600290-centos-stream-10-s390x", "build_id": 9600290, "package_name": "python3.14-numpy", "package_version": "2.3.2-2", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@python/python3.14-c10s/python3.14-numpy", "git_hash": "4b124464d893eb40238702436089b85c263c01b8", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@python/python3.14-c10s--thrnciar", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@python/python3.14-c10s/centos-stream-10-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@python/python3.14-c10s", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@python/python3.14-c10s", "result_dir": "09600290-python3.14-numpy", "built_packages": "", "id": 9600290, "mockchain_macros": { "copr_username": "@python", "copr_projectname": "python3.14-c10s", "vendor": "Fedora Project COPR (@python/python3.14-c10s)" } } ] } [2025-09-25 10:46:47,237][ INFO][PID:2913851] Sending fedora-messaging bus message in build.start [2025-09-25 10:46:48,322][ INFO][PID:2913851] Sending fedora-messaging bus message in chroot.start [2025-09-25 10:46:48,391][ INFO][PID:2913851] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9600290-centos-stream-10-s390x --chroot centos-stream-10-s390x --detached [2025-09-25 10:46:50,107][ INFO][PID:2913851] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '13.116.88.74' (ED25519) to the list of known hosts. [2025-09-25 10:46:50,108][ INFO][PID:2913851] Downloading the builder-live.log file, attempt 1 [2025-09-25 10:46:50,109][ INFO][PID:2913851] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.116.88.74 copr-rpmbuild-log [2025-09-25 10:46:55,114][ INFO][PID:2913851] Periodic builder liveness probe: alive [2025-09-25 10:46:55,114][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:47:00,115][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:47:05,116][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:47:10,117][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:47:15,118][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:47:20,118][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:47:25,119][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:47:30,120][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:47:35,121][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:47:40,122][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:47:45,123][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:47:50,124][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:47:55,125][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:48:00,126][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:48:05,127][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:48:10,128][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:48:15,129][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:48:20,130][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:48:25,131][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:48:30,133][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:48:35,134][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:48:40,135][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:48:45,136][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:48:50,137][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:48:55,138][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:49:00,139][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:49:05,139][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:49:10,141][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:49:15,142][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:49:20,143][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:49:25,144][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:49:30,145][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:49:35,146][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:49:40,147][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:49:45,148][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:49:50,149][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:49:55,150][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:50:00,151][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:50:05,152][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:50:10,153][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:50:15,154][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:50:20,155][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:50:25,156][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:50:30,157][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:50:35,158][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:50:40,159][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:50:45,160][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:50:50,161][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:50:55,162][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:51:00,163][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:51:05,164][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:51:10,165][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:51:15,166][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:51:20,167][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:51:25,168][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:51:30,169][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:51:35,170][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:51:40,171][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:51:45,172][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:51:50,173][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:51:55,174][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:52:00,175][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:52:05,176][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:52:10,177][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:52:15,179][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:52:20,180][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:52:25,182][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:52:30,183][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:52:35,185][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:52:40,186][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:52:45,187][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:52:50,189][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:52:55,190][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:53:00,191][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:53:05,192][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:53:10,193][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:53:15,194][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:53:20,195][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:53:25,196][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:53:30,197][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:53:35,198][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:53:40,199][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:53:45,200][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:53:50,201][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:53:55,202][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:54:00,203][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:54:05,204][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:54:10,205][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:54:15,206][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:54:20,207][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:54:25,208][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:54:30,209][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:54:35,210][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:54:40,211][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:54:45,212][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:54:50,213][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:54:55,214][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:55:00,215][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:55:05,216][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:55:10,219][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:55:15,220][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:55:20,221][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:55:25,223][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:55:30,224][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:55:35,225][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:55:40,226][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:55:45,227][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:55:50,228][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:55:55,229][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:56:00,230][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:56:05,231][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:56:10,232][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:56:15,233][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:56:20,234][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:56:25,235][ INFO][PID:2913851] Checking for cancel request [2025-09-25 10:56:29,491][ INFO][PID:2913851] Downloading results from builder [2025-09-25 10:56:29,491][ INFO][PID:2913851] rsyncing of mockbuilder@13.116.88.74:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-s390x/09600290-python3.14-numpy started [2025-09-25 10:56:29,492][ INFO][PID:2913851] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@13.116.88.74:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-s390x/09600290-python3.14-numpy/ &> /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-s390x/09600290-python3.14-numpy/build-09600290.rsync.log [2025-09-25 10:56:35,604][ INFO][PID:2913851] rsyncing finished. [2025-09-25 10:56:35,604][ INFO][PID:2913851] Releasing VM back to pool [2025-09-25 10:56:35,615][ INFO][PID:2913851] Searching for 'success' file in resultdir [2025-09-25 10:56:35,615][ ERROR][PID:2913851] Build failed: Backend process error: No success file => build failure [2025-09-25 10:56:35,616][ INFO][PID:2913851] Finished build: id=9600290 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/@python/python3.14-c10s chroot=centos-stream-10-s390x [2025-09-25 10:56:35,618][ ERROR][PID:2913851] Backend process error: No success file => build failure [2025-09-25 10:56:35,618][ INFO][PID:2913851] Worker failed build, took 588.4057743549347 [2025-09-25 10:56:35,619][ INFO][PID:2913851] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@python", "project_name": "python3.14-c10s", "project_dirname": "python3.14-c10s", "submitter": "thrnciar", "ended_on": 1758797795.6185126, "started_on": 1758797207.2127383, "submitted_on": null, "status": 0, "chroot": "centos-stream-10-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9600290-centos-stream-10-s390x", "build_id": 9600290, "package_name": "python3.14-numpy", "package_version": "2.3.2-2", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@python/python3.14-c10s/python3.14-numpy", "git_hash": "4b124464d893eb40238702436089b85c263c01b8", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@python/python3.14-c10s--thrnciar", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@python/python3.14-c10s/centos-stream-10-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@python/python3.14-c10s", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@python/python3.14-c10s", "result_dir": "09600290-python3.14-numpy", "built_packages": "", "id": 9600290, "mockchain_macros": { "copr_username": "@python", "copr_projectname": "python3.14-c10s", "vendor": "Fedora Project COPR (@python/python3.14-c10s)" } } ] } [2025-09-25 10:56:35,647][ INFO][PID:2913851] Sending fedora-messaging bus message in build.end [2025-09-25 10:56:35,703][ INFO][PID:2913851] Compressing /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-s390x/09600290-python3.14-numpy/builder-live.log by gzip [2025-09-25 10:56:35,705][ INFO][PID:2913851] Running command 'gzip /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-s390x/09600290-python3.14-numpy/builder-live.log' as PID 2957233 [2025-09-25 10:56:35,716][ INFO][PID:2913851] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-s390x/09600290-python3.14-numpy/builder-live.log) [2025-09-25 10:56:35,717][ INFO][PID:2913851] Compressing /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-s390x/09600290-python3.14-numpy/backend.log by gzip [2025-09-25 10:56:35,718][ INFO][PID:2913851] Running command 'gzip /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-s390x/09600290-python3.14-numpy/backend.log' as PID 2957235