[2025-09-25 10:50:33,751][ INFO][PID:2927473] Marking build as starting [2025-09-25 10:50:33,778][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:50:33,779][ INFO][PID:2927473] VM allocation process starts [2025-09-25 10:50:33,791][ INFO][PID:2927473] Trying to allocate VM: ResallocHost, ticket_id=5260179, requested_tags=['copr_builder', 'arch_s390x'] [2025-09-25 10:50:36,804][ INFO][PID:2927473] Allocated host ResallocHost, ticket_id=5260179, hostname=163.107.90.249, name=copr_ic_s390x_br_sao_2_prod_06928720_20250925_104711, requested_tags=['copr_builder', 'arch_s390x'] [2025-09-25 10:50:36,804][ INFO][PID:2927473] Allocating ssh connection to builder [2025-09-25 10:50:36,805][ INFO][PID:2927473] Checking that builder machine is OK [2025-09-25 10:50:38,471][ INFO][PID:2927473] Running remote command: copr-builder-ready centos-stream-10-s390x [2025-09-25 10:50:40,012][ INFO][PID:2927473] Red Hat subscription not needed for centos-stream-10-s390x Builder is ready to be used [2025-09-25 10:50:40,013][ INFO][PID:2927473] Filling build.info file with builder info [2025-09-25 10:50:40,013][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:50:40,014][ INFO][PID:2927473] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@python", "project_name": "python3.14-c10s", "project_dirname": "python3.14-c10s", "submitter": "thrnciar", "ended_on": null, "started_on": 1758797440.0144763, "submitted_on": null, "status": 3, "chroot": "centos-stream-10-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9600303-centos-stream-10-s390x", "build_id": 9600303, "package_name": "python3.14-numpy", "package_version": "2.3.2-2", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@python/python3.14-c10s/python3.14-numpy", "git_hash": "d71167f3bdb613bff2e31efe06df62c9231c14b9", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@python/python3.14-c10s--thrnciar", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@python/python3.14-c10s/centos-stream-10-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@python/python3.14-c10s", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@python/python3.14-c10s", "result_dir": "09600303-python3.14-numpy", "built_packages": "", "id": 9600303, "mockchain_macros": { "copr_username": "@python", "copr_projectname": "python3.14-c10s", "vendor": "Fedora Project COPR (@python/python3.14-c10s)" } } ] } [2025-09-25 10:50:40,046][ INFO][PID:2927473] Sending fedora-messaging bus message in build.start [2025-09-25 10:50:41,530][ INFO][PID:2927473] Sending fedora-messaging bus message in chroot.start [2025-09-25 10:50:41,647][ INFO][PID:2927473] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9600303-centos-stream-10-s390x --chroot centos-stream-10-s390x --detached [2025-09-25 10:50:43,379][ INFO][PID:2927473] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '163.107.90.249' (ED25519) to the list of known hosts. [2025-09-25 10:50:43,380][ INFO][PID:2927473] Downloading the builder-live.log file, attempt 1 [2025-09-25 10:50:43,382][ INFO][PID:2927473] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@163.107.90.249 copr-rpmbuild-log [2025-09-25 10:50:48,385][ INFO][PID:2927473] Periodic builder liveness probe: alive [2025-09-25 10:50:48,386][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:50:53,387][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:50:58,388][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:51:03,389][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:51:08,390][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:51:13,391][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:51:18,392][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:51:23,393][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:51:28,394][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:51:33,395][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:51:38,396][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:51:43,397][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:51:48,398][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:51:53,399][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:51:58,400][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:52:03,401][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:52:08,402][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:52:13,403][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:52:18,404][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:52:23,405][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:52:28,407][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:52:33,410][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:52:38,411][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:52:43,412][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:52:48,413][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:52:53,414][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:52:58,415][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:53:03,416][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:53:08,417][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:53:13,418][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:53:18,419][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:53:23,420][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:53:28,421][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:53:33,422][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:53:38,423][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:53:43,424][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:53:48,425][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:53:53,426][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:53:58,427][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:54:03,428][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:54:08,429][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:54:13,430][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:54:18,431][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:54:23,432][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:54:28,433][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:54:33,434][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:54:38,436][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:54:43,437][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:54:48,438][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:54:53,439][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:54:58,440][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:55:03,442][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:55:08,444][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:55:13,450][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:55:18,451][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:55:23,452][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:55:28,453][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:55:33,454][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:55:38,455][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:55:43,456][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:55:48,458][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:55:53,459][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:55:58,460][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:56:03,461][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:56:08,462][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:56:13,463][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:56:18,463][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:56:23,464][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:56:28,466][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:56:33,467][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:56:38,468][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:56:43,469][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:56:48,470][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:56:53,471][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:56:58,471][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:57:03,473][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:57:08,473][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:57:13,475][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:57:18,475][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:57:23,476][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:57:28,477][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:57:33,478][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:57:38,479][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:57:43,480][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:57:48,481][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:57:53,482][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:57:58,483][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:58:03,484][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:58:08,486][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:58:13,487][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:58:18,488][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:58:23,489][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:58:28,490][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:58:33,490][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:58:38,491][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:58:43,492][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:58:48,493][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:58:53,494][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:58:58,496][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:59:03,497][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:59:08,497][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:59:13,498][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:59:18,499][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:59:23,500][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:59:28,501][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:59:33,502][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:59:38,503][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:59:43,504][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:59:48,505][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:59:53,507][ INFO][PID:2927473] Checking for cancel request [2025-09-25 10:59:58,508][ INFO][PID:2927473] Checking for cancel request [2025-09-25 11:00:03,508][ INFO][PID:2927473] Checking for cancel request [2025-09-25 11:00:08,510][ INFO][PID:2927473] Checking for cancel request [2025-09-25 11:00:13,510][ INFO][PID:2927473] Checking for cancel request [2025-09-25 11:00:18,511][ INFO][PID:2927473] Checking for cancel request [2025-09-25 11:00:23,512][ INFO][PID:2927473] Checking for cancel request [2025-09-25 11:00:28,513][ INFO][PID:2927473] Checking for cancel request [2025-09-25 11:00:33,514][ INFO][PID:2927473] Checking for cancel request [2025-09-25 11:00:33,700][ INFO][PID:2927473] Downloading results from builder [2025-09-25 11:00:33,701][ INFO][PID:2927473] rsyncing of mockbuilder@163.107.90.249:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-s390x/09600303-python3.14-numpy started [2025-09-25 11:00:33,702][ INFO][PID:2927473] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@163.107.90.249:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-s390x/09600303-python3.14-numpy/ &> /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-s390x/09600303-python3.14-numpy/build-09600303.rsync.log [2025-09-25 11:00:39,817][ INFO][PID:2927473] rsyncing finished. [2025-09-25 11:00:39,817][ INFO][PID:2927473] Releasing VM back to pool [2025-09-25 11:00:39,826][ INFO][PID:2927473] Searching for 'success' file in resultdir [2025-09-25 11:00:39,827][ ERROR][PID:2927473] Build failed: Backend process error: No success file => build failure [2025-09-25 11:00:39,827][ INFO][PID:2927473] Finished build: id=9600303 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/@python/python3.14-c10s chroot=centos-stream-10-s390x [2025-09-25 11:00:39,829][ ERROR][PID:2927473] Backend process error: No success file => build failure [2025-09-25 11:00:39,829][ INFO][PID:2927473] Worker failed build, took 599.8151390552521 [2025-09-25 11:00:39,830][ INFO][PID:2927473] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@python", "project_name": "python3.14-c10s", "project_dirname": "python3.14-c10s", "submitter": "thrnciar", "ended_on": 1758798039.8296154, "started_on": 1758797440.0144763, "submitted_on": null, "status": 0, "chroot": "centos-stream-10-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9600303-centos-stream-10-s390x", "build_id": 9600303, "package_name": "python3.14-numpy", "package_version": "2.3.2-2", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@python/python3.14-c10s/python3.14-numpy", "git_hash": "d71167f3bdb613bff2e31efe06df62c9231c14b9", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@python/python3.14-c10s--thrnciar", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@python/python3.14-c10s/centos-stream-10-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@python/python3.14-c10s", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@python/python3.14-c10s", "result_dir": "09600303-python3.14-numpy", "built_packages": "", "id": 9600303, "mockchain_macros": { "copr_username": "@python", "copr_projectname": "python3.14-c10s", "vendor": "Fedora Project COPR (@python/python3.14-c10s)" } } ] } [2025-09-25 11:00:39,855][ INFO][PID:2927473] Sending fedora-messaging bus message in build.end [2025-09-25 11:00:39,880][ INFO][PID:2927473] Compressing /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-s390x/09600303-python3.14-numpy/builder-live.log by gzip [2025-09-25 11:00:39,881][ INFO][PID:2927473] Running command 'gzip /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-s390x/09600303-python3.14-numpy/builder-live.log' as PID 2975256 [2025-09-25 11:00:39,894][ INFO][PID:2927473] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-s390x/09600303-python3.14-numpy/builder-live.log) [2025-09-25 11:00:39,895][ INFO][PID:2927473] Compressing /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-s390x/09600303-python3.14-numpy/backend.log by gzip [2025-09-25 11:00:39,896][ INFO][PID:2927473] Running command 'gzip /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-s390x/09600303-python3.14-numpy/backend.log' as PID 2975260