[2025-09-26 08:49:50,006][ INFO][PID:3246609] Marking build as starting [2025-09-26 08:49:50,052][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:49:50,053][ INFO][PID:3246609] VM allocation process starts [2025-09-26 08:49:50,070][ INFO][PID:3246609] Trying to allocate VM: ResallocHost, ticket_id=5279392, requested_tags=['copr_builder', 'arch_s390x'] [2025-09-26 08:49:55,073][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:50:00,074][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:50:05,075][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:50:10,076][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:50:15,077][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:50:20,078][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:50:25,079][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:50:30,080][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:50:35,081][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:50:40,082][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:50:45,083][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:50:50,085][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:50:55,086][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:51:00,087][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:51:05,088][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:51:10,089][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:51:15,090][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:51:20,091][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:51:25,092][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:51:30,093][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:51:35,095][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:51:40,095][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:51:45,096][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:51:50,098][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:51:55,099][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:52:00,100][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:52:05,101][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:52:10,102][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:52:15,103][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:52:20,105][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:52:25,106][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:52:30,108][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:52:35,109][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:52:40,110][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:52:45,111][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:52:50,113][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:52:55,114][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:53:00,116][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:53:05,120][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:53:10,121][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:53:15,122][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:53:20,123][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:53:25,124][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:53:30,125][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:53:35,126][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:53:40,127][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:53:45,129][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:53:50,129][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:53:55,131][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:54:00,132][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:54:05,133][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:54:10,134][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:54:15,135][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:54:20,136][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:54:25,137][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:54:30,138][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:54:35,139][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:54:40,140][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:54:45,142][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:54:50,145][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:54:55,146][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:55:00,147][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:55:05,148][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:55:10,149][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:55:15,151][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:55:20,151][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:55:25,152][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:55:30,153][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:55:35,154][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:55:40,155][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:55:45,156][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:55:50,157][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:55:55,158][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:56:00,159][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:56:05,160][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:56:10,161][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:56:15,162][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:56:20,163][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:56:25,164][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:56:30,165][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:56:35,166][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:56:40,168][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:56:45,169][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:56:50,170][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:56:55,171][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:57:00,172][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:57:05,173][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:57:08,220][ INFO][PID:3246609] Allocated host ResallocHost, ticket_id=5279392, hostname=163.107.84.59, name=copr_ic_s390x_br_sao_2_prod_06946301_20250926_085324, requested_tags=['copr_builder', 'arch_s390x'] [2025-09-26 08:57:08,221][ INFO][PID:3246609] Allocating ssh connection to builder [2025-09-26 08:57:08,221][ INFO][PID:3246609] Checking that builder machine is OK [2025-09-26 08:57:09,915][ INFO][PID:3246609] Running remote command: copr-builder-ready centos-stream-10-s390x [2025-09-26 08:57:11,489][ INFO][PID:3246609] Red Hat subscription not needed for centos-stream-10-s390x Builder is ready to be used [2025-09-26 08:57:11,490][ INFO][PID:3246609] Filling build.info file with builder info [2025-09-26 08:57:11,491][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:57:11,492][ INFO][PID:3246609] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@python", "project_name": "python3.14-c10s", "project_dirname": "python3.14-c10s", "submitter": "thrnciar", "ended_on": null, "started_on": 1758877031.4927464, "submitted_on": null, "status": 3, "chroot": "centos-stream-10-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9602878-centos-stream-10-s390x", "build_id": 9602878, "package_name": "python3.14-scipy", "package_version": "1.15.3-6.el10", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@python/python3.14-c10s/python3.14-scipy", "git_hash": "39350abc65e6e1676483d3e0dabf20b60473aa8c", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@python/python3.14-c10s--thrnciar", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@python/python3.14-c10s/centos-stream-10-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@python/python3.14-c10s", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@python/python3.14-c10s", "result_dir": "09602878-python3.14-scipy", "built_packages": "", "id": 9602878, "mockchain_macros": { "copr_username": "@python", "copr_projectname": "python3.14-c10s", "vendor": "Fedora Project COPR (@python/python3.14-c10s)" } } ] } [2025-09-26 08:57:11,545][ INFO][PID:3246609] Sending fedora-messaging bus message in build.start [2025-09-26 08:57:12,183][ INFO][PID:3246609] Sending fedora-messaging bus message in chroot.start [2025-09-26 08:57:12,209][ INFO][PID:3246609] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9602878-centos-stream-10-s390x --chroot centos-stream-10-s390x --detached [2025-09-26 08:57:13,994][ INFO][PID:3246609] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '163.107.84.59' (ED25519) to the list of known hosts. [2025-09-26 08:57:13,995][ INFO][PID:3246609] Downloading the builder-live.log file, attempt 1 [2025-09-26 08:57:13,996][ INFO][PID:3246609] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@163.107.84.59 copr-rpmbuild-log [2025-09-26 08:57:19,002][ INFO][PID:3246609] Periodic builder liveness probe: alive [2025-09-26 08:57:19,002][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:57:24,003][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:57:29,004][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:57:34,005][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:57:39,006][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:57:44,007][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:57:49,008][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:57:54,009][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:57:59,010][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:58:04,011][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:58:09,013][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:58:14,014][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:58:19,015][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:58:24,016][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:58:29,017][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:58:34,018][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:58:39,019][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:58:44,020][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:58:49,021][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:58:54,022][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:58:59,023][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:59:04,024][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:59:09,025][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:59:14,026][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:59:19,027][ INFO][PID:3246609] Checking for cancel request [2025-09-26 08:59:20,988][ INFO][PID:3246609] Downloading results from builder [2025-09-26 08:59:20,989][ INFO][PID:3246609] rsyncing of mockbuilder@163.107.84.59:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-s390x/09602878-python3.14-scipy started [2025-09-26 08:59:20,990][ INFO][PID:3246609] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@163.107.84.59:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-s390x/09602878-python3.14-scipy/ &> /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-s390x/09602878-python3.14-scipy/build-09602878.rsync.log [2025-09-26 08:59:27,649][ INFO][PID:3246609] rsyncing finished. [2025-09-26 08:59:27,650][ INFO][PID:3246609] Releasing VM back to pool [2025-09-26 08:59:27,664][ INFO][PID:3246609] Searching for 'success' file in resultdir [2025-09-26 08:59:27,666][ ERROR][PID:3246609] Build failed: Backend process error: No success file => build failure [2025-09-26 08:59:27,667][ INFO][PID:3246609] Finished build: id=9602878 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/@python/python3.14-c10s chroot=centos-stream-10-s390x [2025-09-26 08:59:27,670][ ERROR][PID:3246609] Backend process error: No success file => build failure [2025-09-26 08:59:27,671][ INFO][PID:3246609] Worker failed build, took 136.17848944664001 [2025-09-26 08:59:27,672][ INFO][PID:3246609] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@python", "project_name": "python3.14-c10s", "project_dirname": "python3.14-c10s", "submitter": "thrnciar", "ended_on": 1758877167.6712358, "started_on": 1758877031.4927464, "submitted_on": null, "status": 0, "chroot": "centos-stream-10-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9602878-centos-stream-10-s390x", "build_id": 9602878, "package_name": "python3.14-scipy", "package_version": "1.15.3-6.el10", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@python/python3.14-c10s/python3.14-scipy", "git_hash": "39350abc65e6e1676483d3e0dabf20b60473aa8c", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@python/python3.14-c10s--thrnciar", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@python/python3.14-c10s/centos-stream-10-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@python/python3.14-c10s", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@python/python3.14-c10s", "result_dir": "09602878-python3.14-scipy", "built_packages": "", "id": 9602878, "mockchain_macros": { "copr_username": "@python", "copr_projectname": "python3.14-c10s", "vendor": "Fedora Project COPR (@python/python3.14-c10s)" } } ] } [2025-09-26 08:59:27,700][ INFO][PID:3246609] Sending fedora-messaging bus message in build.end [2025-09-26 08:59:27,732][ INFO][PID:3246609] Compressing /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-s390x/09602878-python3.14-scipy/builder-live.log by gzip [2025-09-26 08:59:27,733][ INFO][PID:3246609] Running command 'gzip /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-s390x/09602878-python3.14-scipy/builder-live.log' as PID 3308437 [2025-09-26 08:59:27,740][ INFO][PID:3246609] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-s390x/09602878-python3.14-scipy/builder-live.log) [2025-09-26 08:59:27,741][ INFO][PID:3246609] Compressing /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-s390x/09602878-python3.14-scipy/backend.log by gzip [2025-09-26 08:59:27,742][ INFO][PID:3246609] Running command 'gzip /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-s390x/09602878-python3.14-scipy/backend.log' as PID 3308438