[2025-10-02 05:22:20,260][ INFO][PID:3110204] Marking build as starting [2025-10-02 05:22:20,302][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:22:20,303][ INFO][PID:3110204] VM allocation process starts [2025-10-02 05:22:20,325][ INFO][PID:3110204] Trying to allocate VM: ResallocHost, ticket_id=5432201, requested_tags=['copr_builder', 'arch_s390x'] [2025-10-02 05:22:23,352][ INFO][PID:3110204] Allocated host ResallocHost, ticket_id=5432201, hostname=13.120.86.2, name=copr_ic_s390x_eu_es_1_prod_07181911_20251002_050940, requested_tags=['copr_builder', 'arch_s390x'] [2025-10-02 05:22:23,532][ INFO][PID:3110204] Allocating ssh connection to builder [2025-10-02 05:22:23,538][ INFO][PID:3110204] Checking that builder machine is OK [2025-10-02 05:22:24,934][ INFO][PID:3110204] Running remote command: copr-builder-ready fedora-41-s390x [2025-10-02 05:22:26,245][ INFO][PID:3110204] Red Hat subscription not needed for fedora-41-s390x Builder is ready to be used [2025-10-02 05:22:26,246][ INFO][PID:3110204] Filling build.info file with builder info [2025-10-02 05:22:26,247][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:22:26,247][ INFO][PID:3110204] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "openblas-0.3.23", "project_dirname": "openblas-0.3.23", "submitter": "https://src.fedoraproject.org/user/qulogic", "ended_on": null, "started_on": 1759382546.2477074, "submitted_on": null, "status": 3, "chroot": "fedora-41-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9635500-fedora-41-s390x", "build_id": 9635500, "package_name": "python-matplotlib", "package_version": "3.10.6-3", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/python-matplotlib", "git_hash": "47f57db4a3985134545435883b012659c850ed76", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/qulogic", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-41-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23", "result_dir": "09635500-python-matplotlib", "built_packages": "", "id": 9635500, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "openblas-0.3.23", "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)" } } ] } [2025-10-02 05:22:26,283][ INFO][PID:3110204] Sending fedora-messaging bus message in build.start [2025-10-02 05:22:26,891][ INFO][PID:3110204] Sending fedora-messaging bus message in chroot.start [2025-10-02 05:22:26,913][ INFO][PID:3110204] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9635500-fedora-41-s390x --chroot fedora-41-s390x --detached [2025-10-02 05:22:28,312][ INFO][PID:3110204] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '13.120.86.2' (ED25519) to the list of known hosts. [2025-10-02 05:22:28,313][ INFO][PID:3110204] Downloading the builder-live.log file, attempt 1 [2025-10-02 05:22:28,315][ INFO][PID:3110204] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.120.86.2 copr-rpmbuild-log [2025-10-02 05:22:33,331][ INFO][PID:3110204] Periodic builder liveness probe: alive [2025-10-02 05:22:33,331][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:22:38,332][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:22:43,333][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:22:48,334][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:22:53,335][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:22:58,336][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:23:03,337][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:23:08,338][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:23:13,339][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:23:18,340][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:23:23,341][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:23:28,342][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:23:33,343][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:23:38,344][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:23:43,345][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:23:48,345][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:23:53,347][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:23:58,347][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:24:03,348][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:24:08,349][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:24:13,604][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:24:18,605][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:24:23,671][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:24:28,791][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:24:33,792][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:24:38,794][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:24:43,871][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:24:48,872][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:24:54,079][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:24:59,197][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:25:04,246][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:25:09,313][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:25:14,595][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:25:19,688][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:25:24,725][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:25:29,956][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:25:35,668][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:25:40,868][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:25:45,889][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:25:50,949][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:25:56,066][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:26:01,273][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:26:06,391][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:26:11,542][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:26:16,742][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:26:21,852][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:26:26,997][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:26:32,034][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:26:37,052][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:26:42,130][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:26:47,276][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:26:52,439][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:26:57,527][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:27:02,776][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:27:07,960][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:27:12,969][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:27:17,988][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:27:23,034][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:27:28,095][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:27:33,162][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:27:38,281][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:27:43,514][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:27:48,537][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:27:53,601][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:27:58,675][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:28:03,789][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:28:08,840][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:28:13,883][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:28:18,924][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:28:23,930][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:28:28,946][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:28:34,022][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:28:39,184][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:28:44,194][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:28:49,196][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:28:54,271][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:28:59,282][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:29:04,320][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:29:09,505][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:29:14,553][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:29:19,572][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:29:24,757][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:29:29,851][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:29:34,953][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:29:39,970][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:29:45,131][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:29:50,195][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:29:55,204][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:30:00,245][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:30:05,301][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:30:10,459][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:30:15,791][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:30:20,793][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:30:25,793][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:30:30,794][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:30:35,795][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:30:40,832][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:30:45,898][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:30:50,900][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:30:56,045][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:31:01,584][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:31:06,839][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:31:12,157][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:31:17,392][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:31:22,393][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:31:27,395][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:31:32,484][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:31:37,730][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:31:42,732][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:31:47,891][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:31:53,057][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:31:58,287][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:32:03,295][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:32:08,314][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:32:13,545][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:32:18,752][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:32:23,757][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:32:28,759][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:32:33,955][ INFO][PID:3110204] Periodic builder liveness probe: alive [2025-10-02 05:32:33,970][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:32:38,978][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:32:43,985][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:32:49,035][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:32:54,162][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:32:59,517][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:33:06,228][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:33:11,507][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:33:16,709][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:33:21,710][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:33:26,711][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:33:31,742][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:33:36,888][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:33:42,644][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:33:48,224][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:33:53,645][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:33:59,355][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:34:04,602][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:34:09,673][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:34:14,689][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:34:19,713][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:34:24,926][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:34:30,110][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:34:35,240][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:34:40,522][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:34:45,949][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:34:51,108][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:34:56,461][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:35:01,463][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:35:06,474][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:35:11,538][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:35:17,160][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:35:22,236][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:35:27,571][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:35:32,805][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:35:38,532][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:35:44,048][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:35:49,329][ INFO][PID:3110204] Checking for cancel request [2025-10-02 05:35:51,411][ INFO][PID:3110204] Downloading results from builder [2025-10-02 05:35:51,412][ INFO][PID:3110204] rsyncing of mockbuilder@13.120.86.2:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-s390x/09635500-python-matplotlib started [2025-10-02 05:35:51,413][ INFO][PID:3110204] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@13.120.86.2:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-s390x/09635500-python-matplotlib/ &> /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-s390x/09635500-python-matplotlib/build-09635500.rsync.log [2025-10-02 05:36:01,173][ INFO][PID:3110204] rsyncing finished. [2025-10-02 05:36:01,174][ INFO][PID:3110204] Releasing VM back to pool [2025-10-02 05:36:01,183][ INFO][PID:3110204] Searching for 'success' file in resultdir [2025-10-02 05:36:01,183][ ERROR][PID:3110204] Build failed: Backend process error: No success file => build failure [2025-10-02 05:36:01,184][ INFO][PID:3110204] Finished build: id=9635500 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/openblas-0.3.23 chroot=fedora-41-s390x [2025-10-02 05:36:01,186][ ERROR][PID:3110204] Backend process error: No success file => build failure [2025-10-02 05:36:01,186][ INFO][PID:3110204] Worker failed build, took 814.9391539096832 [2025-10-02 05:36:01,187][ INFO][PID:3110204] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "openblas-0.3.23", "project_dirname": "openblas-0.3.23", "submitter": "https://src.fedoraproject.org/user/qulogic", "ended_on": 1759383361.1868613, "started_on": 1759382546.2477074, "submitted_on": null, "status": 0, "chroot": "fedora-41-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9635500-fedora-41-s390x", "build_id": 9635500, "package_name": "python-matplotlib", "package_version": "3.10.6-3", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/python-matplotlib", "git_hash": "47f57db4a3985134545435883b012659c850ed76", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/qulogic", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-41-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23", "result_dir": "09635500-python-matplotlib", "built_packages": "", "id": 9635500, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "openblas-0.3.23", "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)" } } ] } [2025-10-02 05:36:01,235][ INFO][PID:3110204] Sending fedora-messaging bus message in build.end [2025-10-02 05:36:01,259][ INFO][PID:3110204] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-s390x/09635500-python-matplotlib/builder-live.log by gzip [2025-10-02 05:36:01,261][ INFO][PID:3110204] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-s390x/09635500-python-matplotlib/builder-live.log' as PID 3162481 [2025-10-02 05:36:01,333][ INFO][PID:3110204] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-s390x/09635500-python-matplotlib/builder-live.log) [2025-10-02 05:36:01,334][ INFO][PID:3110204] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-s390x/09635500-python-matplotlib/backend.log by gzip [2025-10-02 05:36:01,335][ INFO][PID:3110204] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-s390x/09635500-python-matplotlib/backend.log' as PID 3162485