[2025-10-20 14:49:13,815][ INFO][PID:3026397] Marking build as starting [2025-10-20 14:49:13,885][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:49:13,886][ INFO][PID:3026397] VM allocation process starts [2025-10-20 14:49:13,902][ INFO][PID:3026397] Trying to allocate VM: ResallocHost, ticket_id=5743773, requested_tags=['copr_builder', 'arch_s390x'] [2025-10-20 14:49:18,903][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:49:23,907][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:49:28,908][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:49:33,909][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:49:38,911][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:49:43,912][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:49:48,913][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:49:53,914][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:49:58,915][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:50:03,917][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:50:08,918][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:50:13,919][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:50:18,921][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:50:23,922][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:50:28,923][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:50:33,924][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:50:38,925][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:50:43,926][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:50:48,927][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:50:53,928][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:50:58,929][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:51:03,930][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:51:08,931][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:51:13,932][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:51:18,933][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:51:23,934][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:51:28,935][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:51:33,936][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:51:38,937][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:51:43,938][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:51:48,940][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:51:53,941][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:51:58,942][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:52:03,943][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:52:08,944][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:52:13,944][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:52:18,945][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:52:23,946][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:52:28,948][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:52:33,949][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:52:38,950][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:52:43,951][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:52:48,952][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:52:53,953][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:52:58,957][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:53:03,958][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:53:08,959][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:53:13,960][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:53:18,961][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:53:23,962][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:53:28,963][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:53:33,964][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:53:38,965][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:53:43,966][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:53:48,967][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:53:53,968][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:53:58,969][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:54:03,970][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:54:08,971][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:54:13,972][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:54:18,972][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:54:23,974][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:54:28,975][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:54:33,975][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:54:38,976][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:54:43,978][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:54:48,979][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:54:53,980][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:54:58,981][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:55:03,982][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:55:08,985][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:55:13,986][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:55:18,988][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:55:23,989][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:55:28,991][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:55:32,069][ INFO][PID:3026397] Allocated host ResallocHost, ticket_id=5743773, hostname=163.107.84.59, name=copr_ic_s390x_br_sao_2_prod_07529155_20251020_145215, requested_tags=['copr_builder', 'arch_s390x'] [2025-10-20 14:55:32,069][ INFO][PID:3026397] Allocating ssh connection to builder [2025-10-20 14:55:32,070][ INFO][PID:3026397] Checking that builder machine is OK [2025-10-20 14:55:33,734][ INFO][PID:3026397] Running remote command: copr-builder-ready fedora-42-s390x [2025-10-20 14:55:35,305][ INFO][PID:3026397] Red Hat subscription not needed for fedora-42-s390x Builder is ready to be used [2025-10-20 14:55:35,307][ INFO][PID:3026397] Filling build.info file with builder info [2025-10-20 14:55:35,309][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:55:35,310][ INFO][PID:3026397] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "python3-scipy-1.10.1", "project_dirname": "python3-scipy-1.10.1:pr:fork-music-rpms-python-trimesh-66", "submitter": "https://src.fedoraproject.org/user/music", "ended_on": null, "started_on": 1760972135.3105838, "submitted_on": null, "status": 3, "chroot": "fedora-42-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9705985-fedora-42-s390x", "build_id": 9705985, "package_name": "python-trimesh", "package_version": "4.8.3-2", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/python3-scipy-1.10.1:pr:fork-music-rpms-python-trimesh-66/python-trimesh", "git_hash": "38bcd9649c7ca849ad63582dc7a8aae3eb4d3d0d", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/python3-scipy-1.10.1--https://src.fedoraproject.org/user/music", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.10.1/fedora-42-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.10.1:pr:fork-music-rpms-python-trimesh-66/fedora-42-s390x/", "id": "copr_coprdir", "name": "Coprdir repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1:pr:fork-music-rpms-python-trimesh-66", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.10.1:pr:fork-music-rpms-python-trimesh-66", "result_dir": "09705985-python-trimesh", "built_packages": "", "id": 9705985, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "python3-scipy-1.10.1", "vendor": "Fedora Project COPR (psimovec/python3-scipy-1.10.1)" } } ] } [2025-10-20 14:55:35,363][ INFO][PID:3026397] Sending fedora-messaging bus message in build.start [2025-10-20 14:55:36,524][ INFO][PID:3026397] Sending fedora-messaging bus message in chroot.start [2025-10-20 14:55:36,573][ INFO][PID:3026397] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9705985-fedora-42-s390x --chroot fedora-42-s390x --detached [2025-10-20 14:55:38,318][ INFO][PID:3026397] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '163.107.84.59' (ED25519) to the list of known hosts. [2025-10-20 14:55:38,319][ INFO][PID:3026397] Downloading the builder-live.log file, attempt 1 [2025-10-20 14:55:38,321][ INFO][PID:3026397] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@163.107.84.59 copr-rpmbuild-log [2025-10-20 14:55:43,341][ INFO][PID:3026397] Periodic builder liveness probe: alive [2025-10-20 14:55:43,342][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:55:48,346][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:55:53,348][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:55:58,350][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:56:03,351][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:56:08,353][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:56:13,356][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:56:18,357][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:56:23,358][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:56:28,359][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:56:33,361][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:56:38,363][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:56:43,364][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:56:48,366][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:56:53,368][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:56:58,369][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:57:03,371][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:57:08,372][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:57:13,374][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:57:18,375][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:57:23,376][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:57:28,378][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:57:33,379][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:57:38,380][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:57:43,381][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:57:48,382][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:57:53,383][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:57:58,384][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:58:03,385][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:58:08,386][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:58:13,387][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:58:18,388][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:58:23,389][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:58:28,391][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:58:33,394][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:58:38,396][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:58:43,397][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:58:48,398][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:58:53,399][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:58:58,400][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:59:03,401][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:59:08,406][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:59:13,407][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:59:18,408][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:59:23,409][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:59:28,411][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:59:33,412][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:59:38,413][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:59:43,414][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:59:48,415][ INFO][PID:3026397] Checking for cancel request [2025-10-20 14:59:48,960][ INFO][PID:3026397] Downloading results from builder [2025-10-20 14:59:48,960][ INFO][PID:3026397] rsyncing of mockbuilder@163.107.84.59:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1:pr:fork-music-rpms-python-trimesh-66/fedora-42-s390x/09705985-python-trimesh started [2025-10-20 14:59:48,961][ INFO][PID:3026397] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@163.107.84.59:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1:pr:fork-music-rpms-python-trimesh-66/fedora-42-s390x/09705985-python-trimesh/ &> /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1:pr:fork-music-rpms-python-trimesh-66/fedora-42-s390x/09705985-python-trimesh/build-09705985.rsync.log [2025-10-20 14:59:52,990][ INFO][PID:3026397] rsyncing finished. [2025-10-20 14:59:52,991][ INFO][PID:3026397] Releasing VM back to pool [2025-10-20 14:59:53,003][ INFO][PID:3026397] Searching for 'success' file in resultdir [2025-10-20 14:59:53,003][ ERROR][PID:3026397] Build failed: Backend process error: No success file => build failure [2025-10-20 14:59:53,004][ INFO][PID:3026397] Finished build: id=9705985 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1:pr:fork-music-rpms-python-trimesh-66 chroot=fedora-42-s390x [2025-10-20 14:59:53,005][ ERROR][PID:3026397] Backend process error: No success file => build failure [2025-10-20 14:59:53,006][ INFO][PID:3026397] Worker failed build, took 257.69580125808716 [2025-10-20 14:59:53,006][ INFO][PID:3026397] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "python3-scipy-1.10.1", "project_dirname": "python3-scipy-1.10.1:pr:fork-music-rpms-python-trimesh-66", "submitter": "https://src.fedoraproject.org/user/music", "ended_on": 1760972393.006385, "started_on": 1760972135.3105838, "submitted_on": null, "status": 0, "chroot": "fedora-42-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9705985-fedora-42-s390x", "build_id": 9705985, "package_name": "python-trimesh", "package_version": "4.8.3-2", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/python3-scipy-1.10.1:pr:fork-music-rpms-python-trimesh-66/python-trimesh", "git_hash": "38bcd9649c7ca849ad63582dc7a8aae3eb4d3d0d", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/python3-scipy-1.10.1--https://src.fedoraproject.org/user/music", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.10.1/fedora-42-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.10.1:pr:fork-music-rpms-python-trimesh-66/fedora-42-s390x/", "id": "copr_coprdir", "name": "Coprdir repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1:pr:fork-music-rpms-python-trimesh-66", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.10.1:pr:fork-music-rpms-python-trimesh-66", "result_dir": "09705985-python-trimesh", "built_packages": "", "id": 9705985, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "python3-scipy-1.10.1", "vendor": "Fedora Project COPR (psimovec/python3-scipy-1.10.1)" } } ] } [2025-10-20 14:59:53,046][ INFO][PID:3026397] Sending fedora-messaging bus message in build.end [2025-10-20 14:59:53,070][ INFO][PID:3026397] Compressing /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1:pr:fork-music-rpms-python-trimesh-66/fedora-42-s390x/09705985-python-trimesh/builder-live.log by gzip [2025-10-20 14:59:53,071][ INFO][PID:3026397] Running command 'gzip /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1:pr:fork-music-rpms-python-trimesh-66/fedora-42-s390x/09705985-python-trimesh/builder-live.log' as PID 3085224 [2025-10-20 14:59:53,081][ INFO][PID:3026397] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1:pr:fork-music-rpms-python-trimesh-66/fedora-42-s390x/09705985-python-trimesh/builder-live.log) [2025-10-20 14:59:53,082][ INFO][PID:3026397] Compressing /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1:pr:fork-music-rpms-python-trimesh-66/fedora-42-s390x/09705985-python-trimesh/backend.log by gzip [2025-10-20 14:59:53,083][ INFO][PID:3026397] Running command 'gzip /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1:pr:fork-music-rpms-python-trimesh-66/fedora-42-s390x/09705985-python-trimesh/backend.log' as PID 3085228