[2025-10-17 02:24:08,099][ INFO][PID:2784411] Marking build as starting [2025-10-17 02:24:08,126][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:24:08,129][ INFO][PID:2784411] VM allocation process starts [2025-10-17 02:24:08,149][ INFO][PID:2784411] Trying to allocate VM: ResallocHost, ticket_id=5701176, requested_tags=['copr_builder', 'arch_s390x'] [2025-10-17 02:24:13,152][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:24:18,154][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:24:23,155][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:24:28,160][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:24:33,161][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:24:38,163][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:24:43,174][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:24:48,175][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:24:53,195][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:24:58,214][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:25:03,215][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:25:08,250][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:25:13,301][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:25:18,340][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:25:23,363][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:25:28,391][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:25:33,403][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:25:38,443][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:25:43,468][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:25:48,494][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:25:53,508][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:25:58,511][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:26:03,553][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:26:08,556][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:26:13,759][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:26:18,902][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:26:24,073][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:26:29,093][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:26:34,141][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:26:39,152][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:26:44,158][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:26:49,167][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:26:54,193][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:26:59,208][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:27:04,220][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:27:09,226][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:27:14,251][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:27:19,276][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:27:24,297][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:27:29,304][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:27:34,318][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:27:39,328][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:27:44,329][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:27:49,331][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:27:54,333][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:27:59,336][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:28:04,339][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:28:09,342][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:28:14,347][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:28:19,350][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:28:24,353][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:28:29,356][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:28:34,358][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:28:39,363][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:28:44,365][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:28:49,369][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:28:54,372][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:28:59,377][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:29:04,388][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:29:09,391][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:29:14,394][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:29:19,404][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:29:24,420][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:29:26,362][ INFO][PID:2784411] Allocated host ResallocHost, ticket_id=5701176, hostname=13.116.82.171, name=copr_ic_s390x_br_sao_1_prod_07434948_20251017_022526, requested_tags=['copr_builder', 'arch_s390x'] [2025-10-17 02:29:26,364][ INFO][PID:2784411] Allocating ssh connection to builder [2025-10-17 02:29:26,365][ INFO][PID:2784411] Checking that builder machine is OK [2025-10-17 02:29:28,141][ INFO][PID:2784411] Running remote command: copr-builder-ready centos-stream-9-s390x [2025-10-17 02:29:29,770][ INFO][PID:2784411] Red Hat subscription not needed for centos-stream-9-s390x Builder is ready to be used [2025-10-17 02:29:29,771][ INFO][PID:2784411] Filling build.info file with builder info [2025-10-17 02:29:29,772][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:29:29,773][ INFO][PID:2784411] Sending build state back to frontend: { "builds": [ { "timeout": 108000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "@fedora-llvm-team", "project_name": "llvm-snapshots-big-merge-20251017", "project_dirname": "llvm-snapshots-big-merge-20251017", "submitter": "kkleine", "ended_on": null, "started_on": 1760668169.773104, "submitted_on": null, "status": 3, "chroot": "centos-stream-9-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9696974-centos-stream-9-s390x", "build_id": 9696974, "package_name": "llvm", "package_version": "21.1.3-4", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/llvm-snapshots-big-merge-20251017/llvm", "git_hash": "9e4a58317513632a70957372a5da2c114261668a", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@fedora-llvm-team/llvm-snapshots-big-merge-20251017--kkleine", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251017/centos-stream-9-s390x/", "id": "copr_base", "module_hotfixes": true, "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-test-suite/centos-stream-9-s390x/", "id": "copr_fedora_llvm_team_llvm_test_suite", "name": "Additional repo copr_fedora_llvm_team_llvm_test_suite" } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [ "snapshot_build" ], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251017", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251017", "result_dir": "09696974-llvm", "built_packages": "", "id": 9696974, "mockchain_macros": { "copr_username": "@fedora-llvm-team", "copr_projectname": "llvm-snapshots-big-merge-20251017", "vendor": "Fedora Project COPR (@fedora-llvm-team/llvm-snapshots-big-merge-20251017)" } } ] } [2025-10-17 02:29:29,803][ INFO][PID:2784411] Sending fedora-messaging bus message in build.start [2025-10-17 02:29:30,674][ INFO][PID:2784411] Sending fedora-messaging bus message in chroot.start [2025-10-17 02:29:30,707][ INFO][PID:2784411] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9696974-centos-stream-9-s390x --chroot centos-stream-9-s390x --detached [2025-10-17 02:29:32,510][ INFO][PID:2784411] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '13.116.82.171' (ED25519) to the list of known hosts. [2025-10-17 02:29:32,511][ INFO][PID:2784411] Downloading the builder-live.log file, attempt 1 [2025-10-17 02:29:32,512][ INFO][PID:2784411] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.116.82.171 copr-rpmbuild-log [2025-10-17 02:29:37,526][ INFO][PID:2784411] Periodic builder liveness probe: alive [2025-10-17 02:29:37,527][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:29:42,529][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:29:47,532][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:29:52,534][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:29:57,535][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:30:02,539][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:30:07,547][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:30:12,552][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:30:17,556][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:30:22,558][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:30:27,562][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:30:32,564][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:30:37,566][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:30:42,568][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:30:47,575][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:30:52,576][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:30:57,581][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:31:02,585][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:31:07,588][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:31:12,591][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:31:17,592][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:31:22,594][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:31:27,598][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:31:32,600][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:31:37,606][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:31:42,607][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:31:47,609][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:31:52,611][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:31:57,617][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:32:02,623][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:32:07,624][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:32:12,626][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:32:17,628][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:32:22,630][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:32:27,631][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:32:32,633][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:32:37,635][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:32:42,637][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:32:47,638][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:32:52,639][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:32:57,640][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:33:02,642][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:33:07,643][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:33:12,647][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:33:17,649][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:33:22,650][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:33:27,651][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:33:32,652][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:33:37,654][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:33:42,656][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:33:47,658][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:33:52,664][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:33:57,665][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:34:02,666][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:34:07,671][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:34:12,672][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:34:17,673][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:34:22,674][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:34:27,676][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:34:32,677][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:34:37,678][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:34:42,680][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:34:47,682][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:34:52,684][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:34:57,685][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:35:02,686][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:35:07,692][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:35:12,695][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:35:17,697][ INFO][PID:2784411] Checking for cancel request [2025-10-17 02:35:21,127][ INFO][PID:2784411] Downloading results from builder [2025-10-17 02:35:21,128][ INFO][PID:2784411] rsyncing of mockbuilder@13.116.82.171:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251017/centos-stream-9-s390x/09696974-llvm started [2025-10-17 02:35:21,129][ INFO][PID:2784411] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@13.116.82.171:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251017/centos-stream-9-s390x/09696974-llvm/ &> /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251017/centos-stream-9-s390x/09696974-llvm/build-09696974.rsync.log [2025-10-17 02:35:39,814][ INFO][PID:2784411] rsyncing finished. [2025-10-17 02:35:39,815][ INFO][PID:2784411] Releasing VM back to pool [2025-10-17 02:35:39,829][ INFO][PID:2784411] Searching for 'success' file in resultdir [2025-10-17 02:35:39,830][ ERROR][PID:2784411] Build failed: Backend process error: No success file => build failure [2025-10-17 02:35:39,831][ INFO][PID:2784411] Finished build: id=9696974 failed=True timeout=108000 destdir=/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251017 chroot=centos-stream-9-s390x [2025-10-17 02:35:39,833][ ERROR][PID:2784411] Backend process error: No success file => build failure [2025-10-17 02:35:39,833][ INFO][PID:2784411] Worker failed build, took 370.0606379508972 [2025-10-17 02:35:39,834][ INFO][PID:2784411] Sending build state back to frontend: { "builds": [ { "timeout": 108000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "@fedora-llvm-team", "project_name": "llvm-snapshots-big-merge-20251017", "project_dirname": "llvm-snapshots-big-merge-20251017", "submitter": "kkleine", "ended_on": 1760668539.833742, "started_on": 1760668169.773104, "submitted_on": null, "status": 0, "chroot": "centos-stream-9-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9696974-centos-stream-9-s390x", "build_id": 9696974, "package_name": "llvm", "package_version": "21.1.3-4", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/llvm-snapshots-big-merge-20251017/llvm", "git_hash": "9e4a58317513632a70957372a5da2c114261668a", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@fedora-llvm-team/llvm-snapshots-big-merge-20251017--kkleine", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251017/centos-stream-9-s390x/", "id": "copr_base", "module_hotfixes": true, "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-test-suite/centos-stream-9-s390x/", "id": "copr_fedora_llvm_team_llvm_test_suite", "name": "Additional repo copr_fedora_llvm_team_llvm_test_suite" } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [ "snapshot_build" ], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251017", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251017", "result_dir": "09696974-llvm", "built_packages": "", "id": 9696974, "mockchain_macros": { "copr_username": "@fedora-llvm-team", "copr_projectname": "llvm-snapshots-big-merge-20251017", "vendor": "Fedora Project COPR (@fedora-llvm-team/llvm-snapshots-big-merge-20251017)" } } ] } [2025-10-17 02:35:39,975][ INFO][PID:2784411] Sending fedora-messaging bus message in build.end [2025-10-17 02:35:40,059][ INFO][PID:2784411] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251017/centos-stream-9-s390x/09696974-llvm/builder-live.log by gzip [2025-10-17 02:35:40,060][ INFO][PID:2784411] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251017/centos-stream-9-s390x/09696974-llvm/builder-live.log' as PID 2868742 [2025-10-17 02:35:40,076][ INFO][PID:2784411] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251017/centos-stream-9-s390x/09696974-llvm/builder-live.log) [2025-10-17 02:35:40,077][ INFO][PID:2784411] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251017/centos-stream-9-s390x/09696974-llvm/backend.log by gzip [2025-10-17 02:35:40,078][ INFO][PID:2784411] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251017/centos-stream-9-s390x/09696974-llvm/backend.log' as PID 2868743