[2025-10-09 21:11:13,432][ INFO][PID:1479947] Marking build as starting [2025-10-09 21:11:13,569][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:11:13,571][ INFO][PID:1479947] VM allocation process starts [2025-10-09 21:11:13,596][ INFO][PID:1479947] Trying to allocate VM: ResallocHost, ticket_id=5585980, requested_tags=['copr_builder', 'arch_s390x'] [2025-10-09 21:11:18,597][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:11:19,652][ INFO][PID:1479947] Allocated host ResallocHost, ticket_id=5585980, hostname=13.122.90.7, name=copr_ic_s390x_eu_es_3_prod_07309834_20251009_205831, requested_tags=['copr_builder', 'arch_s390x'] [2025-10-09 21:11:19,653][ INFO][PID:1479947] Allocating ssh connection to builder [2025-10-09 21:11:19,653][ INFO][PID:1479947] Checking that builder machine is OK [2025-10-09 21:11:21,106][ INFO][PID:1479947] Running remote command: copr-builder-ready centos-stream-10-s390x [2025-10-09 21:11:22,395][ INFO][PID:1479947] Red Hat subscription not needed for centos-stream-10-s390x Builder is ready to be used [2025-10-09 21:11:22,396][ INFO][PID:1479947] Filling build.info file with builder info [2025-10-09 21:11:22,397][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:11:22,398][ INFO][PID:1479947] Sending build state back to frontend: { "builds": [ { "timeout": 90000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@fedora-llvm-team", "project_name": "clang-fedora-centos-testing", "project_dirname": "clang-fedora-centos-testing", "submitter": "tstellar", "ended_on": null, "started_on": 1760044282.3983877, "submitted_on": null, "status": 3, "chroot": "centos-stream-10-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9671494-centos-stream-10-s390x", "build_id": 9671494, "package_name": "fips-provider-next", "package_version": "1.2.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/clang-fedora-centos-testing/fips-provider-next", "git_hash": "1c999269456e1848ff4a06a705fee090fd45e867", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@fedora-llvm-team/clang-fedora-centos-testing--tstellar", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-10-s390x/", "id": "copr_base", "name": "Copr repository", "priority": 1000 }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-compat-packages/centos-stream-10-s390x/", "id": "copr_fedora_llvm_team_llvm_compat_packages", "name": "Additional repo copr_fedora_llvm_team_llvm_compat_packages" }, { "baseurl": "https://kojihub.stream.centos.org/kojifiles/repos/c10s-build/latest/s390x/", "id": "https_kojihub_stream_centos_org_kojifiles_repos_c10s_build_latest_s390x", "name": "Additional repo https_kojihub_stream_centos_org_kojifiles_repos_c10s_build_latest_s390x" }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251004/centos-stream-10-s390x/", "id": "copr_fedora_llvm_team_llvm_snapshots_big_merge_20251004", "module_hotfixes": true, "name": "Additional repo copr_fedora_llvm_team_llvm_snapshots_big_merge_20251004" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": 1000, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-fedora-centos-testing", "result_dir": "09671494-fips-provider-next", "built_packages": "", "id": 9671494, "mockchain_macros": { "copr_username": "@fedora-llvm-team", "copr_projectname": "clang-fedora-centos-testing", "vendor": "Fedora Project COPR (@fedora-llvm-team/clang-fedora-centos-testing)" } } ] } [2025-10-09 21:11:22,425][ INFO][PID:1479947] Sending fedora-messaging bus message in build.start [2025-10-09 21:11:23,273][ INFO][PID:1479947] Sending fedora-messaging bus message in chroot.start [2025-10-09 21:11:23,301][ INFO][PID:1479947] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9671494-centos-stream-10-s390x --chroot centos-stream-10-s390x --detached [2025-10-09 21:11:24,694][ INFO][PID:1479947] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '13.122.90.7' (ED25519) to the list of known hosts. [2025-10-09 21:11:24,695][ INFO][PID:1479947] Downloading the builder-live.log file, attempt 1 [2025-10-09 21:11:24,698][ INFO][PID:1479947] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.122.90.7 copr-rpmbuild-log [2025-10-09 21:11:29,704][ INFO][PID:1479947] Periodic builder liveness probe: alive [2025-10-09 21:11:29,706][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:11:34,707][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:11:39,710][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:11:44,712][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:11:49,715][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:11:54,718][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:11:59,720][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:12:04,721][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:12:09,723][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:12:14,724][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:12:19,726][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:12:24,728][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:12:29,730][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:12:34,731][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:12:39,732][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:12:44,733][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:12:49,734][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:12:54,736][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:12:59,739][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:13:04,741][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:13:09,743][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:13:14,745][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:13:19,747][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:13:24,748][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:13:29,752][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:13:34,753][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:13:39,754][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:13:44,755][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:13:49,756][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:13:54,758][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:13:59,760][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:14:04,760][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:14:09,763][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:14:14,764][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:14:19,766][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:14:24,767][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:14:29,770][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:14:34,773][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:14:39,775][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:14:44,777][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:14:49,778][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:14:54,781][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:14:59,782][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:15:04,783][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:15:09,785][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:15:14,787][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:15:19,788][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:15:24,789][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:15:29,791][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:15:34,792][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:15:39,793][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:15:44,794][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:15:49,795][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:15:54,797][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:15:59,800][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:16:04,802][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:16:09,803][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:16:14,805][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:16:19,807][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:16:24,810][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:16:29,811][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:16:34,813][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:16:39,814][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:16:44,815][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:16:49,817][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:16:54,818][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:16:59,819][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:17:04,827][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:17:09,828][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:17:14,829][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:17:19,831][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:17:24,832][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:17:29,833][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:17:34,834][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:17:39,836][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:17:44,837][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:17:49,838][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:17:54,839][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:17:59,840][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:18:04,841][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:18:09,842][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:18:14,843][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:18:19,844][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:18:24,845][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:18:29,846][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:18:34,847][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:18:39,848][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:18:44,849][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:18:49,850][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:18:54,851][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:18:59,852][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:19:04,853][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:19:09,854][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:19:14,854][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:19:19,855][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:19:24,856][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:19:29,857][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:19:34,858][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:19:39,859][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:19:44,860][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:19:49,861][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:19:54,861][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:19:59,862][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:20:04,863][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:20:09,864][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:20:14,865][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:20:19,866][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:20:24,867][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:20:29,868][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:20:34,869][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:20:39,869][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:20:44,870][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:20:49,871][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:20:54,872][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:20:59,873][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:21:04,874][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:21:09,875][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:21:14,876][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:21:19,877][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:21:24,877][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:21:29,884][ INFO][PID:1479947] Periodic builder liveness probe: alive [2025-10-09 21:21:29,885][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:21:34,886][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:21:39,887][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:21:44,888][ INFO][PID:1479947] Checking for cancel request [2025-10-09 21:21:49,763][ INFO][PID:1479947] Downloading results from builder [2025-10-09 21:21:49,763][ INFO][PID:1479947] rsyncing of mockbuilder@13.122.90.7:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-10-s390x/09671494-fips-provider-next started [2025-10-09 21:21:49,764][ INFO][PID:1479947] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@13.122.90.7:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-10-s390x/09671494-fips-provider-next/ &> /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-10-s390x/09671494-fips-provider-next/build-09671494.rsync.log [2025-10-09 21:21:56,833][ INFO][PID:1479947] rsyncing finished. [2025-10-09 21:21:56,833][ INFO][PID:1479947] Releasing VM back to pool [2025-10-09 21:21:56,842][ INFO][PID:1479947] Searching for 'success' file in resultdir [2025-10-09 21:21:56,843][ ERROR][PID:1479947] Build failed: Backend process error: No success file => build failure [2025-10-09 21:21:56,843][ INFO][PID:1479947] Finished build: id=9671494 failed=True timeout=90000 destdir=/var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing chroot=centos-stream-10-s390x [2025-10-09 21:21:56,845][ ERROR][PID:1479947] Backend process error: No success file => build failure [2025-10-09 21:21:56,845][ INFO][PID:1479947] Worker failed build, took 634.4470973014832 [2025-10-09 21:21:56,846][ INFO][PID:1479947] Sending build state back to frontend: { "builds": [ { "timeout": 90000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@fedora-llvm-team", "project_name": "clang-fedora-centos-testing", "project_dirname": "clang-fedora-centos-testing", "submitter": "tstellar", "ended_on": 1760044916.845485, "started_on": 1760044282.3983877, "submitted_on": null, "status": 0, "chroot": "centos-stream-10-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9671494-centos-stream-10-s390x", "build_id": 9671494, "package_name": "fips-provider-next", "package_version": "1.2.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/clang-fedora-centos-testing/fips-provider-next", "git_hash": "1c999269456e1848ff4a06a705fee090fd45e867", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@fedora-llvm-team/clang-fedora-centos-testing--tstellar", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-10-s390x/", "id": "copr_base", "name": "Copr repository", "priority": 1000 }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-compat-packages/centos-stream-10-s390x/", "id": "copr_fedora_llvm_team_llvm_compat_packages", "name": "Additional repo copr_fedora_llvm_team_llvm_compat_packages" }, { "baseurl": "https://kojihub.stream.centos.org/kojifiles/repos/c10s-build/latest/s390x/", "id": "https_kojihub_stream_centos_org_kojifiles_repos_c10s_build_latest_s390x", "name": "Additional repo https_kojihub_stream_centos_org_kojifiles_repos_c10s_build_latest_s390x" }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251004/centos-stream-10-s390x/", "id": "copr_fedora_llvm_team_llvm_snapshots_big_merge_20251004", "module_hotfixes": true, "name": "Additional repo copr_fedora_llvm_team_llvm_snapshots_big_merge_20251004" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": 1000, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-fedora-centos-testing", "result_dir": "09671494-fips-provider-next", "built_packages": "", "id": 9671494, "mockchain_macros": { "copr_username": "@fedora-llvm-team", "copr_projectname": "clang-fedora-centos-testing", "vendor": "Fedora Project COPR (@fedora-llvm-team/clang-fedora-centos-testing)" } } ] } [2025-10-09 21:21:56,869][ INFO][PID:1479947] Sending fedora-messaging bus message in build.end [2025-10-09 21:21:56,892][ INFO][PID:1479947] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-10-s390x/09671494-fips-provider-next/builder-live.log by gzip [2025-10-09 21:21:56,894][ INFO][PID:1479947] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-10-s390x/09671494-fips-provider-next/builder-live.log' as PID 1536615 [2025-10-09 21:21:56,937][ INFO][PID:1479947] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-10-s390x/09671494-fips-provider-next/builder-live.log) [2025-10-09 21:21:56,937][ INFO][PID:1479947] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-10-s390x/09671494-fips-provider-next/backend.log by gzip [2025-10-09 21:21:56,938][ INFO][PID:1479947] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-10-s390x/09671494-fips-provider-next/backend.log' as PID 1536617