[2026-02-11 22:34:29,614][ INFO][PID:3133041] Marking build as starting [2026-02-11 22:34:29,674][ INFO][PID:3133041] Checking that /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x/repodata/repomd.xml exists [2026-02-11 22:34:29,676][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:34:29,676][ INFO][PID:3133041] VM allocation process starts [2026-02-11 22:34:29,691][ INFO][PID:3133041] Trying to allocate VM: ResallocHost, ticket_id=1283202, requested_tags=['copr_builder', 'arch_s390x'] [2026-02-11 22:34:32,706][ INFO][PID:3133041] Allocated host ResallocHost, ticket_id=1283202, hostname=13.120.89.142, name=copr_ic_s390x_eu_es_1_prod_02197966_20260211_222303, requested_tags=['copr_builder', 'arch_s390x'] [2026-02-11 22:34:32,707][ INFO][PID:3133041] Allocating ssh connection to builder [2026-02-11 22:34:32,707][ INFO][PID:3133041] Checking that builder machine is OK [2026-02-11 22:34:34,165][ INFO][PID:3133041] Running remote command: copr-builder-ready centos-stream-9-s390x [2026-02-11 22:34:35,441][ INFO][PID:3133041] Red Hat subscription not needed for centos-stream-9-s390x Builder is ready to be used [2026-02-11 22:34:36,331][ INFO][PID:3133041] Filling build.info file with builder info [2026-02-11 22:34:36,332][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:34:36,333][ INFO][PID:3133041] Sending build state back to frontend: { "builds": [ { "timeout": 90000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@fedora-llvm-team", "project_name": "clang-fedora-centos-testing", "project_dirname": "clang-fedora-centos-testing", "submitter": "tbaeder", "ended_on": null, "started_on": 1770849276.332963, "submitted_on": null, "status": 3, "chroot": "centos-stream-9-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "10116142-centos-stream-9-s390x", "build_id": 10116142, "package_name": "thunderbird", "package_version": "140.6.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/clang-fedora-centos-testing/thunderbird", "git_hash": "3889148882072380121bf113af61a7696f71dfb7", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@fedora-llvm-team/clang-fedora-centos-testing--tbaeder", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x/", "id": "copr_base", "name": "Copr repository", "priority": 1000 }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-compat-packages/centos-stream-9-s390x/", "id": "copr_fedora_llvm_team_llvm_compat_packages", "name": "Additional repo copr_fedora_llvm_team_llvm_compat_packages" }, { "baseurl": "https://kojihub.stream.centos.org/kojifiles/repos/c9s-build/latest/s390x/", "id": "https_kojihub_stream_centos_org_kojifiles_repos_c9s_build_latest_s390x", "name": "Additional repo https_kojihub_stream_centos_org_kojifiles_repos_c9s_build_latest_s390x" }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260205/centos-stream-9-s390x/", "id": "copr_fedora_llvm_team_llvm_snapshots_big_merge_20260205", "module_hotfixes": true, "name": "Additional repo copr_fedora_llvm_team_llvm_snapshots_big_merge_20260205" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": 1000, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-fedora-centos-testing", "result_dir": "10116142-thunderbird", "built_packages": "", "id": 10116142, "mockchain_macros": { "copr_username": "@fedora-llvm-team", "copr_projectname": "clang-fedora-centos-testing", "vendor": "Fedora Project COPR (@fedora-llvm-team/clang-fedora-centos-testing)" } } ] } [2026-02-11 22:34:36,378][ INFO][PID:3133041] Sending fedora-messaging bus message in build.start [2026-02-11 22:34:36,870][ INFO][PID:3133041] Sending fedora-messaging bus message in chroot.start [2026-02-11 22:34:36,898][ INFO][PID:3133041] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10116142-centos-stream-9-s390x --chroot centos-stream-9-s390x --detached [2026-02-11 22:34:38,264][ INFO][PID:3133041] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '13.120.89.142' (ED25519) to the list of known hosts. [2026-02-11 22:34:38,265][ INFO][PID:3133041] Downloading the builder-live.log file, attempt 1 [2026-02-11 22:34:38,266][ INFO][PID:3133041] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.120.89.142 copr-rpmbuild-log [2026-02-11 22:34:43,271][ INFO][PID:3133041] Periodic builder liveness probe: alive [2026-02-11 22:34:43,272][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:34:48,273][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:34:53,273][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:34:58,274][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:35:03,275][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:35:08,276][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:35:13,277][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:35:18,278][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:35:23,279][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:35:28,280][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:35:33,281][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:35:38,282][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:35:43,283][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:35:48,284][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:35:53,285][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:35:58,286][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:36:03,287][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:36:08,288][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:36:13,289][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:36:18,290][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:36:23,291][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:36:28,292][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:36:33,292][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:36:38,293][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:36:43,295][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:36:48,296][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:36:53,297][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:36:58,298][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:37:03,299][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:37:08,300][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:37:13,301][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:37:18,309][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:37:23,310][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:37:28,311][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:37:33,326][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:37:38,329][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:37:43,330][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:37:48,331][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:37:53,332][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:37:58,334][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:38:03,335][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:38:08,341][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:38:13,342][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:38:18,348][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:38:23,359][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:38:28,378][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:38:33,380][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:38:38,381][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:38:43,382][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:38:48,383][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:38:53,384][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:38:58,385][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:39:03,386][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:39:08,387][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:39:13,415][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:39:18,416][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:39:23,417][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:39:28,418][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:39:33,419][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:39:38,420][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:39:43,423][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:39:48,427][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:39:53,428][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:39:58,429][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:40:03,434][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:40:08,439][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:40:13,440][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:40:18,442][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:40:23,445][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:40:28,447][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:40:33,450][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:40:38,451][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:40:43,454][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:40:48,455][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:40:53,457][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:40:58,460][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:41:03,462][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:41:08,463][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:41:13,464][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:41:18,465][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:41:23,468][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:41:28,469][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:41:33,471][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:41:38,472][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:41:43,474][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:41:48,479][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:41:53,480][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:41:58,481][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:42:03,484][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:42:08,485][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:42:13,487][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:42:18,490][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:42:23,493][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:42:28,495][ INFO][PID:3133041] Checking for cancel request [2026-02-11 22:42:32,046][ INFO][PID:3133041] Downloading results from builder [2026-02-11 22:42:32,046][ INFO][PID:3133041] rsyncing of mockbuilder@13.120.89.142:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x/10116142-thunderbird started [2026-02-11 22:42:32,051][ INFO][PID:3133041] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@13.120.89.142:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x/10116142-thunderbird/ &> /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x/10116142-thunderbird/build-10116142.rsync.log [2026-02-11 22:43:19,484][ INFO][PID:3133041] rsyncing finished. [2026-02-11 22:43:19,490][ INFO][PID:3133041] Releasing VM back to pool [2026-02-11 22:43:19,503][ INFO][PID:3133041] Searching for 'success' file in resultdir [2026-02-11 22:43:19,505][ ERROR][PID:3133041] Build failed: Backend process error: No success file => build failure [2026-02-11 22:43:19,505][ INFO][PID:3133041] Finished build: id=10116142 failed=True timeout=90000 destdir=/var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing chroot=centos-stream-9-s390x [2026-02-11 22:43:19,507][ ERROR][PID:3133041] Backend process error: No success file => build failure [2026-02-11 22:43:19,508][ INFO][PID:3133041] Worker failed build, took 523.1754496097565 [2026-02-11 22:43:19,509][ INFO][PID:3133041] Sending build state back to frontend: { "builds": [ { "timeout": 90000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@fedora-llvm-team", "project_name": "clang-fedora-centos-testing", "project_dirname": "clang-fedora-centos-testing", "submitter": "tbaeder", "ended_on": 1770849799.5084126, "started_on": 1770849276.332963, "submitted_on": null, "status": 0, "chroot": "centos-stream-9-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "10116142-centos-stream-9-s390x", "build_id": 10116142, "package_name": "thunderbird", "package_version": "140.6.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/clang-fedora-centos-testing/thunderbird", "git_hash": "3889148882072380121bf113af61a7696f71dfb7", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@fedora-llvm-team/clang-fedora-centos-testing--tbaeder", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x/", "id": "copr_base", "name": "Copr repository", "priority": 1000 }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-compat-packages/centos-stream-9-s390x/", "id": "copr_fedora_llvm_team_llvm_compat_packages", "name": "Additional repo copr_fedora_llvm_team_llvm_compat_packages" }, { "baseurl": "https://kojihub.stream.centos.org/kojifiles/repos/c9s-build/latest/s390x/", "id": "https_kojihub_stream_centos_org_kojifiles_repos_c9s_build_latest_s390x", "name": "Additional repo https_kojihub_stream_centos_org_kojifiles_repos_c9s_build_latest_s390x" }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260205/centos-stream-9-s390x/", "id": "copr_fedora_llvm_team_llvm_snapshots_big_merge_20260205", "module_hotfixes": true, "name": "Additional repo copr_fedora_llvm_team_llvm_snapshots_big_merge_20260205" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": 1000, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-fedora-centos-testing", "result_dir": "10116142-thunderbird", "built_packages": "", "id": 10116142, "mockchain_macros": { "copr_username": "@fedora-llvm-team", "copr_projectname": "clang-fedora-centos-testing", "vendor": "Fedora Project COPR (@fedora-llvm-team/clang-fedora-centos-testing)" } } ] } [2026-02-11 22:43:19,569][ INFO][PID:3133041] Sending fedora-messaging bus message in build.end [2026-02-11 22:43:19,600][ INFO][PID:3133041] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x/10116142-thunderbird/builder-live.log by gzip [2026-02-11 22:43:19,601][ INFO][PID:3133041] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x/10116142-thunderbird/builder-live.log' as PID 3171185 [2026-02-11 22:43:19,653][ INFO][PID:3133041] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x/10116142-thunderbird/builder-live.log) [2026-02-11 22:43:19,654][ INFO][PID:3133041] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x/10116142-thunderbird/backend.log by gzip [2026-02-11 22:43:19,655][ INFO][PID:3133041] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x/10116142-thunderbird/backend.log' as PID 3171190