[2025-10-31 18:08:47,890][ INFO][PID:2239435] Marking build as starting [2025-10-31 18:08:47,934][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:08:47,936][ INFO][PID:2239435] VM allocation process starts [2025-10-31 18:08:47,963][ INFO][PID:2239435] Trying to allocate VM: ResallocHost, ticket_id=5954600, requested_tags=['copr_builder', 'arch_s390x'] [2025-10-31 18:08:51,008][ INFO][PID:2239435] Allocated host ResallocHost, ticket_id=5954600, hostname=13.121.85.98, name=copr_ic_s390x_eu_es_2_prod_07759075_20251031_172509, requested_tags=['copr_builder', 'arch_s390x'] [2025-10-31 18:08:51,009][ INFO][PID:2239435] Allocating ssh connection to builder [2025-10-31 18:08:51,010][ INFO][PID:2239435] Checking that builder machine is OK [2025-10-31 18:08:52,535][ INFO][PID:2239435] Running remote command: copr-builder-ready fedora-rawhide-s390x [2025-10-31 18:08:53,914][ INFO][PID:2239435] Red Hat subscription not needed for fedora-rawhide-s390x Builder is ready to be used [2025-10-31 18:08:53,916][ INFO][PID:2239435] Filling build.info file with builder info [2025-10-31 18:08:53,919][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:08:53,935][ INFO][PID:2239435] Sending build state back to frontend: { "builds": [ { "timeout": 90000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@fedora-llvm-team", "project_name": "clang-fedora-centos-testing", "project_dirname": "clang-fedora-centos-testing", "submitter": "tstellar", "ended_on": null, "started_on": 1761934133.9354353, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9750711-fedora-rawhide-s390x", "build_id": 9750711, "package_name": "cosmic-osd", "package_version": "1.0.0~beta.3-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/clang-fedora-centos-testing/cosmic-osd", "git_hash": "3fc97e01b217e941114d1ac39cde30944c8cab66", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@fedora-llvm-team/clang-fedora-centos-testing--tstellar", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-fedora-centos-testing/fedora-rawhide-s390x/", "id": "copr_base", "name": "Copr repository", "priority": 1000 }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-compat-packages/fedora-rawhide-s390x/", "id": "copr_fedora_llvm_team_llvm_compat_packages", "name": "Additional repo copr_fedora_llvm_team_llvm_compat_packages" }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251030/fedora-rawhide-s390x/", "id": "copr_fedora_llvm_team_llvm_snapshots_big_merge_20251030", "module_hotfixes": true, "name": "Additional repo copr_fedora_llvm_team_llvm_snapshots_big_merge_20251030" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": 1000, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-fedora-centos-testing", "result_dir": "09750711-cosmic-osd", "built_packages": "", "id": 9750711, "mockchain_macros": { "copr_username": "@fedora-llvm-team", "copr_projectname": "clang-fedora-centos-testing", "vendor": "Fedora Project COPR (@fedora-llvm-team/clang-fedora-centos-testing)" } } ] } [2025-10-31 18:08:53,973][ INFO][PID:2239435] Sending fedora-messaging bus message in build.start [2025-10-31 18:08:54,940][ INFO][PID:2239435] Sending fedora-messaging bus message in chroot.start [2025-10-31 18:08:54,972][ INFO][PID:2239435] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9750711-fedora-rawhide-s390x --chroot fedora-rawhide-s390x --detached [2025-10-31 18:08:56,447][ INFO][PID:2239435] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '13.121.85.98' (ED25519) to the list of known hosts. [2025-10-31 18:08:56,450][ INFO][PID:2239435] Downloading the builder-live.log file, attempt 1 [2025-10-31 18:08:56,451][ INFO][PID:2239435] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.121.85.98 copr-rpmbuild-log [2025-10-31 18:09:01,467][ INFO][PID:2239435] Periodic builder liveness probe: alive [2025-10-31 18:09:01,467][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:09:06,473][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:09:11,478][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:09:16,482][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:09:21,490][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:09:26,491][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:09:31,493][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:09:36,498][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:09:41,502][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:09:46,506][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:09:51,510][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:09:56,514][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:10:01,516][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:10:06,518][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:10:11,521][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:10:16,523][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:10:21,524][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:10:26,526][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:10:31,528][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:10:36,532][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:10:41,533][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:10:46,538][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:10:51,540][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:10:56,542][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:11:01,546][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:11:06,551][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:11:11,553][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:11:16,556][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:11:21,557][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:11:26,559][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:11:31,560][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:11:36,561][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:11:41,561][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:11:46,564][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:11:51,565][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:11:56,566][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:12:01,567][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:12:06,568][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:12:11,569][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:12:16,570][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:12:21,571][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:12:26,572][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:12:31,573][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:12:36,574][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:12:41,575][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:12:46,577][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:12:51,579][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:12:56,580][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:13:01,581][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:13:06,584][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:13:11,585][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:13:16,588][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:13:21,590][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:13:26,591][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:13:31,593][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:13:36,594][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:13:41,595][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:13:46,596][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:13:51,597][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:13:56,598][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:14:01,599][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:14:06,601][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:14:11,602][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:14:16,603][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:14:21,604][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:14:26,605][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:14:31,606][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:14:36,607][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:14:41,609][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:14:46,610][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:14:51,612][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:14:56,613][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:15:01,614][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:15:06,615][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:15:11,616][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:15:16,617][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:15:21,619][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:15:26,620][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:15:31,621][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:15:36,623][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:15:41,624][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:15:46,625][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:15:51,626][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:15:56,629][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:16:01,630][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:16:06,631][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:16:11,638][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:16:16,639][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:16:21,640][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:16:26,641][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:16:31,643][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:16:36,644][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:16:41,645][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:16:46,646][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:16:51,647][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:16:56,648][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:17:01,652][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:17:06,654][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:17:11,656][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:17:16,657][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:17:21,658][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:17:26,659][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:17:31,660][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:17:36,661][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:17:41,662][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:17:46,663][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:17:51,664][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:17:56,665][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:18:01,666][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:18:06,668][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:18:11,669][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:18:16,669][ INFO][PID:2239435] Checking for cancel request [2025-10-31 18:18:21,438][ INFO][PID:2239435] Downloading results from builder [2025-10-31 18:18:21,439][ INFO][PID:2239435] rsyncing of mockbuilder@13.121.85.98:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/fedora-rawhide-s390x/09750711-cosmic-osd started [2025-10-31 18:18:21,440][ INFO][PID:2239435] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@13.121.85.98:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/fedora-rawhide-s390x/09750711-cosmic-osd/ &> /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/fedora-rawhide-s390x/09750711-cosmic-osd/build-09750711.rsync.log [2025-10-31 18:18:30,847][ INFO][PID:2239435] rsyncing finished. [2025-10-31 18:18:30,847][ INFO][PID:2239435] Releasing VM back to pool [2025-10-31 18:18:30,902][ INFO][PID:2239435] Searching for 'success' file in resultdir [2025-10-31 18:18:30,902][ ERROR][PID:2239435] Build failed: Backend process error: No success file => build failure [2025-10-31 18:18:30,903][ INFO][PID:2239435] Finished build: id=9750711 failed=True timeout=90000 destdir=/var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing chroot=fedora-rawhide-s390x [2025-10-31 18:18:30,905][ ERROR][PID:2239435] Backend process error: No success file => build failure [2025-10-31 18:18:30,905][ INFO][PID:2239435] Worker failed build, took 576.9703903198242 [2025-10-31 18:18:30,906][ INFO][PID:2239435] Sending build state back to frontend: { "builds": [ { "timeout": 90000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@fedora-llvm-team", "project_name": "clang-fedora-centos-testing", "project_dirname": "clang-fedora-centos-testing", "submitter": "tstellar", "ended_on": 1761934710.9058256, "started_on": 1761934133.9354353, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9750711-fedora-rawhide-s390x", "build_id": 9750711, "package_name": "cosmic-osd", "package_version": "1.0.0~beta.3-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/clang-fedora-centos-testing/cosmic-osd", "git_hash": "3fc97e01b217e941114d1ac39cde30944c8cab66", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@fedora-llvm-team/clang-fedora-centos-testing--tstellar", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-fedora-centos-testing/fedora-rawhide-s390x/", "id": "copr_base", "name": "Copr repository", "priority": 1000 }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-compat-packages/fedora-rawhide-s390x/", "id": "copr_fedora_llvm_team_llvm_compat_packages", "name": "Additional repo copr_fedora_llvm_team_llvm_compat_packages" }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251030/fedora-rawhide-s390x/", "id": "copr_fedora_llvm_team_llvm_snapshots_big_merge_20251030", "module_hotfixes": true, "name": "Additional repo copr_fedora_llvm_team_llvm_snapshots_big_merge_20251030" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": 1000, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-fedora-centos-testing", "result_dir": "09750711-cosmic-osd", "built_packages": "", "id": 9750711, "mockchain_macros": { "copr_username": "@fedora-llvm-team", "copr_projectname": "clang-fedora-centos-testing", "vendor": "Fedora Project COPR (@fedora-llvm-team/clang-fedora-centos-testing)" } } ] } [2025-10-31 18:18:30,931][ INFO][PID:2239435] Sending fedora-messaging bus message in build.end [2025-10-31 18:18:30,955][ INFO][PID:2239435] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/fedora-rawhide-s390x/09750711-cosmic-osd/builder-live.log by gzip [2025-10-31 18:18:30,956][ INFO][PID:2239435] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/fedora-rawhide-s390x/09750711-cosmic-osd/builder-live.log' as PID 2298412 [2025-10-31 18:18:30,977][ INFO][PID:2239435] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/fedora-rawhide-s390x/09750711-cosmic-osd/builder-live.log) [2025-10-31 18:18:30,978][ INFO][PID:2239435] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/fedora-rawhide-s390x/09750711-cosmic-osd/backend.log by gzip [2025-10-31 18:18:30,979][ INFO][PID:2239435] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/fedora-rawhide-s390x/09750711-cosmic-osd/backend.log' as PID 2298414