[2026-09-04 19:24:28,365][ INFO][PID:1468781] Marking build as starting [2026-09-04 19:24:28,479][ INFO][PID:1468781] Checking that /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/repodata/repomd.xml exists [2026-09-04 19:24:28,479][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:24:28,481][ INFO][PID:1468781] rpmeta: no HW info for arch s390x, skipping [2026-09-04 19:24:28,481][ INFO][PID:1468781] VM allocation process starts [2026-09-04 19:24:28,486][ INFO][PID:1468781] Trying to allocate VM: ResallocHost, ticket_id=4851577, requested_tags=['arch_s390x', 'copr_builder'] [2026-09-04 19:24:33,487][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:24:38,488][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:24:43,489][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:24:48,490][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:24:53,491][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:24:58,492][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:25:03,493][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:25:08,494][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:25:13,495][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:25:18,495][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:25:23,496][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:25:28,497][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:25:33,498][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:25:38,499][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:25:43,499][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:25:48,500][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:25:53,501][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:25:58,501][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:26:03,502][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:26:08,503][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:26:13,504][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:26:18,505][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:26:23,506][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:26:28,506][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:26:33,507][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:26:38,508][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:26:43,509][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:26:48,510][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:26:53,510][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:26:58,511][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:27:03,512][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:27:08,513][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:27:13,514][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:27:18,514][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:27:23,515][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:27:28,516][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:27:33,517][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:27:38,518][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:27:43,519][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:27:46,573][ INFO][PID:1468781] Allocated host ResallocHost, ticket_id=4851577, hostname=163.107.90.249, name=copr_ic_s390x_br_sao_2_prod_27644522_20260904_191631, requested_tags=['arch_s390x', 'copr_builder'] [2026-09-04 19:27:46,573][ INFO][PID:1468781] Allocating ssh connection to builder [2026-09-04 19:27:46,574][ INFO][PID:1468781] Checking that builder machine is OK [2026-09-04 19:27:48,093][ INFO][PID:1468781] Installed copr-rpmbuild version: 1.9 [2026-09-04 19:27:48,094][ INFO][PID:1468781] Running remote command: copr-builder-ready fedora-rawhide-s390x [2026-09-04 19:27:49,594][ INFO][PID:1468781] Red Hat subscription not needed for fedora-rawhide-s390x Builder is ready to be used [2026-09-04 19:27:49,595][ INFO][PID:1468781] Filling build.info file with builder info [2026-09-04 19:27:49,595][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:27:49,596][ INFO][PID:1468781] Sending build state back to frontend: { "builds": [ { "timeout": 90000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@fedora-llvm-team", "project_name": "clang-monthly-fedora-rebuild", "project_dirname": "clang-monthly-fedora-rebuild", "submitter": "kkleine", "ended_on": null, "started_on": 1788550069.5960548, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-s390x", "arch": "s390x", "buildroot_pkgs": [ "fedora-clang-default-cc" ], "task_id": "10930040-fedora-rawhide-s390x", "build_id": 10930040, "package_name": "freeze", "package_version": "2.5.0-44", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/clang-monthly-fedora-rebuild/freeze", "git_hash": "09e1705abef4bee50d782798b332349cf4fa960f", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@fedora-llvm-team/clang-monthly-fedora-rebuild--kkleine", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null, "repo_gpgcheck": false }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/tstellar/fedora-clang-default-cc/fedora-rawhide-s390x/", "id": "copr_tstellar_fedora_clang_default_cc", "name": "Additional repo copr_tstellar_fedora_clang_default_cc", "repo_gpgcheck": false }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260827/fedora-rawhide-s390x/", "id": "copr_fedora_llvm_team_llvm_snapshots_big_merge_20260827", "module_hotfixes": true, "name": "Additional repo copr_fedora_llvm_team_llvm_snapshots_big_merge_20260827", "repo_gpgcheck": false } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [ "toolchain_clang", "clang_lto" ], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-monthly-fedora-rebuild", "result_dir": "10930040-freeze", "built_packages": "", "rpmeta_prediction": null, "id": 10930040, "mockchain_macros": { "copr_username": "@fedora-llvm-team", "copr_projectname": "clang-monthly-fedora-rebuild", "vendor": "Fedora Project COPR (@fedora-llvm-team/clang-monthly-fedora-rebuild)" } } ] } [2026-09-04 19:27:49,628][ INFO][PID:1468781] Sending fedora-messaging bus message in build.start [2026-09-04 19:27:49,968][ INFO][PID:1468781] Sending fedora-messaging bus message in chroot.start [2026-09-04 19:27:49,986][ INFO][PID:1468781] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10930040-fedora-rawhide-s390x --chroot fedora-rawhide-s390x --detached [2026-09-04 19:27:51,786][ INFO][PID:1468781] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '163.107.90.249' (ED25519) to the list of known hosts. [2026-09-04 19:27:51,787][ INFO][PID:1468781] Downloading the builder-live.log file, attempt 1 [2026-09-04 19:27:51,788][ INFO][PID:1468781] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@163.107.90.249 copr-rpmbuild-log [2026-09-04 19:27:56,792][ INFO][PID:1468781] Periodic builder liveness probe: alive [2026-09-04 19:27:56,792][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:28:01,793][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:28:06,794][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:28:11,794][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:28:16,795][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:28:21,796][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:28:26,797][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:28:31,798][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:28:36,799][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:28:41,800][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:28:46,800][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:28:51,801][ INFO][PID:1468781] Checking for cancel request [2026-09-04 19:28:52,616][ INFO][PID:1468781] Downloading results from builder [2026-09-04 19:28:52,616][ INFO][PID:1468781] rsyncing of mockbuilder@163.107.90.249:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10930040-freeze started [2026-09-04 19:28:52,617][ INFO][PID:1468781] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@163.107.90.249:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10930040-freeze/ &> /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10930040-freeze/build-10930040.rsync.log [2026-09-04 19:28:55,428][ INFO][PID:1468781] rsyncing finished. [2026-09-04 19:28:55,428][ INFO][PID:1468781] VM Release request [2026-09-04 19:28:55,433][ INFO][PID:1468781] Searching for 'success' file in resultdir [2026-09-04 19:28:55,433][ INFO][PID:1468781] Going to sign pkgs from source: 10930040-fedora-rawhide-s390x in chroot: /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x [2026-09-04 19:28:55,434][ INFO][PID:1468781] Calling '/bin/sign -u @fedora-llvm-team#clang-monthly-fedora-rebuild@copr.fedorahosted.org -p' (attempt #1) [2026-09-04 19:28:55,627][ INFO][PID:1468781] Calling '/bin/sign -4 -h sha256 -u @fedora-llvm-team#clang-monthly-fedora-rebuild@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10930040-freeze/freeze-debugsource-2.5.0-44.fc46.s390x.rpm' (attempt #1) [2026-09-04 19:28:56,477][ INFO][PID:1468781] signed rpm: /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10930040-freeze/freeze-debugsource-2.5.0-44.fc46.s390x.rpm [2026-09-04 19:28:56,477][ INFO][PID:1468781] Calling '/bin/sign -4 -h sha256 -u @fedora-llvm-team#clang-monthly-fedora-rebuild@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10930040-freeze/freeze-2.5.0-44.fc46.src.rpm' (attempt #1) [2026-09-04 19:28:57,335][ INFO][PID:1468781] signed rpm: /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10930040-freeze/freeze-2.5.0-44.fc46.src.rpm [2026-09-04 19:28:57,336][ INFO][PID:1468781] Calling '/bin/sign -4 -h sha256 -u @fedora-llvm-team#clang-monthly-fedora-rebuild@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10930040-freeze/freeze-debuginfo-2.5.0-44.fc46.s390x.rpm' (attempt #1) [2026-09-04 19:28:58,181][ INFO][PID:1468781] signed rpm: /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10930040-freeze/freeze-debuginfo-2.5.0-44.fc46.s390x.rpm [2026-09-04 19:28:58,181][ INFO][PID:1468781] Calling '/bin/sign -4 -h sha256 -u @fedora-llvm-team#clang-monthly-fedora-rebuild@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10930040-freeze/freeze-2.5.0-44.fc46.s390x.rpm' (attempt #1) [2026-09-04 19:28:59,029][ INFO][PID:1468781] signed rpm: /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10930040-freeze/freeze-2.5.0-44.fc46.s390x.rpm [2026-09-04 19:28:59,030][ INFO][PID:1468781] Sign done [2026-09-04 19:28:59,030][ INFO][PID:1468781] Incremental createrepo run, adding 10930040-freeze into https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x, (auto-create-repo=True) [2026-09-04 19:28:59,031][ INFO][PID:1468781] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x --add 10930040-freeze --no-appstream-metadata' as PID 1509119 [2026-09-04 19:29:01,454][ INFO][PID:1468781] Finished after 2 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x --add 10930040-freeze --no-appstream-metadata) [2026-09-04 19:29:01,455][ INFO][PID:1468781] Getting build details [2026-09-04 19:29:01,455][ INFO][PID:1468781] Listing built binary packages in /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10930040-freeze [2026-09-04 19:29:01,455][ INFO][PID:1468781] Built packages: ['freeze-debugsource 2.5.0', 'freeze-debuginfo 2.5.0', 'freeze 2.5.0'] [2026-09-04 19:29:01,456][ INFO][PID:1468781] build details: {'built_packages': 'freeze-debugsource 2.5.0\nfreeze-debuginfo 2.5.0\nfreeze 2.5.0'} [2026-09-04 19:29:01,456][ INFO][PID:1468781] Retrieving pubkey [2026-09-04 19:29:01,456][ INFO][PID:1468781] Calling '/bin/sign -u @fedora-llvm-team#clang-monthly-fedora-rebuild@copr.fedorahosted.org -p' (attempt #1) [2026-09-04 19:29:01,757][ INFO][PID:1468781] Added pubkey for user @fedora-llvm-team project clang-monthly-fedora-rebuild into: /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/pubkey.gpg [2026-09-04 19:29:01,757][ INFO][PID:1468781] Finished build: id=10930040 failed=False timeout=90000 destdir=/var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild chroot=fedora-rawhide-s390x [2026-09-04 19:29:01,758][ INFO][PID:1468781] Worker succeeded build, took 72.16210055351257 [2026-09-04 19:29:01,758][ INFO][PID:1468781] Sending build state back to frontend: { "builds": [ { "timeout": 90000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@fedora-llvm-team", "project_name": "clang-monthly-fedora-rebuild", "project_dirname": "clang-monthly-fedora-rebuild", "submitter": "kkleine", "ended_on": 1788550141.7581553, "started_on": 1788550069.5960548, "submitted_on": null, "status": 1, "chroot": "fedora-rawhide-s390x", "arch": "s390x", "buildroot_pkgs": [ "fedora-clang-default-cc" ], "task_id": "10930040-fedora-rawhide-s390x", "build_id": 10930040, "package_name": "freeze", "package_version": "2.5.0-44", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/clang-monthly-fedora-rebuild/freeze", "git_hash": "09e1705abef4bee50d782798b332349cf4fa960f", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@fedora-llvm-team/clang-monthly-fedora-rebuild--kkleine", "results": { "packages": [ { "name": "freeze-debugsource", "epoch": null, "version": "2.5.0", "release": "44.fc46", "arch": "s390x" }, { "name": "freeze-debuginfo", "epoch": null, "version": "2.5.0", "release": "44.fc46", "arch": "s390x" }, { "name": "freeze", "epoch": null, "version": "2.5.0", "release": "44.fc46", "arch": "src" }, { "name": "freeze", "epoch": null, "version": "2.5.0", "release": "44.fc46", "arch": "s390x" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null, "repo_gpgcheck": false }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/tstellar/fedora-clang-default-cc/fedora-rawhide-s390x/", "id": "copr_tstellar_fedora_clang_default_cc", "name": "Additional repo copr_tstellar_fedora_clang_default_cc", "repo_gpgcheck": false }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260827/fedora-rawhide-s390x/", "id": "copr_fedora_llvm_team_llvm_snapshots_big_merge_20260827", "module_hotfixes": true, "name": "Additional repo copr_fedora_llvm_team_llvm_snapshots_big_merge_20260827", "repo_gpgcheck": false } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [ "toolchain_clang", "clang_lto" ], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-monthly-fedora-rebuild", "result_dir": "10930040-freeze", "built_packages": "freeze-debugsource 2.5.0\nfreeze-debuginfo 2.5.0\nfreeze 2.5.0", "rpmeta_prediction": null, "id": 10930040, "mockchain_macros": { "copr_username": "@fedora-llvm-team", "copr_projectname": "clang-monthly-fedora-rebuild", "vendor": "Fedora Project COPR (@fedora-llvm-team/clang-monthly-fedora-rebuild)" } } ] } [2026-09-04 19:29:01,799][ INFO][PID:1468781] Sending fedora-messaging bus message in build.end [2026-09-04 19:29:01,820][ INFO][PID:1468781] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10930040-freeze/builder-live.log by gzip [2026-09-04 19:29:01,821][ INFO][PID:1468781] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10930040-freeze/builder-live.log' as PID 1509424 [2026-09-04 19:29:01,824][ INFO][PID:1468781] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10930040-freeze/builder-live.log) [2026-09-04 19:29:01,824][ INFO][PID:1468781] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10930040-freeze/backend.log by gzip [2026-09-04 19:29:01,825][ INFO][PID:1468781] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10930040-freeze/backend.log' as PID 1509425