[2026-09-04 03:56:34,643][ INFO][PID:1259689] Marking build as starting [2026-09-04 03:56:34,686][ INFO][PID:1259689] Checking that /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/repodata/repomd.xml exists [2026-09-04 03:56:34,686][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:56:34,688][ INFO][PID:1259689] rpmeta: no HW info for arch s390x, skipping [2026-09-04 03:56:34,688][ INFO][PID:1259689] VM allocation process starts [2026-09-04 03:56:34,693][ INFO][PID:1259689] Trying to allocate VM: ResallocHost, ticket_id=4837826, requested_tags=['arch_s390x', 'copr_builder'] [2026-09-04 03:56:37,700][ INFO][PID:1259689] Allocated host ResallocHost, ticket_id=4837826, hostname=163.107.90.249, name=copr_ic_s390x_br_sao_2_prod_27084523_20260904_033301, requested_tags=['arch_s390x', 'copr_builder'] [2026-09-04 03:56:37,701][ INFO][PID:1259689] Allocating ssh connection to builder [2026-09-04 03:56:37,701][ INFO][PID:1259689] Checking that builder machine is OK [2026-09-04 03:56:39,090][ INFO][PID:1259689] Installed copr-rpmbuild version: 1.9 [2026-09-04 03:56:39,090][ INFO][PID:1259689] Running remote command: copr-builder-ready fedora-rawhide-s390x [2026-09-04 03:56:40,533][ INFO][PID:1259689] Red Hat subscription not needed for fedora-rawhide-s390x Builder is ready to be used [2026-09-04 03:56:40,534][ INFO][PID:1259689] Filling build.info file with builder info [2026-09-04 03:56:40,534][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:56:40,535][ INFO][PID:1259689] Sending build state back to frontend: { "builds": [ { "timeout": 90000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@fedora-llvm-team", "project_name": "clang-monthly-fedora-rebuild", "project_dirname": "clang-monthly-fedora-rebuild", "submitter": "kkleine", "ended_on": null, "started_on": 1788494200.5350845, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-s390x", "arch": "s390x", "buildroot_pkgs": [ "fedora-clang-default-cc" ], "task_id": "10929599-fedora-rawhide-s390x", "build_id": 10929599, "package_name": "mod_perl", "package_version": "2.0.13-14", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/clang-monthly-fedora-rebuild/mod_perl", "git_hash": "5a22f6654865e36166a41c57a4a3c4176190d385", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@fedora-llvm-team/clang-monthly-fedora-rebuild--kkleine", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null, "repo_gpgcheck": false }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/tstellar/fedora-clang-default-cc/fedora-rawhide-s390x/", "id": "copr_tstellar_fedora_clang_default_cc", "name": "Additional repo copr_tstellar_fedora_clang_default_cc", "repo_gpgcheck": false }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260827/fedora-rawhide-s390x/", "id": "copr_fedora_llvm_team_llvm_snapshots_big_merge_20260827", "module_hotfixes": true, "name": "Additional repo copr_fedora_llvm_team_llvm_snapshots_big_merge_20260827", "repo_gpgcheck": false } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [ "toolchain_clang", "clang_lto" ], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-monthly-fedora-rebuild", "result_dir": "10929599-mod_perl", "built_packages": "", "rpmeta_prediction": null, "id": 10929599, "mockchain_macros": { "copr_username": "@fedora-llvm-team", "copr_projectname": "clang-monthly-fedora-rebuild", "vendor": "Fedora Project COPR (@fedora-llvm-team/clang-monthly-fedora-rebuild)" } } ] } [2026-09-04 03:56:40,567][ INFO][PID:1259689] Sending fedora-messaging bus message in build.start [2026-09-04 03:56:40,914][ INFO][PID:1259689] Sending fedora-messaging bus message in chroot.start [2026-09-04 03:56:40,933][ INFO][PID:1259689] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10929599-fedora-rawhide-s390x --chroot fedora-rawhide-s390x --detached [2026-09-04 03:56:42,745][ INFO][PID:1259689] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '163.107.90.249' (ED25519) to the list of known hosts. [2026-09-04 03:56:42,746][ INFO][PID:1259689] Downloading the builder-live.log file, attempt 1 [2026-09-04 03:56:42,747][ INFO][PID:1259689] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@163.107.90.249 copr-rpmbuild-log [2026-09-04 03:56:47,750][ INFO][PID:1259689] Periodic builder liveness probe: alive [2026-09-04 03:56:47,751][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:56:52,752][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:56:57,752][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:57:02,754][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:57:07,755][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:57:12,756][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:57:17,756][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:57:22,757][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:57:27,758][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:57:32,759][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:57:37,760][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:57:42,761][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:57:47,762][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:57:52,763][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:57:57,764][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:58:02,764][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:58:07,765][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:58:12,766][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:58:17,767][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:58:22,819][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:58:27,922][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:58:32,923][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:58:38,085][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:58:43,186][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:58:48,187][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:58:53,188][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:58:58,189][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:59:03,190][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:59:08,191][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:59:13,192][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:59:18,192][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:59:23,193][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:59:28,194][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:59:33,195][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:59:38,196][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:59:43,197][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:59:48,198][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:59:53,199][ INFO][PID:1259689] Checking for cancel request [2026-09-04 03:59:58,206][ INFO][PID:1259689] Checking for cancel request [2026-09-04 04:00:03,208][ INFO][PID:1259689] Checking for cancel request [2026-09-04 04:00:08,210][ INFO][PID:1259689] Checking for cancel request [2026-09-04 04:00:13,211][ INFO][PID:1259689] Checking for cancel request [2026-09-04 04:00:18,211][ INFO][PID:1259689] Checking for cancel request [2026-09-04 04:00:23,212][ INFO][PID:1259689] Checking for cancel request [2026-09-04 04:00:28,213][ INFO][PID:1259689] Checking for cancel request [2026-09-04 04:00:33,214][ INFO][PID:1259689] Checking for cancel request [2026-09-04 04:00:38,215][ INFO][PID:1259689] Checking for cancel request [2026-09-04 04:00:43,216][ INFO][PID:1259689] Checking for cancel request [2026-09-04 04:00:48,217][ INFO][PID:1259689] Checking for cancel request [2026-09-04 04:00:53,218][ INFO][PID:1259689] Checking for cancel request [2026-09-04 04:00:58,219][ INFO][PID:1259689] Checking for cancel request [2026-09-04 04:01:00,978][ INFO][PID:1259689] Downloading results from builder [2026-09-04 04:01:00,979][ INFO][PID:1259689] rsyncing of mockbuilder@163.107.90.249:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10929599-mod_perl started [2026-09-04 04:01:00,979][ INFO][PID:1259689] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@163.107.90.249:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10929599-mod_perl/ &> /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10929599-mod_perl/build-10929599.rsync.log [2026-09-04 04:01:04,512][ INFO][PID:1259689] rsyncing finished. [2026-09-04 04:01:04,513][ INFO][PID:1259689] VM Release request [2026-09-04 04:01:04,518][ INFO][PID:1259689] Searching for 'success' file in resultdir [2026-09-04 04:01:04,519][ INFO][PID:1259689] Going to sign pkgs from source: 10929599-fedora-rawhide-s390x in chroot: /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x [2026-09-04 04:01:04,519][ INFO][PID:1259689] Calling '/bin/sign -u @fedora-llvm-team#clang-monthly-fedora-rebuild@copr.fedorahosted.org -p' (attempt #1) [2026-09-04 04:01:05,160][ INFO][PID:1259689] Calling '/bin/sign -4 -h sha256 -u @fedora-llvm-team#clang-monthly-fedora-rebuild@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10929599-mod_perl/mod_perl-2.0.13-14.fc46.s390x.rpm' (attempt #1) [2026-09-04 04:01:06,944][ INFO][PID:1259689] signed rpm: /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10929599-mod_perl/mod_perl-2.0.13-14.fc46.s390x.rpm [2026-09-04 04:01:06,944][ INFO][PID:1259689] Calling '/bin/sign -4 -h sha256 -u @fedora-llvm-team#clang-monthly-fedora-rebuild@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10929599-mod_perl/mod_perl-debugsource-2.0.13-14.fc46.s390x.rpm' (attempt #1) [2026-09-04 04:01:08,671][ INFO][PID:1259689] signed rpm: /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10929599-mod_perl/mod_perl-debugsource-2.0.13-14.fc46.s390x.rpm [2026-09-04 04:01:08,672][ INFO][PID:1259689] Calling '/bin/sign -4 -h sha256 -u @fedora-llvm-team#clang-monthly-fedora-rebuild@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10929599-mod_perl/mod_perl-debuginfo-2.0.13-14.fc46.s390x.rpm' (attempt #1) [2026-09-04 04:01:10,353][ INFO][PID:1259689] signed rpm: /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10929599-mod_perl/mod_perl-debuginfo-2.0.13-14.fc46.s390x.rpm [2026-09-04 04:01:10,353][ INFO][PID:1259689] Calling '/bin/sign -4 -h sha256 -u @fedora-llvm-team#clang-monthly-fedora-rebuild@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10929599-mod_perl/mod_perl-devel-2.0.13-14.fc46.s390x.rpm' (attempt #1) [2026-09-04 04:01:12,589][ INFO][PID:1259689] signed rpm: /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10929599-mod_perl/mod_perl-devel-2.0.13-14.fc46.s390x.rpm [2026-09-04 04:01:12,590][ INFO][PID:1259689] Calling '/bin/sign -4 -h sha256 -u @fedora-llvm-team#clang-monthly-fedora-rebuild@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10929599-mod_perl/mod_perl-2.0.13-14.fc46.src.rpm' (attempt #1) [2026-09-04 04:01:14,404][ INFO][PID:1259689] signed rpm: /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10929599-mod_perl/mod_perl-2.0.13-14.fc46.src.rpm [2026-09-04 04:01:14,405][ INFO][PID:1259689] Sign done [2026-09-04 04:01:14,405][ INFO][PID:1259689] Incremental createrepo run, adding 10929599-mod_perl into https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x, (auto-create-repo=True) [2026-09-04 04:01:14,406][ INFO][PID:1259689] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x --add 10929599-mod_perl --no-appstream-metadata' as PID 1353999 [2026-09-04 04:01:17,411][ INFO][PID:1259689] Finished after 3 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x --add 10929599-mod_perl --no-appstream-metadata) [2026-09-04 04:01:17,412][ INFO][PID:1259689] Getting build details [2026-09-04 04:01:17,413][ INFO][PID:1259689] Listing built binary packages in /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10929599-mod_perl [2026-09-04 04:01:17,413][ INFO][PID:1259689] Built packages: ['mod_perl-debugsource 2.0.13', 'mod_perl-devel 2.0.13', 'mod_perl-debuginfo 2.0.13', 'mod_perl 2.0.13'] [2026-09-04 04:01:17,413][ INFO][PID:1259689] build details: {'built_packages': 'mod_perl-debugsource 2.0.13\nmod_perl-devel 2.0.13\nmod_perl-debuginfo 2.0.13\nmod_perl 2.0.13'} [2026-09-04 04:01:17,413][ INFO][PID:1259689] Retrieving pubkey [2026-09-04 04:01:17,414][ INFO][PID:1259689] Calling '/bin/sign -u @fedora-llvm-team#clang-monthly-fedora-rebuild@copr.fedorahosted.org -p' (attempt #1) [2026-09-04 04:01:18,068][ INFO][PID:1259689] Added pubkey for user @fedora-llvm-team project clang-monthly-fedora-rebuild into: /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/pubkey.gpg [2026-09-04 04:01:18,069][ INFO][PID:1259689] Finished build: id=10929599 failed=False timeout=90000 destdir=/var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild chroot=fedora-rawhide-s390x [2026-09-04 04:01:18,069][ INFO][PID:1259689] Worker succeeded build, took 277.53460597991943 [2026-09-04 04:01:18,070][ INFO][PID:1259689] Sending build state back to frontend: { "builds": [ { "timeout": 90000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@fedora-llvm-team", "project_name": "clang-monthly-fedora-rebuild", "project_dirname": "clang-monthly-fedora-rebuild", "submitter": "kkleine", "ended_on": 1788494478.0696905, "started_on": 1788494200.5350845, "submitted_on": null, "status": 1, "chroot": "fedora-rawhide-s390x", "arch": "s390x", "buildroot_pkgs": [ "fedora-clang-default-cc" ], "task_id": "10929599-fedora-rawhide-s390x", "build_id": 10929599, "package_name": "mod_perl", "package_version": "2.0.13-14", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/clang-monthly-fedora-rebuild/mod_perl", "git_hash": "5a22f6654865e36166a41c57a4a3c4176190d385", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@fedora-llvm-team/clang-monthly-fedora-rebuild--kkleine", "results": { "packages": [ { "name": "mod_perl-debugsource", "epoch": null, "version": "2.0.13", "release": "14.fc46", "arch": "s390x" }, { "name": "mod_perl-devel", "epoch": null, "version": "2.0.13", "release": "14.fc46", "arch": "s390x" }, { "name": "mod_perl-debuginfo", "epoch": null, "version": "2.0.13", "release": "14.fc46", "arch": "s390x" }, { "name": "mod_perl", "epoch": null, "version": "2.0.13", "release": "14.fc46", "arch": "src" }, { "name": "mod_perl", "epoch": null, "version": "2.0.13", "release": "14.fc46", "arch": "s390x" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null, "repo_gpgcheck": false }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/tstellar/fedora-clang-default-cc/fedora-rawhide-s390x/", "id": "copr_tstellar_fedora_clang_default_cc", "name": "Additional repo copr_tstellar_fedora_clang_default_cc", "repo_gpgcheck": false }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260827/fedora-rawhide-s390x/", "id": "copr_fedora_llvm_team_llvm_snapshots_big_merge_20260827", "module_hotfixes": true, "name": "Additional repo copr_fedora_llvm_team_llvm_snapshots_big_merge_20260827", "repo_gpgcheck": false } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [ "toolchain_clang", "clang_lto" ], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-monthly-fedora-rebuild", "result_dir": "10929599-mod_perl", "built_packages": "mod_perl-debugsource 2.0.13\nmod_perl-devel 2.0.13\nmod_perl-debuginfo 2.0.13\nmod_perl 2.0.13", "rpmeta_prediction": null, "id": 10929599, "mockchain_macros": { "copr_username": "@fedora-llvm-team", "copr_projectname": "clang-monthly-fedora-rebuild", "vendor": "Fedora Project COPR (@fedora-llvm-team/clang-monthly-fedora-rebuild)" } } ] } [2026-09-04 04:01:18,111][ INFO][PID:1259689] Sending fedora-messaging bus message in build.end [2026-09-04 04:01:18,131][ INFO][PID:1259689] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10929599-mod_perl/builder-live.log by gzip [2026-09-04 04:01:18,132][ INFO][PID:1259689] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10929599-mod_perl/builder-live.log' as PID 1358366 [2026-09-04 04:01:18,176][ INFO][PID:1259689] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10929599-mod_perl/builder-live.log) [2026-09-04 04:01:18,176][ INFO][PID:1259689] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10929599-mod_perl/backend.log by gzip [2026-09-04 04:01:18,177][ INFO][PID:1259689] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10929599-mod_perl/backend.log' as PID 1358420