[2025-10-01 14:27:24,845][  INFO][PID:1192710] Marking build as starting
[2025-10-01 14:27:24,871][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:27:24,872][  INFO][PID:1192710] VM allocation process starts
[2025-10-01 14:27:24,897][  INFO][PID:1192710] Trying to allocate VM: ResallocHost, ticket_id=5421854, requested_tags=['copr_builder', 'arch_s390x']
[2025-10-01 14:27:29,899][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:27:34,900][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:27:39,901][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:27:44,902][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:27:49,903][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:27:54,904][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:27:59,905][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:28:04,907][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:28:09,908][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:28:14,909][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:28:19,910][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:28:24,911][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:28:29,912][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:28:34,913][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:28:39,914][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:28:44,914][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:28:49,915][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:28:54,916][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:28:59,917][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:29:04,918][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:29:09,919][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:29:14,920][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:29:19,921][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:29:24,922][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:29:29,923][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:29:34,924][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:29:39,925][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:29:44,926][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:29:49,927][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:29:54,928][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:29:59,929][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:30:04,930][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:30:09,931][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:30:14,932][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:30:19,933][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:30:24,934][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:30:29,935][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:30:34,936][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:30:39,937][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:30:43,003][  INFO][PID:1192710] Allocated host ResallocHost, ticket_id=5421854, hostname=13.116.88.74, name=copr_ic_s390x_br_sao_1_prod_07045570_20251001_142633, requested_tags=['copr_builder', 'arch_s390x']
[2025-10-01 14:30:43,003][  INFO][PID:1192710] Allocating ssh connection to builder
[2025-10-01 14:30:43,004][  INFO][PID:1192710] Checking that builder machine is OK
[2025-10-01 14:30:44,681][  INFO][PID:1192710] Running remote command: copr-builder-ready fedora-rawhide-s390x
[2025-10-01 14:30:46,257][  INFO][PID:1192710] Red Hat subscription not needed for fedora-rawhide-s390x
Builder is ready to be used

[2025-10-01 14:30:46,259][  INFO][PID:1192710] Filling build.info file with builder info
[2025-10-01 14:30:46,262][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:30:46,267][  INFO][PID:1192710] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@fedora-llvm-team",
            "project_name": "clang-monthly-fedora-rebuild",
            "project_dirname": "clang-monthly-fedora-rebuild",
            "submitter": "kkleine",
            "ended_on": null,
            "started_on": 1759329046.2667046,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-rawhide-s390x",
            "arch": "s390x",
            "buildroot_pkgs": [
                "fedora-clang-default-cc"
            ],
            "task_id": "9634121-fedora-rawhide-s390x",
            "build_id": 9634121,
            "package_name": "debugedit",
            "package_version": "5.2-3",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/clang-monthly-fedora-rebuild/debugedit",
            "git_hash": "67e83efac5b9f8da31ff8ccbf1b380133b52fce2",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@fedora-llvm-team/clang-monthly-fedora-rebuild--kkleine",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/tstellar/fedora-clang-default-cc/fedora-rawhide-s390x/",
                    "id": "copr_tstellar_fedora_clang_default_cc",
                    "name": "Additional repo copr_tstellar_fedora_clang_default_cc"
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250929/fedora-rawhide-s390x/",
                    "id": "copr_fedora_llvm_team_llvm_snapshots_big_merge_20250929",
                    "module_hotfixes": true,
                    "name": "Additional repo copr_fedora_llvm_team_llvm_snapshots_big_merge_20250929"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_s390x"
            ],
            "with_opts": [
                "toolchain_clang",
                "clang_lto"
            ],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-monthly-fedora-rebuild",
            "result_dir": "09634121-debugedit",
            "built_packages": "",
            "id": 9634121,
            "mockchain_macros": {
                "copr_username": "@fedora-llvm-team",
                "copr_projectname": "clang-monthly-fedora-rebuild",
                "vendor": "Fedora Project COPR (@fedora-llvm-team/clang-monthly-fedora-rebuild)"
            }
        }
    ]
}
[2025-10-01 14:30:46,300][  INFO][PID:1192710] Sending fedora-messaging bus message in build.start
[2025-10-01 14:30:47,279][  INFO][PID:1192710] Sending fedora-messaging bus message in chroot.start
[2025-10-01 14:30:47,307][  INFO][PID:1192710] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9634121-fedora-rawhide-s390x --chroot fedora-rawhide-s390x --detached
[2025-10-01 14:30:49,034][  INFO][PID:1192710] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '13.116.88.74' (ED25519) to the list of known hosts.


[2025-10-01 14:30:49,039][  INFO][PID:1192710] Downloading the builder-live.log file, attempt 1
[2025-10-01 14:30:49,043][  INFO][PID:1192710] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.116.88.74 copr-rpmbuild-log
[2025-10-01 14:30:54,048][  INFO][PID:1192710] Periodic builder liveness probe: alive
[2025-10-01 14:30:54,048][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:30:59,049][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:31:04,050][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:31:09,051][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:31:14,052][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:31:19,053][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:31:24,054][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:31:29,055][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:31:34,056][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:31:39,057][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:31:44,058][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:31:49,060][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:31:54,062][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:31:59,063][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:32:04,065][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:32:09,067][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:32:14,068][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:32:19,069][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:32:24,070][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:32:29,071][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:32:34,072][  INFO][PID:1192710] Checking for cancel request
[2025-10-01 14:32:35,037][  INFO][PID:1192710] Downloading results from builder
[2025-10-01 14:32:35,038][  INFO][PID:1192710] rsyncing of mockbuilder@13.116.88.74:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/09634121-debugedit started
[2025-10-01 14:32:35,038][  INFO][PID:1192710] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@13.116.88.74:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/09634121-debugedit/ &> /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/09634121-debugedit/build-09634121.rsync.log
[2025-10-01 14:32:38,073][  INFO][PID:1192710] rsyncing finished.
[2025-10-01 14:32:38,074][  INFO][PID:1192710] Releasing VM back to pool
[2025-10-01 14:32:38,082][  INFO][PID:1192710] Searching for 'success' file in resultdir
[2025-10-01 14:32:38,083][  INFO][PID:1192710] Going to sign pkgs from source: 9634121-fedora-rawhide-s390x in chroot: /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x
[2025-10-01 14:32:38,083][  INFO][PID:1192710] Calling '/bin/sign -u @fedora-llvm-team#clang-monthly-fedora-rebuild@copr.fedorahosted.org -p' (attempt #1)
[2025-10-01 14:32:38,425][  INFO][PID:1192710] Calling '/bin/sign -4 -h sha256 -u @fedora-llvm-team#clang-monthly-fedora-rebuild@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/09634121-debugedit/debugedit-debugsource-5.2-3.fc44.s390x.rpm' (attempt #1)
[2025-10-01 14:32:39,433][  INFO][PID:1192710] signed rpm: /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/09634121-debugedit/debugedit-debugsource-5.2-3.fc44.s390x.rpm
[2025-10-01 14:32:39,434][  INFO][PID:1192710] Calling '/bin/sign -4 -h sha256 -u @fedora-llvm-team#clang-monthly-fedora-rebuild@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/09634121-debugedit/debugedit-5.2-3.fc44.src.rpm' (attempt #1)
[2025-10-01 14:32:40,450][  INFO][PID:1192710] signed rpm: /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/09634121-debugedit/debugedit-5.2-3.fc44.src.rpm
[2025-10-01 14:32:40,451][  INFO][PID:1192710] Calling '/bin/sign -4 -h sha256 -u @fedora-llvm-team#clang-monthly-fedora-rebuild@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/09634121-debugedit/debugedit-debuginfo-5.2-3.fc44.s390x.rpm' (attempt #1)
[2025-10-01 14:32:41,471][  INFO][PID:1192710] signed rpm: /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/09634121-debugedit/debugedit-debuginfo-5.2-3.fc44.s390x.rpm
[2025-10-01 14:32:41,472][  INFO][PID:1192710] Calling '/bin/sign -4 -h sha256 -u @fedora-llvm-team#clang-monthly-fedora-rebuild@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/09634121-debugedit/debugedit-5.2-3.fc44.s390x.rpm' (attempt #1)
[2025-10-01 14:32:42,474][  INFO][PID:1192710] signed rpm: /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/09634121-debugedit/debugedit-5.2-3.fc44.s390x.rpm
[2025-10-01 14:32:42,475][  INFO][PID:1192710] Sign done
[2025-10-01 14:32:42,475][  INFO][PID:1192710] Incremental createrepo run, adding 09634121-debugedit into https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x, (auto-create-repo=True)
[2025-10-01 14:32:42,477][  INFO][PID:1192710] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x --add 09634121-debugedit --no-appstream-metadata' as PID 1223798
[2025-10-01 14:32:48,068][  INFO][PID:1192710] Finished after 5 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x --add 09634121-debugedit --no-appstream-metadata)
[2025-10-01 14:32:48,069][  INFO][PID:1192710] Getting build details
[2025-10-01 14:32:48,069][  INFO][PID:1192710] Listing built binary packages in /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/09634121-debugedit
[2025-10-01 14:32:48,069][  INFO][PID:1192710] Built packages:
['debugedit 5.2', 'debugedit-debugsource 5.2', 'debugedit-debuginfo 5.2']
[2025-10-01 14:32:48,070][  INFO][PID:1192710] build details: {'built_packages': 'debugedit 5.2\ndebugedit-debugsource 5.2\ndebugedit-debuginfo 5.2'}
[2025-10-01 14:32:48,070][  INFO][PID:1192710] Retrieving pubkey
[2025-10-01 14:32:48,071][  INFO][PID:1192710] Calling '/bin/sign -u @fedora-llvm-team#clang-monthly-fedora-rebuild@copr.fedorahosted.org -p' (attempt #1)
[2025-10-01 14:32:48,417][  INFO][PID:1192710] Added pubkey for user @fedora-llvm-team project clang-monthly-fedora-rebuild into: /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/pubkey.gpg
[2025-10-01 14:32:48,418][  INFO][PID:1192710] Finished build: id=9634121 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild chroot=fedora-rawhide-s390x 
[2025-10-01 14:32:48,420][  INFO][PID:1192710] Worker succeeded build, took 122.15334272384644
[2025-10-01 14:32:48,420][  INFO][PID:1192710] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@fedora-llvm-team",
            "project_name": "clang-monthly-fedora-rebuild",
            "project_dirname": "clang-monthly-fedora-rebuild",
            "submitter": "kkleine",
            "ended_on": 1759329168.4200473,
            "started_on": 1759329046.2667046,
            "submitted_on": null,
            "status": 1,
            "chroot": "fedora-rawhide-s390x",
            "arch": "s390x",
            "buildroot_pkgs": [
                "fedora-clang-default-cc"
            ],
            "task_id": "9634121-fedora-rawhide-s390x",
            "build_id": 9634121,
            "package_name": "debugedit",
            "package_version": "5.2-3",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/clang-monthly-fedora-rebuild/debugedit",
            "git_hash": "67e83efac5b9f8da31ff8ccbf1b380133b52fce2",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@fedora-llvm-team/clang-monthly-fedora-rebuild--kkleine",
            "results": {
                "packages": [
                    {
                        "name": "debugedit",
                        "epoch": null,
                        "version": "5.2",
                        "release": "3.fc44",
                        "arch": "s390x"
                    },
                    {
                        "name": "debugedit-debugsource",
                        "epoch": null,
                        "version": "5.2",
                        "release": "3.fc44",
                        "arch": "s390x"
                    },
                    {
                        "name": "debugedit-debuginfo",
                        "epoch": null,
                        "version": "5.2",
                        "release": "3.fc44",
                        "arch": "s390x"
                    },
                    {
                        "name": "debugedit",
                        "epoch": null,
                        "version": "5.2",
                        "release": "3.fc44",
                        "arch": "src"
                    }
                ]
            },
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/tstellar/fedora-clang-default-cc/fedora-rawhide-s390x/",
                    "id": "copr_tstellar_fedora_clang_default_cc",
                    "name": "Additional repo copr_tstellar_fedora_clang_default_cc"
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250929/fedora-rawhide-s390x/",
                    "id": "copr_fedora_llvm_team_llvm_snapshots_big_merge_20250929",
                    "module_hotfixes": true,
                    "name": "Additional repo copr_fedora_llvm_team_llvm_snapshots_big_merge_20250929"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_s390x"
            ],
            "with_opts": [
                "toolchain_clang",
                "clang_lto"
            ],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-monthly-fedora-rebuild",
            "result_dir": "09634121-debugedit",
            "built_packages": "debugedit 5.2\ndebugedit-debugsource 5.2\ndebugedit-debuginfo 5.2",
            "id": 9634121,
            "mockchain_macros": {
                "copr_username": "@fedora-llvm-team",
                "copr_projectname": "clang-monthly-fedora-rebuild",
                "vendor": "Fedora Project COPR (@fedora-llvm-team/clang-monthly-fedora-rebuild)"
            }
        }
    ]
}
[2025-10-01 14:32:48,450][  INFO][PID:1192710] Sending fedora-messaging bus message in build.end
[2025-10-01 14:32:48,477][  INFO][PID:1192710] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/09634121-debugedit/builder-live.log by gzip
[2025-10-01 14:32:48,478][  INFO][PID:1192710] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/09634121-debugedit/builder-live.log' as PID 1224284
[2025-10-01 14:32:48,485][  INFO][PID:1192710] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/09634121-debugedit/builder-live.log)
[2025-10-01 14:32:48,486][  INFO][PID:1192710] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/09634121-debugedit/backend.log by gzip
[2025-10-01 14:32:48,487][  INFO][PID:1192710] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/09634121-debugedit/backend.log' as PID 1224285