[2026-04-16 12:34:07,340][  INFO][PID:698758] Marking build as starting
[2026-04-16 12:34:07,398][  INFO][PID:698758] Checking that /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-test-suite/centos-stream-9-x86_64/repodata/repomd.xml exists
[2026-04-16 12:34:07,428][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:34:07,430][  INFO][PID:698758] VM allocation process starts
[2026-04-16 12:34:07,449][  INFO][PID:698758] Trying to allocate VM: ResallocHost, ticket_id=2368880, requested_tags=['arch_x86_64', 'copr_builder']
[2026-04-16 12:34:10,481][  INFO][PID:698758] Allocated host ResallocHost, ticket_id=2368880, hostname=3.237.173.1, name=aws_x86_64_spot_prod_06072263_20260416_123210, requested_tags=['arch_x86_64', 'copr_builder']
[2026-04-16 12:34:10,482][  INFO][PID:698758] Allocating ssh connection to builder
[2026-04-16 12:34:10,482][  INFO][PID:698758] Checking that builder machine is OK
[2026-04-16 12:34:10,824][  INFO][PID:698758] Installed copr-rpmbuild version: 1.8
[2026-04-16 12:34:10,825][  INFO][PID:698758] Running remote command: copr-builder-ready centos-stream-9-x86_64
[2026-04-16 12:34:11,050][  INFO][PID:698758] Red Hat subscription not needed for centos-stream-9-x86_64
Builder is ready to be used

[2026-04-16 12:34:11,050][  INFO][PID:698758] Filling build.info file with builder info
[2026-04-16 12:34:11,051][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:34:11,052][  INFO][PID:698758] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 108000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "@fedora-llvm-team",
            "project_name": "llvm-test-suite",
            "project_dirname": "llvm-test-suite",
            "submitter": "kkleine",
            "ended_on": null,
            "started_on": 1776342851.0523686,
            "submitted_on": null,
            "status": 3,
            "chroot": "centos-stream-9-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "10334666-centos-stream-9-x86_64",
            "build_id": 10334666,
            "package_name": "llvm-test-suite",
            "package_version": "22.1.3-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/llvm-test-suite/llvm-test-suite",
            "git_hash": "3d9f437a0bf4ce7a4c1a87668bf63907740a4a6d",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@fedora-llvm-team/llvm-test-suite--kkleine",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-test-suite/centos-stream-9-x86_64/",
                    "id": "copr_base",
                    "module_hotfixes": true,
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [
                "snapshot_build"
            ],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-test-suite",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-test-suite",
            "result_dir": "10334666-llvm-test-suite",
            "built_packages": "",
            "id": 10334666,
            "mockchain_macros": {
                "copr_username": "@fedora-llvm-team",
                "copr_projectname": "llvm-test-suite",
                "vendor": "Fedora Project COPR (@fedora-llvm-team/llvm-test-suite)"
            }
        }
    ]
}
[2026-04-16 12:34:11,109][  INFO][PID:698758] Sending fedora-messaging bus message in build.start
[2026-04-16 12:34:11,861][  INFO][PID:698758] Sending fedora-messaging bus message in chroot.start
[2026-04-16 12:34:11,892][  INFO][PID:698758] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10334666-centos-stream-9-x86_64 --chroot centos-stream-9-x86_64 --detached
[2026-04-16 12:34:12,807][  INFO][PID:698758] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '3.237.173.1' (ED25519) to the list of known hosts.


[2026-04-16 12:34:12,808][  INFO][PID:698758] Downloading the builder-live.log file, attempt 1
[2026-04-16 12:34:12,810][  INFO][PID:698758] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.237.173.1 copr-rpmbuild-log
[2026-04-16 12:34:17,824][  INFO][PID:698758] Periodic builder liveness probe: alive
[2026-04-16 12:34:17,824][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:34:22,825][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:34:27,830][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:34:32,835][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:34:37,837][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:34:42,838][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:34:47,102][ ERROR][PID:698758] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-16 12:34:47,844][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:34:52,848][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:34:57,103][WARNING][PID:698758] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-16 12:34:57,849][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:35:02,850][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:35:07,104][  INFO][PID:698758] Downloading the builder-live.log file, attempt 2
[2026-04-16 12:35:07,110][  INFO][PID:698758] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.237.173.1 copr-rpmbuild-log
[2026-04-16 12:35:07,853][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:35:12,857][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:35:17,858][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:35:22,860][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:35:27,861][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:35:32,862][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:35:37,871][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:35:42,873][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:35:47,874][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:35:52,875][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:35:57,876][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:36:02,879][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:36:07,182][ ERROR][PID:698758] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-16 12:36:07,883][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:36:12,886][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:36:17,199][WARNING][PID:698758] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-16 12:36:17,888][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:36:22,889][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:36:27,200][  INFO][PID:698758] Downloading the builder-live.log file, attempt 3
[2026-04-16 12:36:27,207][  INFO][PID:698758] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.237.173.1 copr-rpmbuild-log
[2026-04-16 12:36:27,892][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:36:32,895][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:36:37,896][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:36:42,898][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:36:47,899][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:36:52,901][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:36:57,903][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:37:02,910][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:37:07,912][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:37:12,913][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:37:17,915][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:37:22,922][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:37:27,276][ ERROR][PID:698758] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-16 12:37:27,924][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:37:32,926][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:37:37,279][WARNING][PID:698758] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-16 12:37:37,932][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:37:42,934][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:37:47,282][  INFO][PID:698758] Downloading the builder-live.log file, attempt 4
[2026-04-16 12:37:47,287][  INFO][PID:698758] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.237.173.1 copr-rpmbuild-log
[2026-04-16 12:37:47,936][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:37:52,938][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:37:57,940][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:38:02,952][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:38:07,957][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:38:12,959][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:38:17,960][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:38:22,964][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:38:27,965][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:38:32,973][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:38:37,974][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:38:42,978][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:38:47,379][ ERROR][PID:698758] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-16 12:38:47,980][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:38:52,989][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:38:57,385][ ERROR][PID:698758] Giving up for unstable SSH, failures: 1776342897.1030846, 1776342977.198964, 1776343057.2796557, 1776343137.3852437
[2026-04-16 12:38:57,388][ ERROR][PID:698758] Re-try request for task on 'ResallocHost, ticket_id=2368880, hostname=3.237.173.1, name=aws_x86_64_spot_prod_06072263_20260416_123210, requested_tags=['arch_x86_64', 'copr_builder']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2026-04-16 12:38:57,389][  INFO][PID:698758] VM Release request
[2026-04-16 12:38:57,411][  INFO][PID:698758] Retry #1 (on other host)
[2026-04-16 12:38:57,414][  INFO][PID:698758] Checking that /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-test-suite/centos-stream-9-x86_64/repodata/repomd.xml exists
[2026-04-16 12:38:57,419][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:38:57,421][  INFO][PID:698758] VM allocation process starts
[2026-04-16 12:38:57,457][  INFO][PID:698758] Trying to allocate VM: ResallocHost, ticket_id=2369038, requested_tags=['arch_x86_64', 'copr_builder']
[2026-04-16 12:39:02,461][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:39:07,462][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:39:12,469][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:39:17,477][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:39:22,489][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:39:27,493][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:39:32,494][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:39:37,506][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:39:42,508][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:39:47,511][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:39:52,517][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:39:57,520][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:40:02,521][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:40:07,524][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:40:12,528][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:40:17,536][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:40:22,539][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:40:25,679][  INFO][PID:698758] Allocated host ResallocHost, ticket_id=2369038, hostname=100.24.53.189, name=aws_x86_64_spot_prod_06072519_20260416_123823, requested_tags=['arch_x86_64', 'copr_builder']
[2026-04-16 12:40:25,679][  INFO][PID:698758] Allocating ssh connection to builder
[2026-04-16 12:40:25,680][  INFO][PID:698758] Checking that builder machine is OK
[2026-04-16 12:40:26,030][  INFO][PID:698758] Installed copr-rpmbuild version: 1.8
[2026-04-16 12:40:26,036][  INFO][PID:698758] Running remote command: copr-builder-ready centos-stream-9-x86_64
[2026-04-16 12:40:26,368][  INFO][PID:698758] Red Hat subscription not needed for centos-stream-9-x86_64
Builder is ready to be used

[2026-04-16 12:40:26,371][  INFO][PID:698758] Filling build.info file with builder info
[2026-04-16 12:40:26,386][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:40:26,389][  INFO][PID:698758] Not re-notifying FE and msg buses for the new host.
[2026-04-16 12:40:26,390][  INFO][PID:698758] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10334666-centos-stream-9-x86_64 --chroot centos-stream-9-x86_64 --detached
[2026-04-16 12:40:27,206][  INFO][PID:698758] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '100.24.53.189' (ED25519) to the list of known hosts.


[2026-04-16 12:40:27,209][  INFO][PID:698758] Downloading the builder-live.log file, attempt 1
[2026-04-16 12:40:27,210][  INFO][PID:698758] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.24.53.189 copr-rpmbuild-log
[2026-04-16 12:40:32,209][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:40:37,211][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:40:42,214][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:40:47,216][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:40:52,221][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:40:57,224][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:41:02,233][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:41:07,236][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:41:12,243][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:41:17,248][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:41:22,250][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:41:27,251][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:41:32,254][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:41:37,256][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:41:42,259][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:41:47,262][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:41:52,265][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:41:57,272][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:42:02,274][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:42:07,275][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:42:12,277][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:42:17,278][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:42:22,280][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:42:27,282][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:42:32,284][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:42:37,286][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:42:42,287][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:42:47,289][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:42:52,291][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:42:57,294][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:43:02,297][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:43:07,299][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:43:12,300][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:43:17,301][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:43:22,303][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:43:27,304][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:43:32,305][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:43:37,306][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:43:42,308][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:43:47,309][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:43:52,310][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:43:57,311][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:44:02,312][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:44:07,313][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:44:12,314][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:44:17,315][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:44:22,324][  INFO][PID:698758] Periodic builder liveness probe: alive
[2026-04-16 12:44:22,325][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:44:27,325][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:44:32,326][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:44:37,327][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:44:42,328][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:44:47,329][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:44:52,330][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:44:57,331][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:45:02,332][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:45:07,333][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:45:12,334][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:45:17,335][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:45:22,337][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:45:27,337][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:45:32,338][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:45:37,339][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:45:42,340][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:45:47,341][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:45:52,342][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:45:57,343][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:46:02,344][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:46:07,345][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:46:12,346][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:46:17,347][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:46:22,348][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:46:27,349][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:46:32,351][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:46:37,352][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:46:42,353][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:46:47,354][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:46:52,356][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:46:57,357][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:47:02,358][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:47:07,359][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:47:12,360][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:47:17,361][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:47:22,362][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:47:27,363][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:47:32,364][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:47:37,365][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:47:42,366][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:47:47,857][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:47:52,858][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:47:57,860][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:48:02,863][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:48:07,864][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:48:12,865][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:48:17,866][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:48:22,867][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:48:27,868][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:48:32,869][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:48:37,870][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:48:42,871][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:48:47,874][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:48:52,880][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:48:57,881][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:49:02,882][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:49:07,883][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:49:12,884][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:49:17,885][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:49:22,887][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:49:27,896][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:49:32,898][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:49:37,901][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:49:42,906][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:49:47,913][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:49:52,916][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:49:57,918][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:50:02,922][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:50:07,923][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:50:12,925][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:50:17,926][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:50:22,928][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:50:27,930][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:50:32,931][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:50:37,932][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:50:42,935][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:50:47,937][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:50:52,942][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:50:57,956][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:51:02,958][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:51:07,962][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:51:12,971][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:51:17,972][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:51:22,976][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:51:27,978][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:51:32,979][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:51:37,981][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:51:42,983][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:51:47,988][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:51:52,989][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:51:57,990][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:52:02,991][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:52:07,993][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:52:12,999][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:52:18,000][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:52:23,002][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:52:28,004][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:52:33,014][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:52:38,016][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:52:43,018][  INFO][PID:698758] Checking for cancel request
[2026-04-16 12:52:46,411][  INFO][PID:698758] Downloading results from builder
[2026-04-16 12:52:46,411][  INFO][PID:698758] rsyncing of mockbuilder@100.24.53.189:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-test-suite/centos-stream-9-x86_64/10334666-llvm-test-suite started
[2026-04-16 12:52:46,412][  INFO][PID:698758] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@100.24.53.189:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-test-suite/centos-stream-9-x86_64/10334666-llvm-test-suite/ &> /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-test-suite/centos-stream-9-x86_64/10334666-llvm-test-suite/build-10334666.rsync.log
[2026-04-16 12:52:51,350][  INFO][PID:698758] rsyncing finished.
[2026-04-16 12:52:51,351][  INFO][PID:698758] VM Release request
[2026-04-16 12:52:51,362][  INFO][PID:698758] Searching for 'success' file in resultdir
[2026-04-16 12:52:51,363][  INFO][PID:698758] Going to sign pkgs from source: 10334666-centos-stream-9-x86_64 in chroot: /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-test-suite/centos-stream-9-x86_64
[2026-04-16 12:52:51,364][  INFO][PID:698758] Calling '/bin/sign -u @fedora-llvm-team#llvm-test-suite@copr.fedorahosted.org -p' (attempt #1)
[2026-04-16 12:52:51,616][  INFO][PID:698758] Calling '/bin/sign -4 -h sha256 -u @fedora-llvm-team#llvm-test-suite@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-test-suite/centos-stream-9-x86_64/10334666-llvm-test-suite/llvm-test-suite-23.0.0~pre20260416.gc4ca631c47ccb3-1.el9.src.rpm' (attempt #1)
[2026-04-16 12:52:58,705][  INFO][PID:698758] signed rpm: /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-test-suite/centos-stream-9-x86_64/10334666-llvm-test-suite/llvm-test-suite-23.0.0~pre20260416.gc4ca631c47ccb3-1.el9.src.rpm
[2026-04-16 12:52:58,706][  INFO][PID:698758] Calling '/bin/sign -4 -h sha256 -u @fedora-llvm-team#llvm-test-suite@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-test-suite/centos-stream-9-x86_64/10334666-llvm-test-suite/llvm-test-suite-23.0.0~pre20260416.gc4ca631c47ccb3-1.el9.noarch.rpm' (attempt #1)
[2026-04-16 12:53:05,100][  INFO][PID:698758] signed rpm: /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-test-suite/centos-stream-9-x86_64/10334666-llvm-test-suite/llvm-test-suite-23.0.0~pre20260416.gc4ca631c47ccb3-1.el9.noarch.rpm
[2026-04-16 12:53:05,104][  INFO][PID:698758] Sign done
[2026-04-16 12:53:05,105][  INFO][PID:698758] Incremental createrepo run, adding 10334666-llvm-test-suite into https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-test-suite/centos-stream-9-x86_64, (auto-create-repo=True)
[2026-04-16 12:53:05,107][  INFO][PID:698758] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-test-suite/centos-stream-9-x86_64 --add 10334666-llvm-test-suite --no-appstream-metadata' as PID 866578
[2026-04-16 12:53:07,491][  INFO][PID:698758] Finished after 2 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-test-suite/centos-stream-9-x86_64 --add 10334666-llvm-test-suite --no-appstream-metadata)
[2026-04-16 12:53:07,494][  INFO][PID:698758] Getting build details
[2026-04-16 12:53:07,499][  INFO][PID:698758] Listing built binary packages in /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-test-suite/centos-stream-9-x86_64/10334666-llvm-test-suite
[2026-04-16 12:53:07,505][  INFO][PID:698758] Built packages:
['llvm-test-suite 23.0.0~pre20260416.gc4ca631c47ccb3']
[2026-04-16 12:53:07,507][  INFO][PID:698758] build details: {'built_packages': 'llvm-test-suite 23.0.0~pre20260416.gc4ca631c47ccb3'}
[2026-04-16 12:53:07,510][  INFO][PID:698758] Retrieving pubkey
[2026-04-16 12:53:07,512][  INFO][PID:698758] Calling '/bin/sign -u @fedora-llvm-team#llvm-test-suite@copr.fedorahosted.org -p' (attempt #1)
[2026-04-16 12:53:07,986][  INFO][PID:698758] Added pubkey for user @fedora-llvm-team project llvm-test-suite into: /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-test-suite/pubkey.gpg
[2026-04-16 12:53:07,989][  INFO][PID:698758] Finished build: id=10334666 failed=False timeout=108000 destdir=/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-test-suite chroot=centos-stream-9-x86_64 
[2026-04-16 12:53:07,994][  INFO][PID:698758] Worker succeeded build, took 761.6051681041718
[2026-04-16 12:53:07,995][  INFO][PID:698758] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 108000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "@fedora-llvm-team",
            "project_name": "llvm-test-suite",
            "project_dirname": "llvm-test-suite",
            "submitter": "kkleine",
            "ended_on": 1776343987.994553,
            "started_on": 1776343226.389385,
            "submitted_on": null,
            "status": 1,
            "chroot": "centos-stream-9-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "10334666-centos-stream-9-x86_64",
            "build_id": 10334666,
            "package_name": "llvm-test-suite",
            "package_version": "22.1.3-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/llvm-test-suite/llvm-test-suite",
            "git_hash": "3d9f437a0bf4ce7a4c1a87668bf63907740a4a6d",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@fedora-llvm-team/llvm-test-suite--kkleine",
            "results": {
                "packages": [
                    {
                        "name": "llvm-test-suite",
                        "epoch": null,
                        "version": "23.0.0~pre20260416.gc4ca631c47ccb3",
                        "release": "1.el9",
                        "arch": "src"
                    },
                    {
                        "name": "llvm-test-suite",
                        "epoch": null,
                        "version": "23.0.0~pre20260416.gc4ca631c47ccb3",
                        "release": "1.el9",
                        "arch": "noarch"
                    }
                ]
            },
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-test-suite/centos-stream-9-x86_64/",
                    "id": "copr_base",
                    "module_hotfixes": true,
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [
                "snapshot_build"
            ],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-test-suite",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-test-suite",
            "result_dir": "10334666-llvm-test-suite",
            "built_packages": "llvm-test-suite 23.0.0~pre20260416.gc4ca631c47ccb3",
            "id": 10334666,
            "mockchain_macros": {
                "copr_username": "@fedora-llvm-team",
                "copr_projectname": "llvm-test-suite",
                "vendor": "Fedora Project COPR (@fedora-llvm-team/llvm-test-suite)"
            }
        }
    ]
}
[2026-04-16 12:53:08,133][  INFO][PID:698758] Sending fedora-messaging bus message in build.end
[2026-04-16 12:53:08,238][  INFO][PID:698758] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-test-suite/centos-stream-9-x86_64/10334666-llvm-test-suite/builder-live.log by gzip
[2026-04-16 12:53:08,244][  INFO][PID:698758] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-test-suite/centos-stream-9-x86_64/10334666-llvm-test-suite/builder-live.log' as PID 867207
[2026-04-16 12:53:08,280][  INFO][PID:698758] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-test-suite/centos-stream-9-x86_64/10334666-llvm-test-suite/builder-live.log)
[2026-04-16 12:53:08,280][  INFO][PID:698758] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-test-suite/centos-stream-9-x86_64/10334666-llvm-test-suite/backend.log by gzip
[2026-04-16 12:53:08,284][  INFO][PID:698758] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-test-suite/centos-stream-9-x86_64/10334666-llvm-test-suite/backend.log' as PID 867214