[2025-09-03 18:48:04,180][  INFO][PID:1077501] Marking build as starting
[2025-09-03 18:48:04,241][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:48:04,246][  INFO][PID:1077501] VM allocation process starts
[2025-09-03 18:48:04,309][  INFO][PID:1077501] Trying to allocate VM: ResallocHost, ticket_id=4898208, requested_tags=['copr_builder', 'arch_x86_64']
[2025-09-03 18:48:09,311][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:48:14,312][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:48:19,313][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:48:24,314][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:48:29,317][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:48:34,318][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:48:39,319][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:48:44,320][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:48:49,321][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:48:54,322][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:48:59,324][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:49:04,325][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:49:09,326][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:49:14,328][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:49:19,329][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:49:24,330][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:49:29,331][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:49:34,332][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:49:39,333][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:49:44,334][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:49:49,336][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:49:54,337][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:49:59,338][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:50:04,339][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:50:09,340][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:50:14,341][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:50:19,348][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:50:24,349][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:50:29,349][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:50:34,351][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:50:39,352][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:50:44,353][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:50:49,354][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:50:54,355][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:50:59,356][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:51:04,357][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:51:09,358][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:51:14,359][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:51:19,360][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:51:24,362][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:51:29,363][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:51:34,364][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:51:39,365][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:51:44,366][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:51:49,367][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:51:54,368][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:51:59,369][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:52:04,370][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:52:09,371][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:52:14,373][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:52:19,373][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:52:24,374][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:52:29,375][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:52:34,376][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:52:39,377][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:52:44,378][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:52:49,379][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:52:54,380][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:52:59,381][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:53:04,382][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:53:09,383][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:53:14,384][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:53:19,385][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:53:24,386][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:53:29,387][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:53:34,391][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:53:39,393][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:53:44,395][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:53:49,396][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:53:54,397][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:53:59,398][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:54:04,399][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:54:09,400][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:54:14,401][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:54:19,403][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:54:24,404][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:54:29,405][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:54:34,407][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:54:39,408][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:54:44,409][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:54:49,410][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:54:54,411][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:54:59,413][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:55:04,415][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:55:09,416][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:55:14,418][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:55:19,419][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:55:22,438][  INFO][PID:1077501] Allocated host ResallocHost, ticket_id=4898208, hostname=98.82.6.14, name=aws_x86_64_normalreserved_prod_06561135_20250903_185320, requested_tags=['copr_builder', 'arch_x86_64']
[2025-09-03 18:55:22,439][  INFO][PID:1077501] Allocating ssh connection to builder
[2025-09-03 18:55:22,439][  INFO][PID:1077501] Checking that builder machine is OK
[2025-09-03 18:55:22,937][  INFO][PID:1077501] Running remote command: copr-builder-ready fedora-eln-x86_64
[2025-09-03 18:55:23,152][  INFO][PID:1077501] Red Hat subscription not needed for fedora-eln-x86_64
Builder is ready to be used

[2025-09-03 18:55:23,153][  INFO][PID:1077501] Filling build.info file with builder info
[2025-09-03 18:55:23,154][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:55:23,155][  INFO][PID:1077501] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@fedora-llvm-team",
            "project_name": "clang-built-eln",
            "project_dirname": "clang-built-eln:pr:fork-asrivats-rpms-mesa-84",
            "submitter": "https://src.fedoraproject.org/user/asrivats",
            "ended_on": null,
            "started_on": 1756925723.1552775,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-eln-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [
                "clang-rpm-macros",
                "clang",
                "compiler-rt",
                "libomp",
                "libomp-devel",
                "llvm"
            ],
            "task_id": "9520884-fedora-eln-x86_64",
            "build_id": 9520884,
            "package_name": "mesa",
            "package_version": "25.2.1-2",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/clang-built-eln:pr:fork-asrivats-rpms-mesa-84/mesa",
            "git_hash": "b43b20d72f1509c0e6180a61a6e8327424a4bdd8",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@fedora-llvm-team/clang-built-eln--https://src.fedoraproject.org/user/asrivats",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-built-eln/fedora-eln-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-built-eln:pr:fork-asrivats-rpms-mesa-84/fedora-eln-x86_64/",
                    "id": "copr_coprdir",
                    "name": "Coprdir repository",
                    "priority": null
                },
                {
                    "baseurl": "https://kojipkgs.fedoraproject.org/repos/eln-build/latest/$basearch/",
                    "id": "https_kojipkgs_fedoraproject_org_repos_eln_build_latest_basearch",
                    "name": "Additional repo https_kojipkgs_fedoraproject_org_repos_eln_build_latest_basearch"
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-rpm-macros/fedora-$releasever-$basearch/",
                    "id": "https_download_copr_fedorainfracloud_org_results_fedora_llvm_team_clang_rpm_macros_fedora_releasever_basearch",
                    "name": "Additional repo https_download_copr_fedorainfracloud_org_results_fedora_llvm_team_clang_rpm_macros_fedora_releasever_basearch"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [
                "toolchain_clang",
                "clang_lto"
            ],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/clang-built-eln:pr:fork-asrivats-rpms-mesa-84",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-built-eln:pr:fork-asrivats-rpms-mesa-84",
            "result_dir": "09520884-mesa",
            "built_packages": "",
            "id": 9520884,
            "mockchain_macros": {
                "copr_username": "@fedora-llvm-team",
                "copr_projectname": "clang-built-eln",
                "vendor": "Fedora Project COPR (@fedora-llvm-team/clang-built-eln)"
            }
        }
    ]
}
[2025-09-03 18:55:23,196][  INFO][PID:1077501] Sending fedora-messaging bus message in build.start
[2025-09-03 18:55:24,110][  INFO][PID:1077501] Sending fedora-messaging bus message in chroot.start
[2025-09-03 18:55:24,136][  INFO][PID:1077501] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9520884-fedora-eln-x86_64 --chroot fedora-eln-x86_64 --detached
[2025-09-03 18:55:24,477][  INFO][PID:1077501] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '98.82.6.14' (ED25519) to the list of known hosts.


[2025-09-03 18:55:24,478][  INFO][PID:1077501] Downloading the builder-live.log file, attempt 1
[2025-09-03 18:55:24,480][  INFO][PID:1077501] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.82.6.14 copr-rpmbuild-log
[2025-09-03 18:55:29,485][  INFO][PID:1077501] Periodic builder liveness probe: alive
[2025-09-03 18:55:29,486][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:55:34,487][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:55:39,489][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:55:44,490][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:55:49,492][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:55:54,494][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:55:59,496][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:56:04,498][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:56:09,503][  INFO][PID:1077501] Checking for cancel request
[2025-09-03 18:56:11,190][  INFO][PID:1077501] Downloading results from builder
[2025-09-03 18:56:11,191][  INFO][PID:1077501] rsyncing of mockbuilder@98.82.6.14:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@fedora-llvm-team/clang-built-eln:pr:fork-asrivats-rpms-mesa-84/fedora-eln-x86_64/09520884-mesa started
[2025-09-03 18:56:11,192][  INFO][PID:1077501] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@98.82.6.14:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@fedora-llvm-team/clang-built-eln:pr:fork-asrivats-rpms-mesa-84/fedora-eln-x86_64/09520884-mesa/ &> /var/lib/copr/public_html/results/@fedora-llvm-team/clang-built-eln:pr:fork-asrivats-rpms-mesa-84/fedora-eln-x86_64/09520884-mesa/build-09520884.rsync.log
[2025-09-03 18:56:11,414][  INFO][PID:1077501] rsyncing finished.
[2025-09-03 18:56:11,415][  INFO][PID:1077501] Releasing VM back to pool
[2025-09-03 18:56:11,426][  INFO][PID:1077501] Searching for 'success' file in resultdir
[2025-09-03 18:56:11,427][ ERROR][PID:1077501] Build failed: Backend process error: No success file => build failure
[2025-09-03 18:56:11,427][  INFO][PID:1077501] Finished build: id=9520884 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/@fedora-llvm-team/clang-built-eln:pr:fork-asrivats-rpms-mesa-84 chroot=fedora-eln-x86_64 
[2025-09-03 18:56:11,429][ ERROR][PID:1077501] Backend process error: No success file => build failure
[2025-09-03 18:56:11,429][  INFO][PID:1077501] Worker failed build, took 48.274622440338135
[2025-09-03 18:56:11,430][  INFO][PID:1077501] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@fedora-llvm-team",
            "project_name": "clang-built-eln",
            "project_dirname": "clang-built-eln:pr:fork-asrivats-rpms-mesa-84",
            "submitter": "https://src.fedoraproject.org/user/asrivats",
            "ended_on": 1756925771.4299,
            "started_on": 1756925723.1552775,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-eln-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [
                "clang-rpm-macros",
                "clang",
                "compiler-rt",
                "libomp",
                "libomp-devel",
                "llvm"
            ],
            "task_id": "9520884-fedora-eln-x86_64",
            "build_id": 9520884,
            "package_name": "mesa",
            "package_version": "25.2.1-2",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/clang-built-eln:pr:fork-asrivats-rpms-mesa-84/mesa",
            "git_hash": "b43b20d72f1509c0e6180a61a6e8327424a4bdd8",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@fedora-llvm-team/clang-built-eln--https://src.fedoraproject.org/user/asrivats",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-built-eln/fedora-eln-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-built-eln:pr:fork-asrivats-rpms-mesa-84/fedora-eln-x86_64/",
                    "id": "copr_coprdir",
                    "name": "Coprdir repository",
                    "priority": null
                },
                {
                    "baseurl": "https://kojipkgs.fedoraproject.org/repos/eln-build/latest/$basearch/",
                    "id": "https_kojipkgs_fedoraproject_org_repos_eln_build_latest_basearch",
                    "name": "Additional repo https_kojipkgs_fedoraproject_org_repos_eln_build_latest_basearch"
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-rpm-macros/fedora-$releasever-$basearch/",
                    "id": "https_download_copr_fedorainfracloud_org_results_fedora_llvm_team_clang_rpm_macros_fedora_releasever_basearch",
                    "name": "Additional repo https_download_copr_fedorainfracloud_org_results_fedora_llvm_team_clang_rpm_macros_fedora_releasever_basearch"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [
                "toolchain_clang",
                "clang_lto"
            ],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/clang-built-eln:pr:fork-asrivats-rpms-mesa-84",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-built-eln:pr:fork-asrivats-rpms-mesa-84",
            "result_dir": "09520884-mesa",
            "built_packages": "",
            "id": 9520884,
            "mockchain_macros": {
                "copr_username": "@fedora-llvm-team",
                "copr_projectname": "clang-built-eln",
                "vendor": "Fedora Project COPR (@fedora-llvm-team/clang-built-eln)"
            }
        }
    ]
}
[2025-09-03 18:56:11,452][  INFO][PID:1077501] Sending fedora-messaging bus message in build.end
[2025-09-03 18:56:11,476][  INFO][PID:1077501] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/clang-built-eln:pr:fork-asrivats-rpms-mesa-84/fedora-eln-x86_64/09520884-mesa/builder-live.log by gzip
[2025-09-03 18:56:11,477][  INFO][PID:1077501] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-built-eln:pr:fork-asrivats-rpms-mesa-84/fedora-eln-x86_64/09520884-mesa/builder-live.log' as PID 1125616
[2025-09-03 18:56:11,481][  INFO][PID:1077501] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-built-eln:pr:fork-asrivats-rpms-mesa-84/fedora-eln-x86_64/09520884-mesa/builder-live.log)
[2025-09-03 18:56:11,482][  INFO][PID:1077501] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/clang-built-eln:pr:fork-asrivats-rpms-mesa-84/fedora-eln-x86_64/09520884-mesa/backend.log by gzip
[2025-09-03 18:56:11,483][  INFO][PID:1077501] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-built-eln:pr:fork-asrivats-rpms-mesa-84/fedora-eln-x86_64/09520884-mesa/backend.log' as PID 1125617