[2025-11-12 02:28:35,358][  INFO][PID:1291862] Marking build as starting
[2025-11-12 02:28:35,407][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:28:35,408][  INFO][PID:1291862] VM allocation process starts
[2025-11-12 02:28:35,423][  INFO][PID:1291862] Trying to allocate VM: ResallocHost, ticket_id=6134909, requested_tags=['copr_builder', 'arch_x86_64', 'on_demand_powerful']
[2025-11-12 02:28:40,424][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:28:45,426][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:28:50,427][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:28:55,429][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:29:00,430][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:29:05,431][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:29:10,433][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:29:15,440][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:29:20,441][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:29:25,443][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:29:30,445][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:29:35,449][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:29:40,450][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:29:45,451][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:29:50,452][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:29:55,454][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:30:00,459][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:30:03,537][  INFO][PID:1291862] Allocated host ResallocHost, ticket_id=6134909, hostname=98.91.200.124, name=aws_x86_64_powerful_spot_prod_07947310_20251112_022835, requested_tags=['copr_builder', 'arch_x86_64', 'on_demand_powerful']
[2025-11-12 02:30:03,537][  INFO][PID:1291862] Allocating ssh connection to builder
[2025-11-12 02:30:03,538][  INFO][PID:1291862] Checking that builder machine is OK
[2025-11-12 02:30:03,929][  INFO][PID:1291862] Running remote command: copr-builder-ready rhel-8-x86_64
[2025-11-12 02:30:04,180][  INFO][PID:1291862] Checking Red Hat subscription (attempt #1)
Red Hat subscription active
Builder is ready to be used

[2025-11-12 02:30:04,180][  INFO][PID:1291862] Filling build.info file with builder info
[2025-11-12 02:30:04,182][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:30:04,187][  INFO][PID:1291862] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 108000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "@fedora-llvm-team",
            "project_name": "llvm-snapshots-big-merge-20251112",
            "project_dirname": "llvm-snapshots-big-merge-20251112",
            "submitter": "kkleine",
            "ended_on": null,
            "started_on": 1762914604.1872091,
            "submitted_on": null,
            "status": 3,
            "chroot": "rhel-8-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "9788962-rhel-8-x86_64",
            "build_id": 9788962,
            "package_name": "llvm",
            "package_version": "21.1.5-4",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/llvm-snapshots-big-merge-20251112/llvm",
            "git_hash": "f7499e679d58264129c996eb15f8934e2e82261e",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@fedora-llvm-team/llvm-snapshots-big-merge-20251112--kkleine",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251112/rhel-8-x86_64/",
                    "id": "copr_base",
                    "module_hotfixes": true,
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-test-suite/rhel-8-x86_64/",
                    "id": "copr_fedora_llvm_team_llvm_test_suite",
                    "name": "Additional repo copr_fedora_llvm_team_llvm_test_suite"
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "modules": {
                "toggle": [
                    {
                        "enable": "swig:4.0"
                    }
                ]
            },
            "repo_priority": null,
            "tags": [
                "arch_x86_64",
                "on_demand_powerful"
            ],
            "with_opts": [
                "snapshot_build"
            ],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251112",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251112",
            "result_dir": "09788962-llvm",
            "built_packages": "",
            "id": 9788962,
            "mockchain_macros": {
                "copr_username": "@fedora-llvm-team",
                "copr_projectname": "llvm-snapshots-big-merge-20251112",
                "vendor": "Fedora Project COPR (@fedora-llvm-team/llvm-snapshots-big-merge-20251112)"
            }
        }
    ]
}
[2025-11-12 02:30:04,246][  INFO][PID:1291862] Sending fedora-messaging bus message in build.start
[2025-11-12 02:30:05,539][  INFO][PID:1291862] Sending fedora-messaging bus message in chroot.start
[2025-11-12 02:30:05,584][  INFO][PID:1291862] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9788962-rhel-8-x86_64 --chroot rhel-8-x86_64 --detached
[2025-11-12 02:30:05,961][  INFO][PID:1291862] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '98.91.200.124' (ED25519) to the list of known hosts.


[2025-11-12 02:30:05,962][  INFO][PID:1291862] Downloading the builder-live.log file, attempt 1
[2025-11-12 02:30:05,963][  INFO][PID:1291862] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.91.200.124 copr-rpmbuild-log
[2025-11-12 02:30:10,971][  INFO][PID:1291862] Periodic builder liveness probe: alive
[2025-11-12 02:30:10,971][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:30:15,972][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:30:20,974][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:30:25,976][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:30:30,977][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:30:35,979][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:30:40,980][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:30:45,982][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:30:50,985][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:30:55,986][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:31:00,987][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:31:05,988][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:31:10,990][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:31:15,993][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:31:20,994][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:31:25,996][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:31:30,997][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:31:35,998][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:31:41,002][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:31:46,003][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:31:51,004][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:31:56,006][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:32:01,008][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:32:06,008][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:32:11,010][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:32:16,011][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:32:21,014][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:32:26,017][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:32:31,022][  INFO][PID:1291862] Checking for cancel request
[2025-11-12 02:32:31,276][  INFO][PID:1291862] Downloading results from builder
[2025-11-12 02:32:31,278][  INFO][PID:1291862] rsyncing of mockbuilder@98.91.200.124:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251112/rhel-8-x86_64/09788962-llvm started
[2025-11-12 02:32:31,281][  INFO][PID:1291862] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@98.91.200.124:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251112/rhel-8-x86_64/09788962-llvm/ &> /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251112/rhel-8-x86_64/09788962-llvm/build-09788962.rsync.log
[2025-11-12 02:32:33,229][  INFO][PID:1291862] rsyncing finished.
[2025-11-12 02:32:33,230][  INFO][PID:1291862] Releasing VM back to pool
[2025-11-12 02:32:33,254][  INFO][PID:1291862] Searching for 'success' file in resultdir
[2025-11-12 02:32:33,260][ ERROR][PID:1291862] Build failed: Backend process error: No success file => build failure
[2025-11-12 02:32:33,264][  INFO][PID:1291862] Finished build: id=9788962 failed=True timeout=108000 destdir=/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251112 chroot=rhel-8-x86_64 
[2025-11-12 02:32:33,267][ ERROR][PID:1291862] Backend process error: No success file => build failure
[2025-11-12 02:32:33,268][  INFO][PID:1291862] Worker failed build, took 149.08141493797302
[2025-11-12 02:32:33,269][  INFO][PID:1291862] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 108000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "@fedora-llvm-team",
            "project_name": "llvm-snapshots-big-merge-20251112",
            "project_dirname": "llvm-snapshots-big-merge-20251112",
            "submitter": "kkleine",
            "ended_on": 1762914753.268624,
            "started_on": 1762914604.1872091,
            "submitted_on": null,
            "status": 0,
            "chroot": "rhel-8-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "9788962-rhel-8-x86_64",
            "build_id": 9788962,
            "package_name": "llvm",
            "package_version": "21.1.5-4",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/llvm-snapshots-big-merge-20251112/llvm",
            "git_hash": "f7499e679d58264129c996eb15f8934e2e82261e",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@fedora-llvm-team/llvm-snapshots-big-merge-20251112--kkleine",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251112/rhel-8-x86_64/",
                    "id": "copr_base",
                    "module_hotfixes": true,
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-test-suite/rhel-8-x86_64/",
                    "id": "copr_fedora_llvm_team_llvm_test_suite",
                    "name": "Additional repo copr_fedora_llvm_team_llvm_test_suite"
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "modules": {
                "toggle": [
                    {
                        "enable": "swig:4.0"
                    }
                ]
            },
            "repo_priority": null,
            "tags": [
                "arch_x86_64",
                "on_demand_powerful"
            ],
            "with_opts": [
                "snapshot_build"
            ],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251112",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251112",
            "result_dir": "09788962-llvm",
            "built_packages": "",
            "id": 9788962,
            "mockchain_macros": {
                "copr_username": "@fedora-llvm-team",
                "copr_projectname": "llvm-snapshots-big-merge-20251112",
                "vendor": "Fedora Project COPR (@fedora-llvm-team/llvm-snapshots-big-merge-20251112)"
            }
        }
    ]
}
[2025-11-12 02:32:33,298][  INFO][PID:1291862] Sending fedora-messaging bus message in build.end
[2025-11-12 02:32:33,352][  INFO][PID:1291862] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251112/rhel-8-x86_64/09788962-llvm/builder-live.log by gzip
[2025-11-12 02:32:33,354][  INFO][PID:1291862] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251112/rhel-8-x86_64/09788962-llvm/builder-live.log' as PID 1329239
[2025-11-12 02:32:33,367][  INFO][PID:1291862] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251112/rhel-8-x86_64/09788962-llvm/builder-live.log)
[2025-11-12 02:32:33,368][  INFO][PID:1291862] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251112/rhel-8-x86_64/09788962-llvm/backend.log by gzip
[2025-11-12 02:32:33,370][  INFO][PID:1291862] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251112/rhel-8-x86_64/09788962-llvm/backend.log' as PID 1329240