[2026-11-01 22:30:54,962][  INFO][PID:2879307] Marking build as starting
[2026-11-01 22:30:55,030][  INFO][PID:2879307] Checking that https://download.copr.fedorainfracloud.org/results/hellaenergy/o3de-development/fedora-rawhide-x86_64//repodata/repomd.xml exists
[2026-11-01 22:30:55,245][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:30:55,268][  INFO][PID:2879307] rpmeta: package o3de2610 not known to model, skipping
[2026-11-01 22:30:55,269][  INFO][PID:2879307] VM allocation process starts
[2026-11-01 22:30:55,287][  INFO][PID:2879307] Trying to allocate VM: ResallocHost, ticket_id=6117716, requested_tags=['arch_x86_64', 'copr_builder']
[2026-11-01 22:30:58,298][  INFO][PID:2879307] Allocated host ResallocHost, ticket_id=6117716, hostname=100.55.95.115, name=aws_x86_64_reserved_prod_68170159_20261101_222918, requested_tags=['arch_x86_64', 'copr_builder']
[2026-11-01 22:30:58,298][  INFO][PID:2879307] Allocating ssh connection to builder
[2026-11-01 22:30:58,299][  INFO][PID:2879307] Checking that builder machine is OK
[2026-11-01 22:30:58,598][  INFO][PID:2879307] Installed copr-rpmbuild version: 1.10
[2026-11-01 22:30:58,598][  INFO][PID:2879307] Running remote command: copr-builder-ready fedora-rawhide-x86_64
[2026-11-01 22:30:58,758][  INFO][PID:2879307] Red Hat subscription not needed for fedora-rawhide-x86_64
Builder is ready to be used

[2026-11-01 22:30:58,759][  INFO][PID:2879307] Filling build.info file with builder info
[2026-11-01 22:30:58,759][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:30:58,760][  INFO][PID:2879307] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 28800,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "hellaenergy",
            "project_name": "o3de-development",
            "project_dirname": "o3de-development",
            "submitter": "hellaenergy",
            "ended_on": null,
            "started_on": 1793572258.7601857,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-rawhide-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "11241768-fedora-rawhide-x86_64",
            "build_id": 11241768,
            "package_name": "o3de2610",
            "package_version": "2610.0^20261101git106fe7a-130.fc44",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/hellaenergy/o3de-development/o3de2610",
            "git_hash": "a3cdf22e19f656d2b24e47693eac907c8233a15d",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "prebuilt_tarball_url": null,
            "uses_devel_repo": false,
            "sandbox": "hellaenergy/o3de-development--hellaenergy",
            "results": null,
            "appstream": true,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 1,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/hellaenergy/o3de-development/fedora-rawhide-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null,
                    "repo_gpgcheck": false
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/hellaenergy/o3de-dependencies/fedora-rawhide-x86_64/",
                    "id": "copr_hellaenergy_o3de_dependencies",
                    "name": "Additional repo copr_hellaenergy_o3de_dependencies",
                    "repo_gpgcheck": false
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [
                "development_snapshot",
                "qt6",
                "monolithic",
                "swap_hook",
                "system_assimp",
                "system_cityhash",
                "system_dxc",
                "system_expat",
                "system_freetype",
                "system_googlebenchmark",
                "system_libsamplerate",
                "system_lua",
                "system_lz4",
                "system_mcpp",
                "system_mikkelsen",
                "system_openexr",
                "system_png",
                "system_poly2tri",
                "system_rapidjson",
                "system_spirvcross",
                "system_sqlite",
                "system_tiff",
                "system_vulkan_validation_layers",
                "system_xxhash",
                "system_zlib"
            ],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/hellaenergy/o3de-development",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/hellaenergy/o3de-development",
            "result_dir": "11241768-o3de2610",
            "built_packages": "",
            "rpmeta_prediction": null,
            "id": 11241768,
            "mockchain_macros": {
                "copr_username": "hellaenergy",
                "copr_projectname": "o3de-development",
                "vendor": "Fedora Project COPR (hellaenergy/o3de-development)"
            }
        }
    ]
}
[2026-11-01 22:30:58,792][  INFO][PID:2879307] Sending fedora-messaging bus message in build.start
[2026-11-01 22:30:59,171][  INFO][PID:2879307] Sending fedora-messaging bus message in chroot.start
[2026-11-01 22:30:59,192][  INFO][PID:2879307] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/11241768-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached
[2026-11-01 22:30:59,628][  INFO][PID:2879307] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '100.55.95.115' (ED25519) to the list of known hosts.


[2026-11-01 22:30:59,629][  INFO][PID:2879307] Downloading the builder-live.log file, attempt 1
[2026-11-01 22:30:59,630][  INFO][PID:2879307] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.55.95.115 copr-rpmbuild-log
[2026-11-01 22:31:04,639][  INFO][PID:2879307] Periodic builder liveness probe: alive
[2026-11-01 22:31:04,640][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:31:09,641][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:31:14,642][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:31:19,643][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:31:24,644][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:31:29,645][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:31:34,648][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:31:39,652][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:31:44,654][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:31:49,655][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:31:54,655][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:31:59,656][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:32:04,658][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:32:09,659][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:32:14,660][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:32:19,661][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:32:24,662][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:32:29,662][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:32:34,663][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:32:39,664][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:32:44,665][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:32:49,666][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:32:54,667][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:32:59,668][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:33:04,668][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:33:09,669][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:33:14,670][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:33:19,671][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:33:24,672][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:33:29,673][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:33:34,674][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:33:39,675][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:33:44,676][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:33:49,677][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:33:54,678][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:33:59,679][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:34:04,679][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:34:09,680][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:34:14,681][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:34:19,682][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:34:24,683][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:34:29,684][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:34:34,684][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:34:39,685][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:34:44,686][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:34:49,687][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:34:54,688][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:34:59,688][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:35:04,689][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:35:09,690][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:35:14,691][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:35:19,692][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:35:24,692][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:35:29,693][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:35:34,694][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:35:39,695][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:35:44,696][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:35:49,696][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:35:54,697][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:35:59,698][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:36:04,699][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:36:09,700][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:36:14,701][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:36:19,702][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:36:24,702][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:36:29,703][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:36:34,704][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:36:39,705][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:36:44,706][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:36:49,707][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:36:54,707][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:36:59,708][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:37:04,709][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:37:09,710][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:37:14,711][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:37:19,712][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:37:24,713][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:37:29,714][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:37:34,715][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:37:39,717][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:37:44,718][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:37:49,719][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:37:54,720][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:37:59,722][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:38:04,723][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:38:09,724][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:38:14,725][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:38:19,725][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:38:24,726][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:38:29,727][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:38:34,728][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:38:39,729][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:38:44,732][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:38:49,733][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:38:54,734][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:38:59,735][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:39:04,735][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:39:09,736][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:39:14,737][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:39:19,738][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:39:24,738][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:39:29,739][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:39:34,740][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:39:39,741][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:39:44,742][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:39:49,743][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:39:54,744][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:39:59,745][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:40:04,745][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:40:09,746][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:40:14,747][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:40:19,748][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:40:24,749][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:40:29,750][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:40:34,751][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:40:39,752][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:40:44,753][  INFO][PID:2879307] Checking for cancel request
[2026-11-01 22:40:47,293][  INFO][PID:2879307] Downloading results from builder
[2026-11-01 22:40:47,293][  INFO][PID:2879307] rsyncing of mockbuilder@100.55.95.115:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/hellaenergy/o3de-development/fedora-rawhide-x86_64/11241768-o3de2610 started
[2026-11-01 22:40:47,294][  INFO][PID:2879307] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@100.55.95.115:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/hellaenergy/o3de-development/fedora-rawhide-x86_64/11241768-o3de2610/ &> /var/lib/copr/public_html/results/hellaenergy/o3de-development/fedora-rawhide-x86_64/11241768-o3de2610/build-11241768.rsync.log
[2026-11-01 22:41:02,403][  INFO][PID:2879307] rsyncing finished.
[2026-11-01 22:41:02,404][  INFO][PID:2879307] VM Release request
[2026-11-01 22:41:02,410][  INFO][PID:2879307] Searching for 'success' file in resultdir
[2026-11-01 22:41:02,410][ ERROR][PID:2879307] Build failed: Backend process error: No success file => build failure
[2026-11-01 22:41:02,415][  INFO][PID:2879307] Finished build: id=11241768 failed=True timeout=28800 destdir=/var/lib/copr/public_html/results/hellaenergy/o3de-development chroot=fedora-rawhide-x86_64 
[2026-11-01 22:41:02,417][ ERROR][PID:2879307] Backend process error: No success file => build failure
[2026-11-01 22:41:02,421][  INFO][PID:2879307] Worker failed build, took 603.6613845825195
[2026-11-01 22:41:02,422][  INFO][PID:2879307] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 28800,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "hellaenergy",
            "project_name": "o3de-development",
            "project_dirname": "o3de-development",
            "submitter": "hellaenergy",
            "ended_on": 1793572862.4215703,
            "started_on": 1793572258.7601857,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-rawhide-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "11241768-fedora-rawhide-x86_64",
            "build_id": 11241768,
            "package_name": "o3de2610",
            "package_version": "2610.0^20261101git106fe7a-130.fc44",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/hellaenergy/o3de-development/o3de2610",
            "git_hash": "a3cdf22e19f656d2b24e47693eac907c8233a15d",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "prebuilt_tarball_url": null,
            "uses_devel_repo": false,
            "sandbox": "hellaenergy/o3de-development--hellaenergy",
            "results": null,
            "appstream": true,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 1,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/hellaenergy/o3de-development/fedora-rawhide-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null,
                    "repo_gpgcheck": false
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/hellaenergy/o3de-dependencies/fedora-rawhide-x86_64/",
                    "id": "copr_hellaenergy_o3de_dependencies",
                    "name": "Additional repo copr_hellaenergy_o3de_dependencies",
                    "repo_gpgcheck": false
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [
                "development_snapshot",
                "qt6",
                "monolithic",
                "swap_hook",
                "system_assimp",
                "system_cityhash",
                "system_dxc",
                "system_expat",
                "system_freetype",
                "system_googlebenchmark",
                "system_libsamplerate",
                "system_lua",
                "system_lz4",
                "system_mcpp",
                "system_mikkelsen",
                "system_openexr",
                "system_png",
                "system_poly2tri",
                "system_rapidjson",
                "system_spirvcross",
                "system_sqlite",
                "system_tiff",
                "system_vulkan_validation_layers",
                "system_xxhash",
                "system_zlib"
            ],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/hellaenergy/o3de-development",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/hellaenergy/o3de-development",
            "result_dir": "11241768-o3de2610",
            "built_packages": "",
            "rpmeta_prediction": null,
            "id": 11241768,
            "mockchain_macros": {
                "copr_username": "hellaenergy",
                "copr_projectname": "o3de-development",
                "vendor": "Fedora Project COPR (hellaenergy/o3de-development)"
            }
        }
    ]
}
[2026-11-01 22:41:02,473][  INFO][PID:2879307] Sending fedora-messaging bus message in build.end
[2026-11-01 22:41:02,494][  INFO][PID:2879307] Compressing /var/lib/copr/public_html/results/hellaenergy/o3de-development/fedora-rawhide-x86_64/11241768-o3de2610/builder-live.log by gzip
[2026-11-01 22:41:02,495][  INFO][PID:2879307] Running command 'gzip /var/lib/copr/public_html/results/hellaenergy/o3de-development/fedora-rawhide-x86_64/11241768-o3de2610/builder-live.log' as PID 3050559
[2026-11-01 22:41:02,502][  INFO][PID:2879307] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/hellaenergy/o3de-development/fedora-rawhide-x86_64/11241768-o3de2610/builder-live.log)
[2026-11-01 22:41:02,502][  INFO][PID:2879307] Compressing /var/lib/copr/public_html/results/hellaenergy/o3de-development/fedora-rawhide-x86_64/11241768-o3de2610/backend.log by gzip
[2026-11-01 22:41:02,503][  INFO][PID:2879307] Running command 'gzip /var/lib/copr/public_html/results/hellaenergy/o3de-development/fedora-rawhide-x86_64/11241768-o3de2610/backend.log' as PID 3050569