[2026-02-05 15:37:14,628][  INFO][PID:827527] Marking build as starting
[2026-02-05 15:37:14,703][  INFO][PID:827527] Checking that /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-rawhide-ppc64le/repodata/repomd.xml exists
[2026-02-05 15:37:14,944][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:37:14,946][  INFO][PID:827527] VM allocation process starts
[2026-02-05 15:37:14,959][  INFO][PID:827527] Trying to allocate VM: ResallocHost, ticket_id=1185404, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-02-05 15:37:17,977][  INFO][PID:827527] Allocated host ResallocHost, ticket_id=1185404, hostname=2620:52:6:1161:dead:beef:cafe:c18a, name=vmhost_p09_04_prod_01954306_20260205_145313, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-02-05 15:37:17,978][  INFO][PID:827527] Allocating ssh connection to builder
[2026-02-05 15:37:17,979][  INFO][PID:827527] Checking that builder machine is OK
[2026-02-05 15:37:18,544][  INFO][PID:827527] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2026-02-05 15:37:19,281][  INFO][PID:827527] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2026-02-05 15:37:19,282][  INFO][PID:827527] Filling build.info file with builder info
[2026-02-05 15:37:19,283][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:37:19,283][  INFO][PID:827527] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@CoreOS",
            "project_name": "continuous",
            "project_dirname": "continuous",
            "submitter": "https://api.github.com/users/prestist",
            "ended_on": null,
            "started_on": 1770305839.2837074,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "10096528-fedora-rawhide-ppc64le",
            "build_id": 10096528,
            "package_name": "ignition",
            "package_version": "2.25.1.10.g929a7731-3",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@CoreOS/continuous/ignition",
            "git_hash": "ab835cf56e0957c447fda1f8a951caa2114891a7",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@CoreOS/continuous--https://api.github.com/users/prestist",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/fedora-rawhide-ppc64le/",
                    "id": "copr_rhcontainerbot_bootc",
                    "name": "Additional repo copr_rhcontainerbot_bootc"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@CoreOS/continuous",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous",
            "result_dir": "10096528-ignition",
            "built_packages": "",
            "id": 10096528,
            "mockchain_macros": {
                "copr_username": "@CoreOS",
                "copr_projectname": "continuous",
                "vendor": "Fedora Project COPR (@CoreOS/continuous)"
            }
        }
    ]
}
[2026-02-05 15:37:19,359][  INFO][PID:827527] Sending fedora-messaging bus message in build.start
[2026-02-05 15:37:19,887][  INFO][PID:827527] Sending fedora-messaging bus message in chroot.start
[2026-02-05 15:37:19,916][  INFO][PID:827527] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10096528-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2026-02-05 15:37:20,870][  INFO][PID:827527] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c18a' (ED25519) to the list of known hosts.


[2026-02-05 15:37:20,871][  INFO][PID:827527] Downloading the builder-live.log file, attempt 1
[2026-02-05 15:37:20,873][  INFO][PID:827527] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c18a copr-rpmbuild-log
[2026-02-05 15:37:25,876][  INFO][PID:827527] Periodic builder liveness probe: alive
[2026-02-05 15:37:25,877][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:37:30,877][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:37:35,878][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:37:40,879][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:37:45,880][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:37:50,881][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:37:55,882][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:38:00,884][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:38:05,885][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:38:10,885][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:38:15,886][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:38:21,753][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:38:26,754][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:38:31,852][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:38:37,245][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:38:42,246][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:38:47,248][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:38:52,249][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:38:57,262][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:39:02,699][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:39:07,778][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:39:12,819][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:39:17,820][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:39:22,822][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:39:27,823][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:39:32,825][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:39:37,826][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:39:42,827][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:39:47,828][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:39:52,829][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:39:57,833][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:40:02,834][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:40:07,835][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:40:12,836][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:40:17,837][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:40:22,838][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:40:27,933][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:40:32,934][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:40:38,285][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:40:43,286][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:40:48,287][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:40:53,288][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:40:58,289][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:41:03,290][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:41:08,291][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:41:13,292][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:41:18,293][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:41:23,294][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:41:28,296][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:41:33,298][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:41:38,299][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:41:43,300][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:41:48,734][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:41:53,735][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:41:58,838][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:42:03,839][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:42:08,840][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:42:13,842][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:42:18,842][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:42:23,843][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:42:28,856][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:42:34,138][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:42:39,139][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:42:44,140][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:42:49,366][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:42:54,367][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:42:59,556][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:43:04,570][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:43:09,571][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:43:14,572][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:43:19,581][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:43:24,736][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:43:29,737][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:43:34,812][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:43:39,816][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:43:44,817][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:43:49,919][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:43:54,921][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:43:59,922][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:44:05,013][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:44:10,017][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:44:15,020][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:44:20,022][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:44:25,023][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:44:30,025][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:44:35,094][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:44:40,498][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:44:45,499][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:44:50,500][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:44:55,501][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:45:00,502][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:45:05,974][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:45:10,976][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:45:15,977][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:45:20,978][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:45:25,981][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:45:31,194][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:45:36,195][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:45:41,217][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:45:46,218][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:45:51,219][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:45:56,220][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:46:01,221][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:46:06,223][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:46:11,224][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:46:16,225][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:46:21,227][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:46:26,228][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:46:31,228][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:46:36,230][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:46:41,230][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:46:46,231][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:46:51,235][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:46:56,236][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:47:01,237][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:47:06,237][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:47:11,238][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:47:16,240][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:47:21,241][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:47:26,247][  INFO][PID:827527] Periodic builder liveness probe: alive
[2026-02-05 15:47:26,641][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:47:31,643][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:47:36,644][  INFO][PID:827527] Checking for cancel request
[2026-02-05 15:47:37,353][  INFO][PID:827527] Downloading results from builder
[2026-02-05 15:47:37,353][  INFO][PID:827527] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18a]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-rawhide-ppc64le/10096528-ignition started
[2026-02-05 15:47:37,354][  INFO][PID:827527] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18a]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-rawhide-ppc64le/10096528-ignition/ &> /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-rawhide-ppc64le/10096528-ignition/build-10096528.rsync.log
[2026-02-05 15:47:38,426][  INFO][PID:827527] rsyncing finished.
[2026-02-05 15:47:38,426][  INFO][PID:827527] Releasing VM back to pool
[2026-02-05 15:47:38,435][  INFO][PID:827527] Searching for 'success' file in resultdir
[2026-02-05 15:47:38,436][ ERROR][PID:827527] Build failed: Backend process error: No success file => build failure
[2026-02-05 15:47:38,436][  INFO][PID:827527] Finished build: id=10096528 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/@CoreOS/continuous chroot=fedora-rawhide-ppc64le 
[2026-02-05 15:47:38,438][ ERROR][PID:827527] Backend process error: No success file => build failure
[2026-02-05 15:47:38,438][  INFO][PID:827527] Worker failed build, took 619.1552355289459
[2026-02-05 15:47:38,439][  INFO][PID:827527] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@CoreOS",
            "project_name": "continuous",
            "project_dirname": "continuous",
            "submitter": "https://api.github.com/users/prestist",
            "ended_on": 1770306458.438943,
            "started_on": 1770305839.2837074,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "10096528-fedora-rawhide-ppc64le",
            "build_id": 10096528,
            "package_name": "ignition",
            "package_version": "2.25.1.10.g929a7731-3",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@CoreOS/continuous/ignition",
            "git_hash": "ab835cf56e0957c447fda1f8a951caa2114891a7",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@CoreOS/continuous--https://api.github.com/users/prestist",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/fedora-rawhide-ppc64le/",
                    "id": "copr_rhcontainerbot_bootc",
                    "name": "Additional repo copr_rhcontainerbot_bootc"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@CoreOS/continuous",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous",
            "result_dir": "10096528-ignition",
            "built_packages": "",
            "id": 10096528,
            "mockchain_macros": {
                "copr_username": "@CoreOS",
                "copr_projectname": "continuous",
                "vendor": "Fedora Project COPR (@CoreOS/continuous)"
            }
        }
    ]
}
[2026-02-05 15:47:38,502][  INFO][PID:827527] Sending fedora-messaging bus message in build.end
[2026-02-05 15:47:38,531][  INFO][PID:827527] Compressing /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-rawhide-ppc64le/10096528-ignition/builder-live.log by gzip
[2026-02-05 15:47:38,532][  INFO][PID:827527] Running command 'gzip /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-rawhide-ppc64le/10096528-ignition/builder-live.log' as PID 872142
[2026-02-05 15:47:38,623][  INFO][PID:827527] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-rawhide-ppc64le/10096528-ignition/builder-live.log)
[2026-02-05 15:47:38,623][  INFO][PID:827527] Compressing /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-rawhide-ppc64le/10096528-ignition/backend.log by gzip
[2026-02-05 15:47:38,624][  INFO][PID:827527] Running command 'gzip /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-rawhide-ppc64le/10096528-ignition/backend.log' as PID 872175