[2025-09-08 15:21:54,704][  INFO][PID:3952911] Marking build as starting
[2025-09-08 15:21:56,742][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:21:56,743][  INFO][PID:3952911] VM allocation process starts
[2025-09-08 15:21:56,778][  INFO][PID:3952911] Trying to allocate VM: ResallocHost, ticket_id=4964203, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-09-08 15:22:01,788][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:22:02,883][  INFO][PID:3952911] Allocated host ResallocHost, ticket_id=4964203, hostname=140.211.168.104, name=copr_osuosl_p09_prod_06667921_20250908_113933, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-09-08 15:22:02,889][  INFO][PID:3952911] Allocating ssh connection to builder
[2025-09-08 15:22:02,891][  INFO][PID:3952911] Checking that builder machine is OK
[2025-09-08 15:22:04,865][  INFO][PID:3952911] Running remote command: copr-builder-ready fedora-eln-ppc64le
[2025-09-08 15:22:05,940][  INFO][PID:3952911] Red Hat subscription not needed for fedora-eln-ppc64le
Builder is ready to be used

[2025-09-08 15:22:05,940][  INFO][PID:3952911] Filling build.info file with builder info
[2025-09-08 15:22:05,942][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:22:05,945][  INFO][PID:3952911] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "rhcontainerbot",
            "project_name": "bootc",
            "project_dirname": "bootc",
            "submitter": "packit",
            "ended_on": null,
            "started_on": 1757344925.9442956,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-eln-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9533981-fedora-eln-ppc64le",
            "build_id": 9533981,
            "package_name": "bootc",
            "package_version": "202509081112.g2d5b977af4-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rhcontainerbot/bootc/bootc",
            "git_hash": "b566d48cb70582274df3abc8fc71daeac2a4ade0",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rhcontainerbot/bootc--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/fedora-eln-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://kojipkgs.fedoraproject.org/repos/eln-build/latest/$basearch/",
                    "id": "https_kojipkgs_fedoraproject_org_repos_eln_build_latest_basearch",
                    "name": "Additional repo https_kojipkgs_fedoraproject_org_repos_eln_build_latest_basearch"
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rhcontainerbot/bootc",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc",
            "result_dir": "09533981-bootc",
            "built_packages": "",
            "id": 9533981,
            "mockchain_macros": {
                "copr_username": "rhcontainerbot",
                "copr_projectname": "bootc",
                "vendor": "Fedora Project COPR (rhcontainerbot/bootc)"
            }
        }
    ]
}
[2025-09-08 15:22:06,054][  INFO][PID:3952911] Sending fedora-messaging bus message in build.start
[2025-09-08 15:22:06,992][  INFO][PID:3952911] Sending fedora-messaging bus message in chroot.start
[2025-09-08 15:22:07,026][  INFO][PID:3952911] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9533981-fedora-eln-ppc64le --chroot fedora-eln-ppc64le --detached
[2025-09-08 15:22:08,344][  INFO][PID:3952911] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '140.211.168.104' (ED25519) to the list of known hosts.


[2025-09-08 15:22:08,346][  INFO][PID:3952911] Downloading the builder-live.log file, attempt 1
[2025-09-08 15:22:08,348][  INFO][PID:3952911] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.104 copr-rpmbuild-log
[2025-09-08 15:22:13,356][  INFO][PID:3952911] Periodic builder liveness probe: alive
[2025-09-08 15:22:13,356][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:22:18,357][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:22:23,358][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:22:28,360][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:22:33,361][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:22:38,362][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:22:43,364][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:22:48,365][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:22:53,367][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:22:58,368][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:23:03,369][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:23:08,371][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:23:13,372][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:23:18,376][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:23:23,378][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:23:28,379][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:23:33,380][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:23:38,381][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:23:43,382][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:23:48,384][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:23:53,385][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:23:58,386][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:24:03,387][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:24:08,388][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:24:13,389][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:24:18,390][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:24:23,391][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:24:28,392][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:24:33,393][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:24:38,394][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:24:43,395][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:24:48,396][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:24:53,398][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:24:58,399][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:25:03,399][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:25:08,400][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:25:13,402][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:25:18,404][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:25:23,406][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:25:28,407][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:25:33,408][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:25:38,409][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:25:43,410][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:25:48,411][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:25:53,412][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:25:58,413][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:26:03,414][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:26:08,415][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:26:13,416][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:26:18,417][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:26:23,418][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:26:28,419][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:26:33,421][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:26:38,422][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:26:43,423][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:26:48,424][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:26:53,425][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:26:58,426][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:27:03,427][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:27:08,428][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:27:13,429][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:27:18,430][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:27:23,431][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:27:28,432][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:27:33,433][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:27:38,434][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:27:43,435][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:27:48,436][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:27:53,437][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:27:58,439][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:28:03,440][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:28:08,441][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:28:13,442][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:28:18,442][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:28:23,443][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:28:28,445][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:28:33,446][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:28:38,447][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:28:43,447][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:28:48,448][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:28:53,449][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:28:58,451][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:29:03,452][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:29:08,453][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:29:13,454][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:29:18,455][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:29:23,457][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:29:28,458][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:29:33,459][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:29:38,460][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:29:43,460][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:29:48,662][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:30:04,062][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:30:26,951][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:30:31,952][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:30:36,953][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:30:41,954][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:30:46,955][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:30:51,956][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:30:56,956][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:31:32,318][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:31:37,319][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:31:42,320][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:31:47,321][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:32:17,493][  INFO][PID:3952911] Periodic builder liveness probe: alive
[2025-09-08 15:32:17,494][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:32:22,495][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:32:27,496][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:32:32,497][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:32:37,499][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:32:42,500][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:32:47,501][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:33:29,526][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:33:34,527][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:33:39,528][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:33:44,529][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:33:49,531][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:33:54,532][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:33:59,577][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:34:04,679][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:34:09,743][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:34:14,821][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:34:44,583][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:34:49,587][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:34:54,588][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:34:59,589][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:35:37,663][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:35:42,666][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:35:47,667][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:35:52,670][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:35:57,672][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:36:02,673][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:36:34,711][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:36:39,712][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:36:44,714][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:36:49,715][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:36:54,716][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:36:55,139][ ERROR][PID:3952911] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-08 15:36:59,718][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:37:04,719][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:37:05,140][WARNING][PID:3952911] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-09-08 15:37:09,721][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:37:15,140][  INFO][PID:3952911] Downloading the builder-live.log file, attempt 2
[2025-09-08 15:37:40,503][  INFO][PID:3952911] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.104 copr-rpmbuild-log
[2025-09-08 15:37:45,503][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:37:50,504][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:37:55,506][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:38:00,507][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:38:05,508][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:38:40,570][ ERROR][PID:3952911] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-08 15:39:06,455][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:39:11,456][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:39:12,078][WARNING][PID:3952911] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-09-08 15:39:17,052][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:39:22,079][  INFO][PID:3952911] Downloading the builder-live.log file, attempt 3
[2025-09-08 15:39:22,565][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:39:22,770][  INFO][PID:3952911] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.104 copr-rpmbuild-log
[2025-09-08 15:40:03,128][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:40:08,130][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:40:13,131][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:40:18,133][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:40:22,837][ ERROR][PID:3952911] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-08 15:40:23,134][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:40:32,839][WARNING][PID:3952911] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-09-08 15:41:25,335][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:41:30,334][  INFO][PID:3952911] Downloading the builder-live.log file, attempt 4
[2025-09-08 15:41:30,335][  INFO][PID:3952911] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.104 copr-rpmbuild-log
[2025-09-08 15:41:30,336][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:41:35,338][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:42:21,733][  INFO][PID:3952911] Periodic builder liveness probe: dead
[2025-09-08 15:42:21,734][  INFO][PID:3952911] calling cancel callback, and waiting
[2025-09-08 15:42:30,404][ ERROR][PID:3952911] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-08 15:42:40,406][ ERROR][PID:3952911] Giving up for unstable SSH, failures: 1757345825.140213, 1757345952.0781791, 1757346032.8390684, 1757346160.4063451
[2025-09-08 15:43:21,805][ ERROR][PID:3952911] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.104 port 22: Connection timed out

[2025-09-08 15:45:02,036][ ERROR][PID:3952911] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.104 port 22: Connection timed out

[2025-09-08 15:46:12,106][ ERROR][PID:3952911] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.104 port 22: Connection timed out

[2025-09-08 15:47:22,176][ ERROR][PID:3952911] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.104 port 22: Connection timed out

[2025-09-08 15:47:56,718][ ERROR][PID:3952911] Can't ssh to cancel build.
[2025-09-08 15:48:11,486][ ERROR][PID:3952911] Re-try request for task on 'ResallocHost, ticket_id=4964203, hostname=140.211.168.104, name=copr_osuosl_p09_prod_06667921_20250908_113933, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Resalloc ticket FAILED
[2025-09-08 15:48:11,486][  INFO][PID:3952911] Releasing VM back to pool
[2025-09-08 15:48:11,496][  INFO][PID:3952911] Retry #1 (on other host)
[2025-09-08 15:48:11,497][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:48:11,497][  INFO][PID:3952911] VM allocation process starts
[2025-09-08 15:48:11,541][  INFO][PID:3952911] Trying to allocate VM: ResallocHost, ticket_id=4964350, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-09-08 15:48:14,753][  INFO][PID:3952911] Allocated host ResallocHost, ticket_id=4964350, hostname=2620:52:3:1:dead:beef:cafe:c288, name=copr_p09_01_prod_06669305_20250908_152144, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-09-08 15:48:14,753][  INFO][PID:3952911] Allocating ssh connection to builder
[2025-09-08 15:48:14,754][  INFO][PID:3952911] Checking that builder machine is OK
[2025-09-08 15:48:15,621][  INFO][PID:3952911] Running remote command: copr-builder-ready fedora-eln-ppc64le
[2025-09-08 15:48:17,502][  INFO][PID:3952911] Red Hat subscription not needed for fedora-eln-ppc64le
Builder is ready to be used

[2025-09-08 15:48:17,503][  INFO][PID:3952911] Filling build.info file with builder info
[2025-09-08 15:48:17,505][  INFO][PID:3952911] Checking for cancel request
[2025-09-08 15:48:17,710][  INFO][PID:3952911] Not re-notifying FE and msg buses for the new host.
[2025-09-08 15:48:17,711][  INFO][PID:3952911] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9533981-fedora-eln-ppc64le --chroot fedora-eln-ppc64le --detached
[2025-09-08 15:48:18,422][  INFO][PID:3952911] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c288' (ED25519) to the list of known hosts.


[2025-09-08 15:48:55,238][  INFO][PID:3952911] Downloading the builder-live.log file, attempt 1
[2025-09-08 15:48:55,239][  INFO][PID:3952911] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c288 copr-rpmbuild-log
[2025-09-08 15:49:00,238][  INFO][PID:3952911] calling cancel callback, and waiting
[2025-09-08 15:49:06,304][  INFO][PID:3952911] Cancel request succeeded
out:
success
err:
Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c288' (ED25519) to the list of known hosts.

[2025-09-08 15:49:06,305][  INFO][PID:3952911] Downloading results from builder
[2025-09-08 15:49:06,305][  INFO][PID:3952911] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c288]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/09533981-bootc started
[2025-09-08 15:49:06,306][  INFO][PID:3952911] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c288]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/09533981-bootc/ &> /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/09533981-bootc/build-09533981.rsync.log
[2025-09-08 15:49:25,905][  INFO][PID:3952911] rsyncing finished.
[2025-09-08 15:49:25,905][  INFO][PID:3952911] Releasing VM back to pool
[2025-09-08 15:49:25,914][  INFO][PID:3952911] Searching for 'success' file in resultdir
[2025-09-08 15:49:25,915][ ERROR][PID:3952911] Build failed: Backend process error: No success file => build failure
[2025-09-08 15:49:25,915][  INFO][PID:3952911] Finished build: id=9533981 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/rhcontainerbot/bootc chroot=fedora-eln-ppc64le 
[2025-09-08 15:49:25,917][ ERROR][PID:3952911] Backend process error: No success file => build failure
[2025-09-08 15:49:25,918][  INFO][PID:3952911] Worker failed build, took 68.20772409439087
[2025-09-08 15:49:25,919][  INFO][PID:3952911] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "rhcontainerbot",
            "project_name": "bootc",
            "project_dirname": "bootc",
            "submitter": "packit",
            "ended_on": 1757346565.918391,
            "started_on": 1757346497.710667,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-eln-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9533981-fedora-eln-ppc64le",
            "build_id": 9533981,
            "package_name": "bootc",
            "package_version": "202509081112.g2d5b977af4-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rhcontainerbot/bootc/bootc",
            "git_hash": "b566d48cb70582274df3abc8fc71daeac2a4ade0",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rhcontainerbot/bootc--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/fedora-eln-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://kojipkgs.fedoraproject.org/repos/eln-build/latest/$basearch/",
                    "id": "https_kojipkgs_fedoraproject_org_repos_eln_build_latest_basearch",
                    "name": "Additional repo https_kojipkgs_fedoraproject_org_repos_eln_build_latest_basearch"
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rhcontainerbot/bootc",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc",
            "result_dir": "09533981-bootc",
            "built_packages": "",
            "id": 9533981,
            "mockchain_macros": {
                "copr_username": "rhcontainerbot",
                "copr_projectname": "bootc",
                "vendor": "Fedora Project COPR (rhcontainerbot/bootc)"
            }
        }
    ]
}
[2025-09-08 15:49:25,991][  INFO][PID:3952911] Sending fedora-messaging bus message in build.end
[2025-09-08 15:49:26,016][  INFO][PID:3952911] Compressing /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/09533981-bootc/builder-live.log by gzip
[2025-09-08 15:49:26,017][  INFO][PID:3952911] Running command 'gzip /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/09533981-bootc/builder-live.log' as PID 4061430
[2025-09-08 15:49:26,021][  INFO][PID:3952911] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/09533981-bootc/builder-live.log)
[2025-09-08 15:49:26,021][  INFO][PID:3952911] Compressing /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/09533981-bootc/backend.log by gzip
[2025-09-08 15:49:26,023][  INFO][PID:3952911] Running command 'gzip /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/09533981-bootc/backend.log' as PID 4061431