[2026-02-12 11:23:50,425][  INFO][PID:2581247] Marking build as starting
[2026-02-12 11:23:50,551][  INFO][PID:2581247] Checking that /var/lib/copr/public_html/results/@freeipa/freeipa-4.12-nightly/fedora-rawhide-ppc64le/repodata/repomd.xml exists
[2026-02-12 11:23:50,583][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:23:50,584][  INFO][PID:2581247] VM allocation process starts
[2026-02-12 11:23:50,601][  INFO][PID:2581247] Trying to allocate VM: ResallocHost, ticket_id=1290828, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-02-12 11:23:53,614][  INFO][PID:2581247] Allocated host ResallocHost, ticket_id=1290828, hostname=2620:52:6:1161:dead:beef:cafe:c195, name=vmhost_p09_04_prod_02204911_20260212_103933, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-02-12 11:23:53,614][  INFO][PID:2581247] Allocating ssh connection to builder
[2026-02-12 11:23:53,615][  INFO][PID:2581247] Checking that builder machine is OK
[2026-02-12 11:24:53,678][ ERROR][PID:2581247] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c195 port 22: Connection timed out

[2026-02-12 11:25:03,678][ ERROR][PID:2581247] Re-try request for task on 'ResallocHost, ticket_id=1290828, hostname=2620:52:6:1161:dead:beef:cafe:c195, name=vmhost_p09_04_prod_02204911_20260212_103933, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts
[2026-02-12 11:25:03,679][  INFO][PID:2581247] Releasing VM back to pool
[2026-02-12 11:25:03,688][  INFO][PID:2581247] Retry #1 (on other host)
[2026-02-12 11:25:03,688][  INFO][PID:2581247] Checking that /var/lib/copr/public_html/results/@freeipa/freeipa-4.12-nightly/fedora-rawhide-ppc64le/repodata/repomd.xml exists
[2026-02-12 11:25:03,689][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:25:03,690][  INFO][PID:2581247] VM allocation process starts
[2026-02-12 11:25:03,716][  INFO][PID:2581247] Trying to allocate VM: ResallocHost, ticket_id=1290848, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-02-12 11:25:06,750][  INFO][PID:2581247] Allocated host ResallocHost, ticket_id=1290848, hostname=2620:52:6:1161:dead:beef:cafe:c14a, name=vmhost_p09_03_prod_02204969_20260212_104149, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-02-12 11:25:06,750][  INFO][PID:2581247] Allocating ssh connection to builder
[2026-02-12 11:25:06,751][  INFO][PID:2581247] Checking that builder machine is OK
[2026-02-12 11:25:07,775][  INFO][PID:2581247] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2026-02-12 11:25:08,314][  INFO][PID:2581247] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2026-02-12 11:25:08,315][  INFO][PID:2581247] Filling build.info file with builder info
[2026-02-12 11:25:08,315][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:25:08,316][  INFO][PID:2581247] Not re-notifying FE and msg buses for the new host.
[2026-02-12 11:25:08,316][  INFO][PID:2581247] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10118961-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2026-02-12 11:25:09,307][  INFO][PID:2581247] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c14a' (ED25519) to the list of known hosts.


[2026-02-12 11:25:09,308][  INFO][PID:2581247] Downloading the builder-live.log file, attempt 1
[2026-02-12 11:25:09,310][  INFO][PID:2581247] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c14a copr-rpmbuild-log
[2026-02-12 11:25:14,313][  INFO][PID:2581247] Periodic builder liveness probe: alive
[2026-02-12 11:25:14,314][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:25:19,315][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:25:24,316][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:25:29,317][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:25:34,318][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:25:39,319][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:25:44,325][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:25:49,326][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:25:54,327][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:25:59,329][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:26:04,330][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:26:09,331][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:26:14,334][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:26:19,335][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:26:24,336][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:26:29,515][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:26:34,739][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:26:39,795][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:26:44,885][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:26:50,166][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:26:55,205][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:27:00,308][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:27:05,310][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:27:10,632][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:27:15,711][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:27:20,749][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:27:27,001][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:27:32,113][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:27:37,341][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:27:42,712][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:27:48,059][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:27:53,213][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:27:59,619][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:28:05,122][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:28:11,717][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:28:16,955][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:28:22,208][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:28:29,051][  INFO][PID:2581247] Checking for cancel request
[2026-02-12 11:28:33,549][  INFO][PID:2581247] Downloading results from builder
[2026-02-12 11:28:33,549][  INFO][PID:2581247] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c14a]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@freeipa/freeipa-4.12-nightly/fedora-rawhide-ppc64le/10118961-freeipa started
[2026-02-12 11:28:33,550][  INFO][PID:2581247] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c14a]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@freeipa/freeipa-4.12-nightly/fedora-rawhide-ppc64le/10118961-freeipa/ &> /var/lib/copr/public_html/results/@freeipa/freeipa-4.12-nightly/fedora-rawhide-ppc64le/10118961-freeipa/build-10118961.rsync.log
[2026-02-12 11:28:34,389][  INFO][PID:2581247] rsyncing finished.
[2026-02-12 11:28:34,390][  INFO][PID:2581247] Releasing VM back to pool
[2026-02-12 11:28:34,403][  INFO][PID:2581247] Searching for 'success' file in resultdir
[2026-02-12 11:28:34,404][ ERROR][PID:2581247] Build failed: Backend process error: No success file => build failure
[2026-02-12 11:28:34,404][  INFO][PID:2581247] Finished build: id=10118961 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/@freeipa/freeipa-4.12-nightly chroot=fedora-rawhide-ppc64le 
[2026-02-12 11:28:34,406][ ERROR][PID:2581247] Backend process error: No success file => build failure
[2026-02-12 11:28:34,406][  INFO][PID:2581247] Worker failed build, took 206.09048199653625
[2026-02-12 11:28:34,407][  INFO][PID:2581247] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "@freeipa",
            "project_name": "freeipa-4.12-nightly",
            "project_dirname": "freeipa-4.12-nightly",
            "submitter": "https://api.github.com/users/abbra",
            "ended_on": 1770895714.4068882,
            "started_on": 1770895508.3164062,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "10118961-fedora-rawhide-ppc64le",
            "build_id": 10118961,
            "package_name": "freeipa",
            "package_version": "4.12.6.dev202602121122+git-0",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@freeipa/freeipa-4.12-nightly/freeipa",
            "git_hash": "4d5d0014f3a70ee86689028b9d20775ce2b8b159",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@freeipa/freeipa-4.12-nightly--https://api.github.com/users/abbra",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@freeipa/freeipa-4.12-nightly/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@freeipa/freeipa-4.12-nightly",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@freeipa/freeipa-4.12-nightly",
            "result_dir": "10118961-freeipa",
            "built_packages": "",
            "id": 10118961,
            "mockchain_macros": {
                "copr_username": "@freeipa",
                "copr_projectname": "freeipa-4.12-nightly",
                "vendor": "Fedora Project COPR (@freeipa/freeipa-4.12-nightly)"
            }
        }
    ]
}
[2026-02-12 11:28:34,518][  INFO][PID:2581247] Sending fedora-messaging bus message in build.end
[2026-02-12 11:28:35,102][  INFO][PID:2581247] Compressing /var/lib/copr/public_html/results/@freeipa/freeipa-4.12-nightly/fedora-rawhide-ppc64le/10118961-freeipa/builder-live.log by gzip
[2026-02-12 11:28:35,104][  INFO][PID:2581247] Running command 'gzip /var/lib/copr/public_html/results/@freeipa/freeipa-4.12-nightly/fedora-rawhide-ppc64le/10118961-freeipa/builder-live.log' as PID 2607078
[2026-02-12 11:28:35,137][  INFO][PID:2581247] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@freeipa/freeipa-4.12-nightly/fedora-rawhide-ppc64le/10118961-freeipa/builder-live.log)
[2026-02-12 11:28:35,138][  INFO][PID:2581247] Compressing /var/lib/copr/public_html/results/@freeipa/freeipa-4.12-nightly/fedora-rawhide-ppc64le/10118961-freeipa/backend.log by gzip
[2026-02-12 11:28:35,139][  INFO][PID:2581247] Running command 'gzip /var/lib/copr/public_html/results/@freeipa/freeipa-4.12-nightly/fedora-rawhide-ppc64le/10118961-freeipa/backend.log' as PID 2607082