[2025-12-10 17:25:08,830][  INFO][PID:4112889] Marking build as starting
[2025-12-10 17:25:08,885][  INFO][PID:4112889] Checking that /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-43-ppc64le/repodata/repomd.xml exists
[2025-12-10 17:25:08,886][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:25:08,887][  INFO][PID:4112889] VM allocation process starts
[2025-12-10 17:25:08,905][  INFO][PID:4112889] Trying to allocate VM: ResallocHost, ticket_id=265682, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-10 17:25:13,907][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:25:14,938][  INFO][PID:4112889] Allocated host ResallocHost, ticket_id=265682, hostname=2620:52:6:1161:dead:beef:cafe:c14c, name=vmhost_p09_03_prod_00322467_20251210_171750, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-10 17:25:14,939][  INFO][PID:4112889] Allocating ssh connection to builder
[2025-12-10 17:25:14,939][  INFO][PID:4112889] Checking that builder machine is OK
[2025-12-10 17:25:15,851][  INFO][PID:4112889] Running remote command: copr-builder-ready fedora-43-ppc64le
[2025-12-10 17:25:16,504][  INFO][PID:4112889] Red Hat subscription not needed for fedora-43-ppc64le
Builder is ready to be used

[2025-12-10 17:25:16,505][  INFO][PID:4112889] Filling build.info file with builder info
[2025-12-10 17:25:16,506][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:25:16,507][  INFO][PID:4112889] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "psimovec",
            "project_name": "openblas-0.3.23",
            "project_dirname": "openblas-0.3.23",
            "submitter": "https://src.fedoraproject.org/user/kwizart",
            "ended_on": null,
            "started_on": 1765387516.5075355,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-43-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9895740-fedora-43-ppc64le",
            "build_id": 9895740,
            "package_name": "os-autoinst",
            "package_version": "5^20250707gitd55ec72-7",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/os-autoinst",
            "git_hash": "2a6196af357f6f6bd11295129d3f75bbda3ab141",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/kwizart",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-43-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/",
                    "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch",
                    "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23",
            "result_dir": "09895740-os-autoinst",
            "built_packages": "",
            "id": 9895740,
            "mockchain_macros": {
                "copr_username": "psimovec",
                "copr_projectname": "openblas-0.3.23",
                "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)"
            }
        }
    ]
}
[2025-12-10 17:25:16,560][  INFO][PID:4112889] Sending fedora-messaging bus message in build.start
[2025-12-10 17:25:17,209][  INFO][PID:4112889] Sending fedora-messaging bus message in chroot.start
[2025-12-10 17:25:17,240][  INFO][PID:4112889] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9895740-fedora-43-ppc64le --chroot fedora-43-ppc64le --detached
[2025-12-10 17:25:18,162][  INFO][PID:4112889] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c14c' (ED25519) to the list of known hosts.


[2025-12-10 17:25:18,163][  INFO][PID:4112889] Downloading the builder-live.log file, attempt 1
[2025-12-10 17:25:18,164][  INFO][PID:4112889] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c14c copr-rpmbuild-log
[2025-12-10 17:25:23,177][  INFO][PID:4112889] Periodic builder liveness probe: alive
[2025-12-10 17:25:23,177][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:25:28,178][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:25:33,179][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:25:38,180][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:25:43,181][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:25:48,182][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:25:53,183][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:25:58,184][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:26:03,185][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:26:08,186][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:26:13,187][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:26:18,188][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:26:23,189][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:26:28,190][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:26:33,191][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:26:38,192][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:26:43,193][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:26:48,194][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:26:53,195][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:26:58,196][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:27:03,197][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:27:08,198][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:27:13,199][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:27:18,200][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:27:23,201][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:27:28,201][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:27:33,203][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:27:38,205][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:27:43,206][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:27:48,208][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:27:53,209][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:27:58,210][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:28:03,211][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:28:08,212][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:28:13,213][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:28:18,214][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:28:23,216][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:28:28,217][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:28:33,218][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:28:38,219][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:28:43,220][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:28:48,221][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:28:53,222][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:28:58,224][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:29:03,225][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:29:08,226][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:29:13,227][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:29:18,228][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:29:23,229][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:29:28,230][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:29:33,231][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:29:38,232][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:29:43,233][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:29:48,234][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:29:53,235][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:29:58,236][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:30:03,237][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:30:08,238][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:30:13,239][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:30:18,240][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:30:23,241][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:30:28,242][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:30:33,243][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:30:38,244][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:30:43,245][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:30:48,246][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:30:53,247][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:30:58,248][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:31:03,249][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:31:08,250][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:31:13,251][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:31:18,252][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:31:23,253][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:31:28,254][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:31:33,255][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:31:38,256][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:31:43,257][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:31:48,258][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:31:53,259][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:31:58,260][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:32:03,262][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:32:08,264][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:32:13,265][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:32:18,266][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:32:23,267][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:32:28,268][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:32:33,269][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:32:38,270][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:32:43,271][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:32:48,272][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:32:53,273][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:32:58,275][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:33:03,276][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:33:08,277][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:33:13,278][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:33:18,279][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:33:23,279][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:33:28,280][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:33:33,281][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:33:38,283][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:33:43,284][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:33:48,284][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:33:53,285][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:33:58,287][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:34:03,288][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:34:08,289][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:34:11,364][ ERROR][PID:4112889] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-10 17:34:13,290][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:34:18,291][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:34:21,365][WARNING][PID:4112889] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-12-10 17:34:23,292][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:34:28,294][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:34:31,366][  INFO][PID:4112889] Downloading the builder-live.log file, attempt 2
[2025-12-10 17:34:31,367][  INFO][PID:4112889] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c14c copr-rpmbuild-log
[2025-12-10 17:34:33,295][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:34:38,296][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:34:43,298][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:34:48,299][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:34:53,300][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:34:58,301][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:35:03,302][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:35:08,303][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:35:13,304][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:35:18,305][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:35:23,312][  INFO][PID:4112889] Periodic builder liveness probe: alive
[2025-12-10 17:35:23,313][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:35:28,313][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:35:31,434][ ERROR][PID:4112889] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-10 17:35:33,314][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:35:38,315][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:35:41,439][WARNING][PID:4112889] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-12-10 17:35:43,316][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:35:48,317][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:35:51,440][  INFO][PID:4112889] Downloading the builder-live.log file, attempt 3
[2025-12-10 17:35:51,442][  INFO][PID:4112889] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c14c copr-rpmbuild-log
[2025-12-10 17:35:53,318][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:35:58,319][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:36:03,320][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:36:08,321][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:36:13,322][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:36:18,323][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:36:23,324][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:36:28,325][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:36:33,326][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:36:38,327][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:36:43,328][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:36:48,329][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:36:51,509][ ERROR][PID:4112889] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-10 17:36:53,330][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:36:58,331][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:37:01,511][WARNING][PID:4112889] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-12-10 17:37:03,332][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:37:08,333][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:37:11,512][  INFO][PID:4112889] Downloading the builder-live.log file, attempt 4
[2025-12-10 17:37:11,513][  INFO][PID:4112889] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c14c copr-rpmbuild-log
[2025-12-10 17:37:13,334][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:37:18,335][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:37:23,343][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:37:28,344][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:37:33,345][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:37:38,346][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:37:43,347][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:37:48,349][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:37:53,350][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:37:58,351][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:38:03,352][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:38:08,354][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:38:11,581][ ERROR][PID:4112889] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-10 17:38:13,355][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:38:18,357][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:38:21,582][ ERROR][PID:4112889] Giving up for unstable SSH, failures: 1765388061.3654382, 1765388141.4395747, 1765388221.5114636, 1765388301.582754
[2025-12-10 17:38:21,584][ ERROR][PID:4112889] Re-try request for task on 'ResallocHost, ticket_id=265682, hostname=2620:52:6:1161:dead:beef:cafe:c14c, name=vmhost_p09_03_prod_00322467_20251210_171750, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-12-10 17:38:21,585][  INFO][PID:4112889] Releasing VM back to pool
[2025-12-10 17:38:21,601][  INFO][PID:4112889] Retry #1 (on other host)
[2025-12-10 17:38:21,602][  INFO][PID:4112889] Checking that /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-43-ppc64le/repodata/repomd.xml exists
[2025-12-10 17:38:21,602][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:38:21,603][  INFO][PID:4112889] VM allocation process starts
[2025-12-10 17:38:21,628][  INFO][PID:4112889] Trying to allocate VM: ResallocHost, ticket_id=265842, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-10 17:38:26,630][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:38:27,671][  INFO][PID:4112889] Allocated host ResallocHost, ticket_id=265842, hostname=2620:52:6:1161:dead:beef:cafe:c190, name=vmhost_p09_04_prod_00322760_20251210_173055, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-10 17:38:27,672][  INFO][PID:4112889] Allocating ssh connection to builder
[2025-12-10 17:38:27,673][  INFO][PID:4112889] Checking that builder machine is OK
[2025-12-10 17:38:28,602][  INFO][PID:4112889] Running remote command: copr-builder-ready fedora-43-ppc64le
[2025-12-10 17:38:29,138][  INFO][PID:4112889] Red Hat subscription not needed for fedora-43-ppc64le
Builder is ready to be used

[2025-12-10 17:38:29,139][  INFO][PID:4112889] Filling build.info file with builder info
[2025-12-10 17:38:29,142][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:38:29,143][  INFO][PID:4112889] Not re-notifying FE and msg buses for the new host.
[2025-12-10 17:38:29,144][  INFO][PID:4112889] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9895740-fedora-43-ppc64le --chroot fedora-43-ppc64le --detached
[2025-12-10 17:38:30,128][  INFO][PID:4112889] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c190' (ED25519) to the list of known hosts.


[2025-12-10 17:38:30,129][  INFO][PID:4112889] Downloading the builder-live.log file, attempt 1
[2025-12-10 17:38:30,131][  INFO][PID:4112889] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c190 copr-rpmbuild-log
[2025-12-10 17:38:35,129][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:38:40,132][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:38:45,133][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:38:50,137][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:38:55,139][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:39:00,140][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:39:05,142][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:39:10,145][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:39:15,145][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:39:20,148][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:39:25,150][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:39:30,154][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:39:35,155][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:39:40,156][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:39:45,158][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:39:50,160][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:39:55,163][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:40:00,164][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:40:05,169][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:40:10,174][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:40:15,176][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:40:20,178][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:40:25,180][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:40:30,181][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:40:35,182][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:40:40,183][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:40:45,185][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:40:50,187][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:40:55,189][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:41:00,191][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:41:05,192][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:41:10,193][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:41:15,194][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:41:20,196][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:41:25,197][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:41:30,199][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:41:35,200][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:41:40,201][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:41:45,202][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:41:50,204][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:41:55,205][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:42:00,206][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:42:05,208][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:42:10,209][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:42:15,210][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:42:20,212][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:42:25,213][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:42:30,215][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:42:35,216][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:42:40,218][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:42:45,219][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:42:50,220][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:42:55,221][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:43:00,222][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:43:05,223][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:43:10,225][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:43:15,227][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:43:20,228][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:43:25,229][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:43:30,230][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:43:35,231][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:43:40,233][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:43:45,234][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:43:50,236][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:43:55,237][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:44:00,238][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:44:05,239][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:44:10,240][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:44:15,242][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:44:20,243][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:44:25,244][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:44:30,245][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:44:35,247][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:44:40,248][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:44:45,249][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:44:50,250][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:44:55,252][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:45:00,252][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:45:05,254][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:45:10,255][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:45:15,256][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:45:20,257][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:45:25,265][  INFO][PID:4112889] Periodic builder liveness probe: alive
[2025-12-10 17:45:25,266][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:45:30,267][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:45:35,268][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:45:40,269][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:45:45,270][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:45:50,271][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:45:55,272][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:46:00,273][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:46:05,274][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:46:10,275][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:46:15,276][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:46:20,278][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:46:25,280][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:46:30,281][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:46:35,282][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:46:40,283][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:46:45,284][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:46:50,286][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:46:55,287][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:47:00,289][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:47:05,290][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:47:10,291][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:47:15,292][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:47:20,293][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:47:25,294][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:47:30,295][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:47:35,296][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:47:40,297][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:47:45,298][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:47:50,299][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:47:55,300][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:48:00,301][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:48:05,302][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:48:10,303][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:48:15,305][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:48:20,305][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:48:25,306][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:48:30,307][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:48:35,308][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:48:40,309][  INFO][PID:4112889] Checking for cancel request
[2025-12-10 17:48:41,786][  INFO][PID:4112889] Downloading results from builder
[2025-12-10 17:48:41,788][  INFO][PID:4112889] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c190]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-43-ppc64le/09895740-os-autoinst started
[2025-12-10 17:48:41,789][  INFO][PID:4112889] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c190]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-43-ppc64le/09895740-os-autoinst/ &> /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-43-ppc64le/09895740-os-autoinst/build-09895740.rsync.log
[2025-12-10 17:48:42,581][  INFO][PID:4112889] rsyncing finished.
[2025-12-10 17:48:42,581][  INFO][PID:4112889] Releasing VM back to pool
[2025-12-10 17:48:42,589][  INFO][PID:4112889] Searching for 'success' file in resultdir
[2025-12-10 17:48:42,590][ ERROR][PID:4112889] Build failed: Backend process error: No success file => build failure
[2025-12-10 17:48:42,591][  INFO][PID:4112889] Finished build: id=9895740 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/openblas-0.3.23 chroot=fedora-43-ppc64le 
[2025-12-10 17:48:42,592][ ERROR][PID:4112889] Backend process error: No success file => build failure
[2025-12-10 17:48:42,592][  INFO][PID:4112889] Worker failed build, took 613.4491937160492
[2025-12-10 17:48:42,593][  INFO][PID:4112889] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "psimovec",
            "project_name": "openblas-0.3.23",
            "project_dirname": "openblas-0.3.23",
            "submitter": "https://src.fedoraproject.org/user/kwizart",
            "ended_on": 1765388922.592948,
            "started_on": 1765388309.1437542,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-43-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9895740-fedora-43-ppc64le",
            "build_id": 9895740,
            "package_name": "os-autoinst",
            "package_version": "5^20250707gitd55ec72-7",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/os-autoinst",
            "git_hash": "2a6196af357f6f6bd11295129d3f75bbda3ab141",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/kwizart",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-43-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/",
                    "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch",
                    "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23",
            "result_dir": "09895740-os-autoinst",
            "built_packages": "",
            "id": 9895740,
            "mockchain_macros": {
                "copr_username": "psimovec",
                "copr_projectname": "openblas-0.3.23",
                "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)"
            }
        }
    ]
}
[2025-12-10 17:48:42,632][  INFO][PID:4112889] Sending fedora-messaging bus message in build.end
[2025-12-10 17:48:42,660][  INFO][PID:4112889] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-43-ppc64le/09895740-os-autoinst/builder-live.log by gzip
[2025-12-10 17:48:42,661][  INFO][PID:4112889] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-43-ppc64le/09895740-os-autoinst/builder-live.log' as PID 53863
[2025-12-10 17:48:42,690][  INFO][PID:4112889] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-43-ppc64le/09895740-os-autoinst/builder-live.log)
[2025-12-10 17:48:42,691][  INFO][PID:4112889] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-43-ppc64le/09895740-os-autoinst/backend.log by gzip
[2025-12-10 17:48:42,692][  INFO][PID:4112889] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-43-ppc64le/09895740-os-autoinst/backend.log' as PID 53864