[2025-09-01 09:13:45,622][  INFO][PID:2488309] Marking build as starting
[2025-09-01 09:13:45,934][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:13:45,942][  INFO][PID:2488309] VM allocation process starts
[2025-09-01 09:13:46,993][  INFO][PID:2488309] Trying to allocate VM: ResallocHost, ticket_id=4855057, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-09-01 09:13:51,996][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:13:57,008][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:14:02,010][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:14:07,018][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:14:12,024][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:14:17,028][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:14:22,029][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:14:25,215][  INFO][PID:2488309] Allocated host ResallocHost, ticket_id=4855057, hostname=2620:52:3:1:dead:beef:cafe:c24d, name=copr_hv_ppc64le_02_prod_06523014_20250901_085346, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-09-01 09:14:25,216][  INFO][PID:2488309] Allocating ssh connection to builder
[2025-09-01 09:14:25,220][  INFO][PID:2488309] Checking that builder machine is OK
[2025-09-01 09:14:26,385][  INFO][PID:2488309] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-09-01 09:14:26,862][  INFO][PID:2488309] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-09-01 09:14:26,862][  INFO][PID:2488309] Filling build.info file with builder info
[2025-09-01 09:14:26,864][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:14:26,874][  INFO][PID:2488309] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "psimovec",
            "project_name": "python3-scipy-1.10.1",
            "project_dirname": "python3-scipy-1.10.1:pr:fork-lecris-rpms-arbor-10",
            "submitter": "https://src.fedoraproject.org/user/lecris",
            "ended_on": null,
            "started_on": 1756718066.874071,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9511733-fedora-rawhide-ppc64le",
            "build_id": 9511733,
            "package_name": "arbor",
            "package_version": "0.9.0-15",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/python3-scipy-1.10.1:pr:fork-lecris-rpms-arbor-10/arbor",
            "git_hash": "cf8f1b73cfd5cf76e5d23ce8fd9ded70f54aff00",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "psimovec/python3-scipy-1.10.1--https://src.fedoraproject.org/user/lecris",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.10.1/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.10.1:pr:fork-lecris-rpms-arbor-10/fedora-rawhide-ppc64le/",
                    "id": "copr_coprdir",
                    "name": "Coprdir repository",
                    "priority": null
                },
                {
                    "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/",
                    "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch",
                    "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1:pr:fork-lecris-rpms-arbor-10",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.10.1:pr:fork-lecris-rpms-arbor-10",
            "result_dir": "09511733-arbor",
            "built_packages": "",
            "id": 9511733,
            "mockchain_macros": {
                "copr_username": "psimovec",
                "copr_projectname": "python3-scipy-1.10.1",
                "vendor": "Fedora Project COPR (psimovec/python3-scipy-1.10.1)"
            }
        }
    ]
}
[2025-09-01 09:14:26,920][  INFO][PID:2488309] Sending fedora-messaging bus message in build.start
[2025-09-01 09:14:28,293][  INFO][PID:2488309] Sending fedora-messaging bus message in chroot.start
[2025-09-01 09:14:28,386][  INFO][PID:2488309] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9511733-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-09-01 09:14:29,109][  INFO][PID:2488309] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c24d' (ED25519) to the list of known hosts.


[2025-09-01 09:14:29,111][  INFO][PID:2488309] Downloading the builder-live.log file, attempt 1
[2025-09-01 09:14:29,115][  INFO][PID:2488309] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c24d copr-rpmbuild-log
[2025-09-01 09:14:34,127][  INFO][PID:2488309] Periodic builder liveness probe: alive
[2025-09-01 09:14:34,132][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:14:39,133][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:14:44,135][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:14:49,142][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:14:54,145][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:14:59,153][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:15:04,158][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:15:09,160][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:15:14,162][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:15:19,164][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:15:24,165][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:15:29,166][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:15:34,167][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:15:39,169][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:15:44,173][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:15:49,174][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:15:54,175][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:15:59,178][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:16:04,184][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:16:09,186][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:16:14,189][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:16:19,191][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:16:24,193][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:16:29,194][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:16:34,195][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:16:39,196][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:16:44,203][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:16:49,204][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:16:54,211][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:16:59,213][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:17:04,215][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:17:09,218][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:17:14,220][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:17:19,227][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:17:24,229][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:17:29,231][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:17:34,234][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:17:39,236][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:17:44,238][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:17:49,240][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:17:54,241][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:17:59,245][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:18:04,247][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:18:09,248][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:18:14,250][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:18:19,251][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:18:24,253][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:18:29,255][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:18:34,256][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:18:39,258][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:18:44,259][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:18:49,260][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:18:54,261][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:18:59,262][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:19:04,263][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:19:09,264][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:19:14,266][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:19:19,269][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:19:24,270][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:19:29,271][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:19:34,273][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:19:39,278][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:19:44,285][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:19:49,289][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:19:54,297][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:19:59,302][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:20:04,303][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:20:09,304][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:20:14,307][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:20:19,308][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:20:24,309][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:20:29,311][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:20:34,314][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:20:39,317][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:20:44,327][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:20:49,334][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:20:54,341][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:20:59,347][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:21:04,348][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:21:09,352][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:21:14,361][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:21:19,363][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:21:24,364][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:21:29,366][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:21:34,372][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:21:39,377][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:21:44,379][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:21:49,387][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:21:54,389][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:21:59,391][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:22:04,393][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:22:09,394][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:22:14,395][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:22:19,396][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:22:24,400][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:22:29,402][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:22:34,404][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:22:39,405][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:22:44,406][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:22:49,407][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:22:54,409][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:22:59,410][  INFO][PID:2488309] Checking for cancel request
[2025-09-01 09:23:02,135][  INFO][PID:2488309] Downloading results from builder
[2025-09-01 09:23:02,136][  INFO][PID:2488309] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c24d]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1:pr:fork-lecris-rpms-arbor-10/fedora-rawhide-ppc64le/09511733-arbor started
[2025-09-01 09:23:02,137][  INFO][PID:2488309] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c24d]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1:pr:fork-lecris-rpms-arbor-10/fedora-rawhide-ppc64le/09511733-arbor/ &> /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1:pr:fork-lecris-rpms-arbor-10/fedora-rawhide-ppc64le/09511733-arbor/build-09511733.rsync.log
[2025-09-01 09:23:03,354][  INFO][PID:2488309] rsyncing finished.
[2025-09-01 09:23:03,355][  INFO][PID:2488309] Releasing VM back to pool
[2025-09-01 09:23:03,368][  INFO][PID:2488309] Searching for 'success' file in resultdir
[2025-09-01 09:23:03,369][ ERROR][PID:2488309] Build failed: Backend process error: No success file => build failure
[2025-09-01 09:23:03,370][  INFO][PID:2488309] Finished build: id=9511733 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1:pr:fork-lecris-rpms-arbor-10 chroot=fedora-rawhide-ppc64le 
[2025-09-01 09:23:03,372][ ERROR][PID:2488309] Backend process error: No success file => build failure
[2025-09-01 09:23:03,372][  INFO][PID:2488309] Worker failed build, took 516.4988181591034
[2025-09-01 09:23:03,373][  INFO][PID:2488309] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "psimovec",
            "project_name": "python3-scipy-1.10.1",
            "project_dirname": "python3-scipy-1.10.1:pr:fork-lecris-rpms-arbor-10",
            "submitter": "https://src.fedoraproject.org/user/lecris",
            "ended_on": 1756718583.372889,
            "started_on": 1756718066.874071,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9511733-fedora-rawhide-ppc64le",
            "build_id": 9511733,
            "package_name": "arbor",
            "package_version": "0.9.0-15",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/python3-scipy-1.10.1:pr:fork-lecris-rpms-arbor-10/arbor",
            "git_hash": "cf8f1b73cfd5cf76e5d23ce8fd9ded70f54aff00",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "psimovec/python3-scipy-1.10.1--https://src.fedoraproject.org/user/lecris",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.10.1/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.10.1:pr:fork-lecris-rpms-arbor-10/fedora-rawhide-ppc64le/",
                    "id": "copr_coprdir",
                    "name": "Coprdir repository",
                    "priority": null
                },
                {
                    "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/",
                    "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch",
                    "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1:pr:fork-lecris-rpms-arbor-10",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.10.1:pr:fork-lecris-rpms-arbor-10",
            "result_dir": "09511733-arbor",
            "built_packages": "",
            "id": 9511733,
            "mockchain_macros": {
                "copr_username": "psimovec",
                "copr_projectname": "python3-scipy-1.10.1",
                "vendor": "Fedora Project COPR (psimovec/python3-scipy-1.10.1)"
            }
        }
    ]
}
[2025-09-01 09:23:03,412][  INFO][PID:2488309] Sending fedora-messaging bus message in build.end
[2025-09-01 09:23:03,438][  INFO][PID:2488309] Compressing /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1:pr:fork-lecris-rpms-arbor-10/fedora-rawhide-ppc64le/09511733-arbor/builder-live.log by gzip
[2025-09-01 09:23:03,439][  INFO][PID:2488309] Running command 'gzip /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1:pr:fork-lecris-rpms-arbor-10/fedora-rawhide-ppc64le/09511733-arbor/builder-live.log' as PID 2594506
[2025-09-01 09:23:03,453][  INFO][PID:2488309] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1:pr:fork-lecris-rpms-arbor-10/fedora-rawhide-ppc64le/09511733-arbor/builder-live.log)
[2025-09-01 09:23:03,454][  INFO][PID:2488309] Compressing /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1:pr:fork-lecris-rpms-arbor-10/fedora-rawhide-ppc64le/09511733-arbor/backend.log by gzip
[2025-09-01 09:23:03,456][  INFO][PID:2488309] Running command 'gzip /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1:pr:fork-lecris-rpms-arbor-10/fedora-rawhide-ppc64le/09511733-arbor/backend.log' as PID 2594513