[2025-10-20 13:39:48,815][  INFO][PID:2647031] Marking build as starting
[2025-10-20 13:39:48,865][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:39:48,866][  INFO][PID:2647031] VM allocation process starts
[2025-10-20 13:39:48,879][  INFO][PID:2647031] Trying to allocate VM: ResallocHost, ticket_id=5743050, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-10-20 13:39:53,880][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:39:58,882][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:40:03,883][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:40:08,884][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:40:13,885][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:40:18,887][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:40:23,888][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:40:28,889][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:40:33,891][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:40:38,892][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:40:43,893][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:40:48,894][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:40:53,895][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:40:58,896][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:41:03,897][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:41:08,898][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:41:13,900][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:41:18,901][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:41:23,902][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:41:28,904][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:41:33,905][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:41:38,906][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:41:43,911][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:41:48,912][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:41:53,913][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:41:58,914][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:42:03,915][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:42:08,917][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:42:13,918][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:42:18,919][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:42:23,921][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:42:28,922][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:42:33,923][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:42:38,924][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:42:43,926][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:42:48,929][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:42:53,933][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:42:58,935][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:43:03,936][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:43:08,937][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:43:13,938][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:43:18,939][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:43:23,940][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:43:28,941][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:43:33,942][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:43:38,943][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:43:43,944][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:43:48,946][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:43:53,947][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:43:58,948][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:44:03,949][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:44:08,950][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:44:13,951][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:44:18,952][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:44:23,953][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:44:28,954][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:44:33,956][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:44:38,957][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:44:43,961][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:44:48,962][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:44:53,963][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:44:58,964][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:45:03,965][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:45:08,966][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:45:13,968][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:45:18,969][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:45:23,970][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:45:28,971][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:45:33,972][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:45:38,973][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:45:43,974][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:45:48,975][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:45:53,976][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:45:58,978][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:46:03,978][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:46:07,011][  INFO][PID:2647031] Allocated host ResallocHost, ticket_id=5743050, hostname=2620:52:3:1:dead:beef:cafe:c28b, name=copr_p09_01_prod_07524844_20251020_134306, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-10-20 13:46:07,012][  INFO][PID:2647031] Allocating ssh connection to builder
[2025-10-20 13:46:07,013][  INFO][PID:2647031] Checking that builder machine is OK
[2025-10-20 13:46:08,202][  INFO][PID:2647031] Running remote command: copr-builder-ready fedora-42-ppc64le
[2025-10-20 13:46:08,807][  INFO][PID:2647031] Red Hat subscription not needed for fedora-42-ppc64le
Builder is ready to be used

[2025-10-20 13:46:08,808][  INFO][PID:2647031] Filling build.info file with builder info
[2025-10-20 13:46:08,814][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:46:08,815][  INFO][PID:2647031] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "psimovec",
            "project_name": "openblas-0.3.23",
            "project_dirname": "openblas-0.3.23",
            "submitter": "https://src.fedoraproject.org/user/music",
            "ended_on": null,
            "started_on": 1760967968.8152678,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-42-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9706058-fedora-42-ppc64le",
            "build_id": 9706058,
            "package_name": "python-trimesh",
            "package_version": "4.8.3-2",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/python-trimesh",
            "git_hash": "3ca8d7736f12de9c9dcf5b53e2470d5f5809cb8d",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/music",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/",
                    "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch",
                    "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23",
            "result_dir": "09706058-python-trimesh",
            "built_packages": "",
            "id": 9706058,
            "mockchain_macros": {
                "copr_username": "psimovec",
                "copr_projectname": "openblas-0.3.23",
                "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)"
            }
        }
    ]
}
[2025-10-20 13:46:08,865][  INFO][PID:2647031] Sending fedora-messaging bus message in build.start
[2025-10-20 13:46:09,508][  INFO][PID:2647031] Sending fedora-messaging bus message in chroot.start
[2025-10-20 13:46:09,534][  INFO][PID:2647031] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9706058-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached
[2025-10-20 13:46:10,518][  INFO][PID:2647031] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c28b' (ED25519) to the list of known hosts.


[2025-10-20 13:46:10,519][  INFO][PID:2647031] Downloading the builder-live.log file, attempt 1
[2025-10-20 13:46:10,521][  INFO][PID:2647031] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c28b copr-rpmbuild-log
[2025-10-20 13:46:15,530][  INFO][PID:2647031] Periodic builder liveness probe: alive
[2025-10-20 13:46:15,531][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:46:20,533][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:46:25,534][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:46:30,535][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:46:35,536][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:46:40,538][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:46:45,539][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:46:50,539][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:46:55,541][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:47:00,541][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:47:05,543][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:47:10,544][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:47:15,545][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:47:20,546][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:47:25,547][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:47:30,548][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:47:35,549][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:47:40,550][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:47:45,551][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:47:50,552][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:47:55,553][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:48:00,554][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:48:05,556][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:48:10,558][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:48:15,559][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:48:20,561][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:48:25,562][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:48:30,564][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:48:35,566][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:48:40,570][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:48:45,571][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:48:50,575][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:48:55,576][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:49:00,577][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:49:05,578][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:49:10,581][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:49:15,582][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:49:20,583][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:49:25,584][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:49:30,585][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:49:35,586][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:49:40,587][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:49:45,588][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:49:50,589][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:49:55,591][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:50:00,592][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:50:05,594][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:50:10,595][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:50:15,596][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:50:20,597][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:50:25,599][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:50:30,601][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:50:35,603][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:50:40,604][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:50:45,605][  INFO][PID:2647031] Checking for cancel request
[2025-10-20 13:50:49,737][  INFO][PID:2647031] Downloading results from builder
[2025-10-20 13:50:49,737][  INFO][PID:2647031] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c28b]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09706058-python-trimesh started
[2025-10-20 13:50:49,738][  INFO][PID:2647031] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c28b]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09706058-python-trimesh/ &> /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09706058-python-trimesh/build-09706058.rsync.log
[2025-10-20 13:50:50,689][  INFO][PID:2647031] rsyncing finished.
[2025-10-20 13:50:50,689][  INFO][PID:2647031] Releasing VM back to pool
[2025-10-20 13:50:50,700][  INFO][PID:2647031] Searching for 'success' file in resultdir
[2025-10-20 13:50:50,701][ ERROR][PID:2647031] Build failed: Backend process error: No success file => build failure
[2025-10-20 13:50:50,702][  INFO][PID:2647031] Finished build: id=9706058 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/openblas-0.3.23 chroot=fedora-42-ppc64le 
[2025-10-20 13:50:50,703][ ERROR][PID:2647031] Backend process error: No success file => build failure
[2025-10-20 13:50:50,704][  INFO][PID:2647031] Worker failed build, took 281.8888008594513
[2025-10-20 13:50:50,704][  INFO][PID:2647031] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "psimovec",
            "project_name": "openblas-0.3.23",
            "project_dirname": "openblas-0.3.23",
            "submitter": "https://src.fedoraproject.org/user/music",
            "ended_on": 1760968250.7040687,
            "started_on": 1760967968.8152678,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-42-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9706058-fedora-42-ppc64le",
            "build_id": 9706058,
            "package_name": "python-trimesh",
            "package_version": "4.8.3-2",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/python-trimesh",
            "git_hash": "3ca8d7736f12de9c9dcf5b53e2470d5f5809cb8d",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/music",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/",
                    "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch",
                    "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23",
            "result_dir": "09706058-python-trimesh",
            "built_packages": "",
            "id": 9706058,
            "mockchain_macros": {
                "copr_username": "psimovec",
                "copr_projectname": "openblas-0.3.23",
                "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)"
            }
        }
    ]
}
[2025-10-20 13:50:50,752][  INFO][PID:2647031] Sending fedora-messaging bus message in build.end
[2025-10-20 13:50:50,777][  INFO][PID:2647031] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09706058-python-trimesh/builder-live.log by gzip
[2025-10-20 13:50:50,779][  INFO][PID:2647031] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09706058-python-trimesh/builder-live.log' as PID 2726373
[2025-10-20 13:50:50,789][  INFO][PID:2647031] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09706058-python-trimesh/builder-live.log)
[2025-10-20 13:50:50,790][  INFO][PID:2647031] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09706058-python-trimesh/backend.log by gzip
[2025-10-20 13:50:50,791][  INFO][PID:2647031] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09706058-python-trimesh/backend.log' as PID 2726375