[2025-10-14 21:34:59,333][  INFO][PID:1847812] Marking build as starting
[2025-10-14 21:34:59,421][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:34:59,423][  INFO][PID:1847812] VM allocation process starts
[2025-10-14 21:34:59,466][  INFO][PID:1847812] Trying to allocate VM: ResallocHost, ticket_id=5661632, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-10-14 21:35:04,468][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:35:09,469][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:35:14,470][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:35:19,471][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:35:24,472][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:35:29,473][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:35:34,474][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:35:39,475][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:35:44,476][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:35:49,477][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:35:54,478][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:35:59,479][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:36:04,480][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:36:09,481][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:36:14,482][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:36:19,483][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:36:24,484][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:36:29,485][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:36:34,486][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:36:39,487][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:36:44,488][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:36:49,490][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:36:54,491][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:36:59,492][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:37:04,493][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:37:09,494][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:37:14,495][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:37:19,496][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:37:24,497][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:37:29,501][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:37:34,506][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:37:39,507][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:37:44,508][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:37:49,510][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:37:54,511][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:37:59,512][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:38:04,513][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:38:09,514][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:38:14,515][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:38:19,516][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:38:24,517][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:38:29,518][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:38:34,519][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:38:39,520][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:38:44,525][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:38:49,526][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:38:54,528][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:38:59,529][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:39:04,531][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:39:09,531][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:39:14,532][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:39:19,534][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:39:24,535][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:39:29,536][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:39:34,537][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:39:39,538][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:39:44,539][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:39:49,541][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:39:54,542][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:39:59,543][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:40:04,544][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:40:09,546][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:40:14,547][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:40:19,548][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:40:24,549][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:40:29,550][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:40:34,552][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:40:39,553][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:40:44,554][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:40:49,555][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:40:54,556][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:40:59,557][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:41:04,558][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:41:09,559][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:41:14,560][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:41:19,561][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:41:24,563][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:41:29,564][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:41:34,565][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:41:39,567][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:41:44,568][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:41:49,570][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:41:54,571][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:41:59,572][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:42:04,573][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:42:09,574][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:42:14,575][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:42:19,576][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:42:24,578][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:42:29,579][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:42:34,580][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:42:39,581][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:42:44,582][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:42:49,583][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:42:54,584][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:42:59,585][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:43:04,586][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:43:09,587][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:43:14,589][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:43:17,620][  INFO][PID:1847812] Allocated host ResallocHost, ticket_id=5661632, hostname=140.211.168.83, name=copr_osuosl_p09_prod_07394192_20251014_213932, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-10-14 21:43:17,620][  INFO][PID:1847812] Allocating ssh connection to builder
[2025-10-14 21:43:17,621][  INFO][PID:1847812] Checking that builder machine is OK
[2025-10-14 21:43:18,912][  INFO][PID:1847812] Running remote command: copr-builder-ready fedora-42-ppc64le
[2025-10-14 21:43:19,928][  INFO][PID:1847812] Red Hat subscription not needed for fedora-42-ppc64le
Builder is ready to be used

[2025-10-14 21:43:19,929][  INFO][PID:1847812] Filling build.info file with builder info
[2025-10-14 21:43:19,929][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:43:19,931][  INFO][PID:1847812] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "psimovec",
            "project_name": "python3-scipy-1.10.1",
            "project_dirname": "python3-scipy-1.10.1",
            "submitter": "https://src.fedoraproject.org/user/churchyard",
            "ended_on": null,
            "started_on": 1760478199.9308121,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-42-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9688935-fedora-42-ppc64le",
            "build_id": 9688935,
            "package_name": "ipython",
            "package_version": "8.37.0-11",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/python3-scipy-1.10.1/ipython",
            "git_hash": "44497fbf6cd9eda4abc91f903ea4af22026d9286",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "psimovec/python3-scipy-1.10.1--https://src.fedoraproject.org/user/churchyard",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.10.1/fedora-42-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/",
                    "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch",
                    "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.10.1",
            "result_dir": "09688935-ipython",
            "built_packages": "",
            "id": 9688935,
            "mockchain_macros": {
                "copr_username": "psimovec",
                "copr_projectname": "python3-scipy-1.10.1",
                "vendor": "Fedora Project COPR (psimovec/python3-scipy-1.10.1)"
            }
        }
    ]
}
[2025-10-14 21:43:19,976][  INFO][PID:1847812] Sending fedora-messaging bus message in build.start
[2025-10-14 21:43:20,815][  INFO][PID:1847812] Sending fedora-messaging bus message in chroot.start
[2025-10-14 21:43:20,840][  INFO][PID:1847812] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9688935-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached
[2025-10-14 21:43:22,334][  INFO][PID:1847812] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '140.211.168.83' (ED25519) to the list of known hosts.


[2025-10-14 21:43:22,335][  INFO][PID:1847812] Downloading the builder-live.log file, attempt 1
[2025-10-14 21:43:22,336][  INFO][PID:1847812] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.83 copr-rpmbuild-log
[2025-10-14 21:43:27,343][  INFO][PID:1847812] Periodic builder liveness probe: alive
[2025-10-14 21:43:27,344][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:43:32,345][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:43:37,346][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:43:42,347][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:43:47,348][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:43:52,350][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:43:57,352][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:44:02,354][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:44:07,357][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:44:12,358][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:44:17,360][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:44:22,361][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:44:27,363][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:44:32,366][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:44:37,372][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:44:42,451][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:44:47,453][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:44:52,455][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:44:57,456][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:45:02,472][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:45:07,473][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:45:12,475][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:45:17,498][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:45:22,499][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:45:27,555][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:45:32,557][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:45:37,588][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:45:42,590][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:45:47,595][  INFO][PID:1847812] Checking for cancel request
[2025-10-14 21:45:49,791][  INFO][PID:1847812] Downloading results from builder
[2025-10-14 21:45:49,792][  INFO][PID:1847812] rsyncing of mockbuilder@140.211.168.83:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-42-ppc64le/09688935-ipython started
[2025-10-14 21:45:49,793][  INFO][PID:1847812] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@140.211.168.83:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-42-ppc64le/09688935-ipython/ &> /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-42-ppc64le/09688935-ipython/build-09688935.rsync.log
[2025-10-14 21:45:51,833][  INFO][PID:1847812] rsyncing finished.
[2025-10-14 21:45:51,834][  INFO][PID:1847812] Releasing VM back to pool
[2025-10-14 21:45:51,842][  INFO][PID:1847812] Searching for 'success' file in resultdir
[2025-10-14 21:45:51,843][ ERROR][PID:1847812] Build failed: Backend process error: No success file => build failure
[2025-10-14 21:45:51,844][  INFO][PID:1847812] Finished build: id=9688935 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1 chroot=fedora-42-ppc64le 
[2025-10-14 21:45:51,845][ ERROR][PID:1847812] Backend process error: No success file => build failure
[2025-10-14 21:45:51,846][  INFO][PID:1847812] Worker failed build, took 151.91535902023315
[2025-10-14 21:45:51,846][  INFO][PID:1847812] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "psimovec",
            "project_name": "python3-scipy-1.10.1",
            "project_dirname": "python3-scipy-1.10.1",
            "submitter": "https://src.fedoraproject.org/user/churchyard",
            "ended_on": 1760478351.8461711,
            "started_on": 1760478199.9308121,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-42-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9688935-fedora-42-ppc64le",
            "build_id": 9688935,
            "package_name": "ipython",
            "package_version": "8.37.0-11",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/python3-scipy-1.10.1/ipython",
            "git_hash": "44497fbf6cd9eda4abc91f903ea4af22026d9286",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "psimovec/python3-scipy-1.10.1--https://src.fedoraproject.org/user/churchyard",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.10.1/fedora-42-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/",
                    "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch",
                    "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.10.1",
            "result_dir": "09688935-ipython",
            "built_packages": "",
            "id": 9688935,
            "mockchain_macros": {
                "copr_username": "psimovec",
                "copr_projectname": "python3-scipy-1.10.1",
                "vendor": "Fedora Project COPR (psimovec/python3-scipy-1.10.1)"
            }
        }
    ]
}
[2025-10-14 21:45:51,911][  INFO][PID:1847812] Sending fedora-messaging bus message in build.end
[2025-10-14 21:45:51,936][  INFO][PID:1847812] Compressing /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-42-ppc64le/09688935-ipython/builder-live.log by gzip
[2025-10-14 21:45:51,938][  INFO][PID:1847812] Running command 'gzip /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-42-ppc64le/09688935-ipython/builder-live.log' as PID 1926646
[2025-10-14 21:45:51,942][  INFO][PID:1847812] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-42-ppc64le/09688935-ipython/builder-live.log)
[2025-10-14 21:45:51,943][  INFO][PID:1847812] Compressing /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-42-ppc64le/09688935-ipython/backend.log by gzip
[2025-10-14 21:45:51,944][  INFO][PID:1847812] Running command 'gzip /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-42-ppc64le/09688935-ipython/backend.log' as PID 1926647