[2025-09-10 03:53:09,828][  INFO][PID:2240731] Marking build as starting
[2025-09-10 03:53:09,968][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:53:09,969][  INFO][PID:2240731] VM allocation process starts
[2025-09-10 03:53:10,286][  INFO][PID:2240731] Trying to allocate VM: ResallocHost, ticket_id=4989695, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-09-10 03:53:15,299][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:53:20,301][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:53:25,303][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:53:30,316][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:53:35,325][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:53:40,334][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:53:45,336][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:53:50,342][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:53:55,361][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:54:00,377][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:54:05,378][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:54:10,390][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:54:15,402][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:54:20,524][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:54:25,528][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:54:30,613][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:54:35,765][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:54:40,933][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:54:45,965][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:54:52,104][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:54:57,250][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:54:58,652][  INFO][PID:2240731] Allocated host ResallocHost, ticket_id=4989695, hostname=140.211.168.5, name=copr_osuosl_p09_prod_06688490_20250910_034622, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-09-10 03:54:58,653][  INFO][PID:2240731] Allocating ssh connection to builder
[2025-09-10 03:54:58,654][  INFO][PID:2240731] Checking that builder machine is OK
[2025-09-10 03:55:00,086][  INFO][PID:2240731] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-09-10 03:55:01,111][  INFO][PID:2240731] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-09-10 03:55:01,112][  INFO][PID:2240731] Filling build.info file with builder info
[2025-09-10 03:55:01,114][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:55:01,117][  INFO][PID:2240731] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "psimovec",
            "project_name": "scipy-1.10.0",
            "project_dirname": "scipy-1.10.0",
            "submitter": "https://src.fedoraproject.org/user/music",
            "ended_on": null,
            "started_on": 1757476501.1173704,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9541550-fedora-rawhide-ppc64le",
            "build_id": 9541550,
            "package_name": "snakemake",
            "package_version": "9.11.2-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/scipy-1.10.0/snakemake",
            "git_hash": "d2a5e17ca7135919af55efba986158fb11d5b593",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "psimovec/scipy-1.10.0--https://src.fedoraproject.org/user/music",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/",
                    "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch",
                    "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/psimovec/scipy-1.10.0",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/scipy-1.10.0",
            "result_dir": "09541550-snakemake",
            "built_packages": "",
            "id": 9541550,
            "mockchain_macros": {
                "copr_username": "psimovec",
                "copr_projectname": "scipy-1.10.0",
                "vendor": "Fedora Project COPR (psimovec/scipy-1.10.0)"
            }
        }
    ]
}
[2025-09-10 03:55:01,233][  INFO][PID:2240731] Sending fedora-messaging bus message in build.start
[2025-09-10 03:55:05,511][  INFO][PID:2240731] Sending fedora-messaging bus message in chroot.start
[2025-09-10 03:55:05,634][  INFO][PID:2240731] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9541550-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-09-10 03:55:06,987][  INFO][PID:2240731] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '140.211.168.5' (ED25519) to the list of known hosts.


[2025-09-10 03:55:09,106][  INFO][PID:2240731] Downloading the builder-live.log file, attempt 1
[2025-09-10 03:55:09,116][  INFO][PID:2240731] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.5 copr-rpmbuild-log
[2025-09-10 03:55:14,197][  INFO][PID:2240731] Periodic builder liveness probe: alive
[2025-09-10 03:55:14,198][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:55:19,203][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:55:24,210][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:55:29,220][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:55:34,227][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:55:39,236][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:55:44,247][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:55:49,255][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:55:54,294][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:56:00,094][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:56:05,146][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:56:10,175][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:56:15,180][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:56:20,216][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:56:25,229][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:56:30,242][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:56:35,263][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:56:40,275][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:56:45,308][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:56:50,321][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:56:55,325][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:57:00,331][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:57:05,350][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:57:10,357][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:57:15,413][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:57:20,420][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:57:25,422][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:57:30,426][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:57:35,711][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:57:42,178][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:57:48,060][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:57:53,069][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:57:58,091][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:58:03,103][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:58:08,115][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:58:13,129][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:58:18,132][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:58:23,159][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:58:28,174][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:58:33,183][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:58:38,208][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:58:43,220][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:58:48,227][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:58:53,257][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:58:58,352][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:59:03,533][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:59:08,608][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:59:13,662][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:59:18,780][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:59:23,855][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:59:28,994][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:59:34,166][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:59:39,202][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:59:44,204][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:59:49,218][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:59:54,247][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 03:59:59,249][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:00:04,251][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:00:09,253][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:00:14,255][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:00:19,256][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:00:24,258][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:00:29,264][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:00:34,279][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:00:39,282][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:00:44,284][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:00:49,288][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:00:54,293][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:00:59,304][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:01:04,328][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:01:09,336][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:01:14,350][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:01:19,365][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:01:24,376][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:01:29,388][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:01:34,395][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:01:39,409][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:01:44,424][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:01:49,426][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:01:54,445][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:01:59,448][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:02:04,452][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:02:09,484][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:02:14,496][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:02:19,500][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:02:24,503][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:02:29,507][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:02:34,508][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:02:39,510][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:02:44,511][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:02:49,513][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:02:54,517][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:02:59,520][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:03:04,526][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:03:09,527][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:03:14,533][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:03:19,535][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:03:24,538][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:03:29,541][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:03:34,542][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:03:39,548][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:03:44,549][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:03:49,552][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:03:54,553][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:03:59,556][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:04:04,561][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:04:09,563][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:04:14,567][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:04:19,574][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:04:24,577][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:04:29,584][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:04:34,590][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:04:39,600][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:04:44,603][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:04:49,606][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:04:54,612][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:04:59,619][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:05:04,621][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:05:09,630][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:05:14,648][  INFO][PID:2240731] Periodic builder liveness probe: alive
[2025-09-10 04:05:14,649][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:05:19,653][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:05:24,654][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:05:29,656][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:05:34,657][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:05:39,658][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:05:44,662][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:05:49,666][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:05:54,672][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:05:59,675][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:06:04,678][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:06:09,681][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:06:14,683][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:06:19,684][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:06:24,695][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:06:29,696][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:06:34,698][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:06:39,704][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:06:44,706][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:06:49,920][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:06:55,021][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:07:00,496][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:07:05,537][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:07:10,661][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:07:15,755][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:07:21,197][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:07:26,245][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:07:31,305][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:07:36,401][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:07:41,678][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:07:46,869][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:07:51,958][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:07:56,981][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:08:02,072][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:08:07,240][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:08:12,262][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:08:17,339][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:08:22,424][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:08:27,483][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:08:32,531][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:08:37,644][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:08:42,765][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:08:47,791][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:08:52,859][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:08:58,066][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:09:03,115][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:09:08,146][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:09:13,237][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:09:18,306][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:09:23,324][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:09:28,532][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:09:33,539][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:09:38,629][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:09:44,174][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:09:49,831][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:09:58,227][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:10:03,614][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:10:08,724][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:10:15,029][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:10:20,130][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:10:25,726][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:10:31,883][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:10:37,001][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:10:42,074][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:10:47,110][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:10:53,688][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:10:58,787][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:11:03,820][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:11:09,005][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:11:14,065][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:11:19,094][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:11:24,101][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:11:30,047][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:11:36,563][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:11:41,824][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:11:47,906][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:11:53,136][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:11:58,311][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:12:03,490][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:12:08,889][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:12:13,996][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:12:19,163][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:12:24,281][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:12:29,302][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:12:34,305][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:12:39,363][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:12:44,428][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:12:49,454][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:12:54,479][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:12:59,519][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:13:04,741][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:13:10,531][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:13:16,158][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:13:21,380][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:13:26,463][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:13:31,520][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:13:36,577][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:13:41,654][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:13:46,720][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:13:51,800][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:13:56,902][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:14:02,005][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:14:07,073][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:14:12,079][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:14:17,171][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:14:22,216][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:14:27,236][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:14:32,240][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:14:37,246][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:14:42,247][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:14:47,251][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:14:52,254][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:14:57,256][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:15:02,368][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:15:07,446][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:15:12,476][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:15:17,585][  INFO][PID:2240731] Periodic builder liveness probe: alive
[2025-09-10 04:15:17,599][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:15:22,604][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:15:27,609][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:15:32,618][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:15:37,624][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:15:42,628][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:15:47,637][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:15:52,705][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:15:58,048][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:16:03,183][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:16:08,393][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:16:13,449][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:16:18,482][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:16:23,549][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:16:28,584][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:16:33,611][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:16:38,622][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:16:43,624][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:16:48,755][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:16:53,790][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:16:58,840][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:17:03,892][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:17:08,914][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:17:13,916][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:17:18,925][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:17:23,928][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:17:29,077][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:17:34,104][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:17:39,368][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:17:44,396][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:17:49,452][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:17:54,454][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:17:59,471][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:18:04,574][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:18:09,583][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:18:14,588][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:18:19,593][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:18:24,603][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:18:29,614][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:18:34,765][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:18:39,823][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:18:44,855][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:18:49,905][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:18:54,969][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:18:59,979][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:19:05,034][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:19:10,103][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:19:15,156][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:19:20,180][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:19:25,188][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:19:30,287][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:19:35,341][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:19:40,389][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:19:45,453][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:19:50,507][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:19:55,544][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:20:00,615][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:20:05,643][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:20:10,950][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:20:16,009][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:20:21,096][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:20:26,127][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:20:31,196][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:20:36,334][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:20:41,548][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:20:46,731][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:20:51,920][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:20:56,998][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:21:02,095][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:21:07,106][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:21:12,123][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:21:17,170][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:21:22,240][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:21:28,431][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:21:33,444][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:21:38,457][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:21:43,963][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:21:49,019][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:21:54,064][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:21:59,178][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:22:04,191][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:22:09,233][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:22:14,323][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:22:19,381][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:22:24,437][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:22:29,445][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:22:34,458][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:22:39,506][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:22:44,518][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:22:49,640][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:22:55,499][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:23:00,575][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:23:05,718][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:23:11,317][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:23:16,577][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:23:21,583][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:23:26,675][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:23:31,866][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:23:36,875][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:23:42,149][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:23:47,237][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:23:52,347][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:23:57,391][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:24:02,527][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:24:07,651][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:24:12,699][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:24:17,731][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:24:22,761][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:24:27,779][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:24:32,812][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:24:37,830][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:24:42,833][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:24:47,842][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:24:52,861][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:24:57,980][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:25:03,261][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:25:09,115][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:25:14,815][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:25:20,744][  INFO][PID:2240731] Periodic builder liveness probe: alive
[2025-09-10 04:25:21,840][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:25:26,891][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:25:33,043][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:25:39,233][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:25:44,808][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:25:50,090][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:25:55,106][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:26:00,900][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:26:06,271][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:26:11,343][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:26:16,692][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:26:22,816][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:26:27,959][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:26:33,100][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:26:38,482][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:26:43,486][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:26:48,618][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:26:53,667][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:26:58,767][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:27:04,204][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:27:09,510][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:27:14,531][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:27:19,562][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:27:24,591][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:27:29,809][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:27:34,826][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:27:39,989][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:27:45,339][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:27:50,510][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:27:55,656][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:28:01,374][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:28:06,521][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:28:12,089][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:28:17,105][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:28:22,145][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:28:27,410][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:28:32,585][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:28:37,676][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:28:42,686][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:28:47,778][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:28:52,847][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:28:57,858][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:29:02,862][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:29:07,875][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:29:12,884][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:29:17,885][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:29:22,890][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:29:27,891][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:29:32,894][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:29:37,895][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:29:42,897][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:29:48,253][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:29:53,256][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:29:58,269][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:30:03,296][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:30:08,323][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:30:13,399][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:30:18,638][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:30:23,646][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:30:28,649][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:30:33,881][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:30:39,259][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:30:44,268][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:30:49,413][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:30:54,415][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:30:59,575][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:31:04,670][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:31:09,948][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:31:14,985][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:31:19,986][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:31:24,987][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:31:29,992][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:31:34,994][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:31:40,077][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:31:45,218][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:31:50,252][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:31:55,333][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:32:00,345][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:32:05,353][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:32:10,363][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:32:15,552][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:32:20,886][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:32:26,024][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:32:31,166][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:32:36,224][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:32:41,483][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:32:46,528][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:32:51,559][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:32:56,580][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:33:01,590][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:33:06,853][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:33:12,003][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:33:17,044][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:33:22,156][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:33:27,160][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:33:32,188][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:33:32,193][ ERROR][PID:2240731] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-10 04:33:37,225][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:33:42,224][WARNING][PID:2240731] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-09-10 04:33:42,303][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:33:47,360][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:33:52,226][  INFO][PID:2240731] Downloading the builder-live.log file, attempt 2
[2025-09-10 04:33:52,228][  INFO][PID:2240731] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.5 copr-rpmbuild-log
[2025-09-10 04:33:52,401][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:33:57,405][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:34:02,410][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:34:07,433][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:34:12,450][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:34:17,527][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:34:22,628][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:34:27,670][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:34:32,863][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:34:38,000][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:34:43,088][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:34:48,431][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:34:52,307][ ERROR][PID:2240731] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-10 04:34:53,729][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:34:58,781][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:35:02,467][WARNING][PID:2240731] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-09-10 04:35:03,841][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:35:08,890][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:35:12,471][  INFO][PID:2240731] Downloading the builder-live.log file, attempt 3
[2025-09-10 04:35:12,473][  INFO][PID:2240731] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.5 copr-rpmbuild-log
[2025-09-10 04:35:13,899][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:35:18,915][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:35:23,945][  INFO][PID:2240731] Periodic builder liveness probe: dead
[2025-09-10 04:35:23,948][  INFO][PID:2240731] calling cancel callback, and waiting
[2025-09-10 04:36:12,545][ ERROR][PID:2240731] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-10 04:36:22,550][WARNING][PID:2240731] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-09-10 04:36:24,058][ ERROR][PID:2240731] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.5 port 22: Connection timed out

[2025-09-10 04:36:32,552][  INFO][PID:2240731] Downloading the builder-live.log file, attempt 4
[2025-09-10 04:36:32,553][  INFO][PID:2240731] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.5 copr-rpmbuild-log
[2025-09-10 04:37:32,623][ ERROR][PID:2240731] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-10 04:37:34,132][ ERROR][PID:2240731] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.5 port 22: Connection timed out

[2025-09-10 04:37:42,637][ ERROR][PID:2240731] Giving up for unstable SSH, failures: 1757478822.2247386, 1757478902.4674807, 1757478982.5509036, 1757479062.6369634
[2025-09-10 04:38:44,205][ ERROR][PID:2240731] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.5 port 22: Connection timed out

[2025-09-10 04:39:54,301][ ERROR][PID:2240731] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.5 port 22: Connection timed out

[2025-09-10 04:40:04,419][ ERROR][PID:2240731] Can't ssh to cancel build.
[2025-09-10 04:40:04,423][ ERROR][PID:2240731] Re-try request for task on 'ResallocHost, ticket_id=4989695, hostname=140.211.168.5, name=copr_osuosl_p09_prod_06688490_20250910_034622, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED
[2025-09-10 04:40:04,425][  INFO][PID:2240731] Releasing VM back to pool
[2025-09-10 04:40:04,453][  INFO][PID:2240731] Retry #1 (on other host)
[2025-09-10 04:40:04,463][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:40:04,467][  INFO][PID:2240731] VM allocation process starts
[2025-09-10 04:40:04,491][  INFO][PID:2240731] Trying to allocate VM: ResallocHost, ticket_id=4990675, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-09-10 04:40:09,495][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:40:14,496][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:40:19,500][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:40:24,502][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:40:29,508][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:40:32,582][  INFO][PID:2240731] Allocated host ResallocHost, ticket_id=4990675, hostname=2620:52:3:1:dead:beef:cafe:c20c, name=copr_hv_ppc64le_01_prod_06689023_20250910_043111, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-09-10 04:40:32,583][  INFO][PID:2240731] Allocating ssh connection to builder
[2025-09-10 04:40:32,583][  INFO][PID:2240731] Checking that builder machine is OK
[2025-09-10 04:40:35,287][  INFO][PID:2240731] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-09-10 04:40:36,588][  INFO][PID:2240731] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-09-10 04:40:36,590][  INFO][PID:2240731] Filling build.info file with builder info
[2025-09-10 04:40:36,602][  INFO][PID:2240731] Checking for cancel request
[2025-09-10 04:40:36,605][  INFO][PID:2240731] Not re-notifying FE and msg buses for the new host.
[2025-09-10 04:40:36,606][  INFO][PID:2240731] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9541550-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-09-10 04:40:37,808][  INFO][PID:2240731] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c20c' (ED25519) to the list of known hosts.


[2025-09-10 04:40:37,809][  INFO][PID:2240731] Downloading the builder-live.log file, attempt 1
[2025-09-10 04:40:37,812][  INFO][PID:2240731] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c20c copr-rpmbuild-log
[2025-09-10 04:40:42,810][  INFO][PID:2240731] calling cancel callback, and waiting
[2025-09-10 04:40:47,398][  INFO][PID:2240731] Cancel request succeeded
out:
success
err:
Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c20c' (ED25519) to the list of known hosts.

[2025-09-10 04:40:47,399][  INFO][PID:2240731] Downloading results from builder
[2025-09-10 04:40:47,399][  INFO][PID:2240731] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c20c]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09541550-snakemake started
[2025-09-10 04:40:47,400][  INFO][PID:2240731] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c20c]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09541550-snakemake/ &> /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09541550-snakemake/build-09541550.rsync.log
[2025-09-10 04:40:49,180][  INFO][PID:2240731] rsyncing finished.
[2025-09-10 04:40:49,180][  INFO][PID:2240731] Releasing VM back to pool
[2025-09-10 04:40:49,198][  INFO][PID:2240731] Searching for 'success' file in resultdir
[2025-09-10 04:40:49,198][ ERROR][PID:2240731] Build failed: Backend process error: No success file => build failure
[2025-09-10 04:40:49,200][  INFO][PID:2240731] Finished build: id=9541550 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/scipy-1.10.0 chroot=fedora-rawhide-ppc64le 
[2025-09-10 04:40:49,203][ ERROR][PID:2240731] Backend process error: No success file => build failure
[2025-09-10 04:40:49,204][  INFO][PID:2240731] Worker failed build, took 12.599032640457153
[2025-09-10 04:40:49,205][  INFO][PID:2240731] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "psimovec",
            "project_name": "scipy-1.10.0",
            "project_dirname": "scipy-1.10.0",
            "submitter": "https://src.fedoraproject.org/user/music",
            "ended_on": 1757479249.204729,
            "started_on": 1757479236.6056964,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9541550-fedora-rawhide-ppc64le",
            "build_id": 9541550,
            "package_name": "snakemake",
            "package_version": "9.11.2-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/scipy-1.10.0/snakemake",
            "git_hash": "d2a5e17ca7135919af55efba986158fb11d5b593",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "psimovec/scipy-1.10.0--https://src.fedoraproject.org/user/music",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/",
                    "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch",
                    "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/psimovec/scipy-1.10.0",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/scipy-1.10.0",
            "result_dir": "09541550-snakemake",
            "built_packages": "",
            "id": 9541550,
            "mockchain_macros": {
                "copr_username": "psimovec",
                "copr_projectname": "scipy-1.10.0",
                "vendor": "Fedora Project COPR (psimovec/scipy-1.10.0)"
            }
        }
    ]
}
[2025-09-10 04:40:49,262][  INFO][PID:2240731] Sending fedora-messaging bus message in build.end
[2025-09-10 04:40:49,293][  INFO][PID:2240731] Compressing /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09541550-snakemake/builder-live.log by gzip
[2025-09-10 04:40:49,295][  INFO][PID:2240731] Running command 'gzip /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09541550-snakemake/builder-live.log' as PID 2669001
[2025-09-10 04:40:49,309][  INFO][PID:2240731] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09541550-snakemake/builder-live.log)
[2025-09-10 04:40:49,310][  INFO][PID:2240731] Compressing /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09541550-snakemake/backend.log by gzip
[2025-09-10 04:40:49,312][  INFO][PID:2240731] Running command 'gzip /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09541550-snakemake/backend.log' as PID 2669004