[2025-12-14 00:49:26,292][  INFO][PID:1887565] Marking build as starting
[2025-12-14 00:49:26,579][  INFO][PID:1887565] Checking that /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/repodata/repomd.xml exists
[2025-12-14 00:49:26,608][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:49:26,609][  INFO][PID:1887565] VM allocation process starts
[2025-12-14 00:49:26,656][  INFO][PID:1887565] Trying to allocate VM: ResallocHost, ticket_id=326295, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-14 00:49:31,657][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:49:32,710][  INFO][PID:1887565] Allocated host ResallocHost, ticket_id=326295, hostname=2620:52:6:1161:dead:beef:cafe:c193, name=vmhost_p09_04_prod_00530115_20251214_002404, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-14 00:49:32,710][  INFO][PID:1887565] Allocating ssh connection to builder
[2025-12-14 00:49:32,711][  INFO][PID:1887565] Checking that builder machine is OK
[2025-12-14 00:49:33,653][  INFO][PID:1887565] Running remote command: copr-builder-ready fedora-41-ppc64le
[2025-12-14 00:49:34,172][  INFO][PID:1887565] Red Hat subscription not needed for fedora-41-ppc64le
Builder is ready to be used

[2025-12-14 00:49:34,172][  INFO][PID:1887565] Filling build.info file with builder info
[2025-12-14 00:49:34,173][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:49:34,174][  INFO][PID:1887565] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "psimovec",
            "project_name": "openblas-0.3.23",
            "project_dirname": "openblas-0.3.23",
            "submitter": "https://src.fedoraproject.org/user/topazus",
            "ended_on": null,
            "started_on": 1765673374.174055,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-41-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9907029-fedora-41-ppc64le",
            "build_id": 9907029,
            "package_name": "mfem",
            "package_version": "4.9-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/mfem",
            "git_hash": "ece71df0f4912b6ac0fdccb9691285ba4f49e163",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/topazus",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/",
                    "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch",
                    "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23",
            "result_dir": "09907029-mfem",
            "built_packages": "",
            "id": 9907029,
            "mockchain_macros": {
                "copr_username": "psimovec",
                "copr_projectname": "openblas-0.3.23",
                "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)"
            }
        }
    ]
}
[2025-12-14 00:49:34,247][  INFO][PID:1887565] Sending fedora-messaging bus message in build.start
[2025-12-14 00:49:34,841][  INFO][PID:1887565] Sending fedora-messaging bus message in chroot.start
[2025-12-14 00:49:34,868][  INFO][PID:1887565] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9907029-fedora-41-ppc64le --chroot fedora-41-ppc64le --detached
[2025-12-14 00:49:35,797][  INFO][PID:1887565] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c193' (ED25519) to the list of known hosts.


[2025-12-14 00:49:35,800][  INFO][PID:1887565] Downloading the builder-live.log file, attempt 1
[2025-12-14 00:49:35,867][  INFO][PID:1887565] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c193 copr-rpmbuild-log
[2025-12-14 00:49:40,808][  INFO][PID:1887565] Periodic builder liveness probe: alive
[2025-12-14 00:49:40,808][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:49:45,809][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:49:50,810][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:49:55,811][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:50:00,812][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:50:05,813][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:50:10,814][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:50:15,815][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:50:20,816][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:50:25,817][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:50:30,818][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:50:35,819][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:50:35,895][ ERROR][PID:1887565] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-14 00:50:40,820][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:50:45,821][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:50:45,896][WARNING][PID:1887565] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-12-14 00:50:50,823][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:50:55,824][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:50:55,897][  INFO][PID:1887565] Downloading the builder-live.log file, attempt 2
[2025-12-14 00:50:55,898][  INFO][PID:1887565] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c193 copr-rpmbuild-log
[2025-12-14 00:51:00,825][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:51:05,826][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:51:10,827][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:51:15,828][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:51:20,829][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:51:25,830][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:51:30,831][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:51:35,832][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:51:40,833][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:51:45,834][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:51:50,835][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:51:55,836][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:52:00,837][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:52:05,838][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:52:10,839][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:52:15,840][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:52:20,841][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:52:25,842][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:52:30,843][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:52:35,844][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:52:40,845][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:52:45,846][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:52:50,847][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:52:55,848][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:53:00,849][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:53:05,850][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:53:10,851][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:53:15,852][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:53:20,853][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:53:25,854][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:53:30,855][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:53:35,856][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:53:40,857][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:53:45,858][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:53:50,859][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:53:55,861][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:54:00,862][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:54:05,863][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:54:10,864][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:54:15,865][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:54:20,881][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:54:25,882][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:54:30,883][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:54:35,884][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:54:41,215][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:54:46,216][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:54:51,218][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:54:56,219][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:55:01,220][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:55:06,292][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:55:11,293][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:55:16,294][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:55:21,295][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:55:26,534][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:55:31,535][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:55:36,567][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:55:41,568][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:55:46,642][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:55:51,643][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:55:56,892][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:56:01,893][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:56:06,894][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:56:11,895][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:56:16,934][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:56:22,178][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:56:27,179][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:56:32,180][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:56:37,181][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:56:42,502][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:56:47,503][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:56:52,536][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:56:57,538][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:57:02,539][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:57:07,540][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:57:12,541][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:57:17,542][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:57:22,543][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:57:27,546][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:57:32,547][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:57:37,549][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:57:42,590][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:57:47,591][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:57:52,592][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:57:57,633][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:58:02,634][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:58:07,638][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:58:12,646][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:58:17,648][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:58:22,661][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:58:27,665][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:58:32,668][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:58:37,672][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:58:42,673][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:58:47,713][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:58:52,715][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:58:57,717][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:59:02,719][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:59:07,720][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:59:12,721][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:59:17,755][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:59:22,757][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:59:27,834][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:59:32,921][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:59:38,375][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:59:43,396][  INFO][PID:1887565] Periodic builder liveness probe: alive
[2025-12-14 00:59:43,396][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:59:48,397][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:59:53,398][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 00:59:58,399][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:00:03,400][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:00:08,401][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:00:13,402][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:00:18,522][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:00:23,524][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:00:28,525][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:00:33,526][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:00:38,854][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:00:43,855][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:00:48,856][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:00:53,857][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:00:58,858][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:01:03,859][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:01:08,860][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:01:13,861][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:01:18,862][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:01:23,863][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:01:28,864][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:01:33,866][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:01:38,920][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:01:43,954][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:01:49,134][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:01:54,135][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:01:59,296][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:02:04,298][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:02:09,299][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:02:14,301][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:02:19,302][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:02:24,303][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:02:29,304][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:02:34,306][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:02:39,307][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:02:44,452][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:02:49,453][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:02:54,455][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:02:59,458][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:03:04,460][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:03:09,461][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:03:14,462][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:03:19,463][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:03:24,465][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:03:29,553][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:03:34,578][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:03:39,580][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:03:44,581][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:03:49,582][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:03:54,595][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:04:00,060][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:04:05,061][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:04:10,062][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:04:15,063][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:04:20,064][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:04:25,065][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:04:30,066][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:04:35,068][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:04:40,069][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:04:45,069][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:04:50,071][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:04:55,072][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:05:00,134][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:05:05,135][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:05:10,136][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:05:15,137][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:05:20,138][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:05:25,139][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:05:30,142][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:05:35,143][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:05:40,288][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:05:45,289][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:05:50,332][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:05:55,333][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:06:00,334][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:06:05,336][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:06:10,386][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:06:15,389][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:06:20,391][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:06:25,392][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:06:30,393][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:06:35,395][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:06:40,494][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:06:45,765][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:06:50,766][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:06:55,767][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:07:00,768][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:07:05,769][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:07:10,770][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:07:15,771][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:07:20,772][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:07:25,886][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:07:30,888][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:07:35,890][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:07:40,891][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:07:45,893][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:07:50,894][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:07:55,895][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:08:00,897][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:08:05,899][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:08:10,900][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:08:15,901][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:08:20,903][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:08:25,904][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:08:30,905][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:08:35,906][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:08:40,907][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:08:45,908][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:08:51,080][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:08:56,081][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:09:01,082][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:09:06,083][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:09:11,084][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:09:16,085][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:09:21,086][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:09:26,087][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:09:31,088][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:09:36,089][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:09:41,090][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:09:46,103][  INFO][PID:1887565] Periodic builder liveness probe: alive
[2025-12-14 01:09:46,104][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:09:51,105][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:09:56,106][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:10:01,107][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:10:06,109][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:10:11,110][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:10:16,111][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:10:21,114][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:10:26,115][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:10:31,116][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:10:36,117][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:10:41,118][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:10:46,122][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:10:51,124][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:10:56,125][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:11:01,126][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:11:06,127][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:11:11,129][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:11:16,130][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:11:21,190][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:11:26,282][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:11:31,283][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:11:36,284][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:11:41,453][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:11:46,454][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:11:51,455][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:11:56,505][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:12:01,506][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:12:06,523][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:12:11,524][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:12:16,525][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:12:21,526][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:12:26,527][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:12:31,571][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:12:36,574][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:12:41,590][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:12:46,616][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:12:51,679][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:12:56,817][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:13:01,822][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:13:06,869][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:13:12,065][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:13:17,066][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:13:22,340][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:13:27,348][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:13:32,348][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:13:37,456][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:13:42,458][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:13:47,503][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:13:52,511][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:13:57,517][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:14:02,518][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:14:07,578][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:14:12,614][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:14:17,615][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:14:22,661][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:14:27,663][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:14:32,665][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:14:37,667][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:14:42,825][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:14:47,856][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:14:52,857][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:14:57,860][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:15:02,861][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:15:07,873][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:15:12,915][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:15:18,024][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:15:23,026][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:15:28,027][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:15:33,028][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:15:38,061][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:15:43,064][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:15:48,067][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:15:53,069][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:15:58,088][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:16:03,170][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:16:08,171][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:16:13,172][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:16:18,278][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:16:23,280][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:16:28,283][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:16:33,285][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:16:38,289][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:16:43,298][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:16:48,300][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:16:53,302][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:16:58,416][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:17:03,417][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:17:08,695][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:17:13,699][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:17:18,701][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:17:23,701][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:17:28,703][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:17:33,705][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:17:38,709][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:17:43,709][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:17:48,711][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:17:53,714][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:17:58,715][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:18:03,717][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:18:08,723][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:18:13,731][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:18:18,733][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:18:23,734][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:18:28,736][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:18:33,741][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:18:38,753][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:18:43,759][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:18:48,760][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:18:53,762][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:18:58,763][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:19:03,765][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:19:08,766][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:19:13,788][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:19:18,892][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:19:23,896][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:19:28,900][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:19:33,905][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:19:39,051][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:19:44,052][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:19:49,812][  INFO][PID:1887565] Periodic builder liveness probe: alive
[2025-12-14 01:19:49,860][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:19:54,862][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:19:59,863][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:20:04,864][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:20:09,865][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:20:14,866][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:20:19,867][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:20:24,868][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:20:29,869][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:20:34,870][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:20:39,871][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:20:44,871][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:20:49,872][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:20:54,873][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:20:59,874][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:21:04,896][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:21:09,897][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:21:14,898][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:21:19,944][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:21:25,028][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:21:30,029][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:21:35,030][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:21:40,126][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:21:45,127][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:21:50,174][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:21:55,262][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:22:00,276][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:22:05,278][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:22:10,279][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:22:15,281][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:22:20,282][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:22:25,284][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:22:30,285][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:22:35,286][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:22:40,290][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:22:45,292][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:22:50,354][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:22:55,356][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:23:00,366][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:23:05,451][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:23:10,452][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:23:15,453][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:23:20,600][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:23:25,702][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:23:30,703][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:23:35,704][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:23:40,705][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:23:45,706][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:23:50,707][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:23:55,708][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:24:00,709][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:24:05,710][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:24:10,711][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:24:15,712][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:24:21,020][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:24:26,021][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:24:31,022][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:24:36,023][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:24:41,024][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:24:46,025][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:24:51,026][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:24:56,028][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:25:01,029][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:25:06,030][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:25:11,031][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:25:16,032][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:25:21,033][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:25:26,033][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:25:31,035][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:25:36,035][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:25:41,036][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:25:46,037][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:25:51,038][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:25:56,039][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:26:01,040][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:26:06,234][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:26:11,246][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:26:16,248][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:26:21,249][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:26:26,251][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:26:31,252][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:26:36,269][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:26:41,302][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:26:46,353][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:26:51,547][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:26:56,548][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:27:01,550][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:27:06,552][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:27:11,554][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:27:16,555][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:27:21,556][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:27:26,558][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:27:31,562][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:27:32,145][ ERROR][PID:1887565] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-14 01:27:36,744][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:27:41,746][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:27:42,161][WARNING][PID:1887565] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-12-14 01:27:46,748][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:27:51,749][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:27:52,169][  INFO][PID:1887565] Downloading the builder-live.log file, attempt 3
[2025-12-14 01:27:52,271][  INFO][PID:1887565] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c193 copr-rpmbuild-log
[2025-12-14 01:27:56,751][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:28:01,842][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:28:06,843][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:28:11,845][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:28:16,846][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:28:21,848][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:28:26,850][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:28:31,851][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:28:36,851][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:28:41,852][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:28:46,853][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:28:51,855][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:28:56,856][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:29:01,909][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:29:06,975][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:29:11,976][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:29:16,977][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:29:21,978][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:29:26,980][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:29:31,980][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:29:36,981][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:29:42,083][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:29:47,231][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:29:53,304][  INFO][PID:1887565] Periodic builder liveness probe: dead
[2025-12-14 01:29:53,305][  INFO][PID:1887565] calling cancel callback, and waiting
[2025-12-14 01:29:54,090][WARNING][PID:1887565] Can't cancel build
out:

err:
Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c193' (ED25519) to the list of known hosts.
Traceback (most recent call last):
  File "/usr/bin/copr-rpmbuild-cancel", line 85, in <module>
    _main()
    ~~~~~^^
  File "/usr/bin/copr-rpmbuild-cancel", line 69, in _main
    with open(pidfile, "r") as pidfd:
         ~~~~^^^^^^^^^^^^^^
FileNotFoundError: [Errno 2] No such file or directory: '/var/lib/copr-rpmbuild/pid'

[2025-12-14 01:29:54,111][ ERROR][PID:1887565] Re-try request for task on 'ResallocHost, ticket_id=326295, hostname=2620:52:6:1161:dead:beef:cafe:c193, name=vmhost_p09_04_prod_00530115_20251214_002404, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED
[2025-12-14 01:29:54,112][  INFO][PID:1887565] Releasing VM back to pool
[2025-12-14 01:29:54,129][  INFO][PID:1887565] Retry #1 (on other host)
[2025-12-14 01:29:54,151][  INFO][PID:1887565] Checking that /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/repodata/repomd.xml exists
[2025-12-14 01:29:54,180][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:29:54,182][  INFO][PID:1887565] VM allocation process starts
[2025-12-14 01:29:54,258][  INFO][PID:1887565] Trying to allocate VM: ResallocHost, ticket_id=326554, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-14 01:29:59,264][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:30:00,404][  INFO][PID:1887565] Allocated host ResallocHost, ticket_id=326554, hostname=2620:52:6:1161:dead:beef:cafe:c18b, name=vmhost_p09_04_prod_00530671_20251214_011517, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-14 01:30:00,407][  INFO][PID:1887565] Allocating ssh connection to builder
[2025-12-14 01:30:00,413][  INFO][PID:1887565] Checking that builder machine is OK
[2025-12-14 01:30:01,427][  INFO][PID:1887565] Running remote command: copr-builder-ready fedora-41-ppc64le
[2025-12-14 01:30:01,976][  INFO][PID:1887565] Red Hat subscription not needed for fedora-41-ppc64le
Builder is ready to be used

[2025-12-14 01:30:01,980][  INFO][PID:1887565] Filling build.info file with builder info
[2025-12-14 01:30:02,006][  INFO][PID:1887565] Checking for cancel request
[2025-12-14 01:30:02,015][  INFO][PID:1887565] Not re-notifying FE and msg buses for the new host.
[2025-12-14 01:30:02,024][  INFO][PID:1887565] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9907029-fedora-41-ppc64le --chroot fedora-41-ppc64le --detached
[2025-12-14 01:30:03,000][  INFO][PID:1887565] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c18b' (ED25519) to the list of known hosts.


[2025-12-14 01:30:03,002][  INFO][PID:1887565] Downloading the builder-live.log file, attempt 1
[2025-12-14 01:30:03,003][  INFO][PID:1887565] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c18b copr-rpmbuild-log
[2025-12-14 01:30:08,002][  INFO][PID:1887565] calling cancel callback, and waiting
[2025-12-14 01:30:11,767][  INFO][PID:1887565] Cancel request succeeded
out:
success
err:
Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c18b' (ED25519) to the list of known hosts.

[2025-12-14 01:30:11,771][  INFO][PID:1887565] Downloading results from builder
[2025-12-14 01:30:11,781][  INFO][PID:1887565] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18b]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09907029-mfem started
[2025-12-14 01:30:11,790][  INFO][PID:1887565] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18b]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09907029-mfem/ &> /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09907029-mfem/build-09907029.rsync.log
[2025-12-14 01:30:12,784][  INFO][PID:1887565] rsyncing finished.
[2025-12-14 01:30:12,786][  INFO][PID:1887565] Releasing VM back to pool
[2025-12-14 01:30:12,800][  INFO][PID:1887565] Searching for 'success' file in resultdir
[2025-12-14 01:30:12,803][ ERROR][PID:1887565] Build failed: Backend process error: No success file => build failure
[2025-12-14 01:30:12,904][  INFO][PID:1887565] Finished build: id=9907029 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/openblas-0.3.23 chroot=fedora-41-ppc64le 
[2025-12-14 01:30:12,977][ ERROR][PID:1887565] Backend process error: No success file => build failure
[2025-12-14 01:30:12,979][  INFO][PID:1887565] Worker failed build, took 10.971380949020386
[2025-12-14 01:30:12,992][  INFO][PID:1887565] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "psimovec",
            "project_name": "openblas-0.3.23",
            "project_dirname": "openblas-0.3.23",
            "submitter": "https://src.fedoraproject.org/user/topazus",
            "ended_on": 1765675812.979197,
            "started_on": 1765675802.007816,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-41-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9907029-fedora-41-ppc64le",
            "build_id": 9907029,
            "package_name": "mfem",
            "package_version": "4.9-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/mfem",
            "git_hash": "ece71df0f4912b6ac0fdccb9691285ba4f49e163",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/topazus",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/",
                    "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch",
                    "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23",
            "result_dir": "09907029-mfem",
            "built_packages": "",
            "id": 9907029,
            "mockchain_macros": {
                "copr_username": "psimovec",
                "copr_projectname": "openblas-0.3.23",
                "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)"
            }
        }
    ]
}
[2025-12-14 01:30:13,786][  INFO][PID:1887565] Sending fedora-messaging bus message in build.end
[2025-12-14 01:30:14,175][  INFO][PID:1887565] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09907029-mfem/builder-live.log by gzip
[2025-12-14 01:30:14,180][  INFO][PID:1887565] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09907029-mfem/builder-live.log' as PID 2048665
[2025-12-14 01:30:14,190][  INFO][PID:1887565] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09907029-mfem/builder-live.log)
[2025-12-14 01:30:14,195][  INFO][PID:1887565] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09907029-mfem/backend.log by gzip
[2025-12-14 01:30:14,195][  INFO][PID:1887565] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-ppc64le/09907029-mfem/backend.log' as PID 2048667