[2026-09-18 14:29:21,075][  INFO][PID:2922485] Marking build as starting
[2026-09-18 14:29:21,115][  INFO][PID:2922485] Checking that /var/lib/copr/public_html/results/@python/python3.15:pr:fork-r0x0d-rpms-python-rich-rst-7/fedora-rawhide-x86_64/repodata/repomd.xml exists
[2026-09-18 14:29:21,116][  INFO][PID:2922485] Checking that /var/lib/copr/public_html/results/@python/python3.15:pr:fork-r0x0d-rpms-python-rich-rst-7/fedora-rawhide-x86_64/repodata/repomd.xml exists
[2026-09-18 14:29:21,116][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:29:21,133][  INFO][PID:2922485] rpmeta: package python-rich-rst not known to model, skipping
[2026-09-18 14:29:21,134][  INFO][PID:2922485] VM allocation process starts
[2026-09-18 14:29:21,140][  INFO][PID:2922485] Trying to allocate VM: ResallocHost, ticket_id=5105084, requested_tags=['arch_x86_64', 'copr_builder']
[2026-09-18 14:29:26,142][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:29:31,358][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:29:36,359][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:29:42,185][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:29:47,186][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:29:52,187][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:29:57,188][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:30:02,189][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:30:07,193][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:30:12,193][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:30:17,194][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:30:22,196][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:30:27,197][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:30:32,198][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:30:37,201][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:30:42,297][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:30:47,298][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:30:52,299][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:30:57,300][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:31:02,301][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:31:07,301][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:31:12,302][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:31:17,303][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:31:22,304][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:31:27,306][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:31:32,307][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:31:37,309][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:31:42,310][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:31:47,311][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:31:52,312][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:31:57,313][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:32:02,314][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:32:07,317][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:32:12,318][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:32:17,319][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:32:22,320][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:32:27,320][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:32:32,321][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:32:37,322][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:32:42,323][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:32:47,426][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:32:52,426][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:32:57,578][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:33:02,581][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:33:07,584][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:33:12,586][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:33:17,803][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:33:22,804][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:33:27,806][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:33:32,809][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:33:38,042][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:33:43,043][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:33:48,044][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:33:53,046][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:33:58,047][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:34:03,048][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:34:08,049][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:34:13,056][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:34:18,057][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:34:23,058][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:34:28,059][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:34:33,060][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:34:38,124][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:34:43,126][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:34:48,128][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:34:53,129][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:34:58,130][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:35:03,132][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:35:08,133][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:35:13,135][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:35:18,136][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:35:23,137][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:35:28,138][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:35:33,140][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:35:38,141][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:35:43,141][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:35:48,143][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:35:53,144][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:35:58,146][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:36:03,147][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:36:08,150][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:36:13,151][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:36:18,152][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:36:23,154][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:36:28,155][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:36:33,156][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:36:38,158][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:36:43,159][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:36:48,160][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:36:53,163][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:36:58,163][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:37:03,164][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:37:08,165][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:37:13,166][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:37:18,167][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:37:23,168][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:37:28,168][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:37:33,169][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:37:38,921][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:37:39,214][  INFO][PID:2922485] Allocated host ResallocHost, ticket_id=5105084, hostname=2620:52:6:1161:dead:beef:cafe:c12f, name=vmhost_x86_03_prod_40065910_20260918_143527, requested_tags=['arch_x86_64', 'copr_builder']
[2026-09-18 14:37:39,215][  INFO][PID:2922485] Allocating ssh connection to builder
[2026-09-18 14:37:39,215][  INFO][PID:2922485] Checking that builder machine is OK
[2026-09-18 14:37:39,773][  INFO][PID:2922485] Installed copr-rpmbuild version: 1.9
[2026-09-18 14:37:39,774][  INFO][PID:2922485] Running remote command: copr-builder-ready fedora-rawhide-x86_64
[2026-09-18 14:38:39,839][ ERROR][PID:2922485] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c12f port 22: Connection timed out

[2026-09-18 14:38:49,845][ ERROR][PID:2922485] Re-try request for task on 'ResallocHost, ticket_id=5105084, hostname=2620:52:6:1161:dead:beef:cafe:c12f, name=vmhost_x86_03_prod_40065910_20260918_143527, requested_tags=['arch_x86_64', 'copr_builder']': Unable to finish after 1 SSH attempts
[2026-09-18 14:38:49,850][  INFO][PID:2922485] VM Release request
[2026-09-18 14:38:49,857][  INFO][PID:2922485] Retry #1 (on other host)
[2026-09-18 14:38:49,857][  INFO][PID:2922485] Checking that /var/lib/copr/public_html/results/@python/python3.15:pr:fork-r0x0d-rpms-python-rich-rst-7/fedora-rawhide-x86_64/repodata/repomd.xml exists
[2026-09-18 14:38:49,858][  INFO][PID:2922485] Checking that /var/lib/copr/public_html/results/@python/python3.15:pr:fork-r0x0d-rpms-python-rich-rst-7/fedora-rawhide-x86_64/repodata/repomd.xml exists
[2026-09-18 14:38:49,858][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:38:49,872][  INFO][PID:2922485] rpmeta: package python-rich-rst not known to model, skipping
[2026-09-18 14:38:49,873][  INFO][PID:2922485] VM allocation process starts
[2026-09-18 14:38:49,879][  INFO][PID:2922485] Trying to allocate VM: ResallocHost, ticket_id=5105438, requested_tags=['arch_x86_64', 'copr_builder']
[2026-09-18 14:38:54,880][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:38:59,881][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:39:04,881][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:39:09,882][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:39:14,883][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:39:19,884][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:39:24,885][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:39:29,886][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:39:34,887][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:39:40,462][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:39:45,466][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:39:50,467][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:39:55,469][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:40:00,470][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:40:05,471][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:40:10,472][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:40:15,473][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:40:20,474][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:40:25,475][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:40:30,476][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:40:35,476][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:40:40,477][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:40:45,478][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:40:50,479][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:40:55,481][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:41:00,481][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:41:05,482][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:41:07,920][  INFO][PID:2922485] Allocated host ResallocHost, ticket_id=5105438, hostname=3.91.27.10, name=aws_x86_64_normal_prod_40066194_20260918_143754, requested_tags=['arch_x86_64', 'copr_builder']
[2026-09-18 14:41:07,921][  INFO][PID:2922485] Allocating ssh connection to builder
[2026-09-18 14:41:07,921][  INFO][PID:2922485] Checking that builder machine is OK
[2026-09-18 14:41:08,234][  INFO][PID:2922485] Installed copr-rpmbuild version: 1.9
[2026-09-18 14:41:08,235][  INFO][PID:2922485] Running remote command: copr-builder-ready fedora-rawhide-x86_64
[2026-09-18 14:41:08,394][  INFO][PID:2922485] Red Hat subscription not needed for fedora-rawhide-x86_64
Builder is ready to be used

[2026-09-18 14:41:08,394][  INFO][PID:2922485] Filling build.info file with builder info
[2026-09-18 14:41:08,394][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:41:08,395][  INFO][PID:2922485] Not re-notifying FE and msg buses for the new host.
[2026-09-18 14:41:08,395][  INFO][PID:2922485] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/11001021-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached
[2026-09-18 14:41:08,793][  INFO][PID:2922485] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '3.91.27.10' (ED25519) to the list of known hosts.


[2026-09-18 14:41:08,794][  INFO][PID:2922485] Downloading the builder-live.log file, attempt 1
[2026-09-18 14:41:08,795][  INFO][PID:2922485] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.91.27.10 copr-rpmbuild-log
[2026-09-18 14:41:13,798][  INFO][PID:2922485] Periodic builder liveness probe: alive
[2026-09-18 14:41:13,799][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:41:18,799][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:41:23,800][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:41:28,801][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:41:33,802][  INFO][PID:2922485] Checking for cancel request
[2026-09-18 14:41:38,294][  INFO][PID:2922485] Downloading results from builder
[2026-09-18 14:41:38,294][  INFO][PID:2922485] rsyncing of mockbuilder@3.91.27.10:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@python/python3.15:pr:fork-r0x0d-rpms-python-rich-rst-7/fedora-rawhide-x86_64/11001021-python-rich-rst started
[2026-09-18 14:41:38,295][  INFO][PID:2922485] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@3.91.27.10:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@python/python3.15:pr:fork-r0x0d-rpms-python-rich-rst-7/fedora-rawhide-x86_64/11001021-python-rich-rst/ &> /var/lib/copr/public_html/results/@python/python3.15:pr:fork-r0x0d-rpms-python-rich-rst-7/fedora-rawhide-x86_64/11001021-python-rich-rst/build-11001021.rsync.log
[2026-09-18 14:41:38,483][  INFO][PID:2922485] rsyncing finished.
[2026-09-18 14:41:38,484][  INFO][PID:2922485] VM Release request
[2026-09-18 14:41:38,489][  INFO][PID:2922485] Searching for 'success' file in resultdir
[2026-09-18 14:41:38,490][ ERROR][PID:2922485] Build failed: Backend process error: No success file => build failure
[2026-09-18 14:41:38,494][  INFO][PID:2922485] Finished build: id=11001021 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/@python/python3.15:pr:fork-r0x0d-rpms-python-rich-rst-7 chroot=fedora-rawhide-x86_64 
[2026-09-18 14:41:38,496][ ERROR][PID:2922485] Backend process error: No success file => build failure
[2026-09-18 14:41:38,500][  INFO][PID:2922485] Worker failed build, took 30.10500955581665
[2026-09-18 14:41:38,500][  INFO][PID:2922485] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@python",
            "project_name": "python3.15",
            "project_dirname": "python3.15:pr:fork-r0x0d-rpms-python-rich-rst-7",
            "submitter": "https://src.fedoraproject.org/user/r0x0d",
            "ended_on": 1789742498.50031,
            "started_on": 1789742468.3953004,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-rawhide-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "11001021-fedora-rawhide-x86_64",
            "build_id": 11001021,
            "package_name": "python-rich-rst",
            "package_version": "2.1.0-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@python/python3.15:pr:fork-r0x0d-rpms-python-rich-rst-7/python-rich-rst",
            "git_hash": "f5db203cafd425e1ca50822f3ce20cc8e2dd38a9",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@python/python3.15--https://src.fedoraproject.org/user/r0x0d",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@python/python3.15/fedora-rawhide-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": 9,
                    "repo_gpgcheck": false
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@python/python3.15:pr:fork-r0x0d-rpms-python-rich-rst-7/fedora-rawhide-x86_64/",
                    "id": "copr_coprdir",
                    "name": "Coprdir repository",
                    "priority": 9,
                    "repo_gpgcheck": false
                },
                {
                    "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/",
                    "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch",
                    "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch"
                }
            ],
            "background": true,
            "bootstrap": "off",
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": 9,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@python/python3.15:pr:fork-r0x0d-rpms-python-rich-rst-7",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@python/python3.15:pr:fork-r0x0d-rpms-python-rich-rst-7",
            "result_dir": "11001021-python-rich-rst",
            "built_packages": "",
            "rpmeta_prediction": null,
            "id": 11001021,
            "mockchain_macros": {
                "copr_username": "@python",
                "copr_projectname": "python3.15",
                "vendor": "Fedora Project COPR (@python/python3.15)"
            }
        }
    ]
}
[2026-09-18 14:41:38,532][  INFO][PID:2922485] Sending fedora-messaging bus message in build.end
[2026-09-18 14:41:38,868][  INFO][PID:2922485] Compressing /var/lib/copr/public_html/results/@python/python3.15:pr:fork-r0x0d-rpms-python-rich-rst-7/fedora-rawhide-x86_64/11001021-python-rich-rst/builder-live.log by gzip
[2026-09-18 14:41:38,869][  INFO][PID:2922485] Running command 'gzip /var/lib/copr/public_html/results/@python/python3.15:pr:fork-r0x0d-rpms-python-rich-rst-7/fedora-rawhide-x86_64/11001021-python-rich-rst/builder-live.log' as PID 3079743
[2026-09-18 14:41:38,873][  INFO][PID:2922485] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@python/python3.15:pr:fork-r0x0d-rpms-python-rich-rst-7/fedora-rawhide-x86_64/11001021-python-rich-rst/builder-live.log)
[2026-09-18 14:41:38,873][  INFO][PID:2922485] Compressing /var/lib/copr/public_html/results/@python/python3.15:pr:fork-r0x0d-rpms-python-rich-rst-7/fedora-rawhide-x86_64/11001021-python-rich-rst/backend.log by gzip
[2026-09-18 14:41:38,873][  INFO][PID:2922485] Running command 'gzip /var/lib/copr/public_html/results/@python/python3.15:pr:fork-r0x0d-rpms-python-rich-rst-7/fedora-rawhide-x86_64/11001021-python-rich-rst/backend.log' as PID 3079745