[2025-09-11 16:19:31,348][  INFO][PID:3998980] Marking build as starting
[2025-09-11 16:19:31,565][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:19:31,567][  INFO][PID:3998980] VM allocation process starts
[2025-09-11 16:19:31,611][  INFO][PID:3998980] Trying to allocate VM: ResallocHost, ticket_id=5010328, requested_tags=['copr_builder', 'arch_x86_64']
[2025-09-11 16:19:36,615][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:19:41,618][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:19:46,621][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:19:51,623][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:19:56,627][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:20:01,629][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:20:06,632][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:20:11,633][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:20:16,636][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:20:21,640][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:20:26,641][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:20:31,644][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:20:36,655][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:20:41,660][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:20:46,664][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:20:51,671][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:20:56,674][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:21:01,676][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:21:06,678][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:21:11,680][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:21:16,686][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:21:21,687][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:21:26,692][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:21:31,700][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:21:36,703][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:21:41,708][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:21:46,715][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:21:51,725][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:21:56,743][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:22:01,755][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:22:06,764][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:22:11,769][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:22:16,775][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:22:21,778][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:22:26,779][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:22:31,784][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:22:36,796][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:22:41,797][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:22:46,799][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:22:51,809][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:22:56,811][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:23:01,814][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:23:06,816][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:23:11,819][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:23:16,823][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:23:21,833][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:23:26,838][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:23:31,839][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:23:36,840][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:23:41,843][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:23:46,846][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:23:51,847][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:23:56,848][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:24:01,851][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:24:06,852][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:24:11,853][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:24:16,854][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:24:21,856][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:24:26,857][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:24:31,859][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:24:36,861][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:24:41,863][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:24:46,864][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:24:49,959][  INFO][PID:3998980] Allocated host ResallocHost, ticket_id=5010328, hostname=2620:52:3:1:dead:beef:cafe:c197, name=copr_hv_x86_64_03_prod_06718226_20250911_162223, requested_tags=['copr_builder', 'arch_x86_64']
[2025-09-11 16:24:49,959][  INFO][PID:3998980] Allocating ssh connection to builder
[2025-09-11 16:24:49,960][  INFO][PID:3998980] Checking that builder machine is OK
[2025-09-11 16:24:50,574][  INFO][PID:3998980] Running remote command: copr-builder-ready fedora-rawhide-x86_64
[2025-09-11 16:24:51,005][  INFO][PID:3998980] Red Hat subscription not needed for fedora-rawhide-x86_64
Builder is ready to be used

[2025-09-11 16:24:51,006][  INFO][PID:3998980] Filling build.info file with builder info
[2025-09-11 16:24:51,009][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:24:51,013][  INFO][PID:3998980] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@python",
            "project_name": "python-in-pulp",
            "project_dirname": "python-in-pulp",
            "submitter": "https://src.fedoraproject.org/user/kkeithle",
            "ended_on": null,
            "started_on": 1757607891.0128129,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-rawhide-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "9544414-fedora-rawhide-x86_64",
            "build_id": 9544414,
            "package_name": "ceph",
            "package_version": "2:20.1.0-2",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@python/python-in-pulp/ceph",
            "git_hash": "648b631b49c90f7b97e857db28390400adb3db06",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@python/python-in-pulp--https://src.fedoraproject.org/user/kkeithle",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 1,
            "repos": [
                {
                    "baseurl": "https://console.redhat.com/api/pulp-content/public-copr/@python/python-in-pulp/fedora-rawhide-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@python/python-in-pulp",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@python/python-in-pulp",
            "result_dir": "09544414-ceph",
            "built_packages": "",
            "id": 9544414,
            "mockchain_macros": {
                "copr_username": "@python",
                "copr_projectname": "python-in-pulp",
                "vendor": "Fedora Project COPR (@python/python-in-pulp)"
            }
        }
    ]
}
[2025-09-11 16:24:51,045][  INFO][PID:3998980] Sending fedora-messaging bus message in build.start
[2025-09-11 16:24:52,548][  INFO][PID:3998980] Sending fedora-messaging bus message in chroot.start
[2025-09-11 16:24:52,576][  INFO][PID:3998980] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9544414-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached
[2025-09-11 16:24:53,211][  INFO][PID:3998980] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c197' (ED25519) to the list of known hosts.


[2025-09-11 16:24:53,212][  INFO][PID:3998980] Downloading the builder-live.log file, attempt 1
[2025-09-11 16:24:53,215][  INFO][PID:3998980] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c197 copr-rpmbuild-log
[2025-09-11 16:24:58,234][  INFO][PID:3998980] Periodic builder liveness probe: alive
[2025-09-11 16:24:58,237][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:25:03,244][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:25:08,250][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:25:13,253][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:25:18,269][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:25:23,270][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:25:28,274][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:25:33,276][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:25:38,277][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:25:43,279][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:25:48,280][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:25:53,282][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:25:58,283][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:26:03,284][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:26:08,287][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:26:13,288][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:26:18,290][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:26:23,291][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:26:28,292][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:26:33,294][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:26:38,295][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:26:43,299][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:26:48,306][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:26:53,308][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:26:58,309][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:27:03,310][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:27:08,313][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:27:13,316][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:27:18,318][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:27:23,319][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:27:28,321][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:27:33,322][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:27:38,324][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:27:43,329][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:27:48,334][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:27:53,336][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:27:58,338][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:28:03,341][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:28:08,342][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:28:13,346][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:28:18,348][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:28:23,350][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:28:28,351][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:28:33,355][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:28:38,361][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:28:43,363][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:28:48,365][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:28:53,366][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:28:58,367][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:29:03,369][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:29:08,370][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:29:13,371][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:29:18,373][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:29:23,374][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:29:28,376][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:29:33,377][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:29:38,379][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:29:43,380][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:29:48,381][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:29:53,383][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:29:58,384][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:30:03,386][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:30:08,387][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:30:13,390][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:30:18,392][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:30:23,400][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:30:28,401][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:30:33,406][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:30:38,410][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:30:43,412][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:30:48,413][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:30:53,415][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:30:58,416][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:31:03,417][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:31:08,421][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:31:13,424][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:31:18,430][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:31:23,433][  INFO][PID:3998980] Checking for cancel request
[2025-09-11 16:31:24,947][  INFO][PID:3998980] Downloading results from builder
[2025-09-11 16:31:24,947][  INFO][PID:3998980] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c197]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-rawhide-x86_64/09544414-ceph started
[2025-09-11 16:31:24,948][  INFO][PID:3998980] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c197]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-rawhide-x86_64/09544414-ceph/ &> /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-rawhide-x86_64/09544414-ceph/build-09544414.rsync.log
[2025-09-11 16:31:28,504][  INFO][PID:3998980] rsyncing finished.
[2025-09-11 16:31:28,505][  INFO][PID:3998980] Releasing VM back to pool
[2025-09-11 16:31:28,560][  INFO][PID:3998980] Searching for 'success' file in resultdir
[2025-09-11 16:31:28,561][ ERROR][PID:3998980] Build failed: Backend process error: No success file => build failure
[2025-09-11 16:31:28,561][  INFO][PID:3998980] Finished build: id=9544414 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/@python/python-in-pulp chroot=fedora-rawhide-x86_64 
[2025-09-11 16:31:28,563][ ERROR][PID:3998980] Backend process error: No success file => build failure
[2025-09-11 16:31:28,564][  INFO][PID:3998980] Worker failed build, took 397.55142974853516
[2025-09-11 16:31:28,564][  INFO][PID:3998980] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@python",
            "project_name": "python-in-pulp",
            "project_dirname": "python-in-pulp",
            "submitter": "https://src.fedoraproject.org/user/kkeithle",
            "ended_on": 1757608288.5642426,
            "started_on": 1757607891.0128129,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-rawhide-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "9544414-fedora-rawhide-x86_64",
            "build_id": 9544414,
            "package_name": "ceph",
            "package_version": "2:20.1.0-2",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@python/python-in-pulp/ceph",
            "git_hash": "648b631b49c90f7b97e857db28390400adb3db06",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@python/python-in-pulp--https://src.fedoraproject.org/user/kkeithle",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 1,
            "repos": [
                {
                    "baseurl": "https://console.redhat.com/api/pulp-content/public-copr/@python/python-in-pulp/fedora-rawhide-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@python/python-in-pulp",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@python/python-in-pulp",
            "result_dir": "09544414-ceph",
            "built_packages": "",
            "id": 9544414,
            "mockchain_macros": {
                "copr_username": "@python",
                "copr_projectname": "python-in-pulp",
                "vendor": "Fedora Project COPR (@python/python-in-pulp)"
            }
        }
    ]
}
[2025-09-11 16:31:28,589][  INFO][PID:3998980] Sending fedora-messaging bus message in build.end
[2025-09-11 16:31:28,616][  INFO][PID:3998980] Compressing /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-rawhide-x86_64/09544414-ceph/builder-live.log by gzip
[2025-09-11 16:31:28,617][  INFO][PID:3998980] Running command 'gzip /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-rawhide-x86_64/09544414-ceph/builder-live.log' as PID 4115023
[2025-09-11 16:31:28,632][  INFO][PID:3998980] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-rawhide-x86_64/09544414-ceph/builder-live.log)
[2025-09-11 16:31:28,633][  INFO][PID:3998980] Compressing /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-rawhide-x86_64/09544414-ceph/backend.log by gzip
[2025-09-11 16:31:28,634][  INFO][PID:3998980] Running command 'gzip /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-rawhide-x86_64/09544414-ceph/backend.log' as PID 4115024