[2025-09-20 09:29:09,023][  INFO][PID:1612957] Marking build as starting
[2025-09-20 09:29:09,138][  INFO][PID:1612957] Checking for cancel request
[2025-09-20 09:29:09,139][  INFO][PID:1612957] VM allocation process starts
[2025-09-20 09:29:09,158][  INFO][PID:1612957] Trying to allocate VM: ResallocHost, ticket_id=5185294, requested_tags=['copr_builder', 'arch_x86_64']
[2025-09-20 09:29:12,194][  INFO][PID:1612957] Allocated host ResallocHost, ticket_id=5185294, hostname=2620:52:3:1:dead:beef:cafe:c153, name=copr_hv_x86_64_02_prod_06846682_20250920_091119, requested_tags=['copr_builder', 'arch_x86_64']
[2025-09-20 09:29:12,195][  INFO][PID:1612957] Allocating ssh connection to builder
[2025-09-20 09:29:12,196][  INFO][PID:1612957] Checking that builder machine is OK
[2025-09-20 09:29:12,755][  INFO][PID:1612957] Running remote command: copr-builder-ready fedora-43-x86_64
[2025-09-20 09:29:13,071][  INFO][PID:1612957] Red Hat subscription not needed for fedora-43-x86_64
Builder is ready to be used

[2025-09-20 09:29:13,071][  INFO][PID:1612957] Filling build.info file with builder info
[2025-09-20 09:29:13,072][  INFO][PID:1612957] Checking for cancel request
[2025-09-20 09:29:13,073][  INFO][PID:1612957] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@python",
            "project_name": "python-in-pulp",
            "project_dirname": "python-in-pulp",
            "submitter": "https://src.fedoraproject.org/user/ksurma",
            "ended_on": null,
            "started_on": 1758360553.0730948,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-43-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "9583064-fedora-43-x86_64",
            "build_id": 9583064,
            "package_name": "rpy",
            "package_version": "3.5.16-10",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@python/python-in-pulp/rpy",
            "git_hash": "6f18975aedc1af6b33c7f76cea82da12fbbf3dd4",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@python/python-in-pulp--https://src.fedoraproject.org/user/ksurma",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 1,
            "repos": [
                {
                    "baseurl": "https://console.redhat.com/api/pulp-content/public-copr/@python/python-in-pulp/fedora-43-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@python/python-in-pulp",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@python/python-in-pulp",
            "result_dir": "09583064-rpy",
            "built_packages": "",
            "id": 9583064,
            "mockchain_macros": {
                "copr_username": "@python",
                "copr_projectname": "python-in-pulp",
                "vendor": "Fedora Project COPR (@python/python-in-pulp)"
            }
        }
    ]
}
[2025-09-20 09:29:13,096][  INFO][PID:1612957] Sending fedora-messaging bus message in build.start
[2025-09-20 09:29:13,820][  INFO][PID:1612957] Sending fedora-messaging bus message in chroot.start
[2025-09-20 09:29:13,845][  INFO][PID:1612957] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9583064-fedora-43-x86_64 --chroot fedora-43-x86_64 --detached
[2025-09-20 09:29:14,419][  INFO][PID:1612957] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c153' (ED25519) to the list of known hosts.


[2025-09-20 09:29:14,420][  INFO][PID:1612957] Downloading the builder-live.log file, attempt 1
[2025-09-20 09:29:14,422][  INFO][PID:1612957] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c153 copr-rpmbuild-log
[2025-09-20 09:29:19,430][  INFO][PID:1612957] Periodic builder liveness probe: alive
[2025-09-20 09:29:19,431][  INFO][PID:1612957] Checking for cancel request
[2025-09-20 09:29:24,432][  INFO][PID:1612957] Checking for cancel request
[2025-09-20 09:29:29,433][  INFO][PID:1612957] Checking for cancel request
[2025-09-20 09:29:34,434][  INFO][PID:1612957] Checking for cancel request
[2025-09-20 09:29:39,435][  INFO][PID:1612957] Checking for cancel request
[2025-09-20 09:29:44,436][  INFO][PID:1612957] Checking for cancel request
[2025-09-20 09:29:49,437][  INFO][PID:1612957] Checking for cancel request
[2025-09-20 09:29:54,438][  INFO][PID:1612957] Checking for cancel request
[2025-09-20 09:29:59,439][  INFO][PID:1612957] Checking for cancel request
[2025-09-20 09:30:04,440][  INFO][PID:1612957] Checking for cancel request
[2025-09-20 09:30:09,441][  INFO][PID:1612957] Checking for cancel request
[2025-09-20 09:30:14,442][  INFO][PID:1612957] Checking for cancel request
[2025-09-20 09:30:19,443][  INFO][PID:1612957] Checking for cancel request
[2025-09-20 09:30:24,444][  INFO][PID:1612957] Checking for cancel request
[2025-09-20 09:30:29,445][  INFO][PID:1612957] Checking for cancel request
[2025-09-20 09:30:34,446][  INFO][PID:1612957] Checking for cancel request
[2025-09-20 09:30:39,447][  INFO][PID:1612957] Checking for cancel request
[2025-09-20 09:30:39,500][  INFO][PID:1612957] Downloading results from builder
[2025-09-20 09:30:39,501][  INFO][PID:1612957] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c153]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64/09583064-rpy started
[2025-09-20 09:30:39,501][  INFO][PID:1612957] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c153]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64/09583064-rpy/ &> /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64/09583064-rpy/build-09583064.rsync.log
[2025-09-20 09:30:39,912][  INFO][PID:1612957] rsyncing finished.
[2025-09-20 09:30:39,912][  INFO][PID:1612957] Releasing VM back to pool
[2025-09-20 09:30:39,926][  INFO][PID:1612957] Searching for 'success' file in resultdir
[2025-09-20 09:30:39,927][  INFO][PID:1612957] Going to sign pkgs from source: 9583064-fedora-43-x86_64 in chroot: /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64
[2025-09-20 09:30:39,928][  INFO][PID:1612957] Calling '/bin/sign -u @python#python-in-pulp@copr.fedorahosted.org -p' (attempt #1)
[2025-09-20 09:30:40,276][  INFO][PID:1612957] Calling '/bin/sign -4 -h sha256 -u @python#python-in-pulp@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64/09583064-rpy/rpy-3.5.16-10.fc43.x86_64.rpm' (attempt #1)
[2025-09-20 09:30:40,993][  INFO][PID:1612957] signed rpm: /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64/09583064-rpy/rpy-3.5.16-10.fc43.x86_64.rpm
[2025-09-20 09:30:40,993][  INFO][PID:1612957] Calling '/bin/sign -4 -h sha256 -u @python#python-in-pulp@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64/09583064-rpy/rpy-3.5.16-10.fc43.src.rpm' (attempt #1)
[2025-09-20 09:30:42,037][  INFO][PID:1612957] signed rpm: /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64/09583064-rpy/rpy-3.5.16-10.fc43.src.rpm
[2025-09-20 09:30:42,038][  INFO][PID:1612957] Calling '/bin/sign -4 -h sha256 -u @python#python-in-pulp@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64/09583064-rpy/rpy-debugsource-3.5.16-10.fc43.x86_64.rpm' (attempt #1)
[2025-09-20 09:30:43,149][  INFO][PID:1612957] signed rpm: /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64/09583064-rpy/rpy-debugsource-3.5.16-10.fc43.x86_64.rpm
[2025-09-20 09:30:43,150][  INFO][PID:1612957] Calling '/bin/sign -4 -h sha256 -u @python#python-in-pulp@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64/09583064-rpy/python3-rpy-3.5.16-10.fc43.x86_64.rpm' (attempt #1)
[2025-09-20 09:30:44,198][  INFO][PID:1612957] signed rpm: /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64/09583064-rpy/python3-rpy-3.5.16-10.fc43.x86_64.rpm
[2025-09-20 09:30:44,199][  INFO][PID:1612957] Calling '/bin/sign -4 -h sha256 -u @python#python-in-pulp@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64/09583064-rpy/python3-rpy-debuginfo-3.5.16-10.fc43.x86_64.rpm' (attempt #1)
[2025-09-20 09:30:45,250][  INFO][PID:1612957] signed rpm: /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64/09583064-rpy/python3-rpy-debuginfo-3.5.16-10.fc43.x86_64.rpm
[2025-09-20 09:30:45,250][  INFO][PID:1612957] Calling '/bin/sign -4 -h sha256 -u @python#python-in-pulp@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64/09583064-rpy/python3-rpy+numpy-3.5.16-10.fc43.x86_64.rpm' (attempt #1)
[2025-09-20 09:30:46,293][  INFO][PID:1612957] signed rpm: /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64/09583064-rpy/python3-rpy+numpy-3.5.16-10.fc43.x86_64.rpm
[2025-09-20 09:30:46,294][  INFO][PID:1612957] Calling '/bin/sign -4 -h sha256 -u @python#python-in-pulp@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64/09583064-rpy/python3-rpy+pandas-3.5.16-10.fc43.x86_64.rpm' (attempt #1)
[2025-09-20 09:30:47,334][  INFO][PID:1612957] signed rpm: /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64/09583064-rpy/python3-rpy+pandas-3.5.16-10.fc43.x86_64.rpm
[2025-09-20 09:30:47,334][  INFO][PID:1612957] Calling '/bin/sign -4 -h sha256 -u @python#python-in-pulp@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64/09583064-rpy/python3-rpy+all-3.5.16-10.fc43.x86_64.rpm' (attempt #1)
[2025-09-20 09:30:48,210][  INFO][PID:1612957] signed rpm: /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64/09583064-rpy/python3-rpy+all-3.5.16-10.fc43.x86_64.rpm
[2025-09-20 09:30:48,211][  INFO][PID:1612957] Sign done
[2025-09-20 09:30:48,212][  INFO][PID:1612957] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64/09583064-rpy/rpy-3.5.16-10.fc43.x86_64.rpm
[2025-09-20 09:30:49,327][  INFO][PID:1612957] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64/09583064-rpy/rpy-3.5.16-10.fc43.src.rpm
[2025-09-20 09:30:49,327][  INFO][PID:1612957] Uploaded to Pulp: rpy-3.5.16-10.fc43.x86_64.rpm
[2025-09-20 09:30:49,643][  INFO][PID:1612957] Uploaded to Pulp: rpy-3.5.16-10.fc43.src.rpm
[2025-09-20 09:30:49,643][  INFO][PID:1612957] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64/09583064-rpy/rpy-debugsource-3.5.16-10.fc43.x86_64.rpm
[2025-09-20 09:30:51,415][  INFO][PID:1612957] Uploaded to Pulp: rpy-debugsource-3.5.16-10.fc43.x86_64.rpm
[2025-09-20 09:30:51,415][  INFO][PID:1612957] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64/09583064-rpy/python3-rpy-3.5.16-10.fc43.x86_64.rpm
[2025-09-20 09:30:52,152][  INFO][PID:1612957] Uploaded to Pulp: python3-rpy-3.5.16-10.fc43.x86_64.rpm
[2025-09-20 09:30:52,152][  INFO][PID:1612957] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64/09583064-rpy/python3-rpy-debuginfo-3.5.16-10.fc43.x86_64.rpm
[2025-09-20 09:30:52,433][  INFO][PID:1612957] Uploaded to Pulp: python3-rpy-debuginfo-3.5.16-10.fc43.x86_64.rpm
[2025-09-20 09:30:52,433][  INFO][PID:1612957] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64/09583064-rpy/python3-rpy+numpy-3.5.16-10.fc43.x86_64.rpm
[2025-09-20 09:30:52,928][  INFO][PID:1612957] Uploaded to Pulp: python3-rpy+numpy-3.5.16-10.fc43.x86_64.rpm
[2025-09-20 09:30:52,928][  INFO][PID:1612957] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64/09583064-rpy/python3-rpy+pandas-3.5.16-10.fc43.x86_64.rpm
[2025-09-20 09:31:04,964][WARNING][PID:1612957] Retry request #1 on https://mtls.internal.console.redhat.com/api/pulp/public-copr/api/v3/content/rpm/packages/upload/: Requests error on https://mtls.internal.console.redhat.com/api/pulp/public-copr/api/v3/content/rpm/packages/upload/: HTTPSConnectionPool(host='mtls.internal.console.redhat.com', port=443): Read timed out. (read timeout=12.0)
[2025-09-20 09:31:10,117][  INFO][PID:1612957] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64/09583064-rpy/python3-rpy+all-3.5.16-10.fc43.x86_64.rpm
[2025-09-20 09:31:10,627][ ERROR][PID:1612957] Build failed: Request client error on https://mtls.internal.console.redhat.com/api/pulp/public-copr/api/v3/content/rpm/packages/upload/: 400 Bad Request
[2025-09-20 09:31:10,628][  INFO][PID:1612957] Finished build: id=9583064 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/@python/python-in-pulp chroot=fedora-43-x86_64 
[2025-09-20 09:31:10,630][ ERROR][PID:1612957] Unexpected exception (in /usr/lib/python3.13/site-packages/copr_common/request.py:107)
[2025-09-20 09:31:10,637][  INFO][PID:1612957] Worker failed build, took 117.56457138061523
[2025-09-20 09:31:10,638][  INFO][PID:1612957] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@python",
            "project_name": "python-in-pulp",
            "project_dirname": "python-in-pulp",
            "submitter": "https://src.fedoraproject.org/user/ksurma",
            "ended_on": 1758360670.6376662,
            "started_on": 1758360553.0730948,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-43-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "9583064-fedora-43-x86_64",
            "build_id": 9583064,
            "package_name": "rpy",
            "package_version": "3.5.16-10",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@python/python-in-pulp/rpy",
            "git_hash": "6f18975aedc1af6b33c7f76cea82da12fbbf3dd4",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@python/python-in-pulp--https://src.fedoraproject.org/user/ksurma",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 1,
            "repos": [
                {
                    "baseurl": "https://console.redhat.com/api/pulp-content/public-copr/@python/python-in-pulp/fedora-43-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@python/python-in-pulp",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@python/python-in-pulp",
            "result_dir": "09583064-rpy",
            "built_packages": "",
            "id": 9583064,
            "mockchain_macros": {
                "copr_username": "@python",
                "copr_projectname": "python-in-pulp",
                "vendor": "Fedora Project COPR (@python/python-in-pulp)"
            }
        }
    ]
}
[2025-09-20 09:31:10,662][  INFO][PID:1612957] Sending fedora-messaging bus message in build.end
[2025-09-20 09:31:10,685][  INFO][PID:1612957] Compressing /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64/09583064-rpy/builder-live.log by gzip
[2025-09-20 09:31:10,686][  INFO][PID:1612957] Running command 'gzip /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64/09583064-rpy/builder-live.log' as PID 1622242
[2025-09-20 09:31:10,695][  INFO][PID:1612957] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64/09583064-rpy/builder-live.log)
[2025-09-20 09:31:10,696][  INFO][PID:1612957] Compressing /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64/09583064-rpy/backend.log by gzip
[2025-09-20 09:31:10,697][  INFO][PID:1612957] Running command 'gzip /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-43-x86_64/09583064-rpy/backend.log' as PID 1622244