[2026-10-07 15:59:36,374][ INFO][PID:3689532] Marking build as starting [2026-10-07 15:59:36,569][ INFO][PID:3689532] Checking that https://download.copr.fedorainfracloud.org/results/@python/python-in-pulp/fedora-rawhide-x86_64//repodata/repomd.xml exists [2026-10-07 15:59:36,717][ INFO][PID:3689532] Checking for cancel request [2026-10-07 15:59:36,739][ INFO][PID:3689532] rpmeta: predicted 274 min for python-boto3 on fedora-rawhide-x86_64 (at/above threshold 120) -> promoted to powerful builder (tag 'on_demand_powerful' added) [2026-10-07 15:59:36,740][ INFO][PID:3689532] VM allocation process starts [2026-10-07 15:59:36,745][ INFO][PID:3689532] Trying to allocate VM: ResallocHost, ticket_id=5481473, requested_tags=['arch_x86_64', 'copr_builder', 'on_demand_powerful'] [2026-10-07 15:59:41,746][ INFO][PID:3689532] Checking for cancel request [2026-10-07 15:59:46,747][ INFO][PID:3689532] Checking for cancel request [2026-10-07 15:59:51,749][ INFO][PID:3689532] Checking for cancel request [2026-10-07 15:59:56,749][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:00:01,751][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:00:06,752][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:00:11,753][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:00:16,754][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:00:21,755][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:00:26,756][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:00:31,757][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:00:36,757][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:00:41,759][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:00:46,759][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:00:51,760][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:00:56,761][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:01:01,762][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:01:06,763][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:01:11,764][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:01:16,765][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:01:21,766][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:01:26,767][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:01:31,768][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:01:36,769][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:01:41,769][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:01:46,770][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:01:51,771][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:01:56,772][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:02:01,773][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:02:06,774][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:02:11,775][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:02:16,776][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:02:21,776][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:02:26,777][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:02:31,778][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:02:36,779][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:02:41,780][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:02:46,780][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:02:51,781][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:02:56,782][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:03:01,783][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:03:06,784][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:03:11,785][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:03:16,785][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:03:21,786][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:03:26,787][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:03:31,788][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:03:36,789][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:03:41,790][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:03:46,790][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:03:51,791][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:03:56,792][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:04:01,793][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:04:06,793][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:04:11,794][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:04:16,795][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:04:21,796][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:04:26,797][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:04:31,798][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:04:36,798][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:04:41,799][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:04:46,800][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:04:51,801][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:04:56,802][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:05:01,803][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:05:06,803][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:05:11,804][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:05:16,805][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:05:21,806][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:05:26,807][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:05:31,808][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:05:36,808][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:05:41,809][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:05:46,810][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:05:51,811][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:05:56,812][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:06:01,813][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:06:06,814][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:06:11,815][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:06:16,816][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:06:21,817][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:06:26,817][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:06:31,818][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:06:36,819][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:06:41,820][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:06:46,821][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:06:51,821][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:06:56,822][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:07:01,823][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:07:06,824][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:07:11,825][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:07:16,825][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:07:21,826][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:07:26,827][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:07:31,828][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:07:36,829][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:07:41,830][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:07:46,832][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:07:51,833][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:07:56,834][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:08:01,835][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:08:06,835][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:08:11,836][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:08:16,837][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:08:21,838][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:08:26,839][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:08:31,839][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:08:36,840][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:08:41,841][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:08:46,842][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:08:51,843][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:08:56,844][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:09:01,845][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:09:06,846][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:09:11,848][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:09:16,849][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:09:21,850][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:09:26,855][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:09:31,856][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:09:36,856][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:09:41,857][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:09:46,858][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:09:51,862][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:09:56,863][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:10:01,864][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:10:06,867][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:10:11,868][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:10:16,869][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:10:21,870][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:10:26,872][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:10:31,872][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:10:36,873][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:10:41,874][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:10:46,875][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:10:51,876][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:10:56,877][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:11:01,878][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:11:06,878][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:11:11,879][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:11:16,880][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:11:21,881][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:11:26,882][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:11:31,883][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:11:36,884][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:11:41,885][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:11:46,885][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:11:51,886][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:11:54,855][ INFO][PID:3689532] Allocated host ResallocHost, ticket_id=5481473, hostname=54.157.51.57, name=aws_x86_64_powerful_spot_prod_46522632_20261007_160746, requested_tags=['arch_x86_64', 'copr_builder', 'on_demand_powerful'] [2026-10-07 16:11:54,856][ INFO][PID:3689532] Allocating ssh connection to builder [2026-10-07 16:11:54,856][ INFO][PID:3689532] Checking that builder machine is OK [2026-10-07 16:11:55,217][ INFO][PID:3689532] Installed copr-rpmbuild version: 1.10 [2026-10-07 16:11:55,218][ INFO][PID:3689532] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2026-10-07 16:11:55,397][ INFO][PID:3689532] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2026-10-07 16:11:55,397][ INFO][PID:3689532] Filling build.info file with builder info [2026-10-07 16:11:55,398][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:11:55,398][ INFO][PID:3689532] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@python", "project_name": "python-in-pulp", "project_dirname": "python-in-pulp", "submitter": "https://src.fedoraproject.org/user/limb", "ended_on": null, "started_on": 1791389515.3985786, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "11090104-fedora-rawhide-x86_64", "build_id": 11090104, "package_name": "python-boto3", "package_version": "1.43.109-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@python/python-in-pulp/python-boto3", "git_hash": "3fc03b2dec534652a3c1dd48dd879cdaf2417799", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "prebuilt_tarball_url": null, "uses_devel_repo": false, "sandbox": "@python/python-in-pulp--https://src.fedoraproject.org/user/limb", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@python/python-in-pulp/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null, "repo_gpgcheck": false } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64", "on_demand_powerful" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@python/python-in-pulp", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@python/python-in-pulp", "result_dir": "11090104-python-boto3", "built_packages": "", "rpmeta_prediction": 274, "id": 11090104, "mockchain_macros": { "copr_username": "@python", "copr_projectname": "python-in-pulp", "vendor": "Fedora Project COPR (@python/python-in-pulp)" } } ] } [2026-10-07 16:11:55,430][ INFO][PID:3689532] Sending fedora-messaging bus message in build.start [2026-10-07 16:11:55,797][ INFO][PID:3689532] Sending fedora-messaging bus message in chroot.start [2026-10-07 16:11:55,819][ INFO][PID:3689532] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/11090104-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2026-10-07 16:11:56,210][ INFO][PID:3689532] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '54.157.51.57' (ED25519) to the list of known hosts. [2026-10-07 16:11:56,210][ INFO][PID:3689532] Downloading the builder-live.log file, attempt 1 [2026-10-07 16:11:56,212][ INFO][PID:3689532] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.157.51.57 copr-rpmbuild-log [2026-10-07 16:12:01,215][ INFO][PID:3689532] Periodic builder liveness probe: alive [2026-10-07 16:12:01,215][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:12:06,216][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:12:11,217][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:12:16,218][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:12:21,218][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:12:26,219][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:12:31,220][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:12:36,221][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:12:41,222][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:12:46,223][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:12:51,224][ INFO][PID:3689532] Checking for cancel request [2026-10-07 16:12:54,992][ INFO][PID:3689532] Downloading results from builder [2026-10-07 16:12:54,995][ INFO][PID:3689532] rsyncing of mockbuilder@54.157.51.57:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-rawhide-x86_64/11090104-python-boto3 started [2026-10-07 16:12:54,998][ INFO][PID:3689532] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@54.157.51.57:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-rawhide-x86_64/11090104-python-boto3/ &> /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-rawhide-x86_64/11090104-python-boto3/build-11090104.rsync.log [2026-10-07 16:12:55,191][ INFO][PID:3689532] rsyncing finished. [2026-10-07 16:12:55,191][ INFO][PID:3689532] VM Release request [2026-10-07 16:12:55,197][ INFO][PID:3689532] Searching for 'success' file in resultdir [2026-10-07 16:12:55,198][ ERROR][PID:3689532] Build failed: Backend process error: No success file => build failure [2026-10-07 16:12:55,204][ INFO][PID:3689532] Finished build: id=11090104 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/@python/python-in-pulp chroot=fedora-rawhide-x86_64 [2026-10-07 16:12:55,206][ ERROR][PID:3689532] Backend process error: No success file => build failure [2026-10-07 16:12:55,212][ INFO][PID:3689532] Worker failed build, took 59.81354761123657 [2026-10-07 16:12:55,212][ INFO][PID:3689532] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@python", "project_name": "python-in-pulp", "project_dirname": "python-in-pulp", "submitter": "https://src.fedoraproject.org/user/limb", "ended_on": 1791389575.2121263, "started_on": 1791389515.3985786, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "11090104-fedora-rawhide-x86_64", "build_id": 11090104, "package_name": "python-boto3", "package_version": "1.43.109-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@python/python-in-pulp/python-boto3", "git_hash": "3fc03b2dec534652a3c1dd48dd879cdaf2417799", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "prebuilt_tarball_url": null, "uses_devel_repo": false, "sandbox": "@python/python-in-pulp--https://src.fedoraproject.org/user/limb", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@python/python-in-pulp/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null, "repo_gpgcheck": false } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64", "on_demand_powerful" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@python/python-in-pulp", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@python/python-in-pulp", "result_dir": "11090104-python-boto3", "built_packages": "", "rpmeta_prediction": 274, "id": 11090104, "mockchain_macros": { "copr_username": "@python", "copr_projectname": "python-in-pulp", "vendor": "Fedora Project COPR (@python/python-in-pulp)" } } ] } [2026-10-07 16:12:55,248][ INFO][PID:3689532] Sending fedora-messaging bus message in build.end [2026-10-07 16:12:55,270][ INFO][PID:3689532] Compressing /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-rawhide-x86_64/11090104-python-boto3/builder-live.log by gzip [2026-10-07 16:12:55,271][ INFO][PID:3689532] Running command 'gzip /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-rawhide-x86_64/11090104-python-boto3/builder-live.log' as PID 3855549 [2026-10-07 16:12:55,274][ INFO][PID:3689532] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-rawhide-x86_64/11090104-python-boto3/builder-live.log) [2026-10-07 16:12:55,275][ INFO][PID:3689532] Compressing /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-rawhide-x86_64/11090104-python-boto3/backend.log by gzip [2026-10-07 16:12:55,277][ INFO][PID:3689532] Running command 'gzip /var/lib/copr/public_html/results/@python/python-in-pulp/fedora-rawhide-x86_64/11090104-python-boto3/backend.log' as PID 3855550