[2025-08-26 20:03:17,776][ INFO][PID:2931247] Marking build as starting [2025-08-26 20:03:17,840][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:03:17,845][ INFO][PID:2931247] VM allocation process starts [2025-08-26 20:03:17,901][ INFO][PID:2931247] Trying to allocate VM: ResallocHost, ticket_id=4766902, requested_tags=['copr_builder', 'arch_x86_64'] [2025-08-26 20:03:22,907][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:03:27,911][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:03:32,915][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:03:37,919][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:03:42,924][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:03:47,925][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:03:52,939][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:03:57,944][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:04:02,946][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:04:07,949][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:04:12,955][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:04:17,956][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:04:22,957][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:04:26,041][ INFO][PID:2931247] Allocated host ResallocHost, ticket_id=4766902, hostname=44.214.137.122, name=aws_x86_64_spot_prod_06447357_20250826_200256, requested_tags=['copr_builder', 'arch_x86_64'] [2025-08-26 20:04:26,042][ INFO][PID:2931247] Allocating ssh connection to builder [2025-08-26 20:04:26,042][ INFO][PID:2931247] Checking that builder machine is OK [2025-08-26 20:04:26,539][ INFO][PID:2931247] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2025-08-26 20:04:26,778][ INFO][PID:2931247] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2025-08-26 20:04:26,779][ INFO][PID:2931247] Filling build.info file with builder info [2025-08-26 20:04:26,783][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:04:26,787][ INFO][PID:2931247] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@python", "project_name": "python3.14", "project_dirname": "python3.14", "submitter": "https://src.fedoraproject.org/user/limb", "ended_on": null, "started_on": 1756238666.7867434, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9493466-fedora-rawhide-x86_64", "build_id": 9493466, "package_name": "python-botocore", "package_version": "1.40.18-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@python/python3.14/python-botocore", "git_hash": "e48c90604f52752d5c95740eefe207db72926915", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@python/python3.14--https://src.fedoraproject.org/user/limb", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@python/python3.14/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": 9 }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "bootstrap": "off", "fedora_review": false, "isolation": "default", "repo_priority": 9, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@python/python3.14", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@python/python3.14", "result_dir": "09493466-python-botocore", "built_packages": "", "id": 9493466, "mockchain_macros": { "copr_username": "@python", "copr_projectname": "python3.14", "vendor": "Fedora Project COPR (@python/python3.14)" } } ] } [2025-08-26 20:04:26,819][ INFO][PID:2931247] Sending fedora-messaging bus message in build.start [2025-08-26 20:04:28,201][ INFO][PID:2931247] Sending fedora-messaging bus message in chroot.start [2025-08-26 20:04:28,260][ INFO][PID:2931247] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9493466-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2025-08-26 20:04:28,634][ INFO][PID:2931247] Downloading the builder-live.log file, attempt 1 [2025-08-26 20:04:28,642][ INFO][PID:2931247] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.214.137.122 copr-rpmbuild-log [2025-08-26 20:04:33,694][ INFO][PID:2931247] Periodic builder liveness probe: alive [2025-08-26 20:04:33,700][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:04:38,712][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:04:43,713][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:04:48,715][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:04:53,721][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:04:58,722][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:05:03,724][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:05:08,728][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:05:13,734][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:05:18,737][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:05:23,741][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:05:28,744][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:05:33,747][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:05:38,748][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:05:43,751][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:05:48,753][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:05:53,756][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:05:58,757][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:06:03,760][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:06:08,764][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:06:13,767][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:06:18,770][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:06:23,772][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:06:28,780][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:06:33,783][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:06:38,789][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:06:43,794][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:06:48,795][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:06:53,798][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:06:58,806][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:07:03,810][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:07:08,812][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:07:13,817][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:07:14,919][ ERROR][PID:2931247] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-08-26 20:07:18,831][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:07:23,835][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:07:24,925][WARNING][PID:2931247] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-08-26 20:07:28,847][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:07:33,850][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:07:34,929][ INFO][PID:2931247] Downloading the builder-live.log file, attempt 2 [2025-08-26 20:07:34,937][ INFO][PID:2931247] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.214.137.122 copr-rpmbuild-log [2025-08-26 20:07:34,986][ ERROR][PID:2931247] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-08-26 20:07:38,852][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:07:43,854][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:07:44,995][WARNING][PID:2931247] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-08-26 20:07:48,860][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:07:53,866][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:07:54,996][ INFO][PID:2931247] Downloading the builder-live.log file, attempt 3 [2025-08-26 20:07:54,998][ INFO][PID:2931247] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.214.137.122 copr-rpmbuild-log [2025-08-26 20:07:55,035][ ERROR][PID:2931247] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-08-26 20:07:58,868][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:08:03,874][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:08:05,041][WARNING][PID:2931247] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-08-26 20:08:08,876][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:08:13,878][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:08:15,042][ INFO][PID:2931247] Downloading the builder-live.log file, attempt 4 [2025-08-26 20:08:15,043][ INFO][PID:2931247] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.214.137.122 copr-rpmbuild-log [2025-08-26 20:08:18,885][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:08:23,887][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:08:28,889][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:08:33,890][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:08:38,894][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:08:43,900][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:08:48,902][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:08:53,908][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:08:58,909][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:09:03,910][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:09:08,914][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:09:13,915][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:09:15,118][ ERROR][PID:2931247] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-08-26 20:09:18,916][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:09:23,917][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:09:25,122][ ERROR][PID:2931247] Giving up for unstable SSH, failures: 1756238844.9251919, 1756238864.9955583, 1756238885.0402656, 1756238965.121933 [2025-08-26 20:09:25,123][ ERROR][PID:2931247] Re-try request for task on 'ResallocHost, ticket_id=4766902, hostname=44.214.137.122, name=aws_x86_64_spot_prod_06447357_20250826_200256, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-08-26 20:09:25,123][ INFO][PID:2931247] Releasing VM back to pool [2025-08-26 20:09:25,135][ INFO][PID:2931247] Retry #1 (on other host) [2025-08-26 20:09:25,136][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:09:25,137][ INFO][PID:2931247] VM allocation process starts [2025-08-26 20:09:25,150][ INFO][PID:2931247] Trying to allocate VM: ResallocHost, ticket_id=4767256, requested_tags=['copr_builder', 'arch_x86_64'] [2025-08-26 20:09:30,152][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:09:35,154][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:09:40,155][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:09:45,159][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:09:50,161][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:09:55,163][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:10:00,168][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:10:05,172][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:10:10,175][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:10:15,176][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:10:20,189][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:10:25,192][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:10:30,195][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:10:33,315][ INFO][PID:2931247] Allocated host ResallocHost, ticket_id=4767256, hostname=2620:52:3:1:dead:beef:cafe:c1d8, name=copr_hv_x86_64_04_prod_06447511_20250826_200848, requested_tags=['copr_builder', 'arch_x86_64'] [2025-08-26 20:10:33,321][ INFO][PID:2931247] Allocating ssh connection to builder [2025-08-26 20:10:33,328][ INFO][PID:2931247] Checking that builder machine is OK [2025-08-26 20:10:33,904][ INFO][PID:2931247] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2025-08-26 20:10:34,329][ INFO][PID:2931247] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2025-08-26 20:10:34,330][ INFO][PID:2931247] Filling build.info file with builder info [2025-08-26 20:10:34,338][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:10:34,340][ INFO][PID:2931247] Not re-notifying FE and msg buses for the new host. [2025-08-26 20:10:34,341][ INFO][PID:2931247] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9493466-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2025-08-26 20:10:34,994][ INFO][PID:2931247] Downloading the builder-live.log file, attempt 1 [2025-08-26 20:10:35,013][ INFO][PID:2931247] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c1d8 copr-rpmbuild-log [2025-08-26 20:10:39,995][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:10:44,997][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:10:50,006][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:10:55,022][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:11:00,023][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:11:05,027][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:11:10,031][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:11:15,032][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:11:20,036][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:11:25,044][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:11:30,049][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:11:35,053][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:11:40,055][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:11:45,061][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:11:50,064][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:11:55,067][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:12:00,069][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:12:05,080][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:12:10,085][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:12:15,089][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:12:20,097][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:12:25,101][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:12:30,110][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:12:35,124][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:12:40,126][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:12:45,145][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:12:50,149][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:12:55,158][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:13:00,162][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:13:05,185][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:13:10,199][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:13:15,217][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:13:20,227][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:13:25,236][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:13:30,241][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:13:35,252][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:13:40,254][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:13:45,258][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:13:50,264][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:13:55,269][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:14:00,274][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:14:05,288][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:14:10,289][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:14:15,296][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:14:20,298][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:14:25,302][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:14:30,303][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:14:35,335][ INFO][PID:2931247] Periodic builder liveness probe: alive [2025-08-26 20:14:35,336][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:14:40,338][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:14:45,342][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:14:50,352][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:14:55,358][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:15:00,362][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:15:05,366][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:15:10,372][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:15:15,378][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:15:20,379][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:15:25,383][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:15:30,388][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:15:35,395][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:15:40,398][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:15:45,407][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:15:50,409][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:15:55,413][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:16:00,414][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:16:05,417][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:16:10,422][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:16:15,428][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:16:20,435][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:16:25,441][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:16:30,442][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:16:35,450][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:16:40,451][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:16:45,461][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:16:50,465][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:16:55,472][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:17:00,476][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:17:05,483][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:17:10,485][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:17:15,499][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:17:20,502][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:17:25,515][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:17:30,520][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:17:35,534][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:17:40,601][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:17:45,607][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:17:50,618][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:17:55,633][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:18:00,641][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:18:05,648][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:18:10,681][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:18:15,702][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:18:20,711][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:18:25,734][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:18:30,745][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:18:35,758][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:18:40,784][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:18:45,873][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:18:50,908][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:18:55,929][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:19:01,017][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:19:06,053][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:19:11,108][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:19:16,159][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:19:21,222][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:19:26,502][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:19:31,588][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:19:36,689][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:19:41,716][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:19:46,730][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:19:51,789][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:19:56,907][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:20:01,915][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:20:06,979][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:20:11,990][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:20:17,017][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:20:22,034][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:20:27,340][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:20:32,434][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:20:37,559][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:20:42,615][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:20:47,700][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:20:52,817][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:20:58,010][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:21:03,037][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:21:08,066][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:21:13,248][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:21:18,253][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:21:23,291][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:21:28,364][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:21:33,562][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:21:38,644][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:21:43,715][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:21:48,755][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:21:53,785][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:21:58,802][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:22:03,808][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:22:08,818][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:22:13,827][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:22:19,027][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:22:24,029][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:22:29,034][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:22:34,445][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:22:39,962][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:22:45,129][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:22:50,201][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:22:55,214][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:23:00,247][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:23:05,284][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:23:10,290][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:23:15,295][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:23:20,319][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:23:25,323][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:23:30,367][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:23:35,397][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:23:40,447][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:23:45,461][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:23:50,477][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:23:55,497][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:24:00,518][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:24:05,532][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:24:10,559][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:24:15,575][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:24:20,597][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:24:25,611][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:24:30,650][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:24:35,765][ INFO][PID:2931247] Periodic builder liveness probe: alive [2025-08-26 20:24:35,775][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:24:40,790][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:24:45,833][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:24:50,910][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:24:55,932][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:25:00,942][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:25:05,950][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:25:10,954][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:25:15,960][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:25:20,968][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:25:25,981][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:25:30,984][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:25:35,986][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:25:40,997][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:25:46,004][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:25:51,054][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:25:56,109][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:26:01,135][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:26:06,167][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:26:11,204][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:26:16,254][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:26:21,310][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:26:26,398][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:26:31,484][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:26:36,493][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:26:41,506][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:26:46,644][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:26:51,668][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:26:56,721][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:27:01,768][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:27:13,590][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:27:18,593][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:27:23,595][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:27:28,666][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:27:37,848][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:27:45,621][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:27:52,580][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:27:57,583][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:28:09,414][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:28:16,489][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:28:33,563][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:28:38,564][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:28:43,567][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:28:48,573][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:28:53,576][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:29:13,862][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:29:35,260][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:29:54,778][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:30:00,957][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:30:07,917][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:30:13,737][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:30:18,868][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:30:23,913][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:30:29,238][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:30:34,362][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:30:39,382][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:30:44,443][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:30:49,469][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:30:54,565][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:30:59,722][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:31:04,813][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:31:09,912][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:31:14,944][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:31:19,985][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:31:24,995][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:31:30,009][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:31:35,031][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:31:40,060][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:31:45,303][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:31:50,408][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:31:55,472][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:32:00,514][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:32:05,540][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:32:10,545][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:32:15,558][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:32:20,610][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:32:25,617][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:32:30,624][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:32:35,638][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:32:40,647][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:32:45,694][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:32:50,703][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:32:55,714][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:33:00,724][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:33:05,775][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:33:10,804][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:33:15,844][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:33:20,862][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:33:25,870][ INFO][PID:2931247] Checking for cancel request [2025-08-26 20:33:26,141][ INFO][PID:2931247] Downloading results from builder [2025-08-26 20:33:26,186][ INFO][PID:2931247] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c1d8]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@python/python3.14/fedora-rawhide-x86_64/09493466-python-botocore started [2025-08-26 20:33:26,237][ INFO][PID:2931247] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c1d8]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@python/python3.14/fedora-rawhide-x86_64/09493466-python-botocore/ &> /var/lib/copr/public_html/results/@python/python3.14/fedora-rawhide-x86_64/09493466-python-botocore/build-09493466.rsync.log [2025-08-26 20:33:28,408][ INFO][PID:2931247] rsyncing finished. [2025-08-26 20:33:28,413][ INFO][PID:2931247] Releasing VM back to pool [2025-08-26 20:33:28,490][ INFO][PID:2931247] Searching for 'success' file in resultdir [2025-08-26 20:33:28,532][ INFO][PID:2931247] Going to sign pkgs from source: 9493466-fedora-rawhide-x86_64 in chroot: /var/lib/copr/public_html/results/@python/python3.14/fedora-rawhide-x86_64 [2025-08-26 20:33:28,578][ INFO][PID:2931247] Calling '/bin/sign -u @python#python3.14@copr.fedorahosted.org -p' (attempt #1) [2025-08-26 20:33:28,976][ INFO][PID:2931247] Calling '/bin/sign -4 -h sha256 -u @python#python3.14@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@python/python3.14/fedora-rawhide-x86_64/09493466-python-botocore/python-botocore-1.40.18-1.fc44.src.rpm' (attempt #1) [2025-08-26 20:33:30,720][ INFO][PID:2931247] signed rpm: /var/lib/copr/public_html/results/@python/python3.14/fedora-rawhide-x86_64/09493466-python-botocore/python-botocore-1.40.18-1.fc44.src.rpm [2025-08-26 20:33:30,721][ INFO][PID:2931247] Calling '/bin/sign -4 -h sha256 -u @python#python3.14@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@python/python3.14/fedora-rawhide-x86_64/09493466-python-botocore/python3-botocore-1.40.18-1.fc44.noarch.rpm' (attempt #1) [2025-08-26 20:33:32,830][ INFO][PID:2931247] signed rpm: /var/lib/copr/public_html/results/@python/python3.14/fedora-rawhide-x86_64/09493466-python-botocore/python3-botocore-1.40.18-1.fc44.noarch.rpm [2025-08-26 20:33:32,831][ INFO][PID:2931247] Sign done [2025-08-26 20:33:32,848][ INFO][PID:2931247] Incremental createrepo run, adding 09493466-python-botocore into https://download.copr.fedorainfracloud.org/results/@python/python3.14/fedora-rawhide-x86_64, (auto-create-repo=True) [2025-08-26 20:33:32,957][ INFO][PID:2931247] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@python/python3.14/fedora-rawhide-x86_64 --add 09493466-python-botocore --no-appstream-metadata' as PID 3209737 [2025-08-26 20:35:17,733][ INFO][PID:2931247] Finished after 104 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@python/python3.14/fedora-rawhide-x86_64 --add 09493466-python-botocore --no-appstream-metadata) [2025-08-26 20:35:17,758][ INFO][PID:2931247] Getting build details [2025-08-26 20:35:17,762][ INFO][PID:2931247] Listing built binary packages in /var/lib/copr/public_html/results/@python/python3.14/fedora-rawhide-x86_64/09493466-python-botocore [2025-08-26 20:35:17,764][ INFO][PID:2931247] Built packages: ['python3-botocore 1.40.18'] [2025-08-26 20:35:17,860][ INFO][PID:2931247] build details: {'built_packages': 'python3-botocore 1.40.18'} [2025-08-26 20:35:17,865][ INFO][PID:2931247] Retrieving pubkey [2025-08-26 20:35:17,865][ INFO][PID:2931247] Calling '/bin/sign -u @python#python3.14@copr.fedorahosted.org -p' (attempt #1) [2025-08-26 20:35:18,218][ INFO][PID:2931247] Added pubkey for user @python project python3.14 into: /var/lib/copr/public_html/results/@python/python3.14/pubkey.gpg [2025-08-26 20:35:18,225][ INFO][PID:2931247] Finished build: id=9493466 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@python/python3.14 chroot=fedora-rawhide-x86_64 [2025-08-26 20:35:18,321][ INFO][PID:2931247] Worker succeeded build, took 1483.9795610904694 [2025-08-26 20:35:18,340][ INFO][PID:2931247] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@python", "project_name": "python3.14", "project_dirname": "python3.14", "submitter": "https://src.fedoraproject.org/user/limb", "ended_on": 1756240518.319766, "started_on": 1756239034.340205, "submitted_on": null, "status": 1, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9493466-fedora-rawhide-x86_64", "build_id": 9493466, "package_name": "python-botocore", "package_version": "1.40.18-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@python/python3.14/python-botocore", "git_hash": "e48c90604f52752d5c95740eefe207db72926915", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@python/python3.14--https://src.fedoraproject.org/user/limb", "results": { "packages": [ { "name": "python-botocore", "epoch": null, "version": "1.40.18", "release": "1.fc44", "arch": "src" }, { "name": "python3-botocore", "epoch": null, "version": "1.40.18", "release": "1.fc44", "arch": "noarch" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@python/python3.14/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": 9 }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "bootstrap": "off", "fedora_review": false, "isolation": "default", "repo_priority": 9, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@python/python3.14", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@python/python3.14", "result_dir": "09493466-python-botocore", "built_packages": "python3-botocore 1.40.18", "id": 9493466, "mockchain_macros": { "copr_username": "@python", "copr_projectname": "python3.14", "vendor": "Fedora Project COPR (@python/python3.14)" } } ] } [2025-08-26 20:35:19,102][ INFO][PID:2931247] Sending fedora-messaging bus message in build.end [2025-08-26 20:35:19,672][ INFO][PID:2931247] Compressing /var/lib/copr/public_html/results/@python/python3.14/fedora-rawhide-x86_64/09493466-python-botocore/builder-live.log by gzip [2025-08-26 20:35:19,676][ INFO][PID:2931247] Running command 'gzip /var/lib/copr/public_html/results/@python/python3.14/fedora-rawhide-x86_64/09493466-python-botocore/builder-live.log' as PID 3227209 [2025-08-26 20:35:19,890][ INFO][PID:2931247] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@python/python3.14/fedora-rawhide-x86_64/09493466-python-botocore/builder-live.log) [2025-08-26 20:35:19,891][ INFO][PID:2931247] Compressing /var/lib/copr/public_html/results/@python/python3.14/fedora-rawhide-x86_64/09493466-python-botocore/backend.log by gzip [2025-08-26 20:35:19,897][ INFO][PID:2931247] Running command 'gzip /var/lib/copr/public_html/results/@python/python3.14/fedora-rawhide-x86_64/09493466-python-botocore/backend.log' as PID 3227230