[2025-10-29 14:41:25,705][ INFO][PID:1930693] Marking build as starting [2025-10-29 14:41:25,747][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:41:25,748][ INFO][PID:1930693] VM allocation process starts [2025-10-29 14:41:25,760][ INFO][PID:1930693] Trying to allocate VM: ResallocHost, ticket_id=5912995, requested_tags=['copr_builder', 'arch_x86_64'] [2025-10-29 14:41:30,761][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:41:35,763][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:41:40,764][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:41:45,765][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:41:50,766][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:41:55,767][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:42:00,768][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:42:05,769][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:42:10,771][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:42:15,773][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:42:20,774][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:42:25,775][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:42:30,778][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:42:35,779][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:42:40,780][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:42:45,782][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:42:50,783][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:42:55,786][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:43:00,787][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:43:05,790][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:43:10,791][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:43:15,792][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:43:20,793][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:43:25,794][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:43:30,796][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:43:35,797][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:43:40,800][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:43:45,801][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:43:50,804][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:43:55,808][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:44:00,810][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:44:05,812][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:44:10,813][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:44:15,814][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:44:20,815][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:44:25,816][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:44:30,817][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:44:35,818][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:44:40,820][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:44:45,822][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:44:50,823][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:44:55,855][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:45:01,072][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:45:06,074][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:45:11,076][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:45:16,078][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:45:21,080][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:45:26,082][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:45:31,083][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:45:36,085][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:45:41,088][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:45:46,090][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:45:51,162][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:45:56,164][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:46:01,183][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:46:06,318][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:46:11,354][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:46:16,357][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:46:21,371][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:46:26,383][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:46:31,385][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:46:36,386][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:46:41,388][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:46:46,390][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:46:51,392][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:46:56,393][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:47:01,394][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:47:06,399][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:47:11,400][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:47:16,401][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:47:21,402][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:47:26,403][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:47:31,405][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:47:36,406][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:47:41,407][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:47:46,409][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:47:51,410][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:47:56,411][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:48:01,413][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:48:06,414][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:48:11,415][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:48:16,416][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:48:21,420][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:48:26,423][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:48:31,425][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:48:36,426][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:48:41,427][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:48:46,429][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:48:51,431][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:48:56,436][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:49:01,437][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:49:06,438][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:49:11,440][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:49:16,441][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:49:21,442][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:49:26,443][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:49:31,445][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:49:36,447][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:49:41,448][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:49:46,452][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:49:51,455][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:49:56,457][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:50:01,461][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:50:06,463][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:50:11,464][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:50:16,465][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:50:21,466][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:50:26,467][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:50:31,470][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:50:36,471][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:50:41,473][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:50:46,473][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:50:51,474][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:50:56,475][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:51:01,477][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:51:06,478][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:51:11,483][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:51:16,484][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:51:21,485][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:51:26,486][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:51:31,487][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:51:36,489][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:51:41,490][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:51:46,492][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:51:51,493][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:51:56,495][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:52:01,496][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:52:06,497][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:52:11,498][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:52:16,499][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:52:21,501][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:52:26,502][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:52:31,503][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:52:36,504][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:52:41,505][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:52:46,506][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:52:51,507][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:52:56,509][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:53:01,511][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:53:06,513][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:53:11,530][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:53:16,531][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:53:21,532][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:53:26,534][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:53:31,535][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:53:36,536][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:53:41,872][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:53:43,948][ INFO][PID:1930693] Allocated host ResallocHost, ticket_id=5912995, hostname=18.208.224.251, name=aws_x86_64_normal_prod_07716199_20251029_145156, requested_tags=['copr_builder', 'arch_x86_64'] [2025-10-29 14:53:43,949][ INFO][PID:1930693] Allocating ssh connection to builder [2025-10-29 14:53:43,949][ INFO][PID:1930693] Checking that builder machine is OK [2025-10-29 14:53:44,299][ INFO][PID:1930693] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2025-10-29 14:53:44,505][ INFO][PID:1930693] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2025-10-29 14:53:44,505][ INFO][PID:1930693] Filling build.info file with builder info [2025-10-29 14:53:44,506][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:53:44,507][ INFO][PID:1930693] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@python", "project_name": "python3.12", "project_dirname": "python3.12", "submitter": "https://src.fedoraproject.org/user/limb", "ended_on": null, "started_on": 1761749624.5071332, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9744258-fedora-rawhide-x86_64", "build_id": 9744258, "package_name": "python-boto3", "package_version": "1.40.61-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@python/python3.12/python-boto3", "git_hash": "d89c529b6aaae70493e634e5ff09e31225eb7aa9", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@python/python3.12--https://src.fedoraproject.org/user/limb", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@python/python3.12/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "bootstrap": "off", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@python/python3.12", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@python/python3.12", "result_dir": "09744258-python-boto3", "built_packages": "", "id": 9744258, "mockchain_macros": { "copr_username": "@python", "copr_projectname": "python3.12", "vendor": "Fedora Project COPR (@python/python3.12)" } } ] } [2025-10-29 14:53:44,531][ INFO][PID:1930693] Sending fedora-messaging bus message in build.start [2025-10-29 14:53:45,198][ INFO][PID:1930693] Sending fedora-messaging bus message in chroot.start [2025-10-29 14:53:45,223][ INFO][PID:1930693] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9744258-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2025-10-29 14:53:45,562][ INFO][PID:1930693] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '18.208.224.251' (ED25519) to the list of known hosts. [2025-10-29 14:53:45,562][ INFO][PID:1930693] Downloading the builder-live.log file, attempt 1 [2025-10-29 14:53:45,564][ INFO][PID:1930693] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@18.208.224.251 copr-rpmbuild-log [2025-10-29 14:53:50,573][ INFO][PID:1930693] Periodic builder liveness probe: alive [2025-10-29 14:53:50,574][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:53:55,575][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:54:00,577][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:54:05,578][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:54:10,579][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:54:15,580][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:54:20,581][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:54:25,582][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:54:30,583][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:54:35,584][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:54:40,585][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:54:45,586][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:54:50,587][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:54:55,588][ INFO][PID:1930693] Checking for cancel request [2025-10-29 14:54:59,986][ INFO][PID:1930693] Downloading results from builder [2025-10-29 14:54:59,987][ INFO][PID:1930693] rsyncing of mockbuilder@18.208.224.251:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@python/python3.12/fedora-rawhide-x86_64/09744258-python-boto3 started [2025-10-29 14:54:59,988][ INFO][PID:1930693] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@18.208.224.251:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@python/python3.12/fedora-rawhide-x86_64/09744258-python-boto3/ &> /var/lib/copr/public_html/results/@python/python3.12/fedora-rawhide-x86_64/09744258-python-boto3/build-09744258.rsync.log [2025-10-29 14:55:00,220][ INFO][PID:1930693] rsyncing finished. [2025-10-29 14:55:00,221][ INFO][PID:1930693] Releasing VM back to pool [2025-10-29 14:55:00,232][ INFO][PID:1930693] Searching for 'success' file in resultdir [2025-10-29 14:55:00,233][ ERROR][PID:1930693] Build failed: Backend process error: No success file => build failure [2025-10-29 14:55:00,234][ INFO][PID:1930693] Finished build: id=9744258 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/@python/python3.12 chroot=fedora-rawhide-x86_64 [2025-10-29 14:55:00,235][ ERROR][PID:1930693] Backend process error: No success file => build failure [2025-10-29 14:55:00,235][ INFO][PID:1930693] Worker failed build, took 75.72873640060425 [2025-10-29 14:55:00,236][ INFO][PID:1930693] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@python", "project_name": "python3.12", "project_dirname": "python3.12", "submitter": "https://src.fedoraproject.org/user/limb", "ended_on": 1761749700.2358696, "started_on": 1761749624.5071332, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9744258-fedora-rawhide-x86_64", "build_id": 9744258, "package_name": "python-boto3", "package_version": "1.40.61-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@python/python3.12/python-boto3", "git_hash": "d89c529b6aaae70493e634e5ff09e31225eb7aa9", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@python/python3.12--https://src.fedoraproject.org/user/limb", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@python/python3.12/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "bootstrap": "off", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@python/python3.12", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@python/python3.12", "result_dir": "09744258-python-boto3", "built_packages": "", "id": 9744258, "mockchain_macros": { "copr_username": "@python", "copr_projectname": "python3.12", "vendor": "Fedora Project COPR (@python/python3.12)" } } ] } [2025-10-29 14:55:00,274][ INFO][PID:1930693] Sending fedora-messaging bus message in build.end [2025-10-29 14:55:00,302][ INFO][PID:1930693] Compressing /var/lib/copr/public_html/results/@python/python3.12/fedora-rawhide-x86_64/09744258-python-boto3/builder-live.log by gzip [2025-10-29 14:55:00,304][ INFO][PID:1930693] Running command 'gzip /var/lib/copr/public_html/results/@python/python3.12/fedora-rawhide-x86_64/09744258-python-boto3/builder-live.log' as PID 2034234 [2025-10-29 14:55:00,309][ INFO][PID:1930693] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@python/python3.12/fedora-rawhide-x86_64/09744258-python-boto3/builder-live.log) [2025-10-29 14:55:00,309][ INFO][PID:1930693] Compressing /var/lib/copr/public_html/results/@python/python3.12/fedora-rawhide-x86_64/09744258-python-boto3/backend.log by gzip [2025-10-29 14:55:00,310][ INFO][PID:1930693] Running command 'gzip /var/lib/copr/public_html/results/@python/python3.12/fedora-rawhide-x86_64/09744258-python-boto3/backend.log' as PID 2034237