[2025-10-16 15:13:41,586][ INFO][PID:3748131] Marking build as starting [2025-10-16 15:13:41,627][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:13:41,630][ INFO][PID:3748131] VM allocation process starts [2025-10-16 15:13:41,667][ INFO][PID:3748131] Trying to allocate VM: ResallocHost, ticket_id=5692193, requested_tags=['copr_builder', 'arch_x86_64'] [2025-10-16 15:13:46,671][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:13:51,672][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:13:56,673][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:14:01,675][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:14:06,675][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:14:11,676][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:14:16,678][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:14:21,679][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:14:26,680][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:14:31,681][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:14:36,682][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:14:41,683][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:14:46,684][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:14:51,685][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:14:56,686][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:15:01,687][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:15:06,689][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:15:11,693][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:15:16,694][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:15:21,695][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:15:26,696][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:15:31,697][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:15:36,698][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:15:41,699][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:15:46,700][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:15:51,702][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:15:56,703][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:16:01,704][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:16:06,705][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:16:11,710][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:16:16,711][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:16:21,712][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:16:26,713][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:16:31,714][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:16:36,717][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:16:41,718][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:16:46,719][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:16:51,720][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:16:56,721][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:17:01,722][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:17:06,723][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:17:11,725][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:17:16,726][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:17:21,728][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:17:26,729][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:17:31,730][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:17:36,733][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:17:41,734][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:17:46,735][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:17:51,737][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:17:56,739][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:18:01,740][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:18:06,741][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:18:11,743][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:18:16,748][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:18:21,749][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:18:26,751][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:18:31,751][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:18:36,752][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:18:41,753][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:18:46,755][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:18:51,756][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:18:56,757][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:19:01,758][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:19:06,760][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:19:11,764][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:19:16,765][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:19:21,767][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:19:26,770][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:19:31,771][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:19:36,773][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:19:41,774][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:19:46,781][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:19:51,784][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:19:56,785][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:19:59,845][ INFO][PID:3748131] Allocated host ResallocHost, ticket_id=5692193, hostname=98.80.105.98, name=aws_x86_64_spot_prod_07427867_20251016_150210, requested_tags=['copr_builder', 'arch_x86_64'] [2025-10-16 15:19:59,845][ INFO][PID:3748131] Allocating ssh connection to builder [2025-10-16 15:19:59,846][ INFO][PID:3748131] Checking that builder machine is OK [2025-10-16 15:20:00,209][ INFO][PID:3748131] Running remote command: copr-builder-ready fedora-41-x86_64 [2025-10-16 15:20:00,423][ INFO][PID:3748131] Red Hat subscription not needed for fedora-41-x86_64 Builder is ready to be used [2025-10-16 15:20:00,424][ INFO][PID:3748131] Filling build.info file with builder info [2025-10-16 15:20:00,424][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:20:00,425][ INFO][PID:3748131] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@copr", "project_name": "PyPI", "project_dirname": "PyPI", "submitter": "ksurma", "ended_on": null, "started_on": 1760628000.4255154, "submitted_on": null, "status": 3, "chroot": "fedora-41-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9694826-fedora-41-x86_64", "build_id": 9694826, "package_name": "python-pyss3", "package_version": "0.6.5-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@copr/PyPI/python-pyss3", "git_hash": "5c4de5d6444494ba6d85387735e9fc134ffed9a5", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@copr/PyPI--ksurma", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/PyPI/fedora-41-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@copr/PyPI", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@copr/PyPI", "result_dir": "09694826-python-pyss3", "built_packages": "", "id": 9694826, "mockchain_macros": { "copr_username": "@copr", "copr_projectname": "PyPI", "vendor": "Fedora Project COPR (@copr/PyPI)" } } ] } [2025-10-16 15:20:00,454][ INFO][PID:3748131] Sending fedora-messaging bus message in build.start [2025-10-16 15:20:01,275][ INFO][PID:3748131] Sending fedora-messaging bus message in chroot.start [2025-10-16 15:20:01,302][ INFO][PID:3748131] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9694826-fedora-41-x86_64 --chroot fedora-41-x86_64 --detached [2025-10-16 15:20:01,658][ INFO][PID:3748131] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '98.80.105.98' (ED25519) to the list of known hosts. [2025-10-16 15:20:01,659][ INFO][PID:3748131] Downloading the builder-live.log file, attempt 1 [2025-10-16 15:20:01,661][ INFO][PID:3748131] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.80.105.98 copr-rpmbuild-log [2025-10-16 15:20:06,184][ ERROR][PID:3748131] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-10-16 15:20:06,670][ INFO][PID:3748131] Periodic builder liveness probe: alive [2025-10-16 15:20:06,670][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:20:11,671][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:20:16,185][WARNING][PID:3748131] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-10-16 15:20:16,672][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:20:21,674][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:20:26,186][ INFO][PID:3748131] Downloading the builder-live.log file, attempt 2 [2025-10-16 15:20:26,187][ INFO][PID:3748131] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.80.105.98 copr-rpmbuild-log [2025-10-16 15:20:26,675][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:20:31,676][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:20:36,677][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:20:41,678][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:20:46,680][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:20:51,681][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:20:56,682][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:21:01,683][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:21:06,684][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:21:11,685][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:21:16,686][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:21:21,689][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:21:26,256][ ERROR][PID:3748131] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-10-16 15:21:26,690][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:21:31,691][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:21:36,261][WARNING][PID:3748131] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-10-16 15:21:36,693][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:21:41,694][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:21:46,261][ INFO][PID:3748131] Downloading the builder-live.log file, attempt 3 [2025-10-16 15:21:46,263][ INFO][PID:3748131] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.80.105.98 copr-rpmbuild-log [2025-10-16 15:21:46,696][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:21:51,697][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:21:56,699][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:22:01,700][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:22:06,704][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:22:11,705][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:22:16,707][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:22:21,708][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:22:26,712][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:22:31,717][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:22:36,719][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:22:41,720][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:22:46,332][ ERROR][PID:3748131] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-10-16 15:22:46,722][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:22:51,723][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:22:56,344][WARNING][PID:3748131] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-10-16 15:22:56,724][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:23:01,725][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:23:06,344][ INFO][PID:3748131] Downloading the builder-live.log file, attempt 4 [2025-10-16 15:23:06,346][ INFO][PID:3748131] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.80.105.98 copr-rpmbuild-log [2025-10-16 15:23:06,726][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:23:11,727][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:23:16,729][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:23:21,730][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:23:26,737][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:23:31,738][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:23:36,739][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:23:41,741][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:23:46,742][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:23:51,743][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:23:56,745][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:24:01,746][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:24:06,416][ ERROR][PID:3748131] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-10-16 15:24:06,747][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:24:11,748][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:24:16,422][ ERROR][PID:3748131] Giving up for unstable SSH, failures: 1760628016.1856863, 1760628096.2609847, 1760628176.3440256, 1760628256.422588 [2025-10-16 15:24:16,424][ ERROR][PID:3748131] Re-try request for task on 'ResallocHost, ticket_id=5692193, hostname=98.80.105.98, name=aws_x86_64_spot_prod_07427867_20251016_150210, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-10-16 15:24:16,425][ INFO][PID:3748131] Releasing VM back to pool [2025-10-16 15:24:16,442][ INFO][PID:3748131] Retry #1 (on other host) [2025-10-16 15:24:16,443][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:24:16,444][ INFO][PID:3748131] VM allocation process starts [2025-10-16 15:24:16,460][ INFO][PID:3748131] Trying to allocate VM: ResallocHost, ticket_id=5692429, requested_tags=['copr_builder', 'arch_x86_64'] [2025-10-16 15:24:21,462][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:24:26,464][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:24:31,465][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:24:36,467][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:24:41,468][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:24:46,469][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:24:51,470][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:24:56,471][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:25:01,474][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:25:06,478][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:25:11,479][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:25:16,480][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:25:21,481][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:25:26,488][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:25:31,500][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:25:36,509][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:25:41,510][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:25:46,512][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:25:51,513][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:25:56,521][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:26:01,523][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:26:06,530][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:26:11,531][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:26:16,533][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:26:21,537][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:26:26,541][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:26:31,542][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:26:36,545][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:26:41,553][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:26:46,558][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:26:51,561][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:26:56,565][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:27:01,570][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:27:06,572][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:27:11,577][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:27:16,581][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:27:21,584][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:27:26,585][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:27:31,587][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:27:36,590][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:27:41,593][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:27:46,596][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:27:51,602][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:27:56,607][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:28:01,609][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:28:06,619][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:28:11,624][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:28:16,625][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:28:21,627][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:28:26,629][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:28:31,631][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:28:36,635][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:28:41,638][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:28:46,639][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:28:51,641][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:28:56,643][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:29:01,645][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:29:06,648][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:29:11,650][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:29:16,651][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:29:21,653][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:29:26,657][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:29:31,658][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:29:36,661][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:29:41,664][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:29:46,666][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:29:51,667][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:29:56,670][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:30:01,671][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:30:06,673][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:30:11,675][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:30:16,680][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:30:21,681][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:30:26,684][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:30:31,686][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:30:34,694][ INFO][PID:3748131] Allocated host ResallocHost, ticket_id=5692429, hostname=2620:52:3:1:dead:beef:cafe:c188, name=copr_hv_x86_64_03_prod_07428285_20251016_152540, requested_tags=['copr_builder', 'arch_x86_64'] [2025-10-16 15:30:34,695][ INFO][PID:3748131] Allocating ssh connection to builder [2025-10-16 15:30:34,696][ INFO][PID:3748131] Checking that builder machine is OK [2025-10-16 15:30:35,374][ INFO][PID:3748131] Running remote command: copr-builder-ready fedora-41-x86_64 [2025-10-16 15:30:35,737][ INFO][PID:3748131] Red Hat subscription not needed for fedora-41-x86_64 Builder is ready to be used [2025-10-16 15:30:35,737][ INFO][PID:3748131] Filling build.info file with builder info [2025-10-16 15:30:35,744][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:30:35,746][ INFO][PID:3748131] Not re-notifying FE and msg buses for the new host. [2025-10-16 15:30:35,746][ INFO][PID:3748131] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9694826-fedora-41-x86_64 --chroot fedora-41-x86_64 --detached [2025-10-16 15:30:36,314][ INFO][PID:3748131] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c188' (ED25519) to the list of known hosts. [2025-10-16 15:30:36,315][ INFO][PID:3748131] Downloading the builder-live.log file, attempt 1 [2025-10-16 15:30:36,316][ INFO][PID:3748131] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c188 copr-rpmbuild-log [2025-10-16 15:30:41,331][ INFO][PID:3748131] Periodic builder liveness probe: alive [2025-10-16 15:30:41,332][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:30:46,335][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:30:51,336][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:30:56,339][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:31:01,341][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:31:06,346][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:31:11,349][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:31:16,350][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:31:21,358][ INFO][PID:3748131] Checking for cancel request [2025-10-16 15:31:21,381][ INFO][PID:3748131] Downloading results from builder [2025-10-16 15:31:21,382][ INFO][PID:3748131] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c188]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@copr/PyPI/fedora-41-x86_64/09694826-python-pyss3 started [2025-10-16 15:31:21,389][ INFO][PID:3748131] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c188]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@copr/PyPI/fedora-41-x86_64/09694826-python-pyss3/ &> /var/lib/copr/public_html/results/@copr/PyPI/fedora-41-x86_64/09694826-python-pyss3/build-09694826.rsync.log [2025-10-16 15:31:21,842][ INFO][PID:3748131] rsyncing finished. [2025-10-16 15:31:21,843][ INFO][PID:3748131] Releasing VM back to pool [2025-10-16 15:31:21,862][ INFO][PID:3748131] Searching for 'success' file in resultdir [2025-10-16 15:31:21,863][ ERROR][PID:3748131] Build failed: Backend process error: No success file => build failure [2025-10-16 15:31:21,863][ INFO][PID:3748131] Finished build: id=9694826 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/@copr/PyPI chroot=fedora-41-x86_64 [2025-10-16 15:31:21,866][ ERROR][PID:3748131] Backend process error: No success file => build failure [2025-10-16 15:31:21,867][ INFO][PID:3748131] Worker failed build, took 46.120911598205566 [2025-10-16 15:31:21,867][ INFO][PID:3748131] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@copr", "project_name": "PyPI", "project_dirname": "PyPI", "submitter": "ksurma", "ended_on": 1760628681.8670735, "started_on": 1760628635.746162, "submitted_on": null, "status": 0, "chroot": "fedora-41-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9694826-fedora-41-x86_64", "build_id": 9694826, "package_name": "python-pyss3", "package_version": "0.6.5-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@copr/PyPI/python-pyss3", "git_hash": "5c4de5d6444494ba6d85387735e9fc134ffed9a5", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@copr/PyPI--ksurma", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/PyPI/fedora-41-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@copr/PyPI", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@copr/PyPI", "result_dir": "09694826-python-pyss3", "built_packages": "", "id": 9694826, "mockchain_macros": { "copr_username": "@copr", "copr_projectname": "PyPI", "vendor": "Fedora Project COPR (@copr/PyPI)" } } ] } [2025-10-16 15:31:21,903][ INFO][PID:3748131] Sending fedora-messaging bus message in build.end [2025-10-16 15:31:21,929][ INFO][PID:3748131] Compressing /var/lib/copr/public_html/results/@copr/PyPI/fedora-41-x86_64/09694826-python-pyss3/builder-live.log by gzip [2025-10-16 15:31:21,930][ INFO][PID:3748131] Running command 'gzip /var/lib/copr/public_html/results/@copr/PyPI/fedora-41-x86_64/09694826-python-pyss3/builder-live.log' as PID 3884330 [2025-10-16 15:31:21,935][ INFO][PID:3748131] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@copr/PyPI/fedora-41-x86_64/09694826-python-pyss3/builder-live.log) [2025-10-16 15:31:21,936][ INFO][PID:3748131] Compressing /var/lib/copr/public_html/results/@copr/PyPI/fedora-41-x86_64/09694826-python-pyss3/backend.log by gzip [2025-10-16 15:31:21,937][ INFO][PID:3748131] Running command 'gzip /var/lib/copr/public_html/results/@copr/PyPI/fedora-41-x86_64/09694826-python-pyss3/backend.log' as PID 3884333