[2025-12-16 14:50:52,067][ INFO][PID:793261] Marking build as starting [2025-12-16 14:50:52,157][ INFO][PID:793261] Checking that /var/lib/copr/public_html/results/frantisekz/flask-3.0/fedora-rawhide-x86_64/repodata/repomd.xml exists [2025-12-16 14:50:52,219][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:50:52,220][ INFO][PID:793261] VM allocation process starts [2025-12-16 14:50:52,241][ INFO][PID:793261] Trying to allocate VM: ResallocHost, ticket_id=371108, requested_tags=['copr_builder', 'arch_x86_64'] [2025-12-16 14:50:57,244][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:50:58,283][ INFO][PID:793261] Allocated host ResallocHost, ticket_id=371108, hostname=44.220.60.77, name=aws_x86_64_spot_prod_00600885_20251216_144424, requested_tags=['copr_builder', 'arch_x86_64'] [2025-12-16 14:50:58,283][ INFO][PID:793261] Allocating ssh connection to builder [2025-12-16 14:50:58,284][ INFO][PID:793261] Checking that builder machine is OK [2025-12-16 14:50:58,640][ INFO][PID:793261] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2025-12-16 14:50:58,853][ INFO][PID:793261] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2025-12-16 14:50:58,853][ INFO][PID:793261] Filling build.info file with builder info [2025-12-16 14:50:58,854][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:50:58,855][ INFO][PID:793261] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "frantisekz", "project_name": "flask-3.0", "project_dirname": "flask-3.0", "submitter": "https://src.fedoraproject.org/user/pwouters", "ended_on": null, "started_on": 1765896658.85512, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9915221-fedora-rawhide-x86_64", "build_id": 9915221, "package_name": "python-sentry-sdk", "package_version": "2.47.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/frantisekz/flask-3.0/python-sentry-sdk", "git_hash": "a44da3c5ac5d84c5acdf066983707b4bf3ed6633", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "frantisekz/flask-3.0--https://src.fedoraproject.org/user/pwouters", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/frantisekz/flask-3.0/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/frantisekz/flask-3.0", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/frantisekz/flask-3.0", "result_dir": "09915221-python-sentry-sdk", "built_packages": "", "id": 9915221, "mockchain_macros": { "copr_username": "frantisekz", "copr_projectname": "flask-3.0", "vendor": "Fedora Project COPR (frantisekz/flask-3.0)" } } ] } [2025-12-16 14:50:58,900][ INFO][PID:793261] Sending fedora-messaging bus message in build.start [2025-12-16 14:50:59,622][ INFO][PID:793261] Sending fedora-messaging bus message in chroot.start [2025-12-16 14:50:59,659][ INFO][PID:793261] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9915221-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2025-12-16 14:51:00,024][ INFO][PID:793261] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '44.220.60.77' (ED25519) to the list of known hosts. [2025-12-16 14:51:00,025][ INFO][PID:793261] Downloading the builder-live.log file, attempt 1 [2025-12-16 14:51:00,027][ INFO][PID:793261] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.220.60.77 copr-rpmbuild-log [2025-12-16 14:51:05,048][ INFO][PID:793261] Periodic builder liveness probe: alive [2025-12-16 14:51:05,050][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:51:10,051][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:51:15,053][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:51:20,055][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:51:25,056][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:51:30,057][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:51:35,060][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:51:40,061][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:51:45,062][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:51:50,064][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:51:55,065][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:52:00,071][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:52:05,073][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:52:10,075][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:52:15,078][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:52:20,081][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:52:25,083][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:52:30,088][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:52:35,089][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:52:40,092][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:52:45,095][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:52:50,096][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:52:55,097][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:53:00,100][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:53:05,102][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:53:10,103][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:53:15,104][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:53:20,105][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:53:25,108][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:53:30,110][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:53:35,111][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:53:40,113][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:53:45,114][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:53:50,115][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:53:55,116][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:54:00,117][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:54:05,118][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:54:10,119][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:54:15,120][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:54:20,124][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:54:25,125][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:54:30,127][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:54:35,128][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:54:40,129][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:54:45,130][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:54:50,131][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:54:55,132][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:55:00,135][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:55:05,140][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:55:10,141][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:55:15,142][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:55:20,143][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:55:25,144][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:55:30,145][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:55:35,147][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:55:40,148][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:55:45,149][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:55:50,150][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:55:55,151][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:56:00,152][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:56:05,153][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:56:10,154][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:56:15,155][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:56:20,157][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:56:25,158][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:56:30,159][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:56:35,160][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:56:40,161][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:56:45,162][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:56:50,163][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:56:55,164][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:57:00,165][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:57:05,166][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:57:10,170][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:57:15,172][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:57:20,173][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:57:25,175][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:57:30,176][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:57:35,177][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:57:40,178][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:57:45,179][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:57:50,180][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:57:55,181][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:58:00,182][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:58:05,183][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:58:10,184][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:58:15,185][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:58:20,187][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:58:25,188][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:58:30,189][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:58:35,190][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:58:40,191][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:58:45,193][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:58:50,194][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:58:55,195][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:59:00,196][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:59:05,485][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:59:10,487][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:59:15,730][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:59:20,731][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:59:25,732][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:59:30,733][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:59:35,735][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:59:40,739][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:59:45,740][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:59:50,741][ INFO][PID:793261] Checking for cancel request [2025-12-16 14:59:55,742][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:00:01,384][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:00:06,385][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:00:11,386][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:00:16,387][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:00:21,388][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:00:26,389][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:00:31,390][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:00:36,392][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:00:41,393][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:00:46,394][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:00:51,396][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:00:56,397][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:01:01,397][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:01:06,420][ INFO][PID:793261] Periodic builder liveness probe: alive [2025-12-16 15:01:06,420][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:01:11,421][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:01:16,427][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:01:21,428][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:01:26,429][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:01:31,431][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:01:35,165][ ERROR][PID:793261] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-16 15:01:36,432][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:01:41,474][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:01:45,166][WARNING][PID:793261] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-16 15:01:46,475][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:01:51,535][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:01:55,167][ INFO][PID:793261] Downloading the builder-live.log file, attempt 2 [2025-12-16 15:01:55,169][ INFO][PID:793261] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.220.60.77 copr-rpmbuild-log [2025-12-16 15:01:56,536][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:02:01,537][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:02:06,538][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:02:11,579][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:02:16,580][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:02:21,581][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:02:26,873][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:02:31,875][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:02:37,064][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:02:42,102][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:02:47,104][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:02:52,105][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:02:55,236][ ERROR][PID:793261] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-16 15:02:57,107][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:03:02,107][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:03:05,252][WARNING][PID:793261] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-16 15:03:07,108][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:03:12,406][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:03:15,253][ INFO][PID:793261] Downloading the builder-live.log file, attempt 3 [2025-12-16 15:03:15,254][ INFO][PID:793261] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.220.60.77 copr-rpmbuild-log [2025-12-16 15:03:17,407][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:03:22,409][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:03:27,411][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:03:32,412][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:03:37,415][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:03:42,418][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:03:47,419][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:03:52,421][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:03:57,422][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:04:02,423][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:04:07,424][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:04:12,600][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:04:15,321][ ERROR][PID:793261] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-16 15:04:17,601][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:04:22,603][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:04:25,385][WARNING][PID:793261] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-16 15:04:27,673][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:04:32,675][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:04:35,385][ INFO][PID:793261] Downloading the builder-live.log file, attempt 4 [2025-12-16 15:04:35,387][ INFO][PID:793261] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.220.60.77 copr-rpmbuild-log [2025-12-16 15:04:37,676][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:04:42,677][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:04:47,696][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:04:52,784][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:04:57,785][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:05:02,787][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:05:07,789][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:05:13,254][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:05:25,938][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:05:31,115][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:05:38,529][ ERROR][PID:793261] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-16 15:05:43,533][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:05:48,575][ ERROR][PID:793261] Giving up for unstable SSH, failures: 1765897305.1665556, 1765897385.2521052, 1765897465.3850582, 1765897548.574943 [2025-12-16 15:05:48,576][ ERROR][PID:793261] Re-try request for task on 'ResallocHost, ticket_id=371108, hostname=44.220.60.77, name=aws_x86_64_spot_prod_00600885_20251216_144424, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-12-16 15:05:48,576][ INFO][PID:793261] Releasing VM back to pool [2025-12-16 15:05:48,597][ INFO][PID:793261] Retry #1 (on other host) [2025-12-16 15:05:48,599][ INFO][PID:793261] Checking that /var/lib/copr/public_html/results/frantisekz/flask-3.0/fedora-rawhide-x86_64/repodata/repomd.xml exists [2025-12-16 15:05:48,600][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:05:48,601][ INFO][PID:793261] VM allocation process starts [2025-12-16 15:05:48,617][ INFO][PID:793261] Trying to allocate VM: ResallocHost, ticket_id=371266, requested_tags=['copr_builder', 'arch_x86_64'] [2025-12-16 15:05:53,619][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:05:54,647][ INFO][PID:793261] Allocated host ResallocHost, ticket_id=371266, hostname=98.84.25.19, name=aws_x86_64_spot_prod_00600879_20251216_144412, requested_tags=['copr_builder', 'arch_x86_64'] [2025-12-16 15:05:55,139][ INFO][PID:793261] Allocating ssh connection to builder [2025-12-16 15:05:55,140][ INFO][PID:793261] Checking that builder machine is OK [2025-12-16 15:05:55,491][ INFO][PID:793261] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2025-12-16 15:05:55,702][ INFO][PID:793261] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2025-12-16 15:05:55,703][ INFO][PID:793261] Filling build.info file with builder info [2025-12-16 15:05:55,747][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:05:55,748][ INFO][PID:793261] Not re-notifying FE and msg buses for the new host. [2025-12-16 15:05:55,748][ INFO][PID:793261] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9915221-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2025-12-16 15:05:56,095][ INFO][PID:793261] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '98.84.25.19' (ED25519) to the list of known hosts. [2025-12-16 15:05:56,096][ INFO][PID:793261] Downloading the builder-live.log file, attempt 1 [2025-12-16 15:05:56,097][ INFO][PID:793261] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.84.25.19 copr-rpmbuild-log [2025-12-16 15:06:01,096][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:06:06,097][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:06:11,098][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:06:16,110][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:06:21,811][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:06:30,389][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:06:35,390][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:06:40,486][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:06:45,489][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:06:50,714][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:06:55,789][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:07:02,038][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:07:07,073][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:07:12,094][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:07:17,435][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:07:22,446][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:07:27,490][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:07:32,504][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:07:39,159][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:07:44,160][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:07:49,173][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:07:54,187][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:07:59,203][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:08:04,205][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:08:09,210][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:08:14,215][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:08:19,218][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:08:24,222][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:08:29,279][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:08:34,290][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:08:39,298][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:08:44,301][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:08:49,311][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:08:54,367][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:08:59,417][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:09:04,562][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:09:09,885][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:09:14,941][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:09:19,956][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:09:24,970][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:09:29,974][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:09:34,992][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:09:40,003][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:09:45,007][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:09:50,039][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:09:55,063][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:10:00,079][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:10:05,113][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:10:10,120][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:10:15,134][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:10:20,142][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:10:25,162][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:10:30,169][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:10:35,176][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:10:40,189][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:10:45,196][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:10:50,207][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:10:55,213][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:11:00,219][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:11:05,230][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:11:10,274][ INFO][PID:793261] Periodic builder liveness probe: alive [2025-12-16 15:11:10,300][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:11:11,421][ ERROR][PID:793261] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-16 15:11:15,310][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:11:20,315][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:11:21,429][WARNING][PID:793261] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-16 15:11:25,328][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:11:30,335][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:11:31,430][ INFO][PID:793261] Downloading the builder-live.log file, attempt 2 [2025-12-16 15:11:31,437][ INFO][PID:793261] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.84.25.19 copr-rpmbuild-log [2025-12-16 15:11:35,342][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:11:40,352][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:11:45,360][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:11:50,428][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:11:55,438][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:12:00,450][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:12:05,461][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:12:10,514][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:12:15,531][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:12:20,568][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:12:25,662][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:12:30,665][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:12:31,539][ ERROR][PID:793261] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-16 15:12:35,675][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:12:40,677][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:12:41,573][WARNING][PID:793261] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-16 15:12:45,702][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:12:50,711][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:12:51,575][ INFO][PID:793261] Downloading the builder-live.log file, attempt 3 [2025-12-16 15:12:51,577][ INFO][PID:793261] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.84.25.19 copr-rpmbuild-log [2025-12-16 15:12:55,717][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:13:00,954][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:13:05,986][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:13:10,991][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:13:16,190][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:13:21,198][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:13:26,322][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:13:31,329][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:13:36,351][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:13:41,355][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:13:46,378][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:13:51,395][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:13:51,655][ ERROR][PID:793261] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-16 15:13:56,397][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:14:01,400][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:14:01,749][WARNING][PID:793261] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-16 15:14:06,406][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:14:11,510][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:14:11,750][ INFO][PID:793261] Downloading the builder-live.log file, attempt 4 [2025-12-16 15:14:11,751][ INFO][PID:793261] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.84.25.19 copr-rpmbuild-log [2025-12-16 15:14:16,561][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:14:21,750][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:14:27,058][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:14:32,308][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:14:37,312][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:14:42,315][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:14:47,362][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:14:52,368][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:14:57,622][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:15:02,965][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:15:07,973][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:15:11,820][ ERROR][PID:793261] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-16 15:15:12,978][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:15:17,980][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:15:21,897][ ERROR][PID:793261] Giving up for unstable SSH, failures: 1765897881.4294586, 1765897961.573904, 1765898041.7492092, 1765898121.8975832 [2025-12-16 15:15:21,899][ ERROR][PID:793261] Re-try request for task on 'ResallocHost, ticket_id=371266, hostname=98.84.25.19, name=aws_x86_64_spot_prod_00600879_20251216_144412, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-12-16 15:15:21,899][ INFO][PID:793261] Releasing VM back to pool [2025-12-16 15:15:21,945][ INFO][PID:793261] Retry #2 (on other host) [2025-12-16 15:15:21,946][ INFO][PID:793261] Checking that /var/lib/copr/public_html/results/frantisekz/flask-3.0/fedora-rawhide-x86_64/repodata/repomd.xml exists [2025-12-16 15:15:21,946][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:15:21,947][ INFO][PID:793261] VM allocation process starts [2025-12-16 15:15:22,005][ INFO][PID:793261] Trying to allocate VM: ResallocHost, ticket_id=371483, requested_tags=['copr_builder', 'arch_x86_64'] [2025-12-16 15:15:27,007][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:15:28,031][ INFO][PID:793261] Allocated host ResallocHost, ticket_id=371483, hostname=100.31.210.38, name=aws_x86_64_normalreserved_prod_00601858_20251216_151107, requested_tags=['copr_builder', 'arch_x86_64'] [2025-12-16 15:15:28,032][ INFO][PID:793261] Allocating ssh connection to builder [2025-12-16 15:15:28,032][ INFO][PID:793261] Checking that builder machine is OK [2025-12-16 15:15:28,379][ INFO][PID:793261] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2025-12-16 15:15:28,605][ INFO][PID:793261] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2025-12-16 15:15:28,608][ INFO][PID:793261] Filling build.info file with builder info [2025-12-16 15:15:28,621][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:15:28,623][ INFO][PID:793261] Not re-notifying FE and msg buses for the new host. [2025-12-16 15:15:28,623][ INFO][PID:793261] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9915221-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2025-12-16 15:15:28,985][ INFO][PID:793261] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '100.31.210.38' (ED25519) to the list of known hosts. [2025-12-16 15:15:28,989][ INFO][PID:793261] Downloading the builder-live.log file, attempt 1 [2025-12-16 15:15:28,993][ INFO][PID:793261] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.31.210.38 copr-rpmbuild-log [2025-12-16 15:15:33,990][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:15:38,991][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:15:43,992][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:15:48,994][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:15:53,995][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:15:59,009][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:16:04,010][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:16:09,015][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:16:14,016][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:16:19,019][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:16:24,023][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:16:29,024][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:16:34,025][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:16:39,031][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:16:44,032][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:16:49,034][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:16:54,039][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:16:59,040][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:17:04,047][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:17:09,052][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:17:14,056][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:17:19,086][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:17:24,090][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:17:29,092][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:17:34,093][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:17:39,095][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:17:44,107][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:17:49,115][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:17:54,116][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:17:59,117][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:18:04,119][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:18:09,120][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:18:14,122][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:18:19,124][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:18:24,126][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:18:29,138][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:18:34,140][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:18:39,175][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:18:44,178][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:18:49,186][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:18:54,191][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:18:59,192][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:19:04,234][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:19:09,252][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:19:14,253][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:19:19,335][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:19:24,337][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:19:29,409][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:19:34,410][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:19:39,415][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:19:44,573][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:19:49,855][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:19:55,017][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:20:00,019][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:20:05,140][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:20:10,144][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:20:15,145][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:20:20,156][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:20:25,157][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:20:30,158][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:20:35,198][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:20:40,200][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:20:45,202][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:20:50,247][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:20:55,254][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:21:00,258][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:21:05,262][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:21:10,263][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:21:16,138][ INFO][PID:793261] Periodic builder liveness probe: alive [2025-12-16 15:21:16,201][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:21:21,202][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:21:26,203][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:21:31,204][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:21:36,205][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:21:41,208][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:21:46,209][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:21:51,210][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:21:56,217][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:22:01,218][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:22:06,219][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:22:11,220][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:22:16,222][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:22:21,224][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:22:26,225][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:22:31,226][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:22:36,227][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:22:41,228][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:22:46,229][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:22:51,230][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:22:56,231][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:23:01,232][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:23:06,233][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:23:11,236][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:23:16,237][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:23:21,238][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:23:26,239][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:23:31,240][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:23:36,241][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:23:41,242][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:23:46,243][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:23:51,244][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:23:56,245][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:24:01,271][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:24:06,272][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:24:11,274][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:24:16,286][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:24:21,293][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:24:26,294][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:24:31,295][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:24:36,296][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:24:41,298][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:24:46,299][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:24:51,300][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:24:56,301][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:25:01,302][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:25:06,303][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:25:11,304][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:25:16,306][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:25:21,310][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:25:26,311][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:25:31,312][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:25:36,314][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:25:41,315][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:25:46,315][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:25:51,316][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:25:56,318][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:26:01,320][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:26:06,322][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:26:11,325][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:26:16,326][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:26:21,327][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:26:26,329][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:26:31,330][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:26:36,334][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:26:41,336][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:26:46,338][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:26:51,340][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:26:56,341][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:27:01,342][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:27:06,343][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:27:11,345][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:27:16,347][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:27:21,348][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:27:26,350][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:27:31,351][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:27:36,356][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:27:41,357][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:27:46,358][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:27:51,359][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:27:56,361][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:28:01,362][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:28:06,363][ INFO][PID:793261] Checking for cancel request [2025-12-16 15:28:11,210][ INFO][PID:793261] Downloading results from builder [2025-12-16 15:28:11,258][ INFO][PID:793261] rsyncing of mockbuilder@100.31.210.38:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/frantisekz/flask-3.0/fedora-rawhide-x86_64/09915221-python-sentry-sdk started [2025-12-16 15:28:11,303][ INFO][PID:793261] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@100.31.210.38:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/frantisekz/flask-3.0/fedora-rawhide-x86_64/09915221-python-sentry-sdk/ &> /var/lib/copr/public_html/results/frantisekz/flask-3.0/fedora-rawhide-x86_64/09915221-python-sentry-sdk/build-09915221.rsync.log [2025-12-16 15:28:11,587][ INFO][PID:793261] rsyncing finished. [2025-12-16 15:28:11,590][ INFO][PID:793261] Releasing VM back to pool [2025-12-16 15:28:11,664][ INFO][PID:793261] Searching for 'success' file in resultdir [2025-12-16 15:28:11,670][ ERROR][PID:793261] Build failed: Backend process error: No success file => build failure [2025-12-16 15:28:11,795][ INFO][PID:793261] Finished build: id=9915221 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/frantisekz/flask-3.0 chroot=fedora-rawhide-x86_64 [2025-12-16 15:28:11,898][ ERROR][PID:793261] Backend process error: No success file => build failure [2025-12-16 15:28:11,902][ INFO][PID:793261] Worker failed build, took 763.2771430015564 [2025-12-16 15:28:11,917][ INFO][PID:793261] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "frantisekz", "project_name": "flask-3.0", "project_dirname": "flask-3.0", "submitter": "https://src.fedoraproject.org/user/pwouters", "ended_on": 1765898891.900321, "started_on": 1765898128.623178, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9915221-fedora-rawhide-x86_64", "build_id": 9915221, "package_name": "python-sentry-sdk", "package_version": "2.47.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/frantisekz/flask-3.0/python-sentry-sdk", "git_hash": "a44da3c5ac5d84c5acdf066983707b4bf3ed6633", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "frantisekz/flask-3.0--https://src.fedoraproject.org/user/pwouters", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/frantisekz/flask-3.0/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/frantisekz/flask-3.0", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/frantisekz/flask-3.0", "result_dir": "09915221-python-sentry-sdk", "built_packages": "", "id": 9915221, "mockchain_macros": { "copr_username": "frantisekz", "copr_projectname": "flask-3.0", "vendor": "Fedora Project COPR (frantisekz/flask-3.0)" } } ] } [2025-12-16 15:28:12,934][ INFO][PID:793261] Sending fedora-messaging bus message in build.end [2025-12-16 15:28:13,526][ INFO][PID:793261] Compressing /var/lib/copr/public_html/results/frantisekz/flask-3.0/fedora-rawhide-x86_64/09915221-python-sentry-sdk/builder-live.log by gzip [2025-12-16 15:28:13,554][ INFO][PID:793261] Running command 'gzip /var/lib/copr/public_html/results/frantisekz/flask-3.0/fedora-rawhide-x86_64/09915221-python-sentry-sdk/builder-live.log' as PID 1043911 [2025-12-16 15:28:13,808][ INFO][PID:793261] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/frantisekz/flask-3.0/fedora-rawhide-x86_64/09915221-python-sentry-sdk/builder-live.log) [2025-12-16 15:28:13,816][ INFO][PID:793261] Compressing /var/lib/copr/public_html/results/frantisekz/flask-3.0/fedora-rawhide-x86_64/09915221-python-sentry-sdk/backend.log by gzip [2025-12-16 15:28:13,817][ INFO][PID:793261] Running command 'gzip /var/lib/copr/public_html/results/frantisekz/flask-3.0/fedora-rawhide-x86_64/09915221-python-sentry-sdk/backend.log' as PID 1043954