[2026-01-13 09:08:54,751][ INFO][PID:1074385] Marking build as starting [2026-01-13 09:08:55,020][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:08:55,034][ INFO][PID:1074385] VM allocation process starts [2026-01-13 09:08:55,099][ INFO][PID:1074385] Trying to allocate VM: ResallocHost, ticket_id=788834, requested_tags=['copr_builder', 'arch_noarch'] [2026-01-13 09:09:00,114][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:09:05,116][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:09:10,124][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:09:15,135][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:09:20,139][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:09:25,142][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:09:30,154][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:09:35,156][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:09:40,159][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:09:45,161][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:09:50,187][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:09:55,193][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:10:00,209][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:10:05,214][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:10:10,218][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:10:15,244][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:10:20,247][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:10:25,249][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:10:30,253][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:10:35,256][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:10:40,264][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:10:43,669][ INFO][PID:1074385] Allocated host ResallocHost, ticket_id=788834, hostname=44.200.175.24, name=aws_x86_64_normal_prod_01174032_20260113_090021, requested_tags=['copr_builder', 'arch_noarch'] [2026-01-13 09:10:43,675][ INFO][PID:1074385] Allocating ssh connection to builder [2026-01-13 09:10:43,682][ INFO][PID:1074385] Checking that builder machine is OK [2026-01-13 09:11:43,860][ ERROR][PID:1074385] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 44.200.175.24 port 22: Connection timed out [2026-01-13 09:11:53,866][ ERROR][PID:1074385] Re-try request for task on 'ResallocHost, ticket_id=788834, hostname=44.200.175.24, name=aws_x86_64_normal_prod_01174032_20260113_090021, requested_tags=['copr_builder', 'arch_noarch']': Unable to finish after 1 SSH attempts [2026-01-13 09:11:53,937][ INFO][PID:1074385] Releasing VM back to pool [2026-01-13 09:11:53,996][ INFO][PID:1074385] Retry #1 (on other host) [2026-01-13 09:11:54,000][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:11:54,002][ INFO][PID:1074385] VM allocation process starts [2026-01-13 09:11:54,105][ INFO][PID:1074385] Trying to allocate VM: ResallocHost, ticket_id=788967, requested_tags=['copr_builder', 'arch_noarch'] [2026-01-13 09:11:59,110][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:12:04,111][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:12:09,115][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:12:14,128][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:12:19,136][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:12:24,148][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:12:29,151][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:12:34,152][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:12:39,164][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:12:44,172][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:12:49,175][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:12:54,178][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:12:59,196][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:13:04,199][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:13:09,213][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:13:14,228][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:13:19,237][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:13:24,256][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:13:29,261][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:13:34,262][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:13:39,270][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:13:44,273][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:13:49,275][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:13:54,278][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:13:59,280][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:14:04,282][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:14:09,284][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:14:14,300][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:14:19,307][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:14:24,308][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:14:29,311][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:14:34,318][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:14:39,330][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:14:44,331][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:14:49,335][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:14:54,354][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:14:59,362][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:15:04,364][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:15:09,365][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:15:14,367][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:15:19,383][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:15:24,395][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:15:29,409][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:15:34,417][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:15:39,421][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:15:44,438][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:15:49,457][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:15:54,459][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:15:59,464][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:16:04,473][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:16:09,474][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:16:12,622][ INFO][PID:1074385] Allocated host ResallocHost, ticket_id=788967, hostname=100.48.65.9, name=aws_x86_64_normal_prod_01174057_20260113_090056, requested_tags=['copr_builder', 'arch_noarch'] [2026-01-13 09:16:12,624][ INFO][PID:1074385] Allocating ssh connection to builder [2026-01-13 09:16:12,625][ INFO][PID:1074385] Checking that builder machine is OK [2026-01-13 09:17:12,775][ ERROR][PID:1074385] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 100.48.65.9 port 22: Connection timed out [2026-01-13 09:17:22,778][ ERROR][PID:1074385] Re-try request for task on 'ResallocHost, ticket_id=788967, hostname=100.48.65.9, name=aws_x86_64_normal_prod_01174057_20260113_090056, requested_tags=['copr_builder', 'arch_noarch']': Unable to finish after 1 SSH attempts [2026-01-13 09:17:22,782][ INFO][PID:1074385] Releasing VM back to pool [2026-01-13 09:17:22,824][ INFO][PID:1074385] Retry #2 (on other host) [2026-01-13 09:17:22,829][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:17:22,831][ INFO][PID:1074385] VM allocation process starts [2026-01-13 09:17:22,902][ INFO][PID:1074385] Trying to allocate VM: ResallocHost, ticket_id=789129, requested_tags=['copr_builder', 'arch_noarch'] [2026-01-13 09:17:27,910][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:17:32,912][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:17:37,914][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:17:42,921][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:17:47,932][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:17:52,936][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:17:57,941][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:18:02,946][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:18:07,947][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:18:12,953][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:18:17,954][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:18:22,958][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:18:27,959][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:18:31,372][ INFO][PID:1074385] Allocated host ResallocHost, ticket_id=789129, hostname=3.80.4.7, name=aws_x86_64_spot_prod_01174383_20260113_091357, requested_tags=['copr_builder', 'arch_noarch'] [2026-01-13 09:18:31,384][ INFO][PID:1074385] Allocating ssh connection to builder [2026-01-13 09:18:31,396][ INFO][PID:1074385] Checking that builder machine is OK [2026-01-13 09:18:31,832][ INFO][PID:1074385] Running remote command: copr-builder-ready srpm-builds [2026-01-13 09:18:32,248][ INFO][PID:1074385] Red Hat subscription not needed for srpm-builds Builder is ready to be used [2026-01-13 09:18:32,249][ INFO][PID:1074385] Filling build.info file with builder info [2026-01-13 09:18:32,358][ INFO][PID:1074385] Checking for cancel request [2026-01-13 09:18:32,360][ INFO][PID:1074385] Not re-notifying FE and msg buses for the new host. [2026-01-13 09:18:32,361][ INFO][PID:1074385] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --srpm --task-url https://copr.fedorainfracloud.org/backend/get-srpm-build-task/10003236 --detached [2026-01-13 09:18:32,926][ INFO][PID:1074385] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '3.80.4.7' (ED25519) to the list of known hosts. [2026-01-13 09:18:32,927][ INFO][PID:1074385] Downloading the builder-live.log file, attempt 1 [2026-01-13 09:18:32,949][ INFO][PID:1074385] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.80.4.7 copr-rpmbuild-log [2026-01-13 09:18:35,039][ INFO][PID:1074385] Downloading results from builder [2026-01-13 09:18:35,046][ INFO][PID:1074385] rsyncing of mockbuilder@3.80.4.7:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@python/python-sphinx_rtd_theme_rawhide/srpm-builds/10003236 started [2026-01-13 09:18:35,058][ INFO][PID:1074385] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@3.80.4.7:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@python/python-sphinx_rtd_theme_rawhide/srpm-builds/10003236/ &> /var/lib/copr/public_html/results/@python/python-sphinx_rtd_theme_rawhide/srpm-builds/10003236/build-10003236.rsync.log [2026-01-13 09:18:35,640][ INFO][PID:1074385] rsyncing finished. [2026-01-13 09:18:35,647][ INFO][PID:1074385] Releasing VM back to pool [2026-01-13 09:18:35,722][ INFO][PID:1074385] Searching for 'success' file in resultdir [2026-01-13 09:18:35,729][ INFO][PID:1074385] Getting build details [2026-01-13 09:18:35,732][ INFO][PID:1074385] Retrieving SRPM info from /var/lib/copr/public_html/results/@python/python-sphinx_rtd_theme_rawhide/srpm-builds/10003236 [2026-01-13 09:18:35,739][ INFO][PID:1074385] SRPM URL: https://download.copr.fedorainfracloud.org/results/@python/python-sphinx_rtd_theme_rawhide/srpm-builds/10003236/python-niaaml-2.2.0-1.src.rpm [2026-01-13 09:18:35,743][ INFO][PID:1074385] build details: {'srpm_url': 'https://download.copr.fedorainfracloud.org/results/@python/python-sphinx_rtd_theme_rawhide/srpm-builds/10003236/python-niaaml-2.2.0-1.src.rpm', 'pkg_name': 'python-niaaml', 'pkg_version': '2.2.0-1'} [2026-01-13 09:18:35,746][ INFO][PID:1074385] Finished build: id=10003236 failed=False timeout=108000 destdir=/var/lib/copr/public_html/results/@python/python-sphinx_rtd_theme_rawhide chroot=srpm-builds [2026-01-13 09:18:35,767][ INFO][PID:1074385] Worker succeeded build, took 3.4074208736419678 [2026-01-13 09:18:35,772][ INFO][PID:1074385] Sending build state back to frontend: { "builds": [ { "timeout": 108000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": null, "enable_net": true, "project_owner": "@python", "project_name": "python-sphinx_rtd_theme_rawhide", "project_dirname": "python-sphinx_rtd_theme_rawhide", "submitter": "lbalhar", "ended_on": 1768295915.7678285, "started_on": 1768295912.3604076, "submitted_on": null, "status": 1, "chroot": "srpm-builds", "arch": null, "buildroot_pkgs": null, "task_id": "10003236", "build_id": 10003236, "package_name": "python-niaaml", "package_version": null, "git_repo": null, "git_hash": null, "git_branch": null, "source_type": 10, "source_json": "{\"clone_url\": \"https://src.fedoraproject.org/rpms/python-niaaml.git\", \"distgit\": \"fedora\", \"committish\": \"rawhide\"}", "pkg_name": "python-niaaml", "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": "https://download.copr.fedorainfracloud.org/results/@python/python-sphinx_rtd_theme_rawhide/srpm-builds/10003236/python-niaaml-2.2.0-1.src.rpm", "uses_devel_repo": null, "sandbox": "@python/python-sphinx_rtd_theme_rawhide--lbalhar", "results": { "name": "python-niaaml", "epoch": null, "version": "2.2.0", "release": "1", "exclusivearch": [], "excludearch": [] }, "appstream": false, "allow_user_ssh": null, "ssh_public_keys": null, "storage": null, "repos": [], "background": true, "destdir": "/var/lib/copr/public_html/results/@python/python-sphinx_rtd_theme_rawhide", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@python/python-sphinx_rtd_theme_rawhide", "result_dir": "10003236", "built_packages": "", "tags": [ "arch_noarch" ], "pkg_version": "2.2.0-1", "id": 10003236, "mockchain_macros": { "copr_username": "@python", "copr_projectname": "python-sphinx_rtd_theme_rawhide", "vendor": "Fedora Project COPR (@python/python-sphinx_rtd_theme_rawhide)" } } ] } [2026-01-13 09:18:35,972][ INFO][PID:1074385] Sending fedora-messaging bus message in build.end [2026-01-13 09:18:40,246][ INFO][PID:1074385] Compressing /var/lib/copr/public_html/results/@python/python-sphinx_rtd_theme_rawhide/srpm-builds/10003236/builder-live.log by gzip [2026-01-13 09:18:40,253][ INFO][PID:1074385] Running command 'gzip /var/lib/copr/public_html/results/@python/python-sphinx_rtd_theme_rawhide/srpm-builds/10003236/builder-live.log' as PID 1183803 [2026-01-13 09:18:40,259][ INFO][PID:1074385] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@python/python-sphinx_rtd_theme_rawhide/srpm-builds/10003236/builder-live.log) [2026-01-13 09:18:40,261][ INFO][PID:1074385] Compressing /var/lib/copr/public_html/results/@python/python-sphinx_rtd_theme_rawhide/srpm-builds/10003236/backend.log by gzip [2026-01-13 09:18:40,263][ INFO][PID:1074385] Running command 'gzip /var/lib/copr/public_html/results/@python/python-sphinx_rtd_theme_rawhide/srpm-builds/10003236/backend.log' as PID 1183804