[2026-01-05 16:08:27,273][ INFO][PID:1904450] Marking build as starting [2026-01-05 16:08:27,326][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:08:27,328][ INFO][PID:1904450] VM allocation process starts [2026-01-05 16:08:27,352][ INFO][PID:1904450] Trying to allocate VM: ResallocHost, ticket_id=662056, requested_tags=['copr_builder', 'arch_noarch'] [2026-01-05 16:08:32,362][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:08:33,468][ INFO][PID:1904450] Allocated host ResallocHost, ticket_id=662056, hostname=2620:52:6:1161:dead:beef:cafe:c191, name=vmhost_p09_04_prod_00931774_20260105_153656, requested_tags=['copr_builder', 'arch_noarch'] [2026-01-05 16:08:33,469][ INFO][PID:1904450] Allocating ssh connection to builder [2026-01-05 16:08:33,471][ INFO][PID:1904450] Checking that builder machine is OK [2026-01-05 16:09:33,548][ ERROR][PID:1904450] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c191 port 22: Connection timed out [2026-01-05 16:09:43,552][ ERROR][PID:1904450] Re-try request for task on 'ResallocHost, ticket_id=662056, hostname=2620:52:6:1161:dead:beef:cafe:c191, name=vmhost_p09_04_prod_00931774_20260105_153656, requested_tags=['copr_builder', 'arch_noarch']': Unable to finish after 1 SSH attempts [2026-01-05 16:09:43,553][ INFO][PID:1904450] Releasing VM back to pool [2026-01-05 16:09:43,574][ INFO][PID:1904450] Retry #1 (on other host) [2026-01-05 16:09:43,578][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:09:43,583][ INFO][PID:1904450] VM allocation process starts [2026-01-05 16:09:43,648][ INFO][PID:1904450] Trying to allocate VM: ResallocHost, ticket_id=662166, requested_tags=['copr_builder', 'arch_noarch'] [2026-01-05 16:09:48,652][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:09:53,733][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:09:58,749][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:10:03,750][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:10:08,754][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:10:11,823][ INFO][PID:1904450] Allocated host ResallocHost, ticket_id=662166, hostname=2620:52:6:1161:dead:beef:cafe:c191, name=vmhost_p09_04_prod_00931774_20260105_153656, requested_tags=['copr_builder', 'arch_noarch'] [2026-01-05 16:10:11,831][ INFO][PID:1904450] Allocating ssh connection to builder [2026-01-05 16:10:11,832][ INFO][PID:1904450] Checking that builder machine is OK [2026-01-05 16:11:11,957][ ERROR][PID:1904450] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c191 port 22: Connection timed out [2026-01-05 16:11:21,976][ ERROR][PID:1904450] Re-try request for task on 'ResallocHost, ticket_id=662166, hostname=2620:52:6:1161:dead:beef:cafe:c191, name=vmhost_p09_04_prod_00931774_20260105_153656, requested_tags=['copr_builder', 'arch_noarch']': Unable to finish after 1 SSH attempts [2026-01-05 16:11:21,978][ INFO][PID:1904450] Releasing VM back to pool [2026-01-05 16:11:22,058][ INFO][PID:1904450] Retry #2 (on other host) [2026-01-05 16:11:22,059][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:11:22,063][ INFO][PID:1904450] VM allocation process starts [2026-01-05 16:11:22,168][ INFO][PID:1904450] Trying to allocate VM: ResallocHost, ticket_id=662200, requested_tags=['copr_builder', 'arch_noarch'] [2026-01-05 16:11:27,192][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:11:32,198][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:11:37,202][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:11:42,207][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:11:47,217][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:11:52,225][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:11:57,233][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:12:02,247][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:12:07,265][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:12:12,284][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:12:17,312][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:12:22,317][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:12:27,320][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:12:32,330][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:12:37,337][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:12:42,340][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:12:47,352][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:12:52,353][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:12:57,366][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:13:02,380][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:13:07,383][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:13:12,394][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:13:17,445][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:13:22,449][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:13:27,452][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:13:32,465][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:13:37,535][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:13:40,925][ INFO][PID:1904450] Allocated host ResallocHost, ticket_id=662200, hostname=2620:52:6:1161:dead:beef:cafe:c189, name=vmhost_p09_04_prod_00932297_20260105_160742, requested_tags=['copr_builder', 'arch_noarch'] [2026-01-05 16:13:40,926][ INFO][PID:1904450] Allocating ssh connection to builder [2026-01-05 16:13:40,927][ INFO][PID:1904450] Checking that builder machine is OK [2026-01-05 16:13:42,009][ INFO][PID:1904450] Running remote command: copr-builder-ready srpm-builds [2026-01-05 16:13:42,773][ INFO][PID:1904450] Red Hat subscription not needed for srpm-builds Builder is ready to be used [2026-01-05 16:13:42,774][ INFO][PID:1904450] Filling build.info file with builder info [2026-01-05 16:13:42,876][ INFO][PID:1904450] Checking for cancel request [2026-01-05 16:13:42,889][ INFO][PID:1904450] Not re-notifying FE and msg buses for the new host. [2026-01-05 16:13:42,896][ INFO][PID:1904450] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --srpm --task-url https://copr.fedorainfracloud.org/backend/get-srpm-build-task/9976060 --detached [2026-01-05 16:13:44,243][ INFO][PID:1904450] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c189' (ED25519) to the list of known hosts. [2026-01-05 16:13:44,246][ INFO][PID:1904450] Downloading the builder-live.log file, attempt 1 [2026-01-05 16:13:44,269][ INFO][PID:1904450] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c189 copr-rpmbuild-log [2026-01-05 16:13:49,222][ INFO][PID:1904450] Downloading results from builder [2026-01-05 16:13:49,223][ INFO][PID:1904450] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c189]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@python/python-in-pulp/srpm-builds/09976060 started [2026-01-05 16:13:49,233][ INFO][PID:1904450] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c189]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@python/python-in-pulp/srpm-builds/09976060/ &> /var/lib/copr/public_html/results/@python/python-in-pulp/srpm-builds/09976060/build-09976060.rsync.log [2026-01-05 16:14:49,465][ INFO][PID:1904450] rsyncing finished. [2026-01-05 16:14:49,470][ ERROR][PID:1904450] Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-01-05 16:14:49,470][ ERROR][PID:1904450] SSH connection lost on #1 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-01-05 16:14:59,473][ INFO][PID:1904450] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c189]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@python/python-in-pulp/srpm-builds/09976060 started [2026-01-05 16:15:02,569][ INFO][PID:1904450] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c189]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@python/python-in-pulp/srpm-builds/09976060/ &> /var/lib/copr/public_html/results/@python/python-in-pulp/srpm-builds/09976060/build-09976060.rsync.log [2026-01-05 16:16:02,825][ INFO][PID:1904450] rsyncing finished. [2026-01-05 16:16:02,857][ ERROR][PID:1904450] Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-01-05 16:16:02,861][ ERROR][PID:1904450] SSH connection lost on #2 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-01-05 16:16:12,874][ INFO][PID:1904450] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c189]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@python/python-in-pulp/srpm-builds/09976060 started [2026-01-05 16:16:12,879][ INFO][PID:1904450] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c189]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@python/python-in-pulp/srpm-builds/09976060/ &> /var/lib/copr/public_html/results/@python/python-in-pulp/srpm-builds/09976060/build-09976060.rsync.log [2026-01-05 16:16:19,186][ INFO][PID:1904450] rsyncing finished. [2026-01-05 16:16:19,203][ INFO][PID:1904450] Releasing VM back to pool [2026-01-05 16:16:19,302][ INFO][PID:1904450] Searching for 'success' file in resultdir [2026-01-05 16:16:19,321][ INFO][PID:1904450] Getting build details [2026-01-05 16:16:19,329][ INFO][PID:1904450] Retrieving SRPM info from /var/lib/copr/public_html/results/@python/python-in-pulp/srpm-builds/09976060 [2026-01-05 16:16:19,333][ INFO][PID:1904450] SRPM URL: https://download.copr.fedorainfracloud.org/results/@python/python-in-pulp/srpm-builds/09976060/scribus-1.6.5-1.src.rpm [2026-01-05 16:16:19,339][ INFO][PID:1904450] build details: {'srpm_url': 'https://download.copr.fedorainfracloud.org/results/@python/python-in-pulp/srpm-builds/09976060/scribus-1.6.5-1.src.rpm', 'pkg_name': 'scribus', 'pkg_version': '1.6.5-1'} [2026-01-05 16:16:19,345][ INFO][PID:1904450] Finished build: id=9976060 failed=False timeout=108000 destdir=/var/lib/copr/public_html/results/@python/python-in-pulp chroot=srpm-builds [2026-01-05 16:16:19,373][ INFO][PID:1904450] Worker succeeded build, took 156.48400688171387 [2026-01-05 16:16:19,380][ INFO][PID:1904450] Sending build state back to frontend: { "builds": [ { "timeout": 108000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": null, "enable_net": true, "project_owner": "@python", "project_name": "python-in-pulp", "project_dirname": "python-in-pulp", "submitter": "https://src.fedoraproject.org/user/limb", "ended_on": 1767629779.3732452, "started_on": 1767629622.8892384, "submitted_on": null, "status": 1, "chroot": "srpm-builds", "arch": null, "buildroot_pkgs": null, "task_id": "9976060", "build_id": 9976060, "package_name": "scribus", "package_version": null, "git_repo": null, "git_hash": null, "git_branch": null, "source_type": 10, "source_json": "{\"clone_url\": \"https://src.fedoraproject.org/rpms/scribus\", \"distgit\": \"fedora\", \"committish\": \"bd8adf5a426f3554ed41203d05e4f091bdf63151\"}", "pkg_name": "scribus", "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": "https://download.copr.fedorainfracloud.org/results/@python/python-in-pulp/srpm-builds/09976060/scribus-1.6.5-1.src.rpm", "uses_devel_repo": null, "sandbox": "@python/python-in-pulp--https://src.fedoraproject.org/user/limb", "results": { "name": "scribus", "epoch": null, "version": "1.6.5", "release": "1", "exclusivearch": [], "excludearch": [] }, "appstream": false, "allow_user_ssh": null, "ssh_public_keys": null, "storage": null, "repos": [], "background": true, "destdir": "/var/lib/copr/public_html/results/@python/python-in-pulp", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@python/python-in-pulp", "result_dir": "09976060", "built_packages": "", "tags": [ "arch_noarch" ], "pkg_version": "1.6.5-1", "id": 9976060, "mockchain_macros": { "copr_username": "@python", "copr_projectname": "python-in-pulp", "vendor": "Fedora Project COPR (@python/python-in-pulp)" } } ] } [2026-01-05 16:16:19,791][ INFO][PID:1904450] Sending fedora-messaging bus message in build.end [2026-01-05 16:16:25,156][ INFO][PID:1904450] Compressing /var/lib/copr/public_html/results/@python/python-in-pulp/srpm-builds/09976060/builder-live.log by gzip [2026-01-05 16:16:34,313][ INFO][PID:1904450] Running command 'gzip /var/lib/copr/public_html/results/@python/python-in-pulp/srpm-builds/09976060/builder-live.log' as PID 1985482 [2026-01-05 16:16:34,454][ INFO][PID:1904450] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@python/python-in-pulp/srpm-builds/09976060/builder-live.log) [2026-01-05 16:16:34,457][ INFO][PID:1904450] Compressing /var/lib/copr/public_html/results/@python/python-in-pulp/srpm-builds/09976060/backend.log by gzip [2026-01-05 16:16:34,468][ INFO][PID:1904450] Running command 'gzip /var/lib/copr/public_html/results/@python/python-in-pulp/srpm-builds/09976060/backend.log' as PID 1985553