[2025-12-10 08:31:48,352][ INFO][PID:353720] Marking build as starting [2025-12-10 08:31:48,589][ INFO][PID:353720] Checking for cancel request [2025-12-10 08:31:48,593][ INFO][PID:353720] VM allocation process starts [2025-12-10 08:31:48,623][ INFO][PID:353720] Trying to allocate VM: ResallocHost, ticket_id=256728, requested_tags=['copr_builder', 'arch_noarch'] [2025-12-10 08:31:53,626][ INFO][PID:353720] Checking for cancel request [2025-12-10 08:31:58,627][ INFO][PID:353720] Checking for cancel request [2025-12-10 08:32:00,667][ INFO][PID:353720] Allocated host ResallocHost, ticket_id=256728, hostname=2620:52:6:1161:dead:beef:cafe:c150, name=vmhost_p09_03_prod_00301930_20251210_082352, requested_tags=['copr_builder', 'arch_noarch'] [2025-12-10 08:32:00,668][ INFO][PID:353720] Allocating ssh connection to builder [2025-12-10 08:32:00,669][ INFO][PID:353720] Checking that builder machine is OK [2025-12-10 08:32:01,563][ INFO][PID:353720] Running remote command: copr-builder-ready srpm-builds [2025-12-10 08:32:02,086][ INFO][PID:353720] Red Hat subscription not needed for srpm-builds Builder is ready to be used [2025-12-10 08:32:02,088][ INFO][PID:353720] Filling build.info file with builder info [2025-12-10 08:32:02,089][ INFO][PID:353720] Checking for cancel request [2025-12-10 08:32:02,091][ INFO][PID:353720] Sending build state back to frontend: { "builds": [ { "timeout": 108000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": null, "enable_net": true, "project_owner": "yxwang5db2", "project_name": "ola", "project_dirname": "ola", "submitter": "yxwang5db2", "ended_on": null, "started_on": 1765355522.091217, "submitted_on": null, "status": 3, "chroot": "srpm-builds", "arch": null, "buildroot_pkgs": null, "task_id": "9894216", "build_id": 9894216, "package_name": null, "package_version": null, "git_repo": null, "git_hash": null, "git_branch": null, "source_type": 10, "source_json": "{\"clone_url\": \"https://src.fedoraproject.org/rpms/xfce4-hamster-plugin.git\", \"committish\": \"rawhide\"}", "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": null, "sandbox": "yxwang5db2/ola--yxwang5db2", "results": null, "appstream": false, "allow_user_ssh": null, "ssh_public_keys": null, "storage": null, "repos": [], "background": true, "destdir": "/var/lib/copr/public_html/results/yxwang5db2/ola", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/yxwang5db2/ola", "result_dir": "09894216", "built_packages": "", "tags": [ "arch_noarch" ], "id": 9894216, "mockchain_macros": { "copr_username": "yxwang5db2", "copr_projectname": "ola", "vendor": "Fedora Project COPR (yxwang5db2/ola)" } } ] } [2025-12-10 08:32:08,593][ INFO][PID:353720] Sending fedora-messaging bus message in build.start [2025-12-10 08:32:12,242][ INFO][PID:353720] Sending fedora-messaging bus message in chroot.start [2025-12-10 08:32:12,317][ INFO][PID:353720] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --srpm --task-url https://copr.fedorainfracloud.org/backend/get-srpm-build-task/9894216 --detached [2025-12-10 08:32:13,885][ INFO][PID:353720] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c150' (ED25519) to the list of known hosts. [2025-12-10 08:32:13,888][ INFO][PID:353720] Downloading the builder-live.log file, attempt 1 [2025-12-10 08:32:13,890][ INFO][PID:353720] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c150 copr-rpmbuild-log [2025-12-10 08:32:18,900][ INFO][PID:353720] Periodic builder liveness probe: alive [2025-12-10 08:32:18,901][ INFO][PID:353720] Checking for cancel request [2025-12-10 08:32:23,904][ INFO][PID:353720] Checking for cancel request [2025-12-10 08:32:28,913][ INFO][PID:353720] Checking for cancel request [2025-12-10 08:32:33,914][ INFO][PID:353720] Checking for cancel request [2025-12-10 08:32:38,923][ INFO][PID:353720] Checking for cancel request [2025-12-10 08:32:40,077][ INFO][PID:353720] Downloading results from builder [2025-12-10 08:32:40,078][ INFO][PID:353720] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c150]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/yxwang5db2/ola/srpm-builds/09894216 started [2025-12-10 08:32:40,079][ INFO][PID:353720] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c150]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/yxwang5db2/ola/srpm-builds/09894216/ &> /var/lib/copr/public_html/results/yxwang5db2/ola/srpm-builds/09894216/build-09894216.rsync.log [2025-12-10 08:33:40,164][ INFO][PID:353720] rsyncing finished. [2025-12-10 08:33:40,166][ ERROR][PID:353720] Failed to download data from builder due to rsync error, see the rsync log file for details. [2025-12-10 08:33:40,167][ ERROR][PID:353720] SSH connection lost on #1 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details. [2025-12-10 08:33:50,168][ INFO][PID:353720] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c150]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/yxwang5db2/ola/srpm-builds/09894216 started [2025-12-10 08:33:50,170][ INFO][PID:353720] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c150]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/yxwang5db2/ola/srpm-builds/09894216/ &> /var/lib/copr/public_html/results/yxwang5db2/ola/srpm-builds/09894216/build-09894216.rsync.log [2025-12-10 08:34:50,255][ INFO][PID:353720] rsyncing finished. [2025-12-10 08:34:50,257][ ERROR][PID:353720] Failed to download data from builder due to rsync error, see the rsync log file for details. [2025-12-10 08:34:50,258][ ERROR][PID:353720] SSH connection lost on #2 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details. [2025-12-10 08:35:00,264][ INFO][PID:353720] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c150]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/yxwang5db2/ola/srpm-builds/09894216 started [2025-12-10 08:35:00,267][ INFO][PID:353720] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c150]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/yxwang5db2/ola/srpm-builds/09894216/ &> /var/lib/copr/public_html/results/yxwang5db2/ola/srpm-builds/09894216/build-09894216.rsync.log [2025-12-10 08:36:00,373][ INFO][PID:353720] rsyncing finished. [2025-12-10 08:36:00,374][ ERROR][PID:353720] Failed to download data from builder due to rsync error, see the rsync log file for details. [2025-12-10 08:36:00,377][ ERROR][PID:353720] SSH connection lost on #3 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details. [2025-12-10 08:36:10,381][ ERROR][PID:353720] Re-try request for task on 'ResallocHost, ticket_id=256728, hostname=2620:52:6:1161:dead:beef:cafe:c150, name=vmhost_p09_03_prod_00301930_20251210_082352, requested_tags=['copr_builder', 'arch_noarch']': Unable to finish after 3 SSH attempts [2025-12-10 08:36:10,382][ INFO][PID:353720] Releasing VM back to pool [2025-12-10 08:36:10,420][ INFO][PID:353720] Retry #1 (on other host) [2025-12-10 08:36:10,421][ INFO][PID:353720] Checking for cancel request [2025-12-10 08:36:10,427][ INFO][PID:353720] VM allocation process starts [2025-12-10 08:36:10,450][ INFO][PID:353720] Trying to allocate VM: ResallocHost, ticket_id=256926, requested_tags=['copr_builder', 'arch_noarch'] [2025-12-10 08:36:15,464][ INFO][PID:353720] Checking for cancel request [2025-12-10 08:36:20,468][ INFO][PID:353720] Checking for cancel request [2025-12-10 08:36:22,569][ INFO][PID:353720] Allocated host ResallocHost, ticket_id=256926, hostname=2620:52:6:1161:dead:beef:cafe:c156, name=vmhost_p09_03_prod_00301971_20251210_082549, requested_tags=['copr_builder', 'arch_noarch'] [2025-12-10 08:36:22,571][ INFO][PID:353720] Allocating ssh connection to builder [2025-12-10 08:36:22,573][ INFO][PID:353720] Checking that builder machine is OK [2025-12-10 08:36:23,589][ INFO][PID:353720] Running remote command: copr-builder-ready srpm-builds [2025-12-10 08:36:24,119][ INFO][PID:353720] Red Hat subscription not needed for srpm-builds Builder is ready to be used [2025-12-10 08:36:24,123][ INFO][PID:353720] Filling build.info file with builder info [2025-12-10 08:36:24,156][ INFO][PID:353720] Checking for cancel request [2025-12-10 08:36:24,158][ INFO][PID:353720] Not re-notifying FE and msg buses for the new host. [2025-12-10 08:36:24,158][ INFO][PID:353720] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --srpm --task-url https://copr.fedorainfracloud.org/backend/get-srpm-build-task/9894216 --detached [2025-12-10 08:36:25,108][ INFO][PID:353720] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c156' (ED25519) to the list of known hosts. [2025-12-10 08:36:25,111][ INFO][PID:353720] Downloading the builder-live.log file, attempt 1 [2025-12-10 08:36:25,113][ INFO][PID:353720] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c156 copr-rpmbuild-log [2025-12-10 08:36:30,112][ INFO][PID:353720] Checking for cancel request [2025-12-10 08:36:35,115][ INFO][PID:353720] Checking for cancel request [2025-12-10 08:36:40,118][ INFO][PID:353720] Checking for cancel request [2025-12-10 08:36:42,791][ INFO][PID:353720] Downloading results from builder [2025-12-10 08:36:42,801][ INFO][PID:353720] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c156]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/yxwang5db2/ola/srpm-builds/09894216 started [2025-12-10 08:36:42,816][ INFO][PID:353720] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c156]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/yxwang5db2/ola/srpm-builds/09894216/ &> /var/lib/copr/public_html/results/yxwang5db2/ola/srpm-builds/09894216/build-09894216.rsync.log [2025-12-10 08:36:43,522][ INFO][PID:353720] rsyncing finished. [2025-12-10 08:36:43,532][ INFO][PID:353720] Releasing VM back to pool [2025-12-10 08:36:43,581][ INFO][PID:353720] Searching for 'success' file in resultdir [2025-12-10 08:36:43,586][ ERROR][PID:353720] Build failed: Backend process error: No success file => build failure [2025-12-10 08:36:43,592][ INFO][PID:353720] Finished build: id=9894216 failed=True timeout=108000 destdir=/var/lib/copr/public_html/results/yxwang5db2/ola chroot=srpm-builds [2025-12-10 08:36:43,612][ ERROR][PID:353720] Backend process error: No success file => build failure [2025-12-10 08:36:43,617][ INFO][PID:353720] Worker failed build, took 19.45899748802185 [2025-12-10 08:36:43,623][ INFO][PID:353720] Sending build state back to frontend: { "builds": [ { "timeout": 108000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": null, "enable_net": true, "project_owner": "yxwang5db2", "project_name": "ola", "project_dirname": "ola", "submitter": "yxwang5db2", "ended_on": 1765355803.6171474, "started_on": 1765355784.15815, "submitted_on": null, "status": 0, "chroot": "srpm-builds", "arch": null, "buildroot_pkgs": null, "task_id": "9894216", "build_id": 9894216, "package_name": null, "package_version": null, "git_repo": null, "git_hash": null, "git_branch": null, "source_type": 10, "source_json": "{\"clone_url\": \"https://src.fedoraproject.org/rpms/xfce4-hamster-plugin.git\", \"committish\": \"rawhide\"}", "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": null, "sandbox": "yxwang5db2/ola--yxwang5db2", "results": null, "appstream": false, "allow_user_ssh": null, "ssh_public_keys": null, "storage": null, "repos": [], "background": true, "destdir": "/var/lib/copr/public_html/results/yxwang5db2/ola", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/yxwang5db2/ola", "result_dir": "09894216", "built_packages": "", "tags": [ "arch_noarch" ], "id": 9894216, "mockchain_macros": { "copr_username": "yxwang5db2", "copr_projectname": "ola", "vendor": "Fedora Project COPR (yxwang5db2/ola)" } } ] } [2025-12-10 08:36:43,818][ INFO][PID:353720] Sending fedora-messaging bus message in build.end [2025-12-10 08:36:43,914][ INFO][PID:353720] Compressing /var/lib/copr/public_html/results/yxwang5db2/ola/srpm-builds/09894216/builder-live.log by gzip [2025-12-10 08:36:43,919][ INFO][PID:353720] Running command 'gzip /var/lib/copr/public_html/results/yxwang5db2/ola/srpm-builds/09894216/builder-live.log' as PID 403541 [2025-12-10 08:36:43,928][ INFO][PID:353720] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/yxwang5db2/ola/srpm-builds/09894216/builder-live.log) [2025-12-10 08:36:43,936][ INFO][PID:353720] Compressing /var/lib/copr/public_html/results/yxwang5db2/ola/srpm-builds/09894216/backend.log by gzip [2025-12-10 08:36:43,938][ INFO][PID:353720] Running command 'gzip /var/lib/copr/public_html/results/yxwang5db2/ola/srpm-builds/09894216/backend.log' as PID 403550