[2025-12-10 05:18:23,201][ INFO][PID:3752192] Marking build as starting [2025-12-10 05:18:23,312][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:18:23,314][ INFO][PID:3752192] VM allocation process starts [2025-12-10 05:18:23,343][ INFO][PID:3752192] Trying to allocate VM: ResallocHost, ticket_id=254400, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-10 05:18:26,362][ INFO][PID:3752192] Allocated host ResallocHost, ticket_id=254400, hostname=2620:52:6:1161:dead:beef:cafe:c115, name=vmhost_p09_02_prod_00298606_20251210_050213, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-10 05:18:26,363][ INFO][PID:3752192] Allocating ssh connection to builder [2025-12-10 05:18:26,364][ INFO][PID:3752192] Checking that builder machine is OK [2025-12-10 05:19:26,435][ ERROR][PID:3752192] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c115 port 22: Connection timed out [2025-12-10 05:19:36,436][ ERROR][PID:3752192] Re-try request for task on 'ResallocHost, ticket_id=254400, hostname=2620:52:6:1161:dead:beef:cafe:c115, name=vmhost_p09_02_prod_00298606_20251210_050213, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts [2025-12-10 05:19:36,436][ INFO][PID:3752192] Releasing VM back to pool [2025-12-10 05:19:36,446][ INFO][PID:3752192] Retry #1 (on other host) [2025-12-10 05:19:36,446][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:19:36,447][ INFO][PID:3752192] VM allocation process starts [2025-12-10 05:19:36,456][ INFO][PID:3752192] Trying to allocate VM: ResallocHost, ticket_id=254408, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-10 05:19:39,468][ INFO][PID:3752192] Allocated host ResallocHost, ticket_id=254408, hostname=2620:52:6:1161:dead:beef:cafe:c192, name=vmhost_p09_04_prod_00298613_20251210_050240, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-10 05:19:39,469][ INFO][PID:3752192] Allocating ssh connection to builder [2025-12-10 05:19:39,469][ INFO][PID:3752192] Checking that builder machine is OK [2025-12-10 05:19:40,429][ INFO][PID:3752192] Running remote command: copr-builder-ready fedora-42-ppc64le [2025-12-10 05:19:40,902][ INFO][PID:3752192] Red Hat subscription not needed for fedora-42-ppc64le Builder is ready to be used [2025-12-10 05:19:40,902][ INFO][PID:3752192] Filling build.info file with builder info [2025-12-10 05:19:40,903][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:19:40,903][ INFO][PID:3752192] Not re-notifying FE and msg buses for the new host. [2025-12-10 05:19:40,904][ INFO][PID:3752192] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9892101-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached [2025-12-10 05:19:41,831][ INFO][PID:3752192] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c192' (ED25519) to the list of known hosts. [2025-12-10 05:19:41,832][ INFO][PID:3752192] Downloading the builder-live.log file, attempt 1 [2025-12-10 05:19:41,833][ INFO][PID:3752192] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c192 copr-rpmbuild-log [2025-12-10 05:19:46,836][ INFO][PID:3752192] Periodic builder liveness probe: alive [2025-12-10 05:19:46,837][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:19:51,838][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:19:56,839][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:20:01,839][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:20:07,207][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:20:12,209][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:20:17,210][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:20:23,040][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:20:33,449][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:20:38,656][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:20:43,657][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:20:50,113][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:20:57,816][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:21:04,272][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:21:10,520][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:21:16,768][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:21:21,770][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:21:27,601][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:21:32,602][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:21:38,224][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:21:43,225][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:21:48,226][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:21:53,229][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:21:58,240][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:22:03,241][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:22:08,243][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:22:18,442][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:22:23,444][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:22:35,513][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:22:40,514][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:22:48,424][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:22:54,465][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:23:02,796][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:23:10,913][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:23:15,915][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:23:21,329][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:23:26,331][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:23:31,333][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:23:38,887][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:23:44,304][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:23:50,344][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:24:00,129][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:24:05,130][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:24:10,657][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:24:15,663][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:24:23,568][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:24:32,313][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:24:39,809][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:24:45,434][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:24:52,306][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:25:01,673][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:25:08,960][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:25:17,913][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:25:22,915][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:25:27,926][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:25:32,935][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:26:46,579][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:26:51,585][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:26:56,588][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:27:01,592][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:27:12,001][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:27:17,004][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:27:22,006][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:27:27,010][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:27:32,014][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:27:37,644][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:27:42,655][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:27:47,661][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:28:17,203][ INFO][PID:3752192] Checking for cancel request [2025-12-10 05:28:17,893][ INFO][PID:3752192] Downloading results from builder [2025-12-10 05:28:17,894][ INFO][PID:3752192] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c192]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/mochaa/protobuf/fedora-42-ppc64le/09892101-root started [2025-12-10 05:28:17,895][ INFO][PID:3752192] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c192]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/mochaa/protobuf/fedora-42-ppc64le/09892101-root/ &> /var/lib/copr/public_html/results/mochaa/protobuf/fedora-42-ppc64le/09892101-root/build-09892101.rsync.log [2025-12-10 05:37:38,473][ INFO][PID:3752192] rsyncing finished. [2025-12-10 05:37:38,519][ INFO][PID:3752192] Releasing VM back to pool [2025-12-10 05:37:38,736][ INFO][PID:3752192] Searching for 'success' file in resultdir [2025-12-10 05:37:38,740][ ERROR][PID:3752192] Build failed: Backend process error: No success file => build failure [2025-12-10 05:37:38,754][ INFO][PID:3752192] Finished build: id=9892101 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/mochaa/protobuf chroot=fedora-42-ppc64le [2025-12-10 05:37:38,865][ ERROR][PID:3752192] Backend process error: No success file => build failure [2025-12-10 05:37:38,871][ INFO][PID:3752192] Worker failed build, took 1077.9671218395233 [2025-12-10 05:37:38,882][ INFO][PID:3752192] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "mochaa", "project_name": "protobuf", "project_dirname": "protobuf", "submitter": "https://src.fedoraproject.org/user/ellert", "ended_on": 1765345058.8707438, "started_on": 1765343980.903622, "submitted_on": null, "status": 0, "chroot": "fedora-42-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9892101-fedora-42-ppc64le", "build_id": 9892101, "package_name": "root", "package_version": "6.38.00-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/mochaa/protobuf/root", "git_hash": "309f5059fcd3886bffb4684dfcd5bac4e4d86f5e", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "mochaa/protobuf--https://src.fedoraproject.org/user/ellert", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/mochaa/protobuf/fedora-42-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/mochaa/protobuf", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/mochaa/protobuf", "result_dir": "09892101-root", "built_packages": "", "id": 9892101, "mockchain_macros": { "copr_username": "mochaa", "copr_projectname": "protobuf", "vendor": "Fedora Project COPR (mochaa/protobuf)" } } ] } [2025-12-10 05:37:39,638][ INFO][PID:3752192] Sending fedora-messaging bus message in build.end [2025-12-10 05:37:50,218][ INFO][PID:3752192] Compressing /var/lib/copr/public_html/results/mochaa/protobuf/fedora-42-ppc64le/09892101-root/builder-live.log by gzip [2025-12-10 05:37:50,221][ INFO][PID:3752192] Running command 'gzip /var/lib/copr/public_html/results/mochaa/protobuf/fedora-42-ppc64le/09892101-root/builder-live.log' as PID 3875294 [2025-12-10 05:37:50,239][ INFO][PID:3752192] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/mochaa/protobuf/fedora-42-ppc64le/09892101-root/builder-live.log) [2025-12-10 05:37:50,240][ INFO][PID:3752192] Compressing /var/lib/copr/public_html/results/mochaa/protobuf/fedora-42-ppc64le/09892101-root/backend.log by gzip [2025-12-10 05:37:50,241][ INFO][PID:3752192] Running command 'gzip /var/lib/copr/public_html/results/mochaa/protobuf/fedora-42-ppc64le/09892101-root/backend.log' as PID 3875297