[2025-12-13 17:20:13,981][ INFO][PID:282763] Marking build as starting [2025-12-13 17:20:14,058][ INFO][PID:282763] Checking that /var/lib/copr/public_html/results/ganto/lxc4/fedora-rawhide-ppc64le/repodata/repomd.xml exists [2025-12-13 17:20:14,059][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:20:14,060][ INFO][PID:282763] VM allocation process starts [2025-12-13 17:20:14,071][ INFO][PID:282763] Trying to allocate VM: ResallocHost, ticket_id=323760, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-13 17:20:19,073][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:20:20,092][ INFO][PID:282763] Allocated host ResallocHost, ticket_id=323760, hostname=2620:52:6:1161:dead:beef:cafe:c10a, name=vmhost_p09_02_prod_00525496_20251213_170923, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-13 17:20:20,093][ INFO][PID:282763] Allocating ssh connection to builder [2025-12-13 17:20:20,093][ INFO][PID:282763] Checking that builder machine is OK [2025-12-13 17:20:20,964][ INFO][PID:282763] Running remote command: copr-builder-ready fedora-rawhide-ppc64le [2025-12-13 17:21:21,031][ ERROR][PID:282763] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c10a port 22: Connection timed out [2025-12-13 17:21:31,032][ ERROR][PID:282763] Re-try request for task on 'ResallocHost, ticket_id=323760, hostname=2620:52:6:1161:dead:beef:cafe:c10a, name=vmhost_p09_02_prod_00525496_20251213_170923, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts [2025-12-13 17:21:31,033][ INFO][PID:282763] Releasing VM back to pool [2025-12-13 17:21:31,045][ INFO][PID:282763] Retry #1 (on other host) [2025-12-13 17:21:31,045][ INFO][PID:282763] Checking that /var/lib/copr/public_html/results/ganto/lxc4/fedora-rawhide-ppc64le/repodata/repomd.xml exists [2025-12-13 17:21:31,046][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:21:31,046][ INFO][PID:282763] VM allocation process starts [2025-12-13 17:21:31,090][ INFO][PID:282763] Trying to allocate VM: ResallocHost, ticket_id=323762, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-13 17:21:34,166][ INFO][PID:282763] Allocated host ResallocHost, ticket_id=323762, hostname=2620:52:6:1161:dead:beef:cafe:c195, name=vmhost_p09_04_prod_00525553_20251213_171313, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-13 17:21:34,167][ INFO][PID:282763] Allocating ssh connection to builder [2025-12-13 17:21:34,167][ INFO][PID:282763] Checking that builder machine is OK [2025-12-13 17:21:35,143][ INFO][PID:282763] Running remote command: copr-builder-ready fedora-rawhide-ppc64le [2025-12-13 17:21:35,639][ INFO][PID:282763] Red Hat subscription not needed for fedora-rawhide-ppc64le Builder is ready to be used [2025-12-13 17:21:35,640][ INFO][PID:282763] Filling build.info file with builder info [2025-12-13 17:21:35,640][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:21:35,641][ INFO][PID:282763] Not re-notifying FE and msg buses for the new host. [2025-12-13 17:21:35,641][ INFO][PID:282763] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9906449-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached [2025-12-13 17:21:36,583][ INFO][PID:282763] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c195' (ED25519) to the list of known hosts. [2025-12-13 17:21:36,584][ INFO][PID:282763] Downloading the builder-live.log file, attempt 1 [2025-12-13 17:21:36,585][ INFO][PID:282763] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c195 copr-rpmbuild-log [2025-12-13 17:21:41,591][ INFO][PID:282763] Periodic builder liveness probe: alive [2025-12-13 17:21:41,592][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:21:46,593][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:21:51,594][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:21:56,594][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:22:01,595][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:22:06,596][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:22:11,597][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:22:16,598][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:22:21,599][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:22:26,600][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:22:31,601][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:22:36,602][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:22:41,603][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:22:46,604][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:22:51,605][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:22:56,606][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:23:01,607][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:23:06,608][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:23:11,609][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:23:16,610][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:23:21,611][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:23:26,612][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:23:31,612][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:23:36,613][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:23:41,614][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:23:46,725][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:23:51,726][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:23:56,726][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:24:01,727][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:24:06,728][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:24:11,730][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:24:16,730][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:24:21,731][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:24:26,732][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:24:31,733][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:24:36,734][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:24:41,735][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:24:46,736][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:24:51,737][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:24:56,738][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:25:01,739][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:25:06,740][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:25:11,741][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:25:16,742][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:25:21,744][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:25:26,745][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:25:31,746][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:25:36,747][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:25:41,748][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:25:46,749][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:25:51,750][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:25:56,750][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:26:01,751][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:26:06,753][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:26:11,754][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:26:16,755][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:26:21,756][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:26:26,757][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:26:31,758][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:26:36,759][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:26:41,760][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:26:46,761][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:26:51,762][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:26:56,763][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:27:01,764][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:27:06,764][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:27:11,766][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:27:16,767][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:27:21,768][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:27:26,769][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:27:31,770][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:27:36,771][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:27:41,772][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:27:46,773][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:27:51,774][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:27:56,775][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:28:01,780][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:28:06,833][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:28:11,896][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:28:16,897][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:28:21,913][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:28:26,916][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:28:31,917][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:28:36,919][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:28:41,932][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:28:46,933][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:28:51,934][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:28:56,935][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:29:02,025][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:29:07,026][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:29:12,027][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:29:17,028][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:29:22,029][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:29:27,034][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:29:32,080][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:29:37,081][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:29:42,083][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:29:47,123][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:29:52,124][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:29:57,125][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:30:02,126][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:30:07,127][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:30:12,222][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:30:17,224][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:30:22,225][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:30:27,357][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:30:32,360][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:30:37,362][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:30:42,363][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:30:47,364][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:30:52,365][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:30:57,366][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:31:02,367][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:31:07,379][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:31:12,380][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:31:17,382][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:31:22,383][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:31:27,530][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:31:32,568][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:31:37,570][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:31:42,576][ INFO][PID:282763] Periodic builder liveness probe: alive [2025-12-13 17:31:42,577][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:31:47,577][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:31:52,578][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:31:57,579][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:32:02,580][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:32:07,581][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:32:12,582][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:32:17,596][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:32:22,833][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:32:27,834][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:32:32,835][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:32:37,836][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:32:42,837][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:32:47,838][ INFO][PID:282763] Checking for cancel request [2025-12-13 17:32:50,448][ INFO][PID:282763] Downloading results from builder [2025-12-13 17:32:50,449][ INFO][PID:282763] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c195]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/ganto/lxc4/fedora-rawhide-ppc64le/09906449-incus started [2025-12-13 17:32:50,450][ INFO][PID:282763] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c195]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/ganto/lxc4/fedora-rawhide-ppc64le/09906449-incus/ &> /var/lib/copr/public_html/results/ganto/lxc4/fedora-rawhide-ppc64le/09906449-incus/build-09906449.rsync.log [2025-12-13 17:32:51,233][ INFO][PID:282763] rsyncing finished. [2025-12-13 17:32:51,234][ INFO][PID:282763] Releasing VM back to pool [2025-12-13 17:32:51,242][ INFO][PID:282763] Searching for 'success' file in resultdir [2025-12-13 17:32:51,243][ ERROR][PID:282763] Build failed: Backend process error: No success file => build failure [2025-12-13 17:32:51,244][ INFO][PID:282763] Finished build: id=9906449 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/ganto/lxc4 chroot=fedora-rawhide-ppc64le [2025-12-13 17:32:51,245][ ERROR][PID:282763] Backend process error: No success file => build failure [2025-12-13 17:32:51,245][ INFO][PID:282763] Worker failed build, took 675.604457616806 [2025-12-13 17:32:51,246][ INFO][PID:282763] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "ganto", "project_name": "lxc4", "project_dirname": "lxc4", "submitter": "ganto", "ended_on": 1765647171.2459269, "started_on": 1765646495.6414692, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9906449-fedora-rawhide-ppc64le", "build_id": 9906449, "package_name": "incus", "package_version": "6.19.1-0.2", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/ganto/lxc4/incus", "git_hash": "b968a14b0ec2f23c738ae92fbf188c461675226b", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "ganto/lxc4--ganto", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/ganto/lxc4/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "bootstrap": "off", "fedora_review": true, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/ganto/lxc4", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/ganto/lxc4", "result_dir": "09906449-incus", "built_packages": "", "id": 9906449, "mockchain_macros": { "copr_username": "ganto", "copr_projectname": "lxc4", "vendor": "Fedora Project COPR (ganto/lxc4)" } } ] } [2025-12-13 17:32:51,301][ INFO][PID:282763] Sending fedora-messaging bus message in build.end [2025-12-13 17:32:51,853][ INFO][PID:282763] Compressing /var/lib/copr/public_html/results/ganto/lxc4/fedora-rawhide-ppc64le/09906449-incus/builder-live.log by gzip [2025-12-13 17:32:51,854][ INFO][PID:282763] Running command 'gzip /var/lib/copr/public_html/results/ganto/lxc4/fedora-rawhide-ppc64le/09906449-incus/builder-live.log' as PID 320088 [2025-12-13 17:32:51,866][ INFO][PID:282763] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/ganto/lxc4/fedora-rawhide-ppc64le/09906449-incus/builder-live.log) [2025-12-13 17:32:51,866][ INFO][PID:282763] Compressing /var/lib/copr/public_html/results/ganto/lxc4/fedora-rawhide-ppc64le/09906449-incus/backend.log by gzip [2025-12-13 17:32:51,867][ INFO][PID:282763] Running command 'gzip /var/lib/copr/public_html/results/ganto/lxc4/fedora-rawhide-ppc64le/09906449-incus/backend.log' as PID 320089