[2025-12-28 05:15:18,115][ INFO][PID:810641] Marking build as starting [2025-12-28 05:15:18,208][ INFO][PID:810641] Checking that /var/lib/copr/public_html/results/topazus/test-review/fedora-rawhide-ppc64le/repodata/repomd.xml exists [2025-12-28 05:15:18,210][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:15:18,212][ INFO][PID:810641] VM allocation process starts [2025-12-28 05:15:18,231][ INFO][PID:810641] Trying to allocate VM: ResallocHost, ticket_id=541633, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-28 05:15:23,239][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:15:24,452][ INFO][PID:810641] Allocated host ResallocHost, ticket_id=541633, hostname=2620:52:6:1161:dead:beef:cafe:c192, name=vmhost_p09_04_prod_00796383_20251228_044704, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-28 05:15:24,453][ INFO][PID:810641] Allocating ssh connection to builder [2025-12-28 05:15:24,454][ INFO][PID:810641] Checking that builder machine is OK [2025-12-28 05:16:24,526][ ERROR][PID:810641] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c192 port 22: Connection timed out [2025-12-28 05:16:34,530][ ERROR][PID:810641] Re-try request for task on 'ResallocHost, ticket_id=541633, hostname=2620:52:6:1161:dead:beef:cafe:c192, name=vmhost_p09_04_prod_00796383_20251228_044704, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts [2025-12-28 05:16:34,531][ INFO][PID:810641] Releasing VM back to pool [2025-12-28 05:16:34,553][ INFO][PID:810641] Retry #1 (on other host) [2025-12-28 05:16:34,554][ INFO][PID:810641] Checking that /var/lib/copr/public_html/results/topazus/test-review/fedora-rawhide-ppc64le/repodata/repomd.xml exists [2025-12-28 05:16:34,555][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:16:34,558][ INFO][PID:810641] VM allocation process starts [2025-12-28 05:16:34,581][ INFO][PID:810641] Trying to allocate VM: ResallocHost, ticket_id=541640, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-28 05:16:37,608][ INFO][PID:810641] Allocated host ResallocHost, ticket_id=541640, hostname=2620:52:6:1161:dead:beef:cafe:c14c, name=vmhost_p09_03_prod_00796391_20251228_045224, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-28 05:16:37,609][ INFO][PID:810641] Allocating ssh connection to builder [2025-12-28 05:16:37,610][ INFO][PID:810641] Checking that builder machine is OK [2025-12-28 05:16:38,587][ INFO][PID:810641] Running remote command: copr-builder-ready fedora-rawhide-ppc64le [2025-12-28 05:16:39,142][ INFO][PID:810641] Red Hat subscription not needed for fedora-rawhide-ppc64le Builder is ready to be used [2025-12-28 05:16:39,142][ INFO][PID:810641] Filling build.info file with builder info [2025-12-28 05:16:39,143][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:16:39,144][ INFO][PID:810641] Not re-notifying FE and msg buses for the new host. [2025-12-28 05:16:39,144][ INFO][PID:810641] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9954257-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached [2025-12-28 05:16:40,087][ INFO][PID:810641] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c14c' (ED25519) to the list of known hosts. [2025-12-28 05:16:40,090][ INFO][PID:810641] Downloading the builder-live.log file, attempt 1 [2025-12-28 05:16:40,107][ INFO][PID:810641] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c14c copr-rpmbuild-log [2025-12-28 05:16:45,097][ INFO][PID:810641] Periodic builder liveness probe: alive [2025-12-28 05:16:45,098][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:16:50,099][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:16:55,100][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:17:00,102][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:17:05,103][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:17:10,183][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:17:15,184][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:17:20,185][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:17:25,186][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:17:30,187][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:17:35,188][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:17:40,189][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:17:45,194][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:17:50,195][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:17:55,196][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:18:00,197][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:18:05,198][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:18:10,199][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:18:15,200][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:18:20,201][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:18:25,202][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:18:30,203][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:18:35,204][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:18:40,205][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:18:45,206][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:18:50,207][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:18:55,208][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:19:00,209][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:19:05,210][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:19:10,211][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:19:15,212][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:19:20,213][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:19:25,214][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:19:30,215][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:19:35,216][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:19:40,217][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:19:45,218][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:19:50,219][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:19:55,220][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:20:00,221][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:20:05,222][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:20:10,222][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:20:15,223][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:20:20,224][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:20:25,225][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:20:30,226][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:20:35,227][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:20:40,228][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:20:45,229][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:20:50,230][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:20:55,231][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:21:00,232][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:21:05,232][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:21:10,233][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:21:15,234][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:21:20,235][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:21:25,236][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:21:30,237][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:21:35,238][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:21:40,239][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:21:45,240][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:21:50,241][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:21:55,242][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:22:00,243][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:22:05,243][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:22:10,244][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:22:15,245][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:22:20,246][ INFO][PID:810641] Checking for cancel request [2025-12-28 05:22:21,477][ INFO][PID:810641] Downloading results from builder [2025-12-28 05:22:21,477][ INFO][PID:810641] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c14c]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/topazus/test-review/fedora-rawhide-ppc64le/09954257-python-uncertainties started [2025-12-28 05:22:21,478][ INFO][PID:810641] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c14c]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/topazus/test-review/fedora-rawhide-ppc64le/09954257-python-uncertainties/ &> /var/lib/copr/public_html/results/topazus/test-review/fedora-rawhide-ppc64le/09954257-python-uncertainties/build-09954257.rsync.log [2025-12-28 05:22:22,179][ INFO][PID:810641] rsyncing finished. [2025-12-28 05:22:22,180][ INFO][PID:810641] Releasing VM back to pool [2025-12-28 05:22:22,189][ INFO][PID:810641] Searching for 'success' file in resultdir [2025-12-28 05:22:22,190][ ERROR][PID:810641] Build failed: Backend process error: No success file => build failure [2025-12-28 05:22:22,190][ INFO][PID:810641] Finished build: id=9954257 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/topazus/test-review chroot=fedora-rawhide-ppc64le [2025-12-28 05:22:22,192][ ERROR][PID:810641] Backend process error: No success file => build failure [2025-12-28 05:22:22,192][ INFO][PID:810641] Worker failed build, took 343.04861640930176 [2025-12-28 05:22:22,193][ INFO][PID:810641] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "topazus", "project_name": "test-review", "project_dirname": "test-review", "submitter": "topazus", "ended_on": 1766899342.1928287, "started_on": 1766898999.1442122, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9954257-fedora-rawhide-ppc64le", "build_id": 9954257, "package_name": "python-uncertainties", "package_version": "3.2.3-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/topazus/test-review/python-uncertainties", "git_hash": "fe8960b14610f5956677ab36fceee1e00d49fd1e", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "topazus/test-review--topazus", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/topazus/test-review/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/topazus/test-review/fedora-rawhide-ppc64le/", "id": "copr_topazus_test_review", "name": "Additional repo copr_topazus_test_review" } ], "background": false, "fedora_review": true, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/topazus/test-review", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/topazus/test-review", "result_dir": "09954257-python-uncertainties", "built_packages": "", "id": 9954257, "mockchain_macros": { "copr_username": "topazus", "copr_projectname": "test-review", "vendor": "Fedora Project COPR (topazus/test-review)" } } ] } [2025-12-28 05:22:22,268][ INFO][PID:810641] Sending fedora-messaging bus message in build.end [2025-12-28 05:22:22,808][ INFO][PID:810641] Compressing /var/lib/copr/public_html/results/topazus/test-review/fedora-rawhide-ppc64le/09954257-python-uncertainties/builder-live.log by gzip [2025-12-28 05:22:22,810][ INFO][PID:810641] Running command 'gzip /var/lib/copr/public_html/results/topazus/test-review/fedora-rawhide-ppc64le/09954257-python-uncertainties/builder-live.log' as PID 850990 [2025-12-28 05:22:22,830][ INFO][PID:810641] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/topazus/test-review/fedora-rawhide-ppc64le/09954257-python-uncertainties/builder-live.log) [2025-12-28 05:22:22,831][ INFO][PID:810641] Compressing /var/lib/copr/public_html/results/topazus/test-review/fedora-rawhide-ppc64le/09954257-python-uncertainties/backend.log by gzip [2025-12-28 05:22:22,832][ INFO][PID:810641] Running command 'gzip /var/lib/copr/public_html/results/topazus/test-review/fedora-rawhide-ppc64le/09954257-python-uncertainties/backend.log' as PID 850991