[2026-09-15 13:54:08,371][ INFO][PID:1459603] Marking build as starting [2026-09-15 13:54:08,546][ INFO][PID:1459603] Checking that /var/lib/copr/public_html/results/rapier1/hpnss-build-tests/mageia-8-x86_64/repodata/repomd.xml exists [2026-09-15 13:54:08,569][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:54:08,592][ INFO][PID:1459603] rpmeta: predicted 2 min for hpnssh on mageia-8-x86_64 -> normal builder sufficient [2026-09-15 13:54:08,593][ INFO][PID:1459603] VM allocation process starts [2026-09-15 13:54:08,599][ INFO][PID:1459603] Trying to allocate VM: ResallocHost, ticket_id=5038563, requested_tags=['arch_x86_64', 'copr_builder'] [2026-09-15 13:54:13,600][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:54:18,601][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:54:23,602][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:54:28,603][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:54:33,603][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:54:38,604][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:54:43,605][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:54:48,606][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:54:53,607][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:54:58,607][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:55:03,608][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:55:08,609][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:55:13,610][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:55:18,611][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:55:23,611][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:55:28,612][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:55:33,613][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:55:38,614][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:55:43,615][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:55:48,616][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:55:53,616][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:55:58,617][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:56:03,618][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:56:08,619][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:56:13,620][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:56:18,621][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:56:23,622][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:56:28,623][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:56:33,624][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:56:38,624][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:56:43,625][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:56:48,626][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:56:53,627][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:56:58,628][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:57:03,628][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:57:08,629][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:57:13,630][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:57:18,631][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:57:23,632][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:57:28,633][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:57:33,634][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:57:38,636][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:57:43,637][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:57:48,649][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:57:53,650][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:57:58,651][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:58:03,652][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:58:08,652][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:58:13,653][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:58:18,654][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:58:23,655][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:58:26,667][ INFO][PID:1459603] Allocated host ResallocHost, ticket_id=5038563, hostname=44.214.104.144, name=aws_x86_64_reserved_prod_37909829_20260915_135648, requested_tags=['arch_x86_64', 'copr_builder'] [2026-09-15 13:58:26,667][ INFO][PID:1459603] Allocating ssh connection to builder [2026-09-15 13:58:26,668][ INFO][PID:1459603] Checking that builder machine is OK [2026-09-15 13:58:26,939][ INFO][PID:1459603] Installed copr-rpmbuild version: 1.9 [2026-09-15 13:58:26,939][ INFO][PID:1459603] Running remote command: copr-builder-ready mageia-8-x86_64 [2026-09-15 13:58:27,085][ INFO][PID:1459603] Chroot config /etc/mock/mageia-8-x86_64.cfg not found [2026-09-15 13:58:27,085][ INFO][PID:1459603] Warning: Permanently added '44.214.104.144' (ED25519) to the list of known hosts. [2026-09-15 13:58:27,086][ ERROR][PID:1459603] Re-try request for task on 'ResallocHost, ticket_id=5038563, hostname=44.214.104.144, name=aws_x86_64_reserved_prod_37909829_20260915_135648, requested_tags=['arch_x86_64', 'copr_builder']': Builder wasn't ready, trying a new one [2026-09-15 13:58:27,091][ INFO][PID:1459603] VM Release request [2026-09-15 13:58:27,097][ INFO][PID:1459603] Retry #1 (on other host) [2026-09-15 13:58:27,097][ INFO][PID:1459603] Checking that /var/lib/copr/public_html/results/rapier1/hpnss-build-tests/mageia-8-x86_64/repodata/repomd.xml exists [2026-09-15 13:58:27,098][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:58:27,117][ INFO][PID:1459603] rpmeta: predicted 2 min for hpnssh on mageia-8-x86_64 -> normal builder sufficient [2026-09-15 13:58:27,118][ INFO][PID:1459603] VM allocation process starts [2026-09-15 13:58:27,123][ INFO][PID:1459603] Trying to allocate VM: ResallocHost, ticket_id=5038661, requested_tags=['arch_x86_64', 'copr_builder'] [2026-09-15 13:58:32,124][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:58:37,125][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:58:42,127][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:58:47,127][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:58:52,128][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:58:57,129][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:59:02,130][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:59:07,131][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:59:12,132][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:59:17,133][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:59:22,134][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:59:27,135][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:59:32,136][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:59:37,137][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:59:42,137][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:59:47,138][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:59:52,139][ INFO][PID:1459603] Checking for cancel request [2026-09-15 13:59:57,140][ INFO][PID:1459603] Checking for cancel request [2026-09-15 14:00:02,141][ INFO][PID:1459603] Checking for cancel request [2026-09-15 14:00:07,141][ INFO][PID:1459603] Checking for cancel request [2026-09-15 14:00:12,142][ INFO][PID:1459603] Checking for cancel request [2026-09-15 14:00:17,143][ INFO][PID:1459603] Checking for cancel request [2026-09-15 14:00:22,144][ INFO][PID:1459603] Checking for cancel request [2026-09-15 14:00:27,145][ INFO][PID:1459603] Checking for cancel request [2026-09-15 14:00:32,146][ INFO][PID:1459603] Checking for cancel request [2026-09-15 14:00:37,146][ INFO][PID:1459603] Checking for cancel request [2026-09-15 14:00:42,147][ INFO][PID:1459603] Checking for cancel request [2026-09-15 14:00:47,148][ INFO][PID:1459603] Checking for cancel request [2026-09-15 14:00:52,149][ INFO][PID:1459603] Checking for cancel request [2026-09-15 14:00:57,150][ INFO][PID:1459603] Checking for cancel request [2026-09-15 14:01:02,151][ INFO][PID:1459603] Checking for cancel request [2026-09-15 14:01:07,152][ INFO][PID:1459603] Checking for cancel request [2026-09-15 14:01:12,153][ INFO][PID:1459603] Checking for cancel request [2026-09-15 14:01:17,155][ INFO][PID:1459603] Checking for cancel request [2026-09-15 14:01:22,158][ INFO][PID:1459603] Checking for cancel request [2026-09-15 14:01:27,160][ INFO][PID:1459603] Checking for cancel request [2026-09-15 14:01:32,161][ INFO][PID:1459603] Checking for cancel request [2026-09-15 14:01:37,162][ INFO][PID:1459603] Checking for cancel request [2026-09-15 14:01:42,163][ INFO][PID:1459603] Checking for cancel request [2026-09-15 14:01:45,216][ INFO][PID:1459603] Allocated host ResallocHost, ticket_id=5038661, hostname=98.80.182.109, name=aws_x86_64_reserved_prod_37909912_20260915_135703, requested_tags=['arch_x86_64', 'copr_builder'] [2026-09-15 14:01:45,217][ INFO][PID:1459603] Allocating ssh connection to builder [2026-09-15 14:01:45,217][ INFO][PID:1459603] Checking that builder machine is OK [2026-09-15 14:01:45,511][ INFO][PID:1459603] Installed copr-rpmbuild version: 1.9 [2026-09-15 14:01:45,513][ INFO][PID:1459603] Running remote command: copr-builder-ready mageia-8-x86_64 [2026-09-15 14:01:45,670][ INFO][PID:1459603] Chroot config /etc/mock/mageia-8-x86_64.cfg not found [2026-09-15 14:01:45,671][ INFO][PID:1459603] Warning: Permanently added '98.80.182.109' (ED25519) to the list of known hosts. [2026-09-15 14:01:45,672][ ERROR][PID:1459603] Re-try request for task on 'ResallocHost, ticket_id=5038661, hostname=98.80.182.109, name=aws_x86_64_reserved_prod_37909912_20260915_135703, requested_tags=['arch_x86_64', 'copr_builder']': Builder wasn't ready, trying a new one [2026-09-15 14:01:45,681][ INFO][PID:1459603] VM Release request [2026-09-15 14:01:45,688][ INFO][PID:1459603] Retry #2 (on other host) [2026-09-15 14:01:45,688][ INFO][PID:1459603] Checking that /var/lib/copr/public_html/results/rapier1/hpnss-build-tests/mageia-8-x86_64/repodata/repomd.xml exists [2026-09-15 14:01:45,689][ INFO][PID:1459603] Checking for cancel request [2026-09-15 14:01:45,710][ INFO][PID:1459603] rpmeta: predicted 2 min for hpnssh on mageia-8-x86_64 -> normal builder sufficient [2026-09-15 14:01:45,712][ INFO][PID:1459603] VM allocation process starts [2026-09-15 14:01:45,722][ INFO][PID:1459603] Trying to allocate VM: ResallocHost, ticket_id=5038747, requested_tags=['arch_x86_64', 'copr_builder'] [2026-09-15 14:01:50,724][ INFO][PID:1459603] Checking for cancel request [2026-09-15 14:01:55,725][ INFO][PID:1459603] Checking for cancel request [2026-09-15 14:02:00,726][ INFO][PID:1459603] Checking for cancel request [2026-09-15 14:02:05,729][ INFO][PID:1459603] Checking for cancel request [2026-09-15 14:02:10,730][ INFO][PID:1459603] Checking for cancel request [2026-09-15 14:02:13,749][ INFO][PID:1459603] Allocated host ResallocHost, ticket_id=5038747, hostname=2620:52:6:1161:dead:beef:cafe:c137, name=vmhost_x86_03_prod_37909507_20260915_135604, requested_tags=['arch_x86_64', 'copr_builder'] [2026-09-15 14:02:13,749][ INFO][PID:1459603] Allocating ssh connection to builder [2026-09-15 14:02:13,750][ INFO][PID:1459603] Checking that builder machine is OK [2026-09-15 14:02:14,051][ INFO][PID:1459603] Installed copr-rpmbuild version: 1.9 [2026-09-15 14:02:14,051][ INFO][PID:1459603] Running remote command: copr-builder-ready mageia-8-x86_64 [2026-09-15 14:02:14,334][ INFO][PID:1459603] Chroot config /etc/mock/mageia-8-x86_64.cfg not found [2026-09-15 14:02:14,335][ INFO][PID:1459603] Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c137' (ED25519) to the list of known hosts. [2026-09-15 14:02:14,336][ ERROR][PID:1459603] Re-try request for task on 'ResallocHost, ticket_id=5038747, hostname=2620:52:6:1161:dead:beef:cafe:c137, name=vmhost_x86_03_prod_37909507_20260915_135604, requested_tags=['arch_x86_64', 'copr_builder']': Builder wasn't ready, trying a new one [2026-09-15 14:02:14,341][ INFO][PID:1459603] VM Release request [2026-09-15 14:02:14,349][ ERROR][PID:1459603] Backend process error: Three host tried without success: {'44.214.104.144', '2620:52:6:1161:dead:beef:cafe:c137', '98.80.182.109'} [2026-09-15 14:02:14,354][WARNING][PID:1459603] Switching not-finished job state to 'failed' [2026-09-15 14:02:14,355][ INFO][PID:1459603] Worker failed build, took 486.052681684494 [2026-09-15 14:02:14,355][ INFO][PID:1459603] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "rapier1", "project_name": "hpnss-build-tests", "project_dirname": "hpnss-build-tests", "submitter": "rapier1", "ended_on": 1789480934.354544, "started_on": 1789480448.3018622, "submitted_on": null, "status": 0, "chroot": "mageia-8-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10988079-mageia-8-x86_64", "build_id": 10988079, "package_name": "hpnssh", "package_version": "10.5p1_hpn18.11.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rapier1/hpnss-build-tests/hpnssh", "git_hash": "4640c9637e15c8cc6905f5b583026e1683435b8e", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rapier1/hpnss-build-tests--rapier1", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rapier1/hpnss-build-tests/mageia-8-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null, "repo_gpgcheck": false } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rapier1/hpnss-build-tests", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rapier1/hpnss-build-tests", "result_dir": "10988079-hpnssh", "built_packages": "", "rpmeta_prediction": 2, "id": 10988079, "mockchain_macros": { "copr_username": "rapier1", "copr_projectname": "hpnss-build-tests", "vendor": "Fedora Project COPR (rapier1/hpnss-build-tests)" } } ] } [2026-09-15 14:02:14,392][ INFO][PID:1459603] Sending fedora-messaging bus message in build.end [2026-09-15 14:02:14,741][ INFO][PID:1459603] Compressing /var/lib/copr/public_html/results/rapier1/hpnss-build-tests/mageia-8-x86_64/10988079-hpnssh/builder-live.log by gzip [2026-09-15 14:02:14,743][ INFO][PID:1459603] Running command 'gzip /var/lib/copr/public_html/results/rapier1/hpnss-build-tests/mageia-8-x86_64/10988079-hpnssh/builder-live.log' as PID 1640509 [2026-09-15 14:02:14,744][ INFO][PID:1459603] Finished after 0 seconds with exit code 1 (gzip /var/lib/copr/public_html/results/rapier1/hpnss-build-tests/mageia-8-x86_64/10988079-hpnssh/builder-live.log) stdout: stderr: gzip: /var/lib/copr/public_html/results/rapier1/hpnss-build-tests/mageia-8-x86_64/10988079-hpnssh/builder-live.log: No such file or directory [2026-09-15 14:02:14,744][ ERROR][PID:1459603] Unable to compress file /var/lib/copr/public_html/results/rapier1/hpnss-build-tests/mageia-8-x86_64/10988079-hpnssh/builder-live.log [2026-09-15 14:02:14,750][ INFO][PID:1459603] Compressing /var/lib/copr/public_html/results/rapier1/hpnss-build-tests/mageia-8-x86_64/10988079-hpnssh/backend.log by gzip [2026-09-15 14:02:14,751][ INFO][PID:1459603] Running command 'gzip /var/lib/copr/public_html/results/rapier1/hpnss-build-tests/mageia-8-x86_64/10988079-hpnssh/backend.log' as PID 1640516