[2024-11-20 22:47:52,566][ INFO][PID:2840949] Marking build as starting [2024-11-20 22:47:52,717][ INFO][PID:2840949] Trying to allocate VM [2024-11-20 22:47:55,761][ INFO][PID:2840949] Allocated host ResallocHost, ticket_id=5979717, hostname=169.59.162.22 [2024-11-20 22:47:55,761][ INFO][PID:2840949] Allocating ssh connection to builder [2024-11-20 22:47:55,762][ INFO][PID:2840949] Checking that builder machine is OK [2024-11-20 22:47:56,254][ INFO][PID:2840949] Running remote command: copr-builder-ready fedora-rawhide-s390x [2024-11-20 22:47:56,498][ INFO][PID:2840949] [2024-11-20 22:47:56,499][ INFO][PID:2840949] Warning: Permanently added '169.59.162.22' (ED25519) to the list of known hosts. bash: line 1: copr-builder-ready: command not found [2024-11-20 22:47:56,500][ ERROR][PID:2840949] Re-try request for task on 'ResallocHost, ticket_id=5979717, hostname=169.59.162.22': Builder wasn't ready, trying a new one [2024-11-20 22:47:56,500][ INFO][PID:2840949] Releasing VM back to pool [2024-11-20 22:47:56,516][ INFO][PID:2840949] Retry #1 (on other host) [2024-11-20 22:47:56,517][ INFO][PID:2840949] Trying to allocate VM [2024-11-20 22:47:59,550][ INFO][PID:2840949] Allocated host ResallocHost, ticket_id=5979732, hostname=150.239.220.37 [2024-11-20 22:47:59,551][ INFO][PID:2840949] Allocating ssh connection to builder [2024-11-20 22:47:59,552][ INFO][PID:2840949] Checking that builder machine is OK [2024-11-20 22:48:00,046][ INFO][PID:2840949] Running remote command: copr-builder-ready fedora-rawhide-s390x [2024-11-20 22:48:00,310][ INFO][PID:2840949] [2024-11-20 22:48:00,311][ INFO][PID:2840949] Warning: Permanently added '150.239.220.37' (ED25519) to the list of known hosts. bash: line 1: copr-builder-ready: command not found [2024-11-20 22:48:00,312][ ERROR][PID:2840949] Re-try request for task on 'ResallocHost, ticket_id=5979732, hostname=150.239.220.37': Builder wasn't ready, trying a new one [2024-11-20 22:48:00,312][ INFO][PID:2840949] Releasing VM back to pool [2024-11-20 22:48:00,325][ INFO][PID:2840949] Retry #2 (on other host) [2024-11-20 22:48:00,326][ INFO][PID:2840949] Trying to allocate VM [2024-11-20 22:48:03,375][ INFO][PID:2840949] Allocated host ResallocHost, ticket_id=5979743, hostname=150.239.220.37 [2024-11-20 22:48:03,376][ INFO][PID:2840949] Allocating ssh connection to builder [2024-11-20 22:48:03,377][ INFO][PID:2840949] Checking that builder machine is OK [2024-11-20 22:48:03,632][ INFO][PID:2840949] Running remote command: copr-builder-ready fedora-rawhide-s390x [2024-11-20 22:48:03,890][ INFO][PID:2840949] [2024-11-20 22:48:03,891][ INFO][PID:2840949] Warning: Permanently added '150.239.220.37' (ED25519) to the list of known hosts. bash: line 1: copr-builder-ready: command not found [2024-11-20 22:48:03,892][ ERROR][PID:2840949] Re-try request for task on 'ResallocHost, ticket_id=5979743, hostname=150.239.220.37': Builder wasn't ready, trying a new one [2024-11-20 22:48:03,892][ INFO][PID:2840949] Releasing VM back to pool [2024-11-20 22:48:03,910][ INFO][PID:2840949] Retry #3 (on other host) [2024-11-20 22:48:03,911][ INFO][PID:2840949] Trying to allocate VM [2024-11-20 22:48:06,968][ INFO][PID:2840949] Allocated host ResallocHost, ticket_id=5979755, hostname=150.239.220.37 [2024-11-20 22:48:06,969][ INFO][PID:2840949] Allocating ssh connection to builder [2024-11-20 22:48:06,969][ INFO][PID:2840949] Checking that builder machine is OK [2024-11-20 22:48:07,241][ INFO][PID:2840949] Running remote command: copr-builder-ready fedora-rawhide-s390x [2024-11-20 22:48:07,479][ INFO][PID:2840949] [2024-11-20 22:48:07,480][ INFO][PID:2840949] Warning: Permanently added '150.239.220.37' (ED25519) to the list of known hosts. bash: line 1: copr-builder-ready: command not found [2024-11-20 22:48:07,481][ ERROR][PID:2840949] Re-try request for task on 'ResallocHost, ticket_id=5979755, hostname=150.239.220.37': Builder wasn't ready, trying a new one [2024-11-20 22:48:07,481][ INFO][PID:2840949] Releasing VM back to pool [2024-11-20 22:48:07,495][ INFO][PID:2840949] Retry #4 (on other host) [2024-11-20 22:48:07,496][ INFO][PID:2840949] Trying to allocate VM [2024-11-20 22:48:10,526][ INFO][PID:2840949] Allocated host ResallocHost, ticket_id=5979761, hostname=150.239.220.37 [2024-11-20 22:48:10,527][ INFO][PID:2840949] Allocating ssh connection to builder [2024-11-20 22:48:10,528][ INFO][PID:2840949] Checking that builder machine is OK [2024-11-20 22:48:10,781][ INFO][PID:2840949] Running remote command: copr-builder-ready fedora-rawhide-s390x [2024-11-20 22:48:11,019][ INFO][PID:2840949] [2024-11-20 22:48:11,020][ INFO][PID:2840949] Warning: Permanently added '150.239.220.37' (ED25519) to the list of known hosts. bash: line 1: copr-builder-ready: command not found [2024-11-20 22:48:11,021][ ERROR][PID:2840949] Re-try request for task on 'ResallocHost, ticket_id=5979761, hostname=150.239.220.37': Builder wasn't ready, trying a new one [2024-11-20 22:48:11,022][ INFO][PID:2840949] Releasing VM back to pool [2024-11-20 22:48:11,039][ INFO][PID:2840949] Retry #5 (on other host) [2024-11-20 22:48:11,040][ INFO][PID:2840949] Trying to allocate VM [2024-11-20 22:48:14,082][ INFO][PID:2840949] Allocated host ResallocHost, ticket_id=5979763, hostname=150.239.220.37 [2024-11-20 22:48:14,083][ INFO][PID:2840949] Allocating ssh connection to builder [2024-11-20 22:48:14,083][ INFO][PID:2840949] Checking that builder machine is OK [2024-11-20 22:48:14,331][ INFO][PID:2840949] Running remote command: copr-builder-ready fedora-rawhide-s390x [2024-11-20 22:48:14,571][ INFO][PID:2840949] [2024-11-20 22:48:14,572][ INFO][PID:2840949] Warning: Permanently added '150.239.220.37' (ED25519) to the list of known hosts. bash: line 1: copr-builder-ready: command not found [2024-11-20 22:48:14,572][ ERROR][PID:2840949] Re-try request for task on 'ResallocHost, ticket_id=5979763, hostname=150.239.220.37': Builder wasn't ready, trying a new one [2024-11-20 22:48:14,573][ INFO][PID:2840949] Releasing VM back to pool [2024-11-20 22:48:14,586][ INFO][PID:2840949] Retry #6 (on other host) [2024-11-20 22:48:14,587][ INFO][PID:2840949] Trying to allocate VM [2024-11-20 22:48:17,627][ INFO][PID:2840949] Allocated host ResallocHost, ticket_id=5979771, hostname=150.239.220.37 [2024-11-20 22:48:17,628][ INFO][PID:2840949] Allocating ssh connection to builder [2024-11-20 22:48:17,628][ INFO][PID:2840949] Checking that builder machine is OK [2024-11-20 22:48:17,900][ INFO][PID:2840949] Running remote command: copr-builder-ready fedora-rawhide-s390x [2024-11-20 22:48:18,140][ INFO][PID:2840949] [2024-11-20 22:48:18,141][ INFO][PID:2840949] Warning: Permanently added '150.239.220.37' (ED25519) to the list of known hosts. bash: line 1: copr-builder-ready: command not found [2024-11-20 22:48:18,141][ ERROR][PID:2840949] Re-try request for task on 'ResallocHost, ticket_id=5979771, hostname=150.239.220.37': Builder wasn't ready, trying a new one [2024-11-20 22:48:18,141][ INFO][PID:2840949] Releasing VM back to pool [2024-11-20 22:48:18,162][ INFO][PID:2840949] Retry #7 (on other host) [2024-11-20 22:48:18,163][ INFO][PID:2840949] Trying to allocate VM [2024-11-20 22:48:21,196][ INFO][PID:2840949] Allocated host ResallocHost, ticket_id=5979779, hostname=52.117.125.112 [2024-11-20 22:48:21,197][ INFO][PID:2840949] Allocating ssh connection to builder [2024-11-20 22:48:21,198][ INFO][PID:2840949] Checking that builder machine is OK [2024-11-20 22:48:21,449][ INFO][PID:2840949] Running remote command: copr-builder-ready fedora-rawhide-s390x [2024-11-20 22:48:21,689][ INFO][PID:2840949] [2024-11-20 22:48:21,689][ INFO][PID:2840949] Warning: Permanently added '52.117.125.112' (ED25519) to the list of known hosts. bash: line 1: copr-builder-ready: command not found [2024-11-20 22:48:21,690][ ERROR][PID:2840949] Re-try request for task on 'ResallocHost, ticket_id=5979779, hostname=52.117.125.112': Builder wasn't ready, trying a new one [2024-11-20 22:48:21,690][ INFO][PID:2840949] Releasing VM back to pool [2024-11-20 22:48:21,703][ ERROR][PID:2840949] Backend process error: Three host tried without success: {'169.59.162.22', '52.117.125.112', '150.239.220.37'} [2024-11-20 22:48:21,704][WARNING][PID:2840949] Switching not-finished job state to 'failed' [2024-11-20 22:48:21,704][ INFO][PID:2840949] Worker failed build, took 29.1515052318573 [2024-11-20 22:48:21,705][ INFO][PID:2840949] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "openblas-0.3.23", "project_dirname": "openblas-0.3.23", "submitter": "https://src.fedoraproject.org/user/marcdeop", "ended_on": 1732142901.704481, "started_on": 1732142872.5529757, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "8288197-fedora-rawhide-s390x", "build_id": 8288197, "package_name": "kmail-account-wizard", "package_version": "24.11.80-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/kmail-account-wizard", "git_hash": "7d54c452b46fe010ee3944567928e5562225ff2b", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/marcdeop", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-rawhide-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23", "result_dir": "08288197-kmail-account-wizard", "built_packages": "", "id": 8288197, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "openblas-0.3.23", "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)" } } ] } [2024-11-20 22:48:21,788][ INFO][PID:2840949] Sending fedora-messaging bus message in build.end [2024-11-20 22:48:22,490][ INFO][PID:2840949] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-s390x/08288197-kmail-account-wizard/builder-live.log by gzip [2024-11-20 22:48:22,492][ INFO][PID:2840949] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-s390x/08288197-kmail-account-wizard/builder-live.log' as PID 2845284 [2024-11-20 22:48:22,493][ INFO][PID:2840949] Finished after 0 seconds with exit code 1 (gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-s390x/08288197-kmail-account-wizard/builder-live.log) stdout: stderr: gzip: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-s390x/08288197-kmail-account-wizard/builder-live.log: No such file or directory [2024-11-20 22:48:22,494][ ERROR][PID:2840949] Unable to compress file /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-s390x/08288197-kmail-account-wizard/builder-live.log [2024-11-20 22:48:22,494][ INFO][PID:2840949] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-s390x/08288197-kmail-account-wizard/backend.log by gzip [2024-11-20 22:48:22,495][ INFO][PID:2840949] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-s390x/08288197-kmail-account-wizard/backend.log' as PID 2845285