[2025-09-10 14:00:07,457][ INFO][PID:1857170] Marking build as starting [2025-09-10 14:00:07,516][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:00:07,517][ INFO][PID:1857170] VM allocation process starts [2025-09-10 14:00:07,557][ INFO][PID:1857170] Trying to allocate VM: ResallocHost, ticket_id=4998715, requested_tags=['copr_builder', 'arch_x86_64'] [2025-09-10 14:00:12,559][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:00:17,560][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:00:22,561][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:00:27,561][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:00:32,563][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:00:37,766][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:00:42,767][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:00:47,768][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:00:52,773][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:00:57,775][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:01:02,777][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:01:07,778][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:01:12,779][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:01:17,780][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:01:22,783][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:01:27,785][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:01:32,786][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:01:37,790][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:01:42,791][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:01:47,793][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:01:52,794][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:01:57,795][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:02:02,796][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:02:07,797][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:02:12,798][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:02:17,799][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:02:22,800][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:02:27,801][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:02:32,802][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:02:37,803][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:02:42,804][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:02:47,805][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:02:52,807][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:02:57,808][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:03:02,809][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:03:07,810][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:03:14,054][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:03:19,055][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:03:24,056][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:03:29,057][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:03:34,058][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:03:39,059][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:03:44,060][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:03:49,061][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:03:54,063][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:03:59,064][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:04:04,066][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:04:09,067][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:04:14,068][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:04:19,069][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:04:24,071][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:04:42,166][ INFO][PID:1857170] Allocated host ResallocHost, ticket_id=4998715, hostname=13.222.25.148, name=aws_x86_64_spot_prod_06703995_20250910_140148, requested_tags=['copr_builder', 'arch_x86_64'] [2025-09-10 14:04:42,167][ INFO][PID:1857170] Allocating ssh connection to builder [2025-09-10 14:04:42,167][ INFO][PID:1857170] Checking that builder machine is OK [2025-09-10 14:05:42,238][ ERROR][PID:1857170] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 13.222.25.148 port 22: Connection timed out [2025-09-10 14:05:52,239][ ERROR][PID:1857170] Re-try request for task on 'ResallocHost, ticket_id=4998715, hostname=13.222.25.148, name=aws_x86_64_spot_prod_06703995_20250910_140148, requested_tags=['copr_builder', 'arch_x86_64']': Unable to finish after 1 SSH attempts [2025-09-10 14:05:52,239][ INFO][PID:1857170] Releasing VM back to pool [2025-09-10 14:05:52,251][ INFO][PID:1857170] Retry #1 (on other host) [2025-09-10 14:05:52,252][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:05:52,253][ INFO][PID:1857170] VM allocation process starts [2025-09-10 14:05:52,264][ INFO][PID:1857170] Trying to allocate VM: ResallocHost, ticket_id=4998812, requested_tags=['copr_builder', 'arch_x86_64'] [2025-09-10 14:05:57,265][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:06:02,266][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:06:07,267][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:06:12,268][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:06:17,269][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:06:22,270][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:06:27,274][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:06:32,276][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:06:37,278][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:06:42,280][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:06:47,282][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:06:52,285][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:06:57,290][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:07:02,292][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:07:07,293][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:07:12,294][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:07:17,295][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:07:22,296][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:07:27,298][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:07:32,299][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:07:37,300][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:07:42,301][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:07:47,303][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:07:52,304][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:07:57,315][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:08:02,316][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:08:07,318][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:08:12,319][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:08:17,320][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:08:22,321][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:08:27,322][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:08:32,323][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:08:37,324][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:08:42,326][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:08:47,333][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:08:52,335][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:08:57,336][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:09:02,337][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:09:07,338][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:09:10,420][ INFO][PID:1857170] Allocated host ResallocHost, ticket_id=4998812, hostname=2620:52:3:1:dead:beef:cafe:c10d, name=copr_hv_x86_64_01_prod_06704223_20250910_140643, requested_tags=['copr_builder', 'arch_x86_64'] [2025-09-10 14:09:10,421][ INFO][PID:1857170] Allocating ssh connection to builder [2025-09-10 14:09:10,421][ INFO][PID:1857170] Checking that builder machine is OK [2025-09-10 14:09:11,002][ INFO][PID:1857170] Running remote command: copr-builder-ready srpm-builds [2025-09-10 14:09:11,342][ INFO][PID:1857170] Red Hat subscription not needed for srpm-builds Builder is ready to be used [2025-09-10 14:09:11,342][ INFO][PID:1857170] Filling build.info file with builder info [2025-09-10 14:09:11,343][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:09:11,344][ INFO][PID:1857170] Not re-notifying FE and msg buses for the new host. [2025-09-10 14:09:11,345][ INFO][PID:1857170] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --srpm --task-url https://copr.fedorainfracloud.org/backend/get-srpm-build-task/9543376 --detached [2025-09-10 14:09:12,068][ INFO][PID:1857170] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c10d' (ED25519) to the list of known hosts. [2025-09-10 14:09:12,069][ INFO][PID:1857170] Downloading the builder-live.log file, attempt 1 [2025-09-10 14:09:12,071][ INFO][PID:1857170] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c10d copr-rpmbuild-log [2025-09-10 14:09:17,077][ INFO][PID:1857170] Periodic builder liveness probe: alive [2025-09-10 14:09:17,077][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:09:22,078][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:09:27,079][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:09:32,084][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:09:37,085][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:09:42,087][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:09:53,950][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:09:58,951][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:10:03,952][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:10:08,953][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:10:13,954][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:10:18,956][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:10:23,959][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:10:28,960][ INFO][PID:1857170] Checking for cancel request [2025-09-10 14:10:31,937][ INFO][PID:1857170] Downloading results from builder [2025-09-10 14:10:31,938][ INFO][PID:1857170] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c10d]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/packit/gitlab.com-CentOS-automotive-src-automotive-image-builder-353/srpm-builds/09543376 started [2025-09-10 14:10:31,940][ INFO][PID:1857170] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c10d]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/packit/gitlab.com-CentOS-automotive-src-automotive-image-builder-353/srpm-builds/09543376/ &> /var/lib/copr/public_html/results/packit/gitlab.com-CentOS-automotive-src-automotive-image-builder-353/srpm-builds/09543376/build-09543376.rsync.log [2025-09-10 14:10:34,207][ INFO][PID:1857170] rsyncing finished. [2025-09-10 14:10:34,208][ INFO][PID:1857170] Releasing VM back to pool [2025-09-10 14:10:34,220][ INFO][PID:1857170] Searching for 'success' file in resultdir [2025-09-10 14:10:34,221][ INFO][PID:1857170] Getting build details [2025-09-10 14:10:34,221][ INFO][PID:1857170] Retrieving SRPM info from /var/lib/copr/public_html/results/packit/gitlab.com-CentOS-automotive-src-automotive-image-builder-353/srpm-builds/09543376 [2025-09-10 14:10:34,222][ INFO][PID:1857170] SRPM URL: https://download.copr.fedorainfracloud.org/results/packit/gitlab.com-CentOS-automotive-src-automotive-image-builder-353/srpm-builds/09543376/automotive-image-builder-1.1.0-0.202509101410.gitfc844c5.src.rpm [2025-09-10 14:10:34,223][ INFO][PID:1857170] build details: {'srpm_url': 'https://download.copr.fedorainfracloud.org/results/packit/gitlab.com-CentOS-automotive-src-automotive-image-builder-353/srpm-builds/09543376/automotive-image-builder-1.1.0-0.202509101410.gitfc844c5.src.rpm', 'pkg_name': 'automotive-image-builder', 'pkg_version': '1.1.0-0.202509101410.gitfc844c5'} [2025-09-10 14:10:34,223][ INFO][PID:1857170] Finished build: id=9543376 failed=False timeout=108000 destdir=/var/lib/copr/public_html/results/packit/gitlab.com-CentOS-automotive-src-automotive-image-builder-353 chroot=srpm-builds [2025-09-10 14:10:34,226][ INFO][PID:1857170] Worker succeeded build, took 82.88161516189575 [2025-09-10 14:10:34,227][ INFO][PID:1857170] Sending build state back to frontend: { "builds": [ { "timeout": 108000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": null, "enable_net": true, "project_owner": "packit", "project_name": "gitlab.com-CentOS-automotive-src-automotive-image-builder-353", "project_dirname": "gitlab.com-CentOS-automotive-src-automotive-image-builder-353", "submitter": "packit", "ended_on": 1757513434.2260365, "started_on": 1757513351.3444214, "submitted_on": null, "status": 1, "chroot": "srpm-builds", "arch": "x86_64", "buildroot_pkgs": null, "task_id": "9543376", "build_id": 9543376, "package_name": null, "package_version": null, "git_repo": null, "git_hash": null, "git_branch": null, "source_type": 9, "source_json": "{\"script\": \"\\n#!/bin/sh\\n\\ngit config --global user.email \\\"hello@packit.dev\\\"\\ngit config --global user.name \\\"Packit\\\"\\nresultdir=$PWD\\npackit -d prepare-sources --result-dir \\\"$resultdir\\\" --pr-id 353 --merge-pr --target-branch main --job-config-index 0 --merged-ref 'main' --no-create-symlinks https://gitlab.com/CentOS/automotive/src/automotive-image-builder\\n\\n\", \"chroot\": \"fedora-42-x86_64\", \"builddeps\": \"packit git jq python3-devel python3-pip rpm-build make\", \"resultdir\": null, \"repos\": \"copr://packit/packit-stable\"}", "pkg_name": "automotive-image-builder", "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": "https://download.copr.fedorainfracloud.org/results/packit/gitlab.com-CentOS-automotive-src-automotive-image-builder-353/srpm-builds/09543376/automotive-image-builder-1.1.0-0.202509101410.gitfc844c5.src.rpm", "uses_devel_repo": null, "sandbox": "packit/gitlab.com-CentOS-automotive-src-automotive-image-builder-353--packit", "results": { "name": "automotive-image-builder", "epoch": null, "version": "1.1.0", "release": "0.202509101410.gitfc844c5", "exclusivearch": [], "excludearch": [] }, "appstream": false, "allow_user_ssh": null, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/packit/packit-stable/fedora-42-x86_64/", "id": "copr_packit_packit_stable", "name": "Additional repo copr_packit_packit_stable" } ], "background": false, "destdir": "/var/lib/copr/public_html/results/packit/gitlab.com-CentOS-automotive-src-automotive-image-builder-353", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/packit/gitlab.com-CentOS-automotive-src-automotive-image-builder-353", "result_dir": "09543376", "built_packages": "", "tags": [ "arch_x86_64" ], "pkg_version": "1.1.0-0.202509101410.gitfc844c5", "id": 9543376, "mockchain_macros": { "copr_username": "packit", "copr_projectname": "gitlab.com-CentOS-automotive-src-automotive-image-builder-353", "vendor": "Fedora Project COPR (packit/gitlab.com-CentOS-automotive-src-automotive-image-builder-353)" } } ] } [2025-09-10 14:10:34,277][ INFO][PID:1857170] Sending fedora-messaging bus message in build.end [2025-09-10 14:10:35,036][ INFO][PID:1857170] Compressing /var/lib/copr/public_html/results/packit/gitlab.com-CentOS-automotive-src-automotive-image-builder-353/srpm-builds/09543376/builder-live.log by gzip [2025-09-10 14:10:35,038][ INFO][PID:1857170] Running command 'gzip /var/lib/copr/public_html/results/packit/gitlab.com-CentOS-automotive-src-automotive-image-builder-353/srpm-builds/09543376/builder-live.log' as PID 1932731 [2025-09-10 14:10:35,048][ INFO][PID:1857170] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/packit/gitlab.com-CentOS-automotive-src-automotive-image-builder-353/srpm-builds/09543376/builder-live.log) [2025-09-10 14:10:35,048][ INFO][PID:1857170] Compressing /var/lib/copr/public_html/results/packit/gitlab.com-CentOS-automotive-src-automotive-image-builder-353/srpm-builds/09543376/backend.log by gzip [2025-09-10 14:10:35,050][ INFO][PID:1857170] Running command 'gzip /var/lib/copr/public_html/results/packit/gitlab.com-CentOS-automotive-src-automotive-image-builder-353/srpm-builds/09543376/backend.log' as PID 1932733