[2024-11-21 16:54:47,626][ INFO][PID:596559] Marking build as starting [2024-11-21 16:54:47,701][ INFO][PID:596559] Trying to allocate VM [2024-11-21 16:54:50,741][ INFO][PID:596559] Allocated host ResallocHost, ticket_id=6004290, hostname=3.238.245.199 [2024-11-21 16:54:50,742][ INFO][PID:596559] Allocating ssh connection to builder [2024-11-21 16:54:50,743][ INFO][PID:596559] Checking that builder machine is OK [2024-11-21 16:54:51,085][ INFO][PID:596559] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2024-11-21 16:54:51,292][ INFO][PID:596559] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2024-11-21 16:54:51,293][ INFO][PID:596559] Filling build.info file with builder info [2024-11-21 16:54:51,294][ INFO][PID:596559] Sending build state back to frontend: { "builds": [ { "timeout": 115200, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "fberat", "project_name": "automake-1.17_1", "project_dirname": "automake-1.17_1", "submitter": "fberat", "ended_on": null, "started_on": 1732208091.2943969, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "8296271-fedora-rawhide-x86_64", "build_id": 8296271, "package_name": "guile30", "package_version": "3.0.9-3", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/fberat/automake-1.17_1/guile30", "git_hash": "6fab670aa7a9329d06070cd52e29d08fed8ed8e9", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "fberat/automake-1.17_1--fberat", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/fberat/automake-1.17_1/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/fberat/automake-1.17_1", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/fberat/automake-1.17_1", "result_dir": "08296271-guile30", "built_packages": "", "id": 8296271, "mockchain_macros": { "copr_username": "fberat", "copr_projectname": "automake-1.17_1", "vendor": "Fedora Project COPR (fberat/automake-1.17_1)" } } ] } [2024-11-21 16:54:51,343][ INFO][PID:596559] Sending fedora-messaging bus message in build.start [2024-11-21 16:54:52,057][ INFO][PID:596559] Sending fedora-messaging bus message in chroot.start [2024-11-21 16:54:52,077][ INFO][PID:596559] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/8296271-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2024-11-21 16:54:52,417][ INFO][PID:596559] Downloading the builder-live.log file, attempt 1 [2024-11-21 16:54:52,419][ INFO][PID:596559] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.238.245.199 copr-rpmbuild-log [2024-11-21 16:54:57,431][ INFO][PID:596559] Periodic builder liveness probe: alive [2024-11-21 16:58:18,590][ ERROR][PID:596559] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2024-11-21 16:58:28,591][WARNING][PID:596559] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2024-11-21 16:58:38,592][ INFO][PID:596559] Downloading the builder-live.log file, attempt 2 [2024-11-21 16:58:38,594][ INFO][PID:596559] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.238.245.199 copr-rpmbuild-log [2024-11-21 16:59:38,661][ ERROR][PID:596559] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2024-11-21 16:59:48,671][WARNING][PID:596559] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2024-11-21 16:59:58,673][ INFO][PID:596559] Downloading the builder-live.log file, attempt 3 [2024-11-21 16:59:58,674][ INFO][PID:596559] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.238.245.199 copr-rpmbuild-log [2024-11-21 17:00:58,743][ ERROR][PID:596559] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2024-11-21 17:01:08,749][WARNING][PID:596559] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2024-11-21 17:01:18,749][ INFO][PID:596559] Downloading the builder-live.log file, attempt 4 [2024-11-21 17:01:18,751][ INFO][PID:596559] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.238.245.199 copr-rpmbuild-log [2024-11-21 17:02:18,819][ ERROR][PID:596559] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2024-11-21 17:02:28,821][ ERROR][PID:596559] Giving up for unstable SSH, failures: 1732208308.5917537, 1732208388.6717138, 1732208468.7489984, 1732208548.8209934 [2024-11-21 17:02:28,822][ ERROR][PID:596559] Re-try request for task on 'ResallocHost, ticket_id=6004290, hostname=3.238.245.199': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2024-11-21 17:02:28,822][ INFO][PID:596559] Releasing VM back to pool [2024-11-21 17:02:28,842][ INFO][PID:596559] Retry #1 (on other host) [2024-11-21 17:02:28,843][ INFO][PID:596559] Trying to allocate VM [2024-11-21 17:02:56,907][ INFO][PID:596559] Allocated host ResallocHost, ticket_id=6004457, hostname=54.147.117.0 [2024-11-21 17:02:56,908][ INFO][PID:596559] Allocating ssh connection to builder [2024-11-21 17:02:56,908][ INFO][PID:596559] Checking that builder machine is OK [2024-11-21 17:02:57,102][ INFO][PID:596559] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2024-11-21 17:02:57,315][ INFO][PID:596559] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2024-11-21 17:02:57,316][ INFO][PID:596559] Filling build.info file with builder info [2024-11-21 17:02:57,330][ INFO][PID:596559] Not re-notifying FE and msg buses for the new host. [2024-11-21 17:02:57,331][ INFO][PID:596559] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/8296271-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2024-11-21 17:02:57,692][ INFO][PID:596559] Downloading the builder-live.log file, attempt 1 [2024-11-21 17:02:57,694][ INFO][PID:596559] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.147.117.0 copr-rpmbuild-log [2024-11-21 17:04:57,716][ INFO][PID:596559] Periodic builder liveness probe: alive [2024-11-21 17:14:57,870][ INFO][PID:596559] Periodic builder liveness probe: alive [2024-11-21 17:21:39,146][ INFO][PID:596559] Downloading results from builder [2024-11-21 17:21:39,147][ INFO][PID:596559] rsyncing of mockbuilder@54.147.117.0:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/fberat/automake-1.17_1/fedora-rawhide-x86_64/08296271-guile30 started [2024-11-21 17:21:39,148][ INFO][PID:596559] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@54.147.117.0:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/fberat/automake-1.17_1/fedora-rawhide-x86_64/08296271-guile30/ &> /var/lib/copr/public_html/results/fberat/automake-1.17_1/fedora-rawhide-x86_64/08296271-guile30/build-08296271.rsync.log [2024-11-21 17:21:39,506][ INFO][PID:596559] rsyncing finished. [2024-11-21 17:21:39,506][ INFO][PID:596559] Releasing VM back to pool [2024-11-21 17:21:39,516][ INFO][PID:596559] Searching for 'success' file in resultdir [2024-11-21 17:21:39,517][ INFO][PID:596559] Going to sign pkgs from source: 8296271-fedora-rawhide-x86_64 in chroot: /var/lib/copr/public_html/results/fberat/automake-1.17_1/fedora-rawhide-x86_64 [2024-11-21 17:21:39,518][ INFO][PID:596559] Calling '/bin/sign -u fberat#automake-1.17_1@copr.fedorahosted.org -p' (attempt #1) [2024-11-21 17:21:39,693][ INFO][PID:596559] Calling '/bin/sign -4 -h sha256 -u fberat#automake-1.17_1@copr.fedorahosted.org -r /var/lib/copr/public_html/results/fberat/automake-1.17_1/fedora-rawhide-x86_64/08296271-guile30/guile30-3.0.9-3.fc42.x86_64.rpm' (attempt #1) [2024-11-21 17:21:40,523][ INFO][PID:596559] signed rpm: /var/lib/copr/public_html/results/fberat/automake-1.17_1/fedora-rawhide-x86_64/08296271-guile30/guile30-3.0.9-3.fc42.x86_64.rpm [2024-11-21 17:21:40,523][ INFO][PID:596559] Calling '/bin/sign -4 -h sha256 -u fberat#automake-1.17_1@copr.fedorahosted.org -r /var/lib/copr/public_html/results/fberat/automake-1.17_1/fedora-rawhide-x86_64/08296271-guile30/guile30-debuginfo-3.0.9-3.fc42.x86_64.rpm' (attempt #1) [2024-11-21 17:21:41,437][ INFO][PID:596559] signed rpm: /var/lib/copr/public_html/results/fberat/automake-1.17_1/fedora-rawhide-x86_64/08296271-guile30/guile30-debuginfo-3.0.9-3.fc42.x86_64.rpm [2024-11-21 17:21:41,438][ INFO][PID:596559] Calling '/bin/sign -4 -h sha256 -u fberat#automake-1.17_1@copr.fedorahosted.org -r /var/lib/copr/public_html/results/fberat/automake-1.17_1/fedora-rawhide-x86_64/08296271-guile30/guile30-3.0.9-3.fc42.src.rpm' (attempt #1) [2024-11-21 17:21:42,268][ INFO][PID:596559] signed rpm: /var/lib/copr/public_html/results/fberat/automake-1.17_1/fedora-rawhide-x86_64/08296271-guile30/guile30-3.0.9-3.fc42.src.rpm [2024-11-21 17:21:42,269][ INFO][PID:596559] Calling '/bin/sign -4 -h sha256 -u fberat#automake-1.17_1@copr.fedorahosted.org -r /var/lib/copr/public_html/results/fberat/automake-1.17_1/fedora-rawhide-x86_64/08296271-guile30/guile30-devel-3.0.9-3.fc42.x86_64.rpm' (attempt #1) [2024-11-21 17:21:43,082][ INFO][PID:596559] signed rpm: /var/lib/copr/public_html/results/fberat/automake-1.17_1/fedora-rawhide-x86_64/08296271-guile30/guile30-devel-3.0.9-3.fc42.x86_64.rpm [2024-11-21 17:21:43,082][ INFO][PID:596559] Calling '/bin/sign -4 -h sha256 -u fberat#automake-1.17_1@copr.fedorahosted.org -r /var/lib/copr/public_html/results/fberat/automake-1.17_1/fedora-rawhide-x86_64/08296271-guile30/guile30-debugsource-3.0.9-3.fc42.x86_64.rpm' (attempt #1) [2024-11-21 17:21:43,784][ INFO][PID:596559] signed rpm: /var/lib/copr/public_html/results/fberat/automake-1.17_1/fedora-rawhide-x86_64/08296271-guile30/guile30-debugsource-3.0.9-3.fc42.x86_64.rpm [2024-11-21 17:21:43,785][ INFO][PID:596559] Sign done [2024-11-21 17:21:43,785][ INFO][PID:596559] Incremental createrepo run, adding 08296271-guile30 into https://download.copr.fedorainfracloud.org/results/fberat/automake-1.17_1/fedora-rawhide-x86_64, (auto-create-repo=True) [2024-11-21 17:21:43,786][ INFO][PID:596559] Running command 'copr-repo --batched /var/lib/copr/public_html/results/fberat/automake-1.17_1/fedora-rawhide-x86_64 --add 08296271-guile30 --no-appstream-metadata' as PID 757747 [2024-11-21 17:21:47,214][ INFO][PID:596559] Finished after 3 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/fberat/automake-1.17_1/fedora-rawhide-x86_64 --add 08296271-guile30 --no-appstream-metadata) [2024-11-21 17:21:47,215][ INFO][PID:596559] Getting build details [2024-11-21 17:21:47,216][ INFO][PID:596559] Listing built binary packages in /var/lib/copr/public_html/results/fberat/automake-1.17_1/fedora-rawhide-x86_64/08296271-guile30 [2024-11-21 17:21:47,216][ INFO][PID:596559] Built packages: ['guile30-debuginfo 3.0.9', 'guile30-debugsource 3.0.9', 'guile30 3.0.9', 'guile30-devel 3.0.9'] [2024-11-21 17:21:47,217][ INFO][PID:596559] build details: {'built_packages': 'guile30-debuginfo 3.0.9\nguile30-debugsource 3.0.9\nguile30 3.0.9\nguile30-devel 3.0.9'} [2024-11-21 17:21:47,217][ INFO][PID:596559] Retrieving pubkey [2024-11-21 17:21:47,218][ INFO][PID:596559] Calling '/bin/sign -u fberat#automake-1.17_1@copr.fedorahosted.org -p' (attempt #1) [2024-11-21 17:21:47,549][ INFO][PID:596559] Added pubkey for user fberat project automake-1.17_1 into: /var/lib/copr/public_html/results/fberat/automake-1.17_1/pubkey.gpg [2024-11-21 17:21:47,549][ INFO][PID:596559] Finished build: id=8296271 failed=False timeout=115200 destdir=/var/lib/copr/public_html/results/fberat/automake-1.17_1 chroot=fedora-rawhide-x86_64 [2024-11-21 17:21:47,552][ INFO][PID:596559] Worker succeeded build, took 1130.2215197086334 [2024-11-21 17:21:47,553][ INFO][PID:596559] Sending build state back to frontend: { "builds": [ { "timeout": 115200, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "fberat", "project_name": "automake-1.17_1", "project_dirname": "automake-1.17_1", "submitter": "fberat", "ended_on": 1732209707.5522625, "started_on": 1732208577.3307428, "submitted_on": null, "status": 1, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "8296271-fedora-rawhide-x86_64", "build_id": 8296271, "package_name": "guile30", "package_version": "3.0.9-3", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/fberat/automake-1.17_1/guile30", "git_hash": "6fab670aa7a9329d06070cd52e29d08fed8ed8e9", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "fberat/automake-1.17_1--fberat", "results": { "packages": [ { "name": "guile30", "epoch": null, "version": "3.0.9", "release": "3.fc42", "arch": "src" }, { "name": "guile30-debuginfo", "epoch": null, "version": "3.0.9", "release": "3.fc42", "arch": "x86_64" }, { "name": "guile30-debugsource", "epoch": null, "version": "3.0.9", "release": "3.fc42", "arch": "x86_64" }, { "name": "guile30", "epoch": null, "version": "3.0.9", "release": "3.fc42", "arch": "x86_64" }, { "name": "guile30-devel", "epoch": null, "version": "3.0.9", "release": "3.fc42", "arch": "x86_64" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/fberat/automake-1.17_1/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/fberat/automake-1.17_1", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/fberat/automake-1.17_1", "result_dir": "08296271-guile30", "built_packages": "guile30-debuginfo 3.0.9\nguile30-debugsource 3.0.9\nguile30 3.0.9\nguile30-devel 3.0.9", "id": 8296271, "mockchain_macros": { "copr_username": "fberat", "copr_projectname": "automake-1.17_1", "vendor": "Fedora Project COPR (fberat/automake-1.17_1)" } } ] } [2024-11-21 17:21:47,628][ INFO][PID:596559] Sending fedora-messaging bus message in build.end [2024-11-21 17:21:47,653][ INFO][PID:596559] Compressing /var/lib/copr/public_html/results/fberat/automake-1.17_1/fedora-rawhide-x86_64/08296271-guile30/builder-live.log by gzip [2024-11-21 17:21:47,655][ INFO][PID:596559] Running command 'gzip /var/lib/copr/public_html/results/fberat/automake-1.17_1/fedora-rawhide-x86_64/08296271-guile30/builder-live.log' as PID 758103 [2024-11-21 17:21:47,684][ INFO][PID:596559] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/fberat/automake-1.17_1/fedora-rawhide-x86_64/08296271-guile30/builder-live.log) [2024-11-21 17:21:47,684][ INFO][PID:596559] Compressing /var/lib/copr/public_html/results/fberat/automake-1.17_1/fedora-rawhide-x86_64/08296271-guile30/backend.log by gzip