[2026-02-25 15:33:46,032][ INFO][PID:722597] Marking build as starting [2026-02-25 15:33:46,109][ INFO][PID:722597] Checking that /var/lib/copr/public_html/results/hazel-bunny/ports/fedora-42-x86_64/repodata/repomd.xml exists [2026-02-25 15:33:46,110][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:33:46,111][ INFO][PID:722597] VM allocation process starts [2026-02-25 15:33:46,171][ INFO][PID:722597] Trying to allocate VM: ResallocHost, ticket_id=1604162, requested_tags=['copr_builder', 'arch_x86_64'] [2026-02-25 15:33:49,199][ INFO][PID:722597] Allocated host ResallocHost, ticket_id=1604162, hostname=18.207.205.225, name=aws_x86_64_spot_prod_02645444_20260225_153108, requested_tags=['copr_builder', 'arch_x86_64'] [2026-02-25 15:33:49,200][ INFO][PID:722597] Allocating ssh connection to builder [2026-02-25 15:33:49,201][ INFO][PID:722597] Checking that builder machine is OK [2026-02-25 15:33:49,579][ INFO][PID:722597] Running remote command: copr-builder-ready fedora-42-x86_64 [2026-02-25 15:33:49,879][ INFO][PID:722597] Red Hat subscription not needed for fedora-42-x86_64 Builder is ready to be used [2026-02-25 15:33:49,880][ INFO][PID:722597] Filling build.info file with builder info [2026-02-25 15:33:49,881][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:33:49,882][ INFO][PID:722597] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "hazel-bunny", "project_name": "ports", "project_dirname": "ports", "submitter": "hazel-bunny", "ended_on": null, "started_on": 1772033629.8823125, "submitted_on": null, "status": 3, "chroot": "fedora-42-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10168494-fedora-42-x86_64", "build_id": 10168494, "package_name": "yt-dlp-ejs", "package_version": "0.5.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/hazel-bunny/ports/yt-dlp-ejs", "git_hash": "f8ebc9300a8937e14fab0434bcb1da290419736f", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "hazel-bunny/ports--hazel-bunny", "results": null, "appstream": true, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/hazel-bunny/ports/fedora-42-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/hazel-bunny/ports", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/hazel-bunny/ports", "result_dir": "10168494-yt-dlp-ejs", "built_packages": "", "id": 10168494, "mockchain_macros": { "copr_username": "hazel-bunny", "copr_projectname": "ports", "vendor": "Fedora Project COPR (hazel-bunny/ports)" } } ] } [2026-02-25 15:33:49,980][ INFO][PID:722597] Sending fedora-messaging bus message in build.start [2026-02-25 15:33:51,104][ INFO][PID:722597] Sending fedora-messaging bus message in chroot.start [2026-02-25 15:33:51,181][ INFO][PID:722597] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10168494-fedora-42-x86_64 --chroot fedora-42-x86_64 --detached [2026-02-25 15:33:51,570][ INFO][PID:722597] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '18.207.205.225' (ED25519) to the list of known hosts. [2026-02-25 15:33:51,577][ INFO][PID:722597] Downloading the builder-live.log file, attempt 1 [2026-02-25 15:33:51,582][ INFO][PID:722597] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@18.207.205.225 copr-rpmbuild-log [2026-02-25 15:33:56,593][ INFO][PID:722597] Periodic builder liveness probe: alive [2026-02-25 15:33:56,594][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:34:01,595][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:34:06,597][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:34:11,598][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:34:16,599][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:34:21,600][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:34:21,726][ ERROR][PID:722597] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-02-25 15:34:26,602][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:34:31,603][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:34:31,727][WARNING][PID:722597] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-02-25 15:34:36,608][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:34:41,609][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:34:41,728][ INFO][PID:722597] Downloading the builder-live.log file, attempt 2 [2026-02-25 15:34:41,730][ INFO][PID:722597] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@18.207.205.225 copr-rpmbuild-log [2026-02-25 15:34:46,610][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:34:51,613][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:34:56,614][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:35:01,615][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:35:06,617][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:35:11,627][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:35:16,629][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:35:21,630][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:35:26,631][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:35:31,632][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:35:36,634][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:35:41,636][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:35:41,795][ ERROR][PID:722597] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-02-25 15:35:46,637][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:35:51,638][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:35:51,798][WARNING][PID:722597] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-02-25 15:35:56,640][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:36:01,641][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:36:01,799][ INFO][PID:722597] Downloading the builder-live.log file, attempt 3 [2026-02-25 15:36:01,803][ INFO][PID:722597] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@18.207.205.225 copr-rpmbuild-log [2026-02-25 15:36:06,642][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:36:11,644][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:36:16,645][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:36:21,647][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:36:26,648][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:36:31,649][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:36:36,653][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:36:41,655][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:36:46,657][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:36:51,659][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:36:56,666][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:37:01,667][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:37:01,858][ ERROR][PID:722597] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-02-25 15:37:06,668][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:37:11,669][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:37:11,865][WARNING][PID:722597] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-02-25 15:37:16,673][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:37:21,680][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:37:21,866][ INFO][PID:722597] Downloading the builder-live.log file, attempt 4 [2026-02-25 15:37:21,868][ INFO][PID:722597] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@18.207.205.225 copr-rpmbuild-log [2026-02-25 15:37:26,681][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:37:31,683][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:37:36,684][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:37:41,685][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:37:46,686][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:37:51,689][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:37:56,690][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:38:01,691][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:38:06,692][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:38:11,693][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:38:16,694][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:38:21,696][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:38:21,938][ ERROR][PID:722597] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-02-25 15:38:26,697][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:38:31,700][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:38:31,950][ ERROR][PID:722597] Giving up for unstable SSH, failures: 1772033671.7278435, 1772033751.7985106, 1772033831.8657343, 1772033911.9506254 [2026-02-25 15:38:31,951][ ERROR][PID:722597] Re-try request for task on 'ResallocHost, ticket_id=1604162, hostname=18.207.205.225, name=aws_x86_64_spot_prod_02645444_20260225_153108, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-02-25 15:38:31,952][ INFO][PID:722597] Releasing VM back to pool [2026-02-25 15:38:31,965][ INFO][PID:722597] Retry #1 (on other host) [2026-02-25 15:38:31,965][ INFO][PID:722597] Checking that /var/lib/copr/public_html/results/hazel-bunny/ports/fedora-42-x86_64/repodata/repomd.xml exists [2026-02-25 15:38:31,966][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:38:31,968][ INFO][PID:722597] VM allocation process starts [2026-02-25 15:38:31,981][ INFO][PID:722597] Trying to allocate VM: ResallocHost, ticket_id=1604252, requested_tags=['copr_builder', 'arch_x86_64'] [2026-02-25 15:38:35,008][ INFO][PID:722597] Allocated host ResallocHost, ticket_id=1604252, hostname=2620:52:6:1161:dead:beef:cafe:c1d0, name=vmhost_x86_04_prod_02645794_20260225_153641, requested_tags=['copr_builder', 'arch_x86_64'] [2026-02-25 15:38:35,009][ INFO][PID:722597] Allocating ssh connection to builder [2026-02-25 15:38:35,013][ INFO][PID:722597] Checking that builder machine is OK [2026-02-25 15:38:35,673][ INFO][PID:722597] Running remote command: copr-builder-ready fedora-42-x86_64 [2026-02-25 15:38:36,073][ INFO][PID:722597] Red Hat subscription not needed for fedora-42-x86_64 Builder is ready to be used [2026-02-25 15:38:36,074][ INFO][PID:722597] Filling build.info file with builder info [2026-02-25 15:38:36,089][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:38:36,093][ INFO][PID:722597] Not re-notifying FE and msg buses for the new host. [2026-02-25 15:38:36,094][ INFO][PID:722597] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10168494-fedora-42-x86_64 --chroot fedora-42-x86_64 --detached [2026-02-25 15:38:36,802][ INFO][PID:722597] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c1d0' (ED25519) to the list of known hosts. [2026-02-25 15:38:36,803][ INFO][PID:722597] Downloading the builder-live.log file, attempt 1 [2026-02-25 15:38:36,805][ INFO][PID:722597] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c1d0 copr-rpmbuild-log [2026-02-25 15:38:41,804][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:38:46,807][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:38:51,809][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:38:56,815][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:39:01,817][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:39:06,819][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:39:11,822][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:39:16,823][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:39:21,825][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:39:26,832][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:39:31,841][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:39:36,843][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:39:41,844][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:39:46,849][ INFO][PID:722597] Checking for cancel request [2026-02-25 15:39:49,087][ INFO][PID:722597] Downloading results from builder [2026-02-25 15:39:49,087][ INFO][PID:722597] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c1d0]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/hazel-bunny/ports/fedora-42-x86_64/10168494-yt-dlp-ejs started [2026-02-25 15:39:49,090][ INFO][PID:722597] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c1d0]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/hazel-bunny/ports/fedora-42-x86_64/10168494-yt-dlp-ejs/ &> /var/lib/copr/public_html/results/hazel-bunny/ports/fedora-42-x86_64/10168494-yt-dlp-ejs/build-10168494.rsync.log [2026-02-25 15:39:49,746][ INFO][PID:722597] rsyncing finished. [2026-02-25 15:39:49,748][ INFO][PID:722597] Releasing VM back to pool [2026-02-25 15:39:49,773][ INFO][PID:722597] Searching for 'success' file in resultdir [2026-02-25 15:39:49,774][ INFO][PID:722597] Going to sign pkgs from source: 10168494-fedora-42-x86_64 in chroot: /var/lib/copr/public_html/results/hazel-bunny/ports/fedora-42-x86_64 [2026-02-25 15:39:49,774][ INFO][PID:722597] Calling '/bin/sign -u hazel-bunny#ports@copr.fedorahosted.org -p' (attempt #1) [2026-02-25 15:39:50,055][ INFO][PID:722597] Calling '/bin/sign -4 -h sha256 -u hazel-bunny#ports@copr.fedorahosted.org -r /var/lib/copr/public_html/results/hazel-bunny/ports/fedora-42-x86_64/10168494-yt-dlp-ejs/yt-dlp-ejs-0.5.0-1.fc42.src.rpm' (attempt #1) [2026-02-25 15:39:50,569][ INFO][PID:722597] signed rpm: /var/lib/copr/public_html/results/hazel-bunny/ports/fedora-42-x86_64/10168494-yt-dlp-ejs/yt-dlp-ejs-0.5.0-1.fc42.src.rpm [2026-02-25 15:39:50,571][ INFO][PID:722597] Calling '/bin/sign -4 -h sha256 -u hazel-bunny#ports@copr.fedorahosted.org -r /var/lib/copr/public_html/results/hazel-bunny/ports/fedora-42-x86_64/10168494-yt-dlp-ejs/yt-dlp-ejs-0.5.0-1.fc42.noarch.rpm' (attempt #1) [2026-02-25 15:39:51,223][ INFO][PID:722597] signed rpm: /var/lib/copr/public_html/results/hazel-bunny/ports/fedora-42-x86_64/10168494-yt-dlp-ejs/yt-dlp-ejs-0.5.0-1.fc42.noarch.rpm [2026-02-25 15:39:51,224][ INFO][PID:722597] Sign done [2026-02-25 15:39:51,225][ INFO][PID:722597] Incremental createrepo run, adding 10168494-yt-dlp-ejs into https://download.copr.fedorainfracloud.org/results/hazel-bunny/ports/fedora-42-x86_64, (auto-create-repo=True) [2026-02-25 15:39:51,226][ INFO][PID:722597] Running command 'copr-repo --batched /var/lib/copr/public_html/results/hazel-bunny/ports/fedora-42-x86_64 --add 10168494-yt-dlp-ejs' as PID 776028 [2026-02-25 15:40:09,495][ INFO][PID:722597] Finished after 18 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/hazel-bunny/ports/fedora-42-x86_64 --add 10168494-yt-dlp-ejs) [2026-02-25 15:40:09,497][ INFO][PID:722597] Getting build details [2026-02-25 15:40:09,501][ INFO][PID:722597] Listing built binary packages in /var/lib/copr/public_html/results/hazel-bunny/ports/fedora-42-x86_64/10168494-yt-dlp-ejs [2026-02-25 15:40:09,508][ INFO][PID:722597] Built packages: ['yt-dlp-ejs 0.5.0'] [2026-02-25 15:40:09,514][ INFO][PID:722597] build details: {'built_packages': 'yt-dlp-ejs 0.5.0'} [2026-02-25 15:40:09,520][ INFO][PID:722597] Retrieving pubkey [2026-02-25 15:40:09,523][ INFO][PID:722597] Calling '/bin/sign -u hazel-bunny#ports@copr.fedorahosted.org -p' (attempt #1) [2026-02-25 15:40:09,758][ INFO][PID:722597] Added pubkey for user hazel-bunny project ports into: /var/lib/copr/public_html/results/hazel-bunny/ports/pubkey.gpg [2026-02-25 15:40:09,761][ INFO][PID:722597] Finished build: id=10168494 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/hazel-bunny/ports chroot=fedora-42-x86_64 [2026-02-25 15:40:09,775][ INFO][PID:722597] Worker succeeded build, took 93.68232989311218 [2026-02-25 15:40:09,787][ INFO][PID:722597] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "hazel-bunny", "project_name": "ports", "project_dirname": "ports", "submitter": "hazel-bunny", "ended_on": 1772034009.7755947, "started_on": 1772033916.0932648, "submitted_on": null, "status": 1, "chroot": "fedora-42-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10168494-fedora-42-x86_64", "build_id": 10168494, "package_name": "yt-dlp-ejs", "package_version": "0.5.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/hazel-bunny/ports/yt-dlp-ejs", "git_hash": "f8ebc9300a8937e14fab0434bcb1da290419736f", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "hazel-bunny/ports--hazel-bunny", "results": { "packages": [ { "name": "yt-dlp-ejs", "epoch": null, "version": "0.5.0", "release": "1.fc42", "arch": "noarch" }, { "name": "yt-dlp-ejs", "epoch": null, "version": "0.5.0", "release": "1.fc42", "arch": "src" } ] }, "appstream": true, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/hazel-bunny/ports/fedora-42-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/hazel-bunny/ports", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/hazel-bunny/ports", "result_dir": "10168494-yt-dlp-ejs", "built_packages": "yt-dlp-ejs 0.5.0", "id": 10168494, "mockchain_macros": { "copr_username": "hazel-bunny", "copr_projectname": "ports", "vendor": "Fedora Project COPR (hazel-bunny/ports)" } } ] } [2026-02-25 15:40:09,879][ INFO][PID:722597] Sending fedora-messaging bus message in build.end [2026-02-25 15:40:09,917][ INFO][PID:722597] Compressing /var/lib/copr/public_html/results/hazel-bunny/ports/fedora-42-x86_64/10168494-yt-dlp-ejs/builder-live.log by gzip [2026-02-25 15:40:09,918][ INFO][PID:722597] Running command 'gzip /var/lib/copr/public_html/results/hazel-bunny/ports/fedora-42-x86_64/10168494-yt-dlp-ejs/builder-live.log' as PID 781500 [2026-02-25 15:40:09,962][ INFO][PID:722597] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/hazel-bunny/ports/fedora-42-x86_64/10168494-yt-dlp-ejs/builder-live.log) [2026-02-25 15:40:09,963][ INFO][PID:722597] Compressing /var/lib/copr/public_html/results/hazel-bunny/ports/fedora-42-x86_64/10168494-yt-dlp-ejs/backend.log by gzip [2026-02-25 15:40:09,968][ INFO][PID:722597] Running command 'gzip /var/lib/copr/public_html/results/hazel-bunny/ports/fedora-42-x86_64/10168494-yt-dlp-ejs/backend.log' as PID 781514