[2026-01-13 17:57:39,897][ INFO][PID:759884] Marking build as starting [2026-01-13 17:57:40,081][ INFO][PID:759884] Checking that /var/lib/copr/public_html/results/burningpho3nix/private-projects/almalinux-10-x86_64_v2/repodata/repomd.xml exists [2026-01-13 17:57:40,082][ INFO][PID:759884] Checking for cancel request [2026-01-13 17:57:40,083][ INFO][PID:759884] VM allocation process starts [2026-01-13 17:57:40,093][ INFO][PID:759884] Trying to allocate VM: ResallocHost, ticket_id=797673, requested_tags=['copr_builder', 'arch_x86_64_v2'] [2026-01-13 17:57:43,104][ INFO][PID:759884] Allocated host ResallocHost, ticket_id=797673, hostname=98.81.130.229, name=aws_x86_64_spot_prod_01205292_20260113_173657, requested_tags=['copr_builder', 'arch_x86_64_v2'] [2026-01-13 17:57:43,105][ INFO][PID:759884] Allocating ssh connection to builder [2026-01-13 17:57:43,105][ INFO][PID:759884] Checking that builder machine is OK [2026-01-13 17:58:43,163][ ERROR][PID:759884] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 98.81.130.229 port 22: Connection timed out [2026-01-13 17:58:53,164][ ERROR][PID:759884] Re-try request for task on 'ResallocHost, ticket_id=797673, hostname=98.81.130.229, name=aws_x86_64_spot_prod_01205292_20260113_173657, requested_tags=['copr_builder', 'arch_x86_64_v2']': Unable to finish after 1 SSH attempts [2026-01-13 17:58:53,164][ INFO][PID:759884] Releasing VM back to pool [2026-01-13 17:58:53,177][ INFO][PID:759884] Retry #1 (on other host) [2026-01-13 17:58:53,178][ INFO][PID:759884] Checking that /var/lib/copr/public_html/results/burningpho3nix/private-projects/almalinux-10-x86_64_v2/repodata/repomd.xml exists [2026-01-13 17:58:53,180][ INFO][PID:759884] Checking for cancel request [2026-01-13 17:58:53,186][ INFO][PID:759884] VM allocation process starts [2026-01-13 17:58:53,198][ INFO][PID:759884] Trying to allocate VM: ResallocHost, ticket_id=797696, requested_tags=['copr_builder', 'arch_x86_64_v2'] [2026-01-13 17:58:58,200][ INFO][PID:759884] Checking for cancel request [2026-01-13 17:59:03,201][ INFO][PID:759884] Checking for cancel request [2026-01-13 17:59:05,229][ INFO][PID:759884] Allocated host ResallocHost, ticket_id=797696, hostname=98.91.243.61, name=aws_x86_64_spot_prod_01205208_20260113_173445, requested_tags=['copr_builder', 'arch_x86_64_v2'] [2026-01-13 17:59:05,230][ INFO][PID:759884] Allocating ssh connection to builder [2026-01-13 17:59:05,230][ INFO][PID:759884] Checking that builder machine is OK [2026-01-13 18:00:05,299][ ERROR][PID:759884] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 98.91.243.61 port 22: Connection timed out [2026-01-13 18:00:15,311][ ERROR][PID:759884] Re-try request for task on 'ResallocHost, ticket_id=797696, hostname=98.91.243.61, name=aws_x86_64_spot_prod_01205208_20260113_173445, requested_tags=['copr_builder', 'arch_x86_64_v2']': Unable to finish after 1 SSH attempts [2026-01-13 18:00:15,312][ INFO][PID:759884] Releasing VM back to pool [2026-01-13 18:00:15,326][ INFO][PID:759884] Retry #2 (on other host) [2026-01-13 18:00:15,326][ INFO][PID:759884] Checking that /var/lib/copr/public_html/results/burningpho3nix/private-projects/almalinux-10-x86_64_v2/repodata/repomd.xml exists [2026-01-13 18:00:15,327][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:00:15,327][ INFO][PID:759884] VM allocation process starts [2026-01-13 18:00:15,338][ INFO][PID:759884] Trying to allocate VM: ResallocHost, ticket_id=797709, requested_tags=['copr_builder', 'arch_x86_64_v2'] [2026-01-13 18:00:20,339][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:00:25,340][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:00:30,341][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:00:35,342][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:00:40,343][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:00:45,344][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:00:50,345][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:00:55,346][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:01:00,347][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:01:05,349][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:01:10,351][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:01:15,352][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:01:20,354][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:01:23,427][ INFO][PID:759884] Allocated host ResallocHost, ticket_id=797709, hostname=3.85.95.67, name=aws_x86_64_normalreserved_prod_01205553_20260113_175540, requested_tags=['copr_builder', 'arch_x86_64_v2'] [2026-01-13 18:01:23,429][ INFO][PID:759884] Allocating ssh connection to builder [2026-01-13 18:01:23,431][ INFO][PID:759884] Checking that builder machine is OK [2026-01-13 18:01:23,753][ INFO][PID:759884] Running remote command: copr-builder-ready almalinux-10-x86_64_v2 [2026-01-13 18:01:23,950][ INFO][PID:759884] Red Hat subscription not needed for almalinux-10-x86_64_v2 Builder is ready to be used [2026-01-13 18:01:23,951][ INFO][PID:759884] Filling build.info file with builder info [2026-01-13 18:01:23,953][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:01:23,954][ INFO][PID:759884] Not re-notifying FE and msg buses for the new host. [2026-01-13 18:01:23,954][ INFO][PID:759884] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10004951-almalinux-10-x86_64_v2 --chroot almalinux-10-x86_64_v2 --detached [2026-01-13 18:01:24,275][ INFO][PID:759884] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '3.85.95.67' (ED25519) to the list of known hosts. [2026-01-13 18:01:24,276][ INFO][PID:759884] Downloading the builder-live.log file, attempt 1 [2026-01-13 18:01:24,278][ INFO][PID:759884] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.85.95.67 copr-rpmbuild-log [2026-01-13 18:01:29,285][ INFO][PID:759884] Periodic builder liveness probe: alive [2026-01-13 18:01:29,286][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:01:34,288][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:01:39,289][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:01:44,291][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:01:49,293][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:01:54,295][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:01:59,297][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:02:04,299][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:02:09,462][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:02:14,463][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:02:19,464][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:02:24,465][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:02:29,466][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:02:34,467][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:02:39,469][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:02:44,470][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:02:49,472][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:02:54,475][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:02:59,478][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:03:04,479][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:03:09,480][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:03:14,481][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:03:19,482][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:03:24,483][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:03:29,484][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:03:34,486][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:03:39,487][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:03:44,488][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:03:49,491][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:03:54,500][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:03:59,501][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:04:04,502][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:04:09,503][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:04:14,508][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:04:19,509][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:04:24,510][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:04:29,511][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:04:34,513][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:04:39,514][ INFO][PID:759884] Checking for cancel request [2026-01-13 18:04:41,480][ INFO][PID:759884] Downloading results from builder [2026-01-13 18:04:41,480][ INFO][PID:759884] rsyncing of mockbuilder@3.85.95.67:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/burningpho3nix/private-projects/almalinux-10-x86_64_v2/10004951-repogoon started [2026-01-13 18:04:41,481][ INFO][PID:759884] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@3.85.95.67:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/burningpho3nix/private-projects/almalinux-10-x86_64_v2/10004951-repogoon/ &> /var/lib/copr/public_html/results/burningpho3nix/private-projects/almalinux-10-x86_64_v2/10004951-repogoon/build-10004951.rsync.log [2026-01-13 18:04:42,128][ INFO][PID:759884] rsyncing finished. [2026-01-13 18:04:42,129][ INFO][PID:759884] Releasing VM back to pool [2026-01-13 18:04:42,139][ INFO][PID:759884] Searching for 'success' file in resultdir [2026-01-13 18:04:42,140][ INFO][PID:759884] Going to sign pkgs from source: 10004951-almalinux-10-x86_64_v2 in chroot: /var/lib/copr/public_html/results/burningpho3nix/private-projects/almalinux-10-x86_64_v2 [2026-01-13 18:04:42,140][ INFO][PID:759884] Calling '/bin/sign -u burningpho3nix#private-projects@copr.fedorahosted.org -p' (attempt #1) [2026-01-13 18:04:42,417][ INFO][PID:759884] Calling '/bin/sign -4 -h sha256 -u burningpho3nix#private-projects@copr.fedorahosted.org -r /var/lib/copr/public_html/results/burningpho3nix/private-projects/almalinux-10-x86_64_v2/10004951-repogoon/repogoon-0.6.2-20260113.src.rpm' (attempt #1) [2026-01-13 18:04:44,716][ INFO][PID:759884] signed rpm: /var/lib/copr/public_html/results/burningpho3nix/private-projects/almalinux-10-x86_64_v2/10004951-repogoon/repogoon-0.6.2-20260113.src.rpm [2026-01-13 18:04:44,718][ INFO][PID:759884] Calling '/bin/sign -4 -h sha256 -u burningpho3nix#private-projects@copr.fedorahosted.org -r /var/lib/copr/public_html/results/burningpho3nix/private-projects/almalinux-10-x86_64_v2/10004951-repogoon/repogoon-0.6.2-20260113.x86_64_v2.rpm' (attempt #1) [2026-01-13 18:04:46,153][ INFO][PID:759884] signed rpm: /var/lib/copr/public_html/results/burningpho3nix/private-projects/almalinux-10-x86_64_v2/10004951-repogoon/repogoon-0.6.2-20260113.x86_64_v2.rpm [2026-01-13 18:04:46,156][ INFO][PID:759884] Sign done [2026-01-13 18:04:46,157][ INFO][PID:759884] Incremental createrepo run, adding 10004951-repogoon into https://download.copr.fedorainfracloud.org/results/burningpho3nix/private-projects/almalinux-10-x86_64_v2, (auto-create-repo=True) [2026-01-13 18:04:46,159][ INFO][PID:759884] Running command 'copr-repo --batched /var/lib/copr/public_html/results/burningpho3nix/private-projects/almalinux-10-x86_64_v2 --add 10004951-repogoon' as PID 815749 [2026-01-13 18:04:47,907][ INFO][PID:759884] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/burningpho3nix/private-projects/almalinux-10-x86_64_v2 --add 10004951-repogoon) [2026-01-13 18:04:47,909][ INFO][PID:759884] Getting build details [2026-01-13 18:04:47,910][ INFO][PID:759884] Listing built binary packages in /var/lib/copr/public_html/results/burningpho3nix/private-projects/almalinux-10-x86_64_v2/10004951-repogoon [2026-01-13 18:04:47,911][ INFO][PID:759884] Built packages: ['repogoon 0.6.2'] [2026-01-13 18:04:47,912][ INFO][PID:759884] build details: {'built_packages': 'repogoon 0.6.2'} [2026-01-13 18:04:47,913][ INFO][PID:759884] Retrieving pubkey [2026-01-13 18:04:47,914][ INFO][PID:759884] Calling '/bin/sign -u burningpho3nix#private-projects@copr.fedorahosted.org -p' (attempt #1) [2026-01-13 18:04:48,208][ INFO][PID:759884] Added pubkey for user burningpho3nix project private-projects into: /var/lib/copr/public_html/results/burningpho3nix/private-projects/pubkey.gpg [2026-01-13 18:04:48,209][ INFO][PID:759884] Finished build: id=10004951 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/burningpho3nix/private-projects chroot=almalinux-10-x86_64_v2 [2026-01-13 18:04:48,211][ INFO][PID:759884] Worker succeeded build, took 204.25733256340027 [2026-01-13 18:04:48,212][ INFO][PID:759884] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "burningpho3nix", "project_name": "private-projects", "project_dirname": "private-projects", "submitter": "burningpho3nix", "ended_on": 1768327488.2114723, "started_on": 1768327283.9541397, "submitted_on": null, "status": 1, "chroot": "almalinux-10-x86_64_v2", "arch": "x86_64_v2", "buildroot_pkgs": [], "task_id": "10004951-almalinux-10-x86_64_v2", "build_id": 10004951, "package_name": "repogoon", "package_version": "0.6.2-20260113", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/burningpho3nix/private-projects/repogoon", "git_hash": "907c14ca94d1dbbae36573ee554389447ca6d426", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "burningpho3nix/private-projects--burningpho3nix", "results": { "packages": [ { "name": "repogoon", "epoch": null, "version": "0.6.2", "release": "20260113", "arch": "x86_64_v2" }, { "name": "repogoon", "epoch": null, "version": "0.6.2", "release": "20260113", "arch": "src" } ] }, "appstream": true, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/burningpho3nix/private-projects/almalinux-10-x86_64_v2/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": true, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64_v2" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/burningpho3nix/private-projects", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/burningpho3nix/private-projects", "result_dir": "10004951-repogoon", "built_packages": "repogoon 0.6.2", "id": 10004951, "mockchain_macros": { "copr_username": "burningpho3nix", "copr_projectname": "private-projects", "vendor": "Fedora Project COPR (burningpho3nix/private-projects)" } } ] } [2026-01-13 18:04:48,316][ INFO][PID:759884] Sending fedora-messaging bus message in build.end [2026-01-13 18:04:48,876][ INFO][PID:759884] Compressing /var/lib/copr/public_html/results/burningpho3nix/private-projects/almalinux-10-x86_64_v2/10004951-repogoon/builder-live.log by gzip [2026-01-13 18:04:48,878][ INFO][PID:759884] Running command 'gzip /var/lib/copr/public_html/results/burningpho3nix/private-projects/almalinux-10-x86_64_v2/10004951-repogoon/builder-live.log' as PID 815959 [2026-01-13 18:04:48,909][ INFO][PID:759884] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/burningpho3nix/private-projects/almalinux-10-x86_64_v2/10004951-repogoon/builder-live.log) [2026-01-13 18:04:48,910][ INFO][PID:759884] Compressing /var/lib/copr/public_html/results/burningpho3nix/private-projects/almalinux-10-x86_64_v2/10004951-repogoon/backend.log by gzip [2026-01-13 18:04:48,911][ INFO][PID:759884] Running command 'gzip /var/lib/copr/public_html/results/burningpho3nix/private-projects/almalinux-10-x86_64_v2/10004951-repogoon/backend.log' as PID 815961