[2026-10-22 22:32:57,421][ INFO][PID:3949730] Marking build as starting [2026-10-22 22:32:57,522][ INFO][PID:3949730] Checking that /var/lib/copr/public_html/results/semeijn/lab/epel-10-ppc64le/repodata/repomd.xml exists [2026-10-22 22:32:57,527][ INFO][PID:3949730] Checking for cancel request [2026-10-22 22:32:57,581][ INFO][PID:3949730] rpmeta: predicted 2 min for 3proxy on epel-10-ppc64le -> normal builder sufficient [2026-10-22 22:32:57,584][ INFO][PID:3949730] VM allocation process starts [2026-10-22 22:32:57,626][ INFO][PID:3949730] Trying to allocate VM: ResallocHost, ticket_id=5901524, requested_tags=['arch_power9', 'arch_ppc64le', 'copr_builder'] [2026-10-22 22:33:00,656][ INFO][PID:3949730] Allocated host ResallocHost, ticket_id=5901524, hostname=2620:52:6:1161:dead:beef:cafe:c17b, name=vmhost_p09_04_prod_58710552_20261022_204251, requested_tags=['arch_power9', 'arch_ppc64le', 'copr_builder'] [2026-10-22 22:33:00,656][ INFO][PID:3949730] Allocating ssh connection to builder [2026-10-22 22:33:00,657][ INFO][PID:3949730] Checking that builder machine is OK [2026-10-22 22:34:00,722][ ERROR][PID:3949730] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c17b port 22: Connection timed out [2026-10-22 22:34:10,731][ ERROR][PID:3949730] Re-try request for task on 'ResallocHost, ticket_id=5901524, hostname=2620:52:6:1161:dead:beef:cafe:c17b, name=vmhost_p09_04_prod_58710552_20261022_204251, requested_tags=['arch_power9', 'arch_ppc64le', 'copr_builder']': Unable to finish after 1 SSH attempts [2026-10-22 22:34:10,734][ INFO][PID:3949730] VM Release request [2026-10-22 22:34:10,740][ INFO][PID:3949730] Retry #1 (on other host) [2026-10-22 22:34:10,741][ INFO][PID:3949730] Checking that /var/lib/copr/public_html/results/semeijn/lab/epel-10-ppc64le/repodata/repomd.xml exists [2026-10-22 22:34:10,741][ INFO][PID:3949730] Checking for cancel request [2026-10-22 22:34:10,761][ INFO][PID:3949730] rpmeta: predicted 2 min for 3proxy on epel-10-ppc64le -> normal builder sufficient [2026-10-22 22:34:10,762][ INFO][PID:3949730] VM allocation process starts [2026-10-22 22:34:10,767][ INFO][PID:3949730] Trying to allocate VM: ResallocHost, ticket_id=5901553, requested_tags=['arch_power9', 'arch_ppc64le', 'copr_builder'] [2026-10-22 22:34:13,775][ INFO][PID:3949730] Allocated host ResallocHost, ticket_id=5901553, hostname=2620:52:6:1161:dead:beef:cafe:c17f, name=vmhost_p09_04_prod_58775743_20261022_220747, requested_tags=['arch_power9', 'arch_ppc64le', 'copr_builder'] [2026-10-22 22:34:13,775][ INFO][PID:3949730] Allocating ssh connection to builder [2026-10-22 22:34:13,775][ INFO][PID:3949730] Checking that builder machine is OK [2026-10-22 22:35:13,840][ ERROR][PID:3949730] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c17f port 22: Connection timed out [2026-10-22 22:35:23,843][ ERROR][PID:3949730] Re-try request for task on 'ResallocHost, ticket_id=5901553, hostname=2620:52:6:1161:dead:beef:cafe:c17f, name=vmhost_p09_04_prod_58775743_20261022_220747, requested_tags=['arch_power9', 'arch_ppc64le', 'copr_builder']': Unable to finish after 1 SSH attempts [2026-10-22 22:35:23,846][ INFO][PID:3949730] VM Release request [2026-10-22 22:35:23,851][ INFO][PID:3949730] Retry #2 (on other host) [2026-10-22 22:35:23,852][ INFO][PID:3949730] Checking that /var/lib/copr/public_html/results/semeijn/lab/epel-10-ppc64le/repodata/repomd.xml exists [2026-10-22 22:35:23,852][ INFO][PID:3949730] Checking for cancel request [2026-10-22 22:35:23,871][ INFO][PID:3949730] rpmeta: predicted 2 min for 3proxy on epel-10-ppc64le -> normal builder sufficient [2026-10-22 22:35:23,872][ INFO][PID:3949730] VM allocation process starts [2026-10-22 22:35:23,900][ INFO][PID:3949730] Trying to allocate VM: ResallocHost, ticket_id=5901573, requested_tags=['arch_power9', 'arch_ppc64le', 'copr_builder'] [2026-10-22 22:35:26,909][ INFO][PID:3949730] Allocated host ResallocHost, ticket_id=5901573, hostname=2620:52:6:1161:dead:beef:cafe:c131, name=vmhost_p09_01_prod_58776639_20261022_220901, requested_tags=['arch_power9', 'arch_ppc64le', 'copr_builder'] [2026-10-22 22:35:26,910][ INFO][PID:3949730] Allocating ssh connection to builder [2026-10-22 22:35:26,910][ INFO][PID:3949730] Checking that builder machine is OK [2026-10-22 22:35:27,701][ INFO][PID:3949730] Installed copr-rpmbuild version: 1.10 [2026-10-22 22:35:27,701][ INFO][PID:3949730] Running remote command: copr-builder-ready epel-10-ppc64le [2026-10-22 22:35:28,250][ INFO][PID:3949730] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2026-10-22 22:35:28,251][ INFO][PID:3949730] Filling build.info file with builder info [2026-10-22 22:35:28,251][ INFO][PID:3949730] Checking for cancel request [2026-10-22 22:35:28,251][ INFO][PID:3949730] Not re-notifying FE and msg buses for the new host. [2026-10-22 22:35:28,251][ INFO][PID:3949730] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/11194948-epel-10-ppc64le --chroot epel-10-ppc64le --detached [2026-10-22 22:35:29,333][ INFO][PID:3949730] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c131' (ED25519) to the list of known hosts. [2026-10-22 22:35:29,334][ INFO][PID:3949730] Downloading the builder-live.log file, attempt 1 [2026-10-22 22:35:29,335][ INFO][PID:3949730] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c131 copr-rpmbuild-log [2026-10-22 22:35:34,339][ INFO][PID:3949730] Periodic builder liveness probe: alive [2026-10-22 22:35:34,340][ INFO][PID:3949730] Checking for cancel request [2026-10-22 22:35:39,340][ INFO][PID:3949730] Checking for cancel request [2026-10-22 22:35:44,341][ INFO][PID:3949730] Checking for cancel request [2026-10-22 22:35:49,342][ INFO][PID:3949730] Checking for cancel request [2026-10-22 22:35:54,343][ INFO][PID:3949730] Checking for cancel request [2026-10-22 22:35:59,344][ INFO][PID:3949730] Checking for cancel request [2026-10-22 22:36:04,345][ INFO][PID:3949730] Checking for cancel request [2026-10-22 22:36:09,345][ INFO][PID:3949730] Checking for cancel request [2026-10-22 22:36:14,346][ INFO][PID:3949730] Checking for cancel request [2026-10-22 22:36:19,347][ INFO][PID:3949730] Checking for cancel request [2026-10-22 22:36:24,348][ INFO][PID:3949730] Checking for cancel request [2026-10-22 22:36:29,350][ INFO][PID:3949730] Checking for cancel request [2026-10-22 22:36:34,350][ INFO][PID:3949730] Checking for cancel request [2026-10-22 22:36:39,351][ INFO][PID:3949730] Checking for cancel request [2026-10-22 22:36:44,352][ INFO][PID:3949730] Checking for cancel request [2026-10-22 22:36:49,353][ INFO][PID:3949730] Checking for cancel request [2026-10-22 22:36:54,354][ INFO][PID:3949730] Checking for cancel request [2026-10-22 22:36:59,355][ INFO][PID:3949730] Checking for cancel request [2026-10-22 22:37:04,355][ INFO][PID:3949730] Checking for cancel request [2026-10-22 22:37:09,356][ INFO][PID:3949730] Checking for cancel request [2026-10-22 22:37:14,357][ INFO][PID:3949730] Checking for cancel request [2026-10-22 22:37:19,358][ INFO][PID:3949730] Checking for cancel request [2026-10-22 22:37:24,359][ INFO][PID:3949730] Checking for cancel request [2026-10-22 22:37:26,183][ INFO][PID:3949730] Downloading results from builder [2026-10-22 22:37:26,184][ INFO][PID:3949730] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c131]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/semeijn/lab/epel-10-ppc64le/11194948-3proxy started [2026-10-22 22:37:26,185][ INFO][PID:3949730] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c131]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/semeijn/lab/epel-10-ppc64le/11194948-3proxy/ &> /var/lib/copr/public_html/results/semeijn/lab/epel-10-ppc64le/11194948-3proxy/build-11194948.rsync.log [2026-10-22 22:37:26,711][ INFO][PID:3949730] rsyncing finished. [2026-10-22 22:37:26,711][ INFO][PID:3949730] VM Release request [2026-10-22 22:37:26,717][ INFO][PID:3949730] Searching for 'success' file in resultdir [2026-10-22 22:37:26,718][ INFO][PID:3949730] Going to sign pkgs from source: 11194948-epel-10-ppc64le in chroot: /var/lib/copr/public_html/results/semeijn/lab/epel-10-ppc64le [2026-10-22 22:37:26,718][ INFO][PID:3949730] Calling '/bin/sign -u semeijn#lab@copr.fedorahosted.org -p' (attempt #1) [2026-10-22 22:37:26,910][ INFO][PID:3949730] Calling '/bin/sign -4 -h sha256 -u semeijn#lab@copr.fedorahosted.org -r /var/lib/copr/public_html/results/semeijn/lab/epel-10-ppc64le/11194948-3proxy/3proxy-debugsource-1.0.1-2.el10.ppc64le.rpm' (attempt #1) [2026-10-22 22:37:27,502][ INFO][PID:3949730] signed rpm: /var/lib/copr/public_html/results/semeijn/lab/epel-10-ppc64le/11194948-3proxy/3proxy-debugsource-1.0.1-2.el10.ppc64le.rpm [2026-10-22 22:37:27,503][ INFO][PID:3949730] Calling '/bin/sign -4 -h sha256 -u semeijn#lab@copr.fedorahosted.org -r /var/lib/copr/public_html/results/semeijn/lab/epel-10-ppc64le/11194948-3proxy/3proxy-debuginfo-1.0.1-2.el10.ppc64le.rpm' (attempt #1) [2026-10-22 22:37:27,990][ INFO][PID:3949730] signed rpm: /var/lib/copr/public_html/results/semeijn/lab/epel-10-ppc64le/11194948-3proxy/3proxy-debuginfo-1.0.1-2.el10.ppc64le.rpm [2026-10-22 22:37:27,990][ INFO][PID:3949730] Calling '/bin/sign -4 -h sha256 -u semeijn#lab@copr.fedorahosted.org -r /var/lib/copr/public_html/results/semeijn/lab/epel-10-ppc64le/11194948-3proxy/3proxy-1.0.1-2.el10.src.rpm' (attempt #1) [2026-10-22 22:37:28,585][ INFO][PID:3949730] signed rpm: /var/lib/copr/public_html/results/semeijn/lab/epel-10-ppc64le/11194948-3proxy/3proxy-1.0.1-2.el10.src.rpm [2026-10-22 22:37:28,585][ INFO][PID:3949730] Calling '/bin/sign -4 -h sha256 -u semeijn#lab@copr.fedorahosted.org -r /var/lib/copr/public_html/results/semeijn/lab/epel-10-ppc64le/11194948-3proxy/3proxy-1.0.1-2.el10.ppc64le.rpm' (attempt #1) [2026-10-22 22:37:29,293][ INFO][PID:3949730] signed rpm: /var/lib/copr/public_html/results/semeijn/lab/epel-10-ppc64le/11194948-3proxy/3proxy-1.0.1-2.el10.ppc64le.rpm [2026-10-22 22:37:29,294][ INFO][PID:3949730] Sign done [2026-10-22 22:37:29,294][ INFO][PID:3949730] Incremental createrepo run, adding 11194948-3proxy into https://download.copr.fedorainfracloud.org/results/semeijn/lab/epel-10-ppc64le, (auto-create-repo=True) [2026-10-22 22:37:29,294][ INFO][PID:3949730] Running command 'copr-repo --batched /var/lib/copr/public_html/results/semeijn/lab/epel-10-ppc64le --add 11194948-3proxy --no-appstream-metadata' as PID 4022230 [2026-10-22 22:37:29,537][ INFO][PID:3949730] Finished after 0 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/semeijn/lab/epel-10-ppc64le --add 11194948-3proxy --no-appstream-metadata) [2026-10-22 22:37:29,538][ INFO][PID:3949730] Getting build details [2026-10-22 22:37:29,538][ INFO][PID:3949730] Listing built binary packages in /var/lib/copr/public_html/results/semeijn/lab/epel-10-ppc64le/11194948-3proxy [2026-10-22 22:37:29,539][ INFO][PID:3949730] Built packages: ['3proxy-debugsource 1.0.1', '3proxy-debuginfo 1.0.1', '3proxy 1.0.1'] [2026-10-22 22:37:29,539][ INFO][PID:3949730] build details: {'built_packages': '3proxy-debugsource 1.0.1\n3proxy-debuginfo 1.0.1\n3proxy 1.0.1'} [2026-10-22 22:37:29,539][ INFO][PID:3949730] Retrieving pubkey [2026-10-22 22:37:29,539][ INFO][PID:3949730] Calling '/bin/sign -u semeijn#lab@copr.fedorahosted.org -p' (attempt #1) [2026-10-22 22:37:29,848][ INFO][PID:3949730] Added pubkey for user semeijn project lab into: /var/lib/copr/public_html/results/semeijn/lab/pubkey.gpg [2026-10-22 22:37:29,848][ INFO][PID:3949730] Finished build: id=11194948 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/semeijn/lab chroot=epel-10-ppc64le [2026-10-22 22:37:29,848][ INFO][PID:3949730] Worker succeeded build, took 121.59720158576965 [2026-10-22 22:37:29,849][ INFO][PID:3949730] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "semeijn", "project_name": "lab", "project_dirname": "lab", "submitter": "semeijn", "ended_on": 1792708649.8489385, "started_on": 1792708528.2517369, "submitted_on": null, "status": 1, "chroot": "epel-10-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "11194948-epel-10-ppc64le", "build_id": 11194948, "package_name": "3proxy", "package_version": "1.0.1-2", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/semeijn/lab/3proxy", "git_hash": "9941033d22f21bb263cc562e2d85a8c7feb19ed0", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "prebuilt_tarball_url": null, "uses_devel_repo": false, "sandbox": "semeijn/lab--semeijn", "results": { "packages": [ { "name": "3proxy-debugsource", "epoch": null, "version": "1.0.1", "release": "2.el10", "arch": "ppc64le" }, { "name": "3proxy-debuginfo", "epoch": null, "version": "1.0.1", "release": "2.el10", "arch": "ppc64le" }, { "name": "3proxy", "epoch": null, "version": "1.0.1", "release": "2.el10", "arch": "src" }, { "name": "3proxy", "epoch": null, "version": "1.0.1", "release": "2.el10", "arch": "ppc64le" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/semeijn/lab/epel-10-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null, "repo_gpgcheck": false } ], "background": false, "fedora_review": true, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/semeijn/lab", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/semeijn/lab", "result_dir": "11194948-3proxy", "built_packages": "3proxy-debugsource 1.0.1\n3proxy-debuginfo 1.0.1\n3proxy 1.0.1", "rpmeta_prediction": 2, "id": 11194948, "mockchain_macros": { "copr_username": "semeijn", "copr_projectname": "lab", "vendor": "Fedora Project COPR (semeijn/lab)" } } ] } [2026-10-22 22:37:29,913][ INFO][PID:3949730] Sending fedora-messaging bus message in build.end [2026-10-22 22:37:30,279][ INFO][PID:3949730] Compressing /var/lib/copr/public_html/results/semeijn/lab/epel-10-ppc64le/11194948-3proxy/builder-live.log by gzip [2026-10-22 22:37:30,280][ INFO][PID:3949730] Running command 'gzip /var/lib/copr/public_html/results/semeijn/lab/epel-10-ppc64le/11194948-3proxy/builder-live.log' as PID 4022425 [2026-10-22 22:37:30,283][ INFO][PID:3949730] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/semeijn/lab/epel-10-ppc64le/11194948-3proxy/builder-live.log) [2026-10-22 22:37:30,284][ INFO][PID:3949730] Compressing /var/lib/copr/public_html/results/semeijn/lab/epel-10-ppc64le/11194948-3proxy/backend.log by gzip [2026-10-22 22:37:30,284][ INFO][PID:3949730] Running command 'gzip /var/lib/copr/public_html/results/semeijn/lab/epel-10-ppc64le/11194948-3proxy/backend.log' as PID 4022426