[2026-01-22 22:53:31,479][ INFO][PID:945145] Marking build as starting [2026-01-22 22:53:31,627][ INFO][PID:945145] Checking that /var/lib/copr/public_html/results/ufven/podman/epel-9-ppc64le/repodata/repomd.xml exists [2026-01-22 22:53:31,688][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:53:31,689][ INFO][PID:945145] VM allocation process starts [2026-01-22 22:53:31,705][ INFO][PID:945145] Trying to allocate VM: ResallocHost, ticket_id=977961, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2026-01-22 22:53:34,723][ INFO][PID:945145] Allocated host ResallocHost, ticket_id=977961, hostname=2620:52:6:1161:dead:beef:cafe:c10d, name=vmhost_p09_02_prod_01490638_20260122_221558, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2026-01-22 22:53:34,723][ INFO][PID:945145] Allocating ssh connection to builder [2026-01-22 22:53:34,723][ INFO][PID:945145] Checking that builder machine is OK [2026-01-22 22:53:36,146][ INFO][PID:945145] Running remote command: copr-builder-ready epel-9-ppc64le [2026-01-22 22:53:36,785][ INFO][PID:945145] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2026-01-22 22:53:36,785][ INFO][PID:945145] Filling build.info file with builder info [2026-01-22 22:53:36,786][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:53:36,787][ INFO][PID:945145] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "ufven", "project_name": "podman", "project_dirname": "podman", "submitter": null, "ended_on": null, "started_on": 1769122416.787201, "submitted_on": null, "status": 3, "chroot": "epel-9-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10048833-epel-9-ppc64le", "build_id": 10048833, "package_name": "crun", "package_version": "102:1.26-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/ufven/podman/crun", "git_hash": "04a8b3377a8b70cb0c007846706519777ef395b6", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "ufven/podman--465cd21f-2360-4ac9-884f-a11cd6c2820b", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/ufven/podman/epel-9-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/ufven/podman", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/ufven/podman", "result_dir": "10048833-crun", "built_packages": "", "id": 10048833, "mockchain_macros": { "copr_username": "ufven", "copr_projectname": "podman", "vendor": "Fedora Project COPR (ufven/podman)" } } ] } [2026-01-22 22:53:36,832][ INFO][PID:945145] Sending fedora-messaging bus message in build.start [2026-01-22 22:53:37,389][ INFO][PID:945145] Sending fedora-messaging bus message in chroot.start [2026-01-22 22:53:37,419][ INFO][PID:945145] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10048833-epel-9-ppc64le --chroot epel-9-ppc64le --detached [2026-01-22 22:54:37,484][ ERROR][PID:945145] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c10d port 22: Connection timed out [2026-01-22 22:54:47,485][ ERROR][PID:945145] Re-try request for task on 'ResallocHost, ticket_id=977961, hostname=2620:52:6:1161:dead:beef:cafe:c10d, name=vmhost_p09_02_prod_01490638_20260122_221558, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': Unable to finish after 1 SSH attempts [2026-01-22 22:54:47,485][ INFO][PID:945145] Releasing VM back to pool [2026-01-22 22:54:47,493][ INFO][PID:945145] Retry #1 (on other host) [2026-01-22 22:54:47,494][ INFO][PID:945145] Checking that /var/lib/copr/public_html/results/ufven/podman/epel-9-ppc64le/repodata/repomd.xml exists [2026-01-22 22:54:47,494][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:54:47,495][ INFO][PID:945145] VM allocation process starts [2026-01-22 22:54:47,539][ INFO][PID:945145] Trying to allocate VM: ResallocHost, ticket_id=977967, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2026-01-22 22:54:50,581][ INFO][PID:945145] Allocated host ResallocHost, ticket_id=977967, hostname=2620:52:6:1161:dead:beef:cafe:c18a, name=vmhost_p09_04_prod_01490646_20260122_221654, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2026-01-22 22:54:50,754][ INFO][PID:945145] Allocating ssh connection to builder [2026-01-22 22:54:50,754][ INFO][PID:945145] Checking that builder machine is OK [2026-01-22 22:54:51,791][ INFO][PID:945145] Running remote command: copr-builder-ready epel-9-ppc64le [2026-01-22 22:54:52,364][ INFO][PID:945145] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2026-01-22 22:54:52,364][ INFO][PID:945145] Filling build.info file with builder info [2026-01-22 22:54:52,379][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:54:52,379][ INFO][PID:945145] Not re-notifying FE and msg buses for the new host. [2026-01-22 22:54:52,380][ INFO][PID:945145] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10048833-epel-9-ppc64le --chroot epel-9-ppc64le --detached [2026-01-22 22:54:53,406][ INFO][PID:945145] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c18a' (ED25519) to the list of known hosts. [2026-01-22 22:54:53,407][ INFO][PID:945145] Downloading the builder-live.log file, attempt 1 [2026-01-22 22:54:53,408][ INFO][PID:945145] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c18a copr-rpmbuild-log [2026-01-22 22:54:58,414][ INFO][PID:945145] Periodic builder liveness probe: alive [2026-01-22 22:54:58,414][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:55:03,415][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:55:08,416][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:55:13,417][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:55:18,418][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:55:23,419][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:55:28,420][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:55:33,421][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:55:38,422][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:55:43,423][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:55:48,424][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:55:53,425][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:55:58,426][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:56:03,427][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:56:08,428][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:56:13,429][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:56:18,430][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:56:23,431][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:56:28,432][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:56:33,433][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:56:38,434][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:56:43,435][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:56:48,436][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:56:53,437][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:56:58,438][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:57:03,439][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:57:08,440][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:57:13,441][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:57:18,442][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:57:23,443][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:57:28,444][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:57:33,445][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:57:38,446][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:57:43,447][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:57:48,449][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:57:53,450][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:57:58,451][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:58:03,452][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:58:08,453][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:58:13,454][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:58:18,455][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:58:23,457][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:58:28,458][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:58:33,458][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:58:38,460][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:58:43,461][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:58:48,462][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:58:53,463][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:58:58,464][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:59:03,465][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:59:08,466][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:59:13,467][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:59:18,468][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:59:23,469][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:59:28,470][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:59:33,471][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:59:38,472][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:59:43,473][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:59:48,474][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:59:53,475][ INFO][PID:945145] Checking for cancel request [2026-01-22 22:59:58,476][ INFO][PID:945145] Checking for cancel request [2026-01-22 23:00:03,477][ INFO][PID:945145] Checking for cancel request [2026-01-22 23:00:08,478][ INFO][PID:945145] Checking for cancel request [2026-01-22 23:00:13,479][ INFO][PID:945145] Checking for cancel request [2026-01-22 23:00:18,480][ INFO][PID:945145] Checking for cancel request [2026-01-22 23:00:23,481][ INFO][PID:945145] Checking for cancel request [2026-01-22 23:00:28,482][ INFO][PID:945145] Checking for cancel request [2026-01-22 23:00:33,482][ INFO][PID:945145] Checking for cancel request [2026-01-22 23:00:38,484][ INFO][PID:945145] Checking for cancel request [2026-01-22 23:00:43,485][ INFO][PID:945145] Checking for cancel request [2026-01-22 23:00:48,486][ INFO][PID:945145] Checking for cancel request [2026-01-22 23:00:53,487][ INFO][PID:945145] Checking for cancel request [2026-01-22 23:00:58,488][ INFO][PID:945145] Checking for cancel request [2026-01-22 23:01:03,489][ INFO][PID:945145] Checking for cancel request [2026-01-22 23:01:08,490][ INFO][PID:945145] Checking for cancel request [2026-01-22 23:01:13,491][ INFO][PID:945145] Checking for cancel request [2026-01-22 23:01:18,492][ INFO][PID:945145] Checking for cancel request [2026-01-22 23:01:23,493][ INFO][PID:945145] Checking for cancel request [2026-01-22 23:01:28,494][ INFO][PID:945145] Checking for cancel request [2026-01-22 23:01:33,495][ INFO][PID:945145] Checking for cancel request [2026-01-22 23:01:38,496][ INFO][PID:945145] Checking for cancel request [2026-01-22 23:01:43,497][ INFO][PID:945145] Checking for cancel request [2026-01-22 23:01:48,498][ INFO][PID:945145] Checking for cancel request [2026-01-22 23:01:50,365][ INFO][PID:945145] Downloading results from builder [2026-01-22 23:01:50,365][ INFO][PID:945145] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18a]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/ufven/podman/epel-9-ppc64le/10048833-crun started [2026-01-22 23:01:50,366][ INFO][PID:945145] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18a]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/ufven/podman/epel-9-ppc64le/10048833-crun/ &> /var/lib/copr/public_html/results/ufven/podman/epel-9-ppc64le/10048833-crun/build-10048833.rsync.log [2026-01-22 23:01:51,038][ INFO][PID:945145] rsyncing finished. [2026-01-22 23:01:51,038][ INFO][PID:945145] Releasing VM back to pool [2026-01-22 23:01:51,047][ INFO][PID:945145] Searching for 'success' file in resultdir [2026-01-22 23:01:51,047][ INFO][PID:945145] Going to sign pkgs from source: 10048833-epel-9-ppc64le in chroot: /var/lib/copr/public_html/results/ufven/podman/epel-9-ppc64le [2026-01-22 23:01:51,048][ INFO][PID:945145] Calling '/bin/sign -u ufven#podman@copr.fedorahosted.org -p' (attempt #1) [2026-01-22 23:01:51,318][ INFO][PID:945145] Calling '/bin/sign -4 -h sha256 -u ufven#podman@copr.fedorahosted.org -r /var/lib/copr/public_html/results/ufven/podman/epel-9-ppc64le/10048833-crun/crun-debuginfo-1.26-1.el9.ppc64le.rpm' (attempt #1) [2026-01-22 23:01:52,107][ INFO][PID:945145] signed rpm: /var/lib/copr/public_html/results/ufven/podman/epel-9-ppc64le/10048833-crun/crun-debuginfo-1.26-1.el9.ppc64le.rpm [2026-01-22 23:01:52,108][ INFO][PID:945145] Calling '/bin/sign -4 -h sha256 -u ufven#podman@copr.fedorahosted.org -r /var/lib/copr/public_html/results/ufven/podman/epel-9-ppc64le/10048833-crun/crun-1.26-1.el9.src.rpm' (attempt #1) [2026-01-22 23:01:53,187][ INFO][PID:945145] signed rpm: /var/lib/copr/public_html/results/ufven/podman/epel-9-ppc64le/10048833-crun/crun-1.26-1.el9.src.rpm [2026-01-22 23:01:53,187][ INFO][PID:945145] Calling '/bin/sign -4 -h sha256 -u ufven#podman@copr.fedorahosted.org -r /var/lib/copr/public_html/results/ufven/podman/epel-9-ppc64le/10048833-crun/crun-1.26-1.el9.ppc64le.rpm' (attempt #1) [2026-01-22 23:01:53,951][ INFO][PID:945145] signed rpm: /var/lib/copr/public_html/results/ufven/podman/epel-9-ppc64le/10048833-crun/crun-1.26-1.el9.ppc64le.rpm [2026-01-22 23:01:53,951][ INFO][PID:945145] Calling '/bin/sign -4 -h sha256 -u ufven#podman@copr.fedorahosted.org -r /var/lib/copr/public_html/results/ufven/podman/epel-9-ppc64le/10048833-crun/crun-debugsource-1.26-1.el9.ppc64le.rpm' (attempt #1) [2026-01-22 23:01:54,706][ INFO][PID:945145] signed rpm: /var/lib/copr/public_html/results/ufven/podman/epel-9-ppc64le/10048833-crun/crun-debugsource-1.26-1.el9.ppc64le.rpm [2026-01-22 23:01:54,707][ INFO][PID:945145] Sign done [2026-01-22 23:01:54,708][ INFO][PID:945145] Incremental createrepo run, adding 10048833-crun into https://download.copr.fedorainfracloud.org/results/ufven/podman/epel-9-ppc64le, (auto-create-repo=True) [2026-01-22 23:01:54,709][ INFO][PID:945145] Running command 'copr-repo --batched /var/lib/copr/public_html/results/ufven/podman/epel-9-ppc64le --add 10048833-crun --no-appstream-metadata' as PID 981259 [2026-01-22 23:01:55,954][ INFO][PID:945145] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/ufven/podman/epel-9-ppc64le --add 10048833-crun --no-appstream-metadata) [2026-01-22 23:01:55,955][ INFO][PID:945145] Getting build details [2026-01-22 23:01:55,955][ INFO][PID:945145] Listing built binary packages in /var/lib/copr/public_html/results/ufven/podman/epel-9-ppc64le/10048833-crun [2026-01-22 23:01:55,956][ INFO][PID:945145] Built packages: ['crun 1.26', 'crun-debuginfo 1.26', 'crun-debugsource 1.26'] [2026-01-22 23:01:55,956][ INFO][PID:945145] build details: {'built_packages': 'crun 1.26\ncrun-debuginfo 1.26\ncrun-debugsource 1.26'} [2026-01-22 23:01:55,957][ INFO][PID:945145] Retrieving pubkey [2026-01-22 23:01:55,957][ INFO][PID:945145] Calling '/bin/sign -u ufven#podman@copr.fedorahosted.org -p' (attempt #1) [2026-01-22 23:01:56,239][ INFO][PID:945145] Added pubkey for user ufven project podman into: /var/lib/copr/public_html/results/ufven/podman/pubkey.gpg [2026-01-22 23:01:56,239][ INFO][PID:945145] Finished build: id=10048833 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/ufven/podman chroot=epel-9-ppc64le [2026-01-22 23:01:56,241][ INFO][PID:945145] Worker succeeded build, took 423.86186146736145 [2026-01-22 23:01:56,242][ INFO][PID:945145] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "ufven", "project_name": "podman", "project_dirname": "podman", "submitter": null, "ended_on": 1769122916.241824, "started_on": 1769122492.3799624, "submitted_on": null, "status": 1, "chroot": "epel-9-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10048833-epel-9-ppc64le", "build_id": 10048833, "package_name": "crun", "package_version": "102:1.26-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/ufven/podman/crun", "git_hash": "04a8b3377a8b70cb0c007846706519777ef395b6", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "ufven/podman--465cd21f-2360-4ac9-884f-a11cd6c2820b", "results": { "packages": [ { "name": "crun", "epoch": 102, "version": "1.26", "release": "1.el9", "arch": "ppc64le" }, { "name": "crun", "epoch": 102, "version": "1.26", "release": "1.el9", "arch": "src" }, { "name": "crun-debuginfo", "epoch": 102, "version": "1.26", "release": "1.el9", "arch": "ppc64le" }, { "name": "crun-debugsource", "epoch": 102, "version": "1.26", "release": "1.el9", "arch": "ppc64le" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/ufven/podman/epel-9-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/ufven/podman", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/ufven/podman", "result_dir": "10048833-crun", "built_packages": "crun 1.26\ncrun-debuginfo 1.26\ncrun-debugsource 1.26", "id": 10048833, "mockchain_macros": { "copr_username": "ufven", "copr_projectname": "podman", "vendor": "Fedora Project COPR (ufven/podman)" } } ] } [2026-01-22 23:01:56,319][ INFO][PID:945145] Sending fedora-messaging bus message in build.end [2026-01-22 23:01:56,350][ INFO][PID:945145] Compressing /var/lib/copr/public_html/results/ufven/podman/epel-9-ppc64le/10048833-crun/builder-live.log by gzip [2026-01-22 23:01:56,352][ INFO][PID:945145] Running command 'gzip /var/lib/copr/public_html/results/ufven/podman/epel-9-ppc64le/10048833-crun/builder-live.log' as PID 981394 [2026-01-22 23:01:56,363][ INFO][PID:945145] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/ufven/podman/epel-9-ppc64le/10048833-crun/builder-live.log) [2026-01-22 23:01:56,364][ INFO][PID:945145] Compressing /var/lib/copr/public_html/results/ufven/podman/epel-9-ppc64le/10048833-crun/backend.log by gzip [2026-01-22 23:01:56,365][ INFO][PID:945145] Running command 'gzip /var/lib/copr/public_html/results/ufven/podman/epel-9-ppc64le/10048833-crun/backend.log' as PID 981395