[2025-12-14 02:13:28,102][  INFO][PID:2244604] Marking build as starting
[2025-12-14 02:13:28,349][  INFO][PID:2244604] Checking that /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-eln-ppc64le/repodata/repomd.xml exists
[2025-12-14 02:13:28,424][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:13:28,425][  INFO][PID:2244604] VM allocation process starts
[2025-12-14 02:13:28,526][  INFO][PID:2244604] Trying to allocate VM: ResallocHost, ticket_id=327168, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-12-14 02:13:33,536][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:13:38,550][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:13:43,552][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:13:46,685][  INFO][PID:2244604] Allocated host ResallocHost, ticket_id=327168, hostname=2620:52:6:1161:dead:beef:cafe:c10e, name=vmhost_p09_02_prod_00530963_20251214_013915, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-12-14 02:13:46,686][  INFO][PID:2244604] Allocating ssh connection to builder
[2025-12-14 02:13:46,687][  INFO][PID:2244604] Checking that builder machine is OK
[2025-12-14 02:13:47,583][  INFO][PID:2244604] Running remote command: copr-builder-ready fedora-eln-ppc64le
[2025-12-14 02:13:48,206][  INFO][PID:2244604] Red Hat subscription not needed for fedora-eln-ppc64le
Builder is ready to be used

[2025-12-14 02:13:48,209][  INFO][PID:2244604] Filling build.info file with builder info
[2025-12-14 02:13:48,225][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:13:48,249][  INFO][PID:2244604] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "amatej",
            "project_name": "dnf-nightly",
            "project_dirname": "dnf-nightly",
            "submitter": "amatej",
            "ended_on": null,
            "started_on": 1765678428.2497587,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-eln-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9907722-fedora-eln-ppc64le",
            "build_id": 9907722,
            "package_name": "libmodulemd",
            "package_version": "2.15.3-0.20251214021243230619.main.1.g527ebfa",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/amatej/dnf-nightly/libmodulemd",
            "git_hash": "4dc6cf202a5f30f7f2aadd6e2cca95889ca1782f",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "amatej/dnf-nightly--amatej",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/amatej/dnf-nightly/fedora-eln-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/",
                    "id": "copr_rpmsoftwaremanagement_dnf_nightly",
                    "name": "Additional repo copr_rpmsoftwaremanagement_dnf_nightly"
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/amatej/dnf-nightly",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/amatej/dnf-nightly",
            "result_dir": "09907722-libmodulemd",
            "built_packages": "",
            "id": 9907722,
            "mockchain_macros": {
                "copr_username": "amatej",
                "copr_projectname": "dnf-nightly",
                "vendor": "Fedora Project COPR (amatej/dnf-nightly)"
            }
        }
    ]
}
[2025-12-14 02:13:48,772][  INFO][PID:2244604] Sending fedora-messaging bus message in build.start
[2025-12-14 02:13:54,599][  INFO][PID:2244604] Sending fedora-messaging bus message in chroot.start
[2025-12-14 02:13:54,659][  INFO][PID:2244604] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9907722-fedora-eln-ppc64le --chroot fedora-eln-ppc64le --detached
[2025-12-14 02:14:54,790][ ERROR][PID:2244604] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c10e port 22: Connection timed out

[2025-12-14 02:15:04,793][ ERROR][PID:2244604] Re-try request for task on 'ResallocHost, ticket_id=327168, hostname=2620:52:6:1161:dead:beef:cafe:c10e, name=vmhost_p09_02_prod_00530963_20251214_013915, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': Unable to finish after 1 SSH attempts
[2025-12-14 02:15:04,795][  INFO][PID:2244604] Releasing VM back to pool
[2025-12-14 02:15:04,836][  INFO][PID:2244604] Retry #1 (on other host)
[2025-12-14 02:15:04,847][  INFO][PID:2244604] Checking that /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-eln-ppc64le/repodata/repomd.xml exists
[2025-12-14 02:15:04,850][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:15:04,855][  INFO][PID:2244604] VM allocation process starts
[2025-12-14 02:15:04,938][  INFO][PID:2244604] Trying to allocate VM: ResallocHost, ticket_id=327305, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-12-14 02:15:09,947][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:15:14,950][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:15:19,952][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:15:24,957][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:15:29,958][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:15:33,279][  INFO][PID:2244604] Allocated host ResallocHost, ticket_id=327305, hostname=2620:52:6:1161:dead:beef:cafe:c18e, name=vmhost_p09_04_prod_00531058_20251214_014727, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-12-14 02:15:33,282][  INFO][PID:2244604] Allocating ssh connection to builder
[2025-12-14 02:15:33,297][  INFO][PID:2244604] Checking that builder machine is OK
[2025-12-14 02:15:34,399][  INFO][PID:2244604] Running remote command: copr-builder-ready fedora-eln-ppc64le
[2025-12-14 02:15:34,933][  INFO][PID:2244604] Red Hat subscription not needed for fedora-eln-ppc64le
Builder is ready to be used

[2025-12-14 02:15:34,937][  INFO][PID:2244604] Filling build.info file with builder info
[2025-12-14 02:15:34,952][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:15:34,957][  INFO][PID:2244604] Not re-notifying FE and msg buses for the new host.
[2025-12-14 02:15:34,964][  INFO][PID:2244604] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9907722-fedora-eln-ppc64le --chroot fedora-eln-ppc64le --detached
[2025-12-14 02:15:36,145][  INFO][PID:2244604] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c18e' (ED25519) to the list of known hosts.


[2025-12-14 02:15:36,158][  INFO][PID:2244604] Downloading the builder-live.log file, attempt 1
[2025-12-14 02:15:36,165][  INFO][PID:2244604] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c18e copr-rpmbuild-log
[2025-12-14 02:15:41,174][  INFO][PID:2244604] Periodic builder liveness probe: alive
[2025-12-14 02:15:41,175][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:15:46,188][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:15:51,197][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:15:56,204][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:16:01,209][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:16:06,235][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:16:11,238][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:16:16,251][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:16:21,261][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:16:26,273][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:16:31,282][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:16:36,285][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:16:41,307][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:16:46,320][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:16:51,329][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:16:56,331][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:17:01,333][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:17:06,346][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:17:11,349][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:17:16,365][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:17:21,370][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:17:26,378][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:17:31,395][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:17:36,402][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:17:41,405][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:17:46,408][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:17:51,414][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:17:56,416][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:18:01,425][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:18:06,426][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:18:11,440][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:18:16,446][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:18:21,451][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:18:26,453][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:18:31,457][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:18:36,470][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:18:41,472][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:18:46,475][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:18:51,478][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:18:56,480][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:19:01,482][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:19:06,484][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:19:11,485][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:19:16,493][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:19:21,495][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:19:26,499][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:19:31,512][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:19:36,515][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:19:41,534][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:19:46,535][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:19:51,537][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:19:56,539][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:20:01,540][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:20:06,542][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:20:11,546][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:20:15,039][  INFO][PID:2244604] Downloading results from builder
[2025-12-14 02:20:15,044][  INFO][PID:2244604] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18e]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-eln-ppc64le/09907722-libmodulemd started
[2025-12-14 02:20:15,052][  INFO][PID:2244604] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18e]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-eln-ppc64le/09907722-libmodulemd/ &> /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-eln-ppc64le/09907722-libmodulemd/build-09907722.rsync.log
[2025-12-14 02:21:15,183][  INFO][PID:2244604] rsyncing finished.
[2025-12-14 02:21:15,184][ ERROR][PID:2244604] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2025-12-14 02:21:15,185][ ERROR][PID:2244604] SSH connection lost on #1 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2025-12-14 02:21:25,187][  INFO][PID:2244604] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18e]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-eln-ppc64le/09907722-libmodulemd started
[2025-12-14 02:21:25,202][  INFO][PID:2244604] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18e]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-eln-ppc64le/09907722-libmodulemd/ &> /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-eln-ppc64le/09907722-libmodulemd/build-09907722.rsync.log
[2025-12-14 02:22:25,341][  INFO][PID:2244604] rsyncing finished.
[2025-12-14 02:22:25,341][ ERROR][PID:2244604] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2025-12-14 02:22:25,348][ ERROR][PID:2244604] SSH connection lost on #2 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2025-12-14 02:22:35,352][  INFO][PID:2244604] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18e]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-eln-ppc64le/09907722-libmodulemd started
[2025-12-14 02:22:35,353][  INFO][PID:2244604] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18e]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-eln-ppc64le/09907722-libmodulemd/ &> /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-eln-ppc64le/09907722-libmodulemd/build-09907722.rsync.log
[2025-12-14 02:23:35,501][  INFO][PID:2244604] rsyncing finished.
[2025-12-14 02:23:35,509][ ERROR][PID:2244604] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2025-12-14 02:23:35,510][ ERROR][PID:2244604] SSH connection lost on #3 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2025-12-14 02:23:45,511][ ERROR][PID:2244604] Re-try request for task on 'ResallocHost, ticket_id=327305, hostname=2620:52:6:1161:dead:beef:cafe:c18e, name=vmhost_p09_04_prod_00531058_20251214_014727, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': Unable to finish after 3 SSH attempts
[2025-12-14 02:23:45,512][  INFO][PID:2244604] Releasing VM back to pool
[2025-12-14 02:23:45,536][  INFO][PID:2244604] Retry #2 (on other host)
[2025-12-14 02:23:45,540][  INFO][PID:2244604] Checking that /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-eln-ppc64le/repodata/repomd.xml exists
[2025-12-14 02:23:45,542][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:23:45,546][  INFO][PID:2244604] VM allocation process starts
[2025-12-14 02:23:45,576][  INFO][PID:2244604] Trying to allocate VM: ResallocHost, ticket_id=327642, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-12-14 02:23:50,582][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:23:55,587][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:24:00,589][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:24:03,670][  INFO][PID:2244604] Allocated host ResallocHost, ticket_id=327642, hostname=2620:52:6:1161:dead:beef:cafe:c115, name=vmhost_p09_02_prod_00531047_20251214_014559, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-12-14 02:24:03,671][  INFO][PID:2244604] Allocating ssh connection to builder
[2025-12-14 02:24:03,671][  INFO][PID:2244604] Checking that builder machine is OK
[2025-12-14 02:24:04,760][  INFO][PID:2244604] Running remote command: copr-builder-ready fedora-eln-ppc64le
[2025-12-14 02:24:05,336][  INFO][PID:2244604] Red Hat subscription not needed for fedora-eln-ppc64le
Builder is ready to be used

[2025-12-14 02:24:05,336][  INFO][PID:2244604] Filling build.info file with builder info
[2025-12-14 02:24:05,347][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:24:05,350][  INFO][PID:2244604] Not re-notifying FE and msg buses for the new host.
[2025-12-14 02:24:05,353][  INFO][PID:2244604] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9907722-fedora-eln-ppc64le --chroot fedora-eln-ppc64le --detached
[2025-12-14 02:24:06,153][  INFO][PID:2244604] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c115' (ED25519) to the list of known hosts.


[2025-12-14 02:24:06,154][  INFO][PID:2244604] Downloading the builder-live.log file, attempt 1
[2025-12-14 02:24:06,159][  INFO][PID:2244604] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c115 copr-rpmbuild-log
[2025-12-14 02:24:11,155][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:24:16,160][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:24:21,161][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:24:26,163][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:24:31,170][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:24:36,196][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:24:41,202][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:24:46,209][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:24:51,227][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:24:56,229][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:25:01,231][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:25:06,232][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:25:11,236][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:25:16,239][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:25:21,317][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:25:26,319][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:25:31,322][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:25:36,325][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:25:41,336][  INFO][PID:2244604] Periodic builder liveness probe: alive
[2025-12-14 02:25:41,337][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:25:46,339][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:25:51,340][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:25:56,344][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:26:01,345][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:26:06,347][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:26:11,349][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:26:16,350][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:26:21,352][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:26:26,353][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:26:31,358][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:26:36,361][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:26:41,363][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:26:46,364][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:26:51,366][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:26:56,367][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:27:01,373][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:27:06,374][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:27:11,376][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:27:16,379][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:27:21,381][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:27:26,383][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:27:31,388][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:27:36,390][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:27:41,394][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:27:46,396][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:27:51,397][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:27:56,399][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:28:01,400][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:28:06,408][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:28:11,418][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:28:16,422][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:28:21,423][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:28:26,435][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:28:31,439][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:28:36,461][  INFO][PID:2244604] Checking for cancel request
[2025-12-14 02:28:36,926][  INFO][PID:2244604] Downloading results from builder
[2025-12-14 02:28:36,935][  INFO][PID:2244604] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c115]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-eln-ppc64le/09907722-libmodulemd started
[2025-12-14 02:28:36,945][  INFO][PID:2244604] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c115]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-eln-ppc64le/09907722-libmodulemd/ &> /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-eln-ppc64le/09907722-libmodulemd/build-09907722.rsync.log
[2025-12-14 02:28:37,631][  INFO][PID:2244604] rsyncing finished.
[2025-12-14 02:28:37,642][  INFO][PID:2244604] Releasing VM back to pool
[2025-12-14 02:28:37,675][  INFO][PID:2244604] Searching for 'success' file in resultdir
[2025-12-14 02:28:37,678][ ERROR][PID:2244604] Build failed: Backend process error: No success file => build failure
[2025-12-14 02:28:37,679][  INFO][PID:2244604] Finished build: id=9907722 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/amatej/dnf-nightly chroot=fedora-eln-ppc64le 
[2025-12-14 02:28:37,689][ ERROR][PID:2244604] Backend process error: No success file => build failure
[2025-12-14 02:28:37,694][  INFO][PID:2244604] Worker failed build, took 272.3438756465912
[2025-12-14 02:28:37,699][  INFO][PID:2244604] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "amatej",
            "project_name": "dnf-nightly",
            "project_dirname": "dnf-nightly",
            "submitter": "amatej",
            "ended_on": 1765679317.6947234,
            "started_on": 1765679045.3508477,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-eln-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9907722-fedora-eln-ppc64le",
            "build_id": 9907722,
            "package_name": "libmodulemd",
            "package_version": "2.15.3-0.20251214021243230619.main.1.g527ebfa",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/amatej/dnf-nightly/libmodulemd",
            "git_hash": "4dc6cf202a5f30f7f2aadd6e2cca95889ca1782f",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "amatej/dnf-nightly--amatej",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/amatej/dnf-nightly/fedora-eln-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/",
                    "id": "copr_rpmsoftwaremanagement_dnf_nightly",
                    "name": "Additional repo copr_rpmsoftwaremanagement_dnf_nightly"
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/amatej/dnf-nightly",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/amatej/dnf-nightly",
            "result_dir": "09907722-libmodulemd",
            "built_packages": "",
            "id": 9907722,
            "mockchain_macros": {
                "copr_username": "amatej",
                "copr_projectname": "dnf-nightly",
                "vendor": "Fedora Project COPR (amatej/dnf-nightly)"
            }
        }
    ]
}
[2025-12-14 02:28:38,083][  INFO][PID:2244604] Sending fedora-messaging bus message in build.end
[2025-12-14 02:28:38,179][  INFO][PID:2244604] Compressing /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-eln-ppc64le/09907722-libmodulemd/builder-live.log by gzip
[2025-12-14 02:28:38,181][  INFO][PID:2244604] Running command 'gzip /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-eln-ppc64le/09907722-libmodulemd/builder-live.log' as PID 2395278
[2025-12-14 02:28:38,208][  INFO][PID:2244604] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-eln-ppc64le/09907722-libmodulemd/builder-live.log)
[2025-12-14 02:28:38,209][  INFO][PID:2244604] Compressing /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-eln-ppc64le/09907722-libmodulemd/backend.log by gzip
[2025-12-14 02:28:38,215][  INFO][PID:2244604] Running command 'gzip /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-eln-ppc64le/09907722-libmodulemd/backend.log' as PID 2395282