[2026-01-21 23:46:17,233][  INFO][PID:2247649] Marking build as starting
[2026-01-21 23:46:17,581][  INFO][PID:2247649] Checking that /var/lib/copr/public_html/results/celenity/copr/fedora-43-ppc64le/repodata/repomd.xml exists
[2026-01-21 23:46:17,588][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:46:17,589][  INFO][PID:2247649] VM allocation process starts
[2026-01-21 23:46:17,604][  INFO][PID:2247649] Trying to allocate VM: ResallocHost, ticket_id=957093, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-21 23:46:20,624][  INFO][PID:2247649] Allocated host ResallocHost, ticket_id=957093, hostname=2620:52:6:1161:dead:beef:cafe:c192, name=vmhost_p09_04_prod_01465888_20260121_231356, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-21 23:46:20,625][  INFO][PID:2247649] Allocating ssh connection to builder
[2026-01-21 23:46:20,625][  INFO][PID:2247649] Checking that builder machine is OK
[2026-01-21 23:47:20,677][ ERROR][PID:2247649] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c192 port 22: Connection timed out

[2026-01-21 23:47:30,677][ ERROR][PID:2247649] Re-try request for task on 'ResallocHost, ticket_id=957093, hostname=2620:52:6:1161:dead:beef:cafe:c192, name=vmhost_p09_04_prod_01465888_20260121_231356, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts
[2026-01-21 23:47:30,678][  INFO][PID:2247649] Releasing VM back to pool
[2026-01-21 23:47:30,687][  INFO][PID:2247649] Retry #1 (on other host)
[2026-01-21 23:47:30,688][  INFO][PID:2247649] Checking that /var/lib/copr/public_html/results/celenity/copr/fedora-43-ppc64le/repodata/repomd.xml exists
[2026-01-21 23:47:30,688][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:47:30,688][  INFO][PID:2247649] VM allocation process starts
[2026-01-21 23:47:30,727][  INFO][PID:2247649] Trying to allocate VM: ResallocHost, ticket_id=957106, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-21 23:47:33,760][  INFO][PID:2247649] Allocated host ResallocHost, ticket_id=957106, hostname=2620:52:6:1161:dead:beef:cafe:c153, name=vmhost_p09_03_prod_01465935_20260121_231939, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-21 23:47:33,760][  INFO][PID:2247649] Allocating ssh connection to builder
[2026-01-21 23:47:33,761][  INFO][PID:2247649] Checking that builder machine is OK
[2026-01-21 23:47:36,943][  INFO][PID:2247649] Running remote command: copr-builder-ready fedora-43-ppc64le
[2026-01-21 23:47:38,551][  INFO][PID:2247649] Red Hat subscription not needed for fedora-43-ppc64le
Builder is ready to be used

[2026-01-21 23:47:38,551][  INFO][PID:2247649] Filling build.info file with builder info
[2026-01-21 23:47:38,552][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:47:38,552][  INFO][PID:2247649] Not re-notifying FE and msg buses for the new host.
[2026-01-21 23:47:38,553][  INFO][PID:2247649] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10043124-fedora-43-ppc64le --chroot fedora-43-ppc64le --detached
[2026-01-21 23:47:41,024][  INFO][PID:2247649] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c153' (ED25519) to the list of known hosts.


[2026-01-21 23:47:41,024][  INFO][PID:2247649] Downloading the builder-live.log file, attempt 1
[2026-01-21 23:47:41,026][  INFO][PID:2247649] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c153 copr-rpmbuild-log
[2026-01-21 23:47:46,030][  INFO][PID:2247649] Periodic builder liveness probe: alive
[2026-01-21 23:47:46,031][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:47:51,032][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:47:56,033][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:48:01,034][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:48:06,034][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:48:11,035][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:48:16,036][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:48:21,037][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:48:26,038][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:48:31,039][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:48:36,040][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:48:41,041][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:48:46,043][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:48:51,044][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:48:56,271][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:49:01,272][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:49:06,273][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:49:11,274][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:49:16,292][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:49:21,293][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:49:26,294][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:49:31,295][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:49:36,296][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:49:41,340][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:49:46,518][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:49:51,525][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:49:56,531][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:50:01,532][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:50:06,533][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:50:11,535][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:50:16,536][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:50:21,539][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:50:26,540][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:50:31,541][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:50:36,544][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:50:41,545][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:50:46,546][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:50:51,547][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:50:56,548][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:51:01,548][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:51:06,549][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:51:11,550][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:51:16,551][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:51:21,552][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:51:26,553][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:51:31,554][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:51:36,555][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:51:41,556][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:51:46,557][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:51:51,558][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:51:56,559][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:52:01,560][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:52:06,562][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:52:11,564][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:52:16,565][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:52:21,566][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:52:26,567][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:52:31,568][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:52:36,569][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:52:41,570][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:52:46,571][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:52:51,572][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:52:56,573][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:53:01,574][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:53:06,575][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:53:11,576][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:53:16,578][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:53:21,578][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:53:26,579][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:53:31,580][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:53:36,582][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:53:41,583][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:53:46,584][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:53:51,585][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:53:56,586][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:54:01,587][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:54:06,808][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:54:11,809][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:54:16,810][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:54:21,811][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:54:26,812][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:54:31,813][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:54:36,815][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:54:41,816][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:54:46,817][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:54:51,818][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:54:56,819][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:55:01,820][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:55:06,821][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:55:11,822][  INFO][PID:2247649] Checking for cancel request
[2026-01-21 23:55:15,633][  INFO][PID:2247649] Downloading results from builder
[2026-01-21 23:55:15,634][  INFO][PID:2247649] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c153]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/celenity/copr/fedora-43-ppc64le/10043124-dove started
[2026-01-21 23:55:15,635][  INFO][PID:2247649] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c153]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/celenity/copr/fedora-43-ppc64le/10043124-dove/ &> /var/lib/copr/public_html/results/celenity/copr/fedora-43-ppc64le/10043124-dove/build-10043124.rsync.log
[2026-01-21 23:56:15,719][  INFO][PID:2247649] rsyncing finished.
[2026-01-21 23:56:15,747][ ERROR][PID:2247649] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-01-21 23:56:15,747][ ERROR][PID:2247649] SSH connection lost on #1 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-01-21 23:56:25,748][  INFO][PID:2247649] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c153]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/celenity/copr/fedora-43-ppc64le/10043124-dove started
[2026-01-21 23:56:25,749][  INFO][PID:2247649] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c153]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/celenity/copr/fedora-43-ppc64le/10043124-dove/ &> /var/lib/copr/public_html/results/celenity/copr/fedora-43-ppc64le/10043124-dove/build-10043124.rsync.log
[2026-01-21 23:57:25,825][  INFO][PID:2247649] rsyncing finished.
[2026-01-21 23:57:25,826][ ERROR][PID:2247649] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-01-21 23:57:25,826][ ERROR][PID:2247649] SSH connection lost on #2 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-01-21 23:57:35,826][  INFO][PID:2247649] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c153]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/celenity/copr/fedora-43-ppc64le/10043124-dove started
[2026-01-21 23:57:35,827][  INFO][PID:2247649] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c153]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/celenity/copr/fedora-43-ppc64le/10043124-dove/ &> /var/lib/copr/public_html/results/celenity/copr/fedora-43-ppc64le/10043124-dove/build-10043124.rsync.log
[2026-01-21 23:57:39,955][  INFO][PID:2247649] rsyncing finished.
[2026-01-21 23:57:39,955][  INFO][PID:2247649] Releasing VM back to pool
[2026-01-21 23:57:39,964][  INFO][PID:2247649] Searching for 'success' file in resultdir
[2026-01-21 23:57:39,964][  INFO][PID:2247649] Going to sign pkgs from source: 10043124-fedora-43-ppc64le in chroot: /var/lib/copr/public_html/results/celenity/copr/fedora-43-ppc64le
[2026-01-21 23:57:39,965][  INFO][PID:2247649] Calling '/bin/sign -u celenity#copr@copr.fedorahosted.org -p' (attempt #1)
[2026-01-21 23:57:40,238][  INFO][PID:2247649] Calling '/bin/sign -4 -h sha256 -u celenity#copr@copr.fedorahosted.org -r /var/lib/copr/public_html/results/celenity/copr/fedora-43-ppc64le/10043124-dove/dove-202601211-1.fc43.src.rpm' (attempt #1)
[2026-01-21 23:57:41,056][  INFO][PID:2247649] signed rpm: /var/lib/copr/public_html/results/celenity/copr/fedora-43-ppc64le/10043124-dove/dove-202601211-1.fc43.src.rpm
[2026-01-21 23:57:41,057][  INFO][PID:2247649] Calling '/bin/sign -4 -h sha256 -u celenity#copr@copr.fedorahosted.org -r /var/lib/copr/public_html/results/celenity/copr/fedora-43-ppc64le/10043124-dove/dove-202601211-1.fc43.noarch.rpm' (attempt #1)
[2026-01-21 23:57:41,783][  INFO][PID:2247649] signed rpm: /var/lib/copr/public_html/results/celenity/copr/fedora-43-ppc64le/10043124-dove/dove-202601211-1.fc43.noarch.rpm
[2026-01-21 23:57:41,784][  INFO][PID:2247649] Sign done
[2026-01-21 23:57:41,784][  INFO][PID:2247649] Incremental createrepo run, adding 10043124-dove into https://download.copr.fedorainfracloud.org/results/celenity/copr/fedora-43-ppc64le, (auto-create-repo=True)
[2026-01-21 23:57:41,785][  INFO][PID:2247649] Running command 'copr-repo --batched /var/lib/copr/public_html/results/celenity/copr/fedora-43-ppc64le --add 10043124-dove' as PID 2300228
[2026-01-21 23:57:45,810][  INFO][PID:2247649] Finished after 4 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/celenity/copr/fedora-43-ppc64le --add 10043124-dove)
[2026-01-21 23:57:45,811][  INFO][PID:2247649] Getting build details
[2026-01-21 23:57:45,811][  INFO][PID:2247649] Listing built binary packages in /var/lib/copr/public_html/results/celenity/copr/fedora-43-ppc64le/10043124-dove
[2026-01-21 23:57:45,811][  INFO][PID:2247649] Built packages:
['dove 202601211']
[2026-01-21 23:57:45,812][  INFO][PID:2247649] build details: {'built_packages': 'dove 202601211'}
[2026-01-21 23:57:45,812][  INFO][PID:2247649] Retrieving pubkey
[2026-01-21 23:57:45,813][  INFO][PID:2247649] Calling '/bin/sign -u celenity#copr@copr.fedorahosted.org -p' (attempt #1)
[2026-01-21 23:57:46,013][  INFO][PID:2247649] Added pubkey for user celenity project copr into: /var/lib/copr/public_html/results/celenity/copr/pubkey.gpg
[2026-01-21 23:57:46,014][  INFO][PID:2247649] Finished build: id=10043124 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/celenity/copr chroot=fedora-43-ppc64le 
[2026-01-21 23:57:46,016][  INFO][PID:2247649] Worker succeeded build, took 607.4633455276489
[2026-01-21 23:57:46,016][  INFO][PID:2247649] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "celenity",
            "project_name": "copr",
            "project_dirname": "copr",
            "submitter": "celenity",
            "ended_on": 1769039866.016248,
            "started_on": 1769039258.5529025,
            "submitted_on": null,
            "status": 1,
            "chroot": "fedora-43-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "10043124-fedora-43-ppc64le",
            "build_id": 10043124,
            "package_name": "dove",
            "package_version": "202601211-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/celenity/copr/dove",
            "git_hash": "acbf8b723a966ca74a7a50a4de94ea022934cabc",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "celenity/copr--celenity",
            "results": {
                "packages": [
                    {
                        "name": "dove",
                        "epoch": null,
                        "version": "202601211",
                        "release": "1.fc43",
                        "arch": "noarch"
                    },
                    {
                        "name": "dove",
                        "epoch": null,
                        "version": "202601211",
                        "release": "1.fc43",
                        "arch": "src"
                    }
                ]
            },
            "appstream": true,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/celenity/copr/fedora-43-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/celenity/copr",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/celenity/copr",
            "result_dir": "10043124-dove",
            "built_packages": "dove 202601211",
            "id": 10043124,
            "mockchain_macros": {
                "copr_username": "celenity",
                "copr_projectname": "copr",
                "vendor": "Fedora Project COPR (celenity/copr)"
            }
        }
    ]
}
[2026-01-21 23:57:46,180][  INFO][PID:2247649] Sending fedora-messaging bus message in build.end
[2026-01-21 23:57:47,505][  INFO][PID:2247649] Compressing /var/lib/copr/public_html/results/celenity/copr/fedora-43-ppc64le/10043124-dove/builder-live.log by gzip
[2026-01-21 23:57:47,506][  INFO][PID:2247649] Running command 'gzip /var/lib/copr/public_html/results/celenity/copr/fedora-43-ppc64le/10043124-dove/builder-live.log' as PID 2300587
[2026-01-21 23:57:47,595][  INFO][PID:2247649] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/celenity/copr/fedora-43-ppc64le/10043124-dove/builder-live.log)
[2026-01-21 23:57:47,595][  INFO][PID:2247649] Compressing /var/lib/copr/public_html/results/celenity/copr/fedora-43-ppc64le/10043124-dove/backend.log by gzip
[2026-01-21 23:57:47,596][  INFO][PID:2247649] Running command 'gzip /var/lib/copr/public_html/results/celenity/copr/fedora-43-ppc64le/10043124-dove/backend.log' as PID 2300593