[2025-12-29 22:57:19,507][  INFO][PID:2552029] Marking build as starting
[2025-12-29 22:57:19,564][  INFO][PID:2552029] Checking that /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/repodata/repomd.xml exists
[2025-12-29 22:57:19,565][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 22:57:19,566][  INFO][PID:2552029] VM allocation process starts
[2025-12-29 22:57:19,637][  INFO][PID:2552029] Trying to allocate VM: ResallocHost, ticket_id=564722, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-29 22:57:22,675][  INFO][PID:2552029] Allocated host ResallocHost, ticket_id=564722, hostname=2620:52:6:1161:dead:beef:cafe:c14f, name=vmhost_p09_03_prod_00832944_20251229_224511, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-29 22:57:22,676][  INFO][PID:2552029] Allocating ssh connection to builder
[2025-12-29 22:57:22,676][  INFO][PID:2552029] Checking that builder machine is OK
[2025-12-29 22:57:23,623][  INFO][PID:2552029] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-12-29 22:57:24,106][  INFO][PID:2552029] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-12-29 22:57:24,106][  INFO][PID:2552029] Filling build.info file with builder info
[2025-12-29 22:57:24,107][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 22:57:24,108][  INFO][PID:2552029] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 115200,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "siddhesh",
            "project_name": "mbp-gcc-16",
            "project_dirname": "mbp-gcc-16",
            "submitter": "siddhesh",
            "ended_on": null,
            "started_on": 1767049044.108053,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9956560-fedora-rawhide-ppc64le",
            "build_id": 9956560,
            "package_name": "mpop",
            "package_version": "1.4.21-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/siddhesh/mbp-gcc-16/mpop",
            "git_hash": "33f2a34e903c404bfc5c112f7ac8d783be843ffb",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "siddhesh/mbp-gcc-16--siddhesh",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://kojipkgs.fedoraproject.org/repos/f44-build-side-124978/latest/$basearch/",
                    "id": "https_kojipkgs_fedoraproject_org_repos_f44_build_side_124978_latest_basearch",
                    "name": "Additional repo https_kojipkgs_fedoraproject_org_repos_f44_build_side_124978_latest_basearch"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/siddhesh/mbp-gcc-16",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/siddhesh/mbp-gcc-16",
            "result_dir": "09956560-mpop",
            "built_packages": "",
            "id": 9956560,
            "mockchain_macros": {
                "copr_username": "siddhesh",
                "copr_projectname": "mbp-gcc-16",
                "vendor": "Fedora Project COPR (siddhesh/mbp-gcc-16)"
            }
        }
    ]
}
[2025-12-29 22:57:24,155][  INFO][PID:2552029] Sending fedora-messaging bus message in build.start
[2025-12-29 22:57:24,706][  INFO][PID:2552029] Sending fedora-messaging bus message in chroot.start
[2025-12-29 22:57:24,732][  INFO][PID:2552029] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9956560-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-12-29 22:57:25,652][  INFO][PID:2552029] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c14f' (ED25519) to the list of known hosts.


[2025-12-29 22:57:25,653][  INFO][PID:2552029] Downloading the builder-live.log file, attempt 1
[2025-12-29 22:57:25,654][  INFO][PID:2552029] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c14f copr-rpmbuild-log
[2025-12-29 22:57:30,658][  INFO][PID:2552029] Periodic builder liveness probe: alive
[2025-12-29 22:57:30,659][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 22:57:35,659][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 22:57:40,660][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 22:57:45,661][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 22:57:50,662][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 22:57:55,663][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 22:58:00,664][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 22:58:05,665][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 22:58:10,667][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 22:58:15,667][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 22:58:20,668][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 22:58:25,670][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 22:58:30,671][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 22:58:35,672][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 22:58:40,673][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 22:58:45,674][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 22:58:50,676][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 22:58:55,677][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 22:59:00,678][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 22:59:05,680][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 22:59:10,681][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 22:59:15,682][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 22:59:20,683][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 22:59:25,684][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 22:59:30,685][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 22:59:35,687][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 22:59:40,688][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 22:59:45,689][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 22:59:50,689][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 22:59:55,691][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:00:00,692][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:00:05,693][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:00:10,694][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:00:15,695][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:00:19,370][ ERROR][PID:2552029] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-29 23:00:20,696][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:00:25,697][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:00:29,371][WARNING][PID:2552029] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-12-29 23:00:30,698][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:00:35,699][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:00:39,371][  INFO][PID:2552029] Downloading the builder-live.log file, attempt 2
[2025-12-29 23:00:39,373][  INFO][PID:2552029] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c14f copr-rpmbuild-log
[2025-12-29 23:00:40,700][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:00:45,702][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:00:50,703][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:00:55,704][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:01:00,705][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:01:05,706][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:01:10,707][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:01:15,708][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:01:20,710][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:01:25,712][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:01:30,713][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:01:35,714][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:01:39,385][ ERROR][PID:2552029] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-29 23:01:40,715][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:01:45,716][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:01:49,389][WARNING][PID:2552029] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-12-29 23:01:50,717][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:01:55,718][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:01:59,390][  INFO][PID:2552029] Downloading the builder-live.log file, attempt 3
[2025-12-29 23:01:59,391][  INFO][PID:2552029] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c14f copr-rpmbuild-log
[2025-12-29 23:02:00,719][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:02:05,720][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:02:10,721][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:02:15,722][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:02:20,724][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:02:25,728][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:02:30,729][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:02:35,730][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:02:40,731][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:02:45,732][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:02:50,733][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:02:55,735][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:02:59,459][ ERROR][PID:2552029] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-29 23:03:00,735][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:03:05,737][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:03:09,464][WARNING][PID:2552029] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-12-29 23:03:10,738][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:03:15,739][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:03:19,465][  INFO][PID:2552029] Downloading the builder-live.log file, attempt 4
[2025-12-29 23:03:19,466][  INFO][PID:2552029] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c14f copr-rpmbuild-log
[2025-12-29 23:03:20,740][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:03:25,741][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:03:30,742][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:03:35,743][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:03:40,744][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:03:45,745][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:03:50,746][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:03:55,747][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:04:00,748][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:04:05,749][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:04:10,750][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:04:15,751][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:04:19,530][ ERROR][PID:2552029] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-29 23:04:20,752][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:04:25,752][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:04:29,549][ ERROR][PID:2552029] Giving up for unstable SSH, failures: 1767049229.3709538, 1767049309.3897495, 1767049389.4643853, 1767049469.5490587
[2025-12-29 23:04:29,550][ ERROR][PID:2552029] Re-try request for task on 'ResallocHost, ticket_id=564722, hostname=2620:52:6:1161:dead:beef:cafe:c14f, name=vmhost_p09_03_prod_00832944_20251229_224511, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-12-29 23:04:29,550][  INFO][PID:2552029] Releasing VM back to pool
[2025-12-29 23:04:29,559][  INFO][PID:2552029] Retry #1 (on other host)
[2025-12-29 23:04:29,560][  INFO][PID:2552029] Checking that /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/repodata/repomd.xml exists
[2025-12-29 23:04:29,560][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:04:29,561][  INFO][PID:2552029] VM allocation process starts
[2025-12-29 23:04:29,608][  INFO][PID:2552029] Trying to allocate VM: ResallocHost, ticket_id=564814, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-29 23:04:32,639][  INFO][PID:2552029] Allocated host ResallocHost, ticket_id=564814, hostname=2620:52:6:1161:dead:beef:cafe:c14b, name=vmhost_p09_03_prod_00832896_20251229_223930, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-29 23:04:32,640][  INFO][PID:2552029] Allocating ssh connection to builder
[2025-12-29 23:04:32,640][  INFO][PID:2552029] Checking that builder machine is OK
[2025-12-29 23:04:33,523][  INFO][PID:2552029] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-12-29 23:04:34,563][  INFO][PID:2552029] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-12-29 23:04:34,563][  INFO][PID:2552029] Filling build.info file with builder info
[2025-12-29 23:04:34,573][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:04:34,574][  INFO][PID:2552029] Not re-notifying FE and msg buses for the new host.
[2025-12-29 23:04:34,574][  INFO][PID:2552029] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9956560-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-12-29 23:04:35,529][  INFO][PID:2552029] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c14b' (ED25519) to the list of known hosts.


[2025-12-29 23:04:35,530][  INFO][PID:2552029] Downloading the builder-live.log file, attempt 1
[2025-12-29 23:04:35,531][  INFO][PID:2552029] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c14b copr-rpmbuild-log
[2025-12-29 23:04:40,531][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:04:45,532][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:04:50,533][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:04:55,534][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:05:00,535][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:05:05,536][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:05:10,537][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:05:15,538][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:05:20,539][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:05:25,540][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:05:30,541][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:05:35,542][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:05:35,590][ ERROR][PID:2552029] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-29 23:05:40,543][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:05:45,544][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:05:45,604][WARNING][PID:2552029] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-12-29 23:05:50,545][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:05:55,546][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:05:55,605][  INFO][PID:2552029] Downloading the builder-live.log file, attempt 2
[2025-12-29 23:05:55,606][  INFO][PID:2552029] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c14b copr-rpmbuild-log
[2025-12-29 23:06:00,547][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:06:05,548][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:06:10,549][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:06:15,550][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:06:20,551][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:06:25,552][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:06:30,559][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:06:35,560][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:06:40,561][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:06:45,562][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:06:50,563][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:06:55,564][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:06:55,629][ ERROR][PID:2552029] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-29 23:07:00,565][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:07:05,566][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:07:05,638][WARNING][PID:2552029] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-12-29 23:07:10,568][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:07:15,569][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:07:15,639][  INFO][PID:2552029] Downloading the builder-live.log file, attempt 3
[2025-12-29 23:07:15,641][  INFO][PID:2552029] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c14b copr-rpmbuild-log
[2025-12-29 23:07:20,570][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:07:25,574][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:07:30,581][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:07:35,588][  INFO][PID:2552029] Periodic builder liveness probe: alive
[2025-12-29 23:07:35,588][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:07:40,591][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:07:45,593][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:07:50,595][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:07:55,598][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:08:00,602][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:08:05,608][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:08:10,612][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:08:15,616][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:08:15,711][ ERROR][PID:2552029] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-29 23:08:20,618][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:08:25,619][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:08:25,728][WARNING][PID:2552029] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-12-29 23:08:30,621][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:08:35,626][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:08:35,733][  INFO][PID:2552029] Downloading the builder-live.log file, attempt 4
[2025-12-29 23:08:35,735][  INFO][PID:2552029] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c14b copr-rpmbuild-log
[2025-12-29 23:08:40,629][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:08:45,631][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:08:50,634][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:08:55,638][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:09:00,644][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:09:05,645][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:09:10,647][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:09:15,651][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:09:20,657][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:09:25,658][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:09:30,664][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:09:35,666][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:09:40,673][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:09:45,679][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:09:50,681][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:09:55,683][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:10:00,684][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:10:05,685][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:10:10,686][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:10:15,687][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:10:20,689][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:10:25,690][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:10:30,691][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:10:35,692][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:10:40,693][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:10:45,694][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:10:50,695][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:10:55,696][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:11:00,699][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:11:05,701][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:11:10,702][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:11:15,703][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:11:20,705][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:11:25,706][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:11:30,708][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:11:35,709][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:11:40,711][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:11:45,712][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:11:50,713][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:11:55,714][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:12:00,716][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:12:05,717][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:12:10,718][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:12:15,719][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:12:20,720][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:12:25,721][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:12:30,722][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:12:35,723][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:12:40,724][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:12:45,725][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:12:50,726][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:12:55,727][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:13:00,728][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:13:05,729][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:13:10,730][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:13:15,731][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:13:20,732][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:13:25,735][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:13:30,736][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:13:35,737][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:13:40,738][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:13:45,739][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:13:50,740][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:13:55,741][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:14:00,742][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:14:05,744][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:14:10,744][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:14:15,746][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:14:20,747][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:14:25,748][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:14:30,749][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:14:35,750][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:14:40,752][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:14:45,753][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:14:50,754][  INFO][PID:2552029] Checking for cancel request
[2025-12-29 23:14:53,847][  INFO][PID:2552029] Downloading results from builder
[2025-12-29 23:14:53,848][  INFO][PID:2552029] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c14b]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09956560-mpop started
[2025-12-29 23:14:53,849][  INFO][PID:2552029] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c14b]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09956560-mpop/ &> /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09956560-mpop/build-09956560.rsync.log
[2025-12-29 23:14:54,502][  INFO][PID:2552029] rsyncing finished.
[2025-12-29 23:14:54,503][  INFO][PID:2552029] Releasing VM back to pool
[2025-12-29 23:14:54,513][  INFO][PID:2552029] Searching for 'success' file in resultdir
[2025-12-29 23:14:54,515][  INFO][PID:2552029] Going to sign pkgs from source: 9956560-fedora-rawhide-ppc64le in chroot: /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le
[2025-12-29 23:14:54,516][  INFO][PID:2552029] Calling '/bin/sign -u siddhesh#mbp-gcc-16@copr.fedorahosted.org -p' (attempt #1)
[2025-12-29 23:14:54,785][  INFO][PID:2552029] Calling '/bin/sign -4 -h sha256 -u siddhesh#mbp-gcc-16@copr.fedorahosted.org -r /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09956560-mpop/mpop-debuginfo-1.4.21-1.fc44.ppc64le.rpm' (attempt #1)
[2025-12-29 23:14:55,609][  INFO][PID:2552029] signed rpm: /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09956560-mpop/mpop-debuginfo-1.4.21-1.fc44.ppc64le.rpm
[2025-12-29 23:14:55,609][  INFO][PID:2552029] Calling '/bin/sign -4 -h sha256 -u siddhesh#mbp-gcc-16@copr.fedorahosted.org -r /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09956560-mpop/mpop-1.4.21-1.fc44.src.rpm' (attempt #1)
[2025-12-29 23:14:56,435][  INFO][PID:2552029] signed rpm: /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09956560-mpop/mpop-1.4.21-1.fc44.src.rpm
[2025-12-29 23:14:56,435][  INFO][PID:2552029] Calling '/bin/sign -4 -h sha256 -u siddhesh#mbp-gcc-16@copr.fedorahosted.org -r /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09956560-mpop/mpop-1.4.21-1.fc44.ppc64le.rpm' (attempt #1)
[2025-12-29 23:14:57,276][  INFO][PID:2552029] signed rpm: /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09956560-mpop/mpop-1.4.21-1.fc44.ppc64le.rpm
[2025-12-29 23:14:57,276][  INFO][PID:2552029] Calling '/bin/sign -4 -h sha256 -u siddhesh#mbp-gcc-16@copr.fedorahosted.org -r /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09956560-mpop/mpop-debugsource-1.4.21-1.fc44.ppc64le.rpm' (attempt #1)
[2025-12-29 23:14:58,109][  INFO][PID:2552029] signed rpm: /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09956560-mpop/mpop-debugsource-1.4.21-1.fc44.ppc64le.rpm
[2025-12-29 23:14:58,109][  INFO][PID:2552029] Sign done
[2025-12-29 23:14:58,110][  INFO][PID:2552029] Incremental createrepo run, adding 09956560-mpop into https://download.copr.fedorainfracloud.org/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le, (auto-create-repo=True)
[2025-12-29 23:14:58,111][  INFO][PID:2552029] Running command 'copr-repo --batched /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le --add 09956560-mpop --no-appstream-metadata' as PID 2651392
[2025-12-29 23:15:08,576][  INFO][PID:2552029] Finished after 10 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le --add 09956560-mpop --no-appstream-metadata)
[2025-12-29 23:15:08,577][  INFO][PID:2552029] Getting build details
[2025-12-29 23:15:08,577][  INFO][PID:2552029] Listing built binary packages in /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09956560-mpop
[2025-12-29 23:15:08,577][  INFO][PID:2552029] Built packages:
['mpop-debugsource 1.4.21', 'mpop-debuginfo 1.4.21', 'mpop 1.4.21']
[2025-12-29 23:15:08,578][  INFO][PID:2552029] build details: {'built_packages': 'mpop-debugsource 1.4.21\nmpop-debuginfo 1.4.21\nmpop 1.4.21'}
[2025-12-29 23:15:08,578][  INFO][PID:2552029] Retrieving pubkey
[2025-12-29 23:15:08,578][  INFO][PID:2552029] Calling '/bin/sign -u siddhesh#mbp-gcc-16@copr.fedorahosted.org -p' (attempt #1)
[2025-12-29 23:15:08,863][  INFO][PID:2552029] Added pubkey for user siddhesh project mbp-gcc-16 into: /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/pubkey.gpg
[2025-12-29 23:15:08,863][  INFO][PID:2552029] Finished build: id=9956560 failed=False timeout=115200 destdir=/var/lib/copr/public_html/results/siddhesh/mbp-gcc-16 chroot=fedora-rawhide-ppc64le 
[2025-12-29 23:15:08,865][  INFO][PID:2552029] Worker succeeded build, took 634.2911381721497
[2025-12-29 23:15:08,866][  INFO][PID:2552029] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 115200,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "siddhesh",
            "project_name": "mbp-gcc-16",
            "project_dirname": "mbp-gcc-16",
            "submitter": "siddhesh",
            "ended_on": 1767050108.8654294,
            "started_on": 1767049474.5742912,
            "submitted_on": null,
            "status": 1,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9956560-fedora-rawhide-ppc64le",
            "build_id": 9956560,
            "package_name": "mpop",
            "package_version": "1.4.21-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/siddhesh/mbp-gcc-16/mpop",
            "git_hash": "33f2a34e903c404bfc5c112f7ac8d783be843ffb",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "siddhesh/mbp-gcc-16--siddhesh",
            "results": {
                "packages": [
                    {
                        "name": "mpop",
                        "epoch": null,
                        "version": "1.4.21",
                        "release": "1.fc44",
                        "arch": "src"
                    },
                    {
                        "name": "mpop-debugsource",
                        "epoch": null,
                        "version": "1.4.21",
                        "release": "1.fc44",
                        "arch": "ppc64le"
                    },
                    {
                        "name": "mpop-debuginfo",
                        "epoch": null,
                        "version": "1.4.21",
                        "release": "1.fc44",
                        "arch": "ppc64le"
                    },
                    {
                        "name": "mpop",
                        "epoch": null,
                        "version": "1.4.21",
                        "release": "1.fc44",
                        "arch": "ppc64le"
                    }
                ]
            },
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://kojipkgs.fedoraproject.org/repos/f44-build-side-124978/latest/$basearch/",
                    "id": "https_kojipkgs_fedoraproject_org_repos_f44_build_side_124978_latest_basearch",
                    "name": "Additional repo https_kojipkgs_fedoraproject_org_repos_f44_build_side_124978_latest_basearch"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/siddhesh/mbp-gcc-16",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/siddhesh/mbp-gcc-16",
            "result_dir": "09956560-mpop",
            "built_packages": "mpop-debugsource 1.4.21\nmpop-debuginfo 1.4.21\nmpop 1.4.21",
            "id": 9956560,
            "mockchain_macros": {
                "copr_username": "siddhesh",
                "copr_projectname": "mbp-gcc-16",
                "vendor": "Fedora Project COPR (siddhesh/mbp-gcc-16)"
            }
        }
    ]
}
[2025-12-29 23:15:08,989][  INFO][PID:2552029] Sending fedora-messaging bus message in build.end
[2025-12-29 23:15:09,017][  INFO][PID:2552029] Compressing /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09956560-mpop/builder-live.log by gzip
[2025-12-29 23:15:09,019][  INFO][PID:2552029] Running command 'gzip /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09956560-mpop/builder-live.log' as PID 2652259
[2025-12-29 23:15:09,025][  INFO][PID:2552029] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09956560-mpop/builder-live.log)
[2025-12-29 23:15:09,026][  INFO][PID:2552029] Compressing /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09956560-mpop/backend.log by gzip
[2025-12-29 23:15:09,027][  INFO][PID:2552029] Running command 'gzip /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09956560-mpop/backend.log' as PID 2652261