[2025-12-31 20:43:58,571][  INFO][PID:2495379] Marking build as starting
[2025-12-31 20:43:58,619][  INFO][PID:2495379] Checking that /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16.checker/fedora-rawhide-ppc64le/repodata/repomd.xml exists
[2025-12-31 20:43:58,620][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:43:58,621][  INFO][PID:2495379] VM allocation process starts
[2025-12-31 20:43:58,632][  INFO][PID:2495379] Trying to allocate VM: ResallocHost, ticket_id=597805, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-31 20:44:01,691][  INFO][PID:2495379] Allocated host ResallocHost, ticket_id=597805, hostname=2620:52:6:1161:dead:beef:cafe:c148, name=vmhost_p09_03_prod_00872494_20251231_203408, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-31 20:44:01,692][  INFO][PID:2495379] Allocating ssh connection to builder
[2025-12-31 20:44:01,692][  INFO][PID:2495379] Checking that builder machine is OK
[2025-12-31 20:44:02,569][  INFO][PID:2495379] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-12-31 20:44:03,127][  INFO][PID:2495379] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-12-31 20:44:03,128][  INFO][PID:2495379] Filling build.info file with builder info
[2025-12-31 20:44:03,129][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:44:03,130][  INFO][PID:2495379] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 115200,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "siddhesh",
            "project_name": "mbp-gcc-16.checker",
            "project_dirname": "mbp-gcc-16.checker",
            "submitter": "siddhesh",
            "ended_on": null,
            "started_on": 1767213843.1308086,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9965742-fedora-rawhide-ppc64le",
            "build_id": 9965742,
            "package_name": "ddnet",
            "package_version": "19.5-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/siddhesh/mbp-gcc-16.checker/ddnet",
            "git_hash": "9b2190b33d20b7027c4e4212bfaa206ccb7e81d1",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "siddhesh/mbp-gcc-16.checker--siddhesh",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/siddhesh/mbp-gcc-16.checker/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/siddhesh/mbp-gcc-16.checker",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/siddhesh/mbp-gcc-16.checker",
            "result_dir": "09965742-ddnet",
            "built_packages": "",
            "id": 9965742,
            "mockchain_macros": {
                "copr_username": "siddhesh",
                "copr_projectname": "mbp-gcc-16.checker",
                "vendor": "Fedora Project COPR (siddhesh/mbp-gcc-16.checker)"
            }
        }
    ]
}
[2025-12-31 20:44:03,182][  INFO][PID:2495379] Sending fedora-messaging bus message in build.start
[2025-12-31 20:44:03,729][  INFO][PID:2495379] Sending fedora-messaging bus message in chroot.start
[2025-12-31 20:44:03,758][  INFO][PID:2495379] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9965742-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-12-31 20:44:04,712][  INFO][PID:2495379] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c148' (ED25519) to the list of known hosts.


[2025-12-31 20:44:04,713][  INFO][PID:2495379] Downloading the builder-live.log file, attempt 1
[2025-12-31 20:44:04,716][  INFO][PID:2495379] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c148 copr-rpmbuild-log
[2025-12-31 20:44:09,722][  INFO][PID:2495379] Periodic builder liveness probe: alive
[2025-12-31 20:44:09,723][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:44:14,724][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:44:19,725][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:44:24,726][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:44:29,727][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:44:34,728][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:44:39,729][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:44:44,729][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:44:49,730][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:44:54,731][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:44:59,733][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:45:04,734][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:45:09,745][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:45:14,759][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:45:19,761][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:45:24,763][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:45:29,764][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:45:34,765][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:45:39,766][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:45:44,767][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:45:49,768][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:45:54,769][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:45:59,769][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:46:04,770][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:46:09,771][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:46:14,779][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:46:19,783][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:46:24,786][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:46:29,787][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:46:34,788][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:46:39,789][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:46:44,790][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:46:49,791][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:46:54,792][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:46:59,793][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:47:04,794][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:47:09,795][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:47:14,796][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:47:19,797][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:47:24,798][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:47:29,800][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:47:34,801][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:47:39,801][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:47:44,802][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:47:49,803][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:47:54,805][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:47:59,806][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:48:04,807][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:48:09,808][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:48:14,809][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:48:19,810][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:48:24,811][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:48:29,847][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:48:34,848][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:48:39,849][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:48:44,850][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:48:49,851][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:48:54,853][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:48:59,854][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:49:04,855][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:49:09,378][ ERROR][PID:2495379] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-31 20:49:09,856][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:49:14,857][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:49:19,379][WARNING][PID:2495379] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-12-31 20:49:19,858][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:49:24,860][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:49:29,380][  INFO][PID:2495379] Downloading the builder-live.log file, attempt 2
[2025-12-31 20:49:29,381][  INFO][PID:2495379] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c148 copr-rpmbuild-log
[2025-12-31 20:49:29,407][ ERROR][PID:2495379] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-31 20:49:29,861][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:49:34,862][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:49:39,407][WARNING][PID:2495379] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-12-31 20:49:39,948][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:49:44,949][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:49:49,408][  INFO][PID:2495379] Downloading the builder-live.log file, attempt 3
[2025-12-31 20:49:49,409][  INFO][PID:2495379] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c148 copr-rpmbuild-log
[2025-12-31 20:49:49,437][ ERROR][PID:2495379] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-31 20:49:49,950][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:49:54,951][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:49:59,439][WARNING][PID:2495379] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-12-31 20:49:59,952][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:50:04,953][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:50:09,441][  INFO][PID:2495379] Downloading the builder-live.log file, attempt 4
[2025-12-31 20:50:09,442][  INFO][PID:2495379] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c148 copr-rpmbuild-log
[2025-12-31 20:50:09,471][ ERROR][PID:2495379] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-31 20:50:09,954][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:50:14,955][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:50:19,484][ ERROR][PID:2495379] Giving up for unstable SSH, failures: 1767214159.3795705, 1767214179.4078, 1767214199.4399307, 1767214219.4843686
[2025-12-31 20:50:19,485][ ERROR][PID:2495379] Re-try request for task on 'ResallocHost, ticket_id=597805, hostname=2620:52:6:1161:dead:beef:cafe:c148, name=vmhost_p09_03_prod_00872494_20251231_203408, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-12-31 20:50:19,485][  INFO][PID:2495379] Releasing VM back to pool
[2025-12-31 20:50:19,493][  INFO][PID:2495379] Retry #1 (on other host)
[2025-12-31 20:50:19,494][  INFO][PID:2495379] Checking that /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16.checker/fedora-rawhide-ppc64le/repodata/repomd.xml exists
[2025-12-31 20:50:19,494][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:50:19,495][  INFO][PID:2495379] VM allocation process starts
[2025-12-31 20:50:19,536][  INFO][PID:2495379] Trying to allocate VM: ResallocHost, ticket_id=597866, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-31 20:50:22,590][  INFO][PID:2495379] Allocated host ResallocHost, ticket_id=597866, hostname=2620:52:6:1161:dead:beef:cafe:c14f, name=vmhost_p09_03_prod_00872545_20251231_204018, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-31 20:50:22,591][  INFO][PID:2495379] Allocating ssh connection to builder
[2025-12-31 20:50:22,591][  INFO][PID:2495379] Checking that builder machine is OK
[2025-12-31 20:50:23,607][  INFO][PID:2495379] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-12-31 20:51:23,670][ ERROR][PID:2495379] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c14f port 22: Connection timed out

[2025-12-31 20:51:33,671][ ERROR][PID:2495379] Re-try request for task on 'ResallocHost, ticket_id=597866, hostname=2620:52:6:1161:dead:beef:cafe:c14f, name=vmhost_p09_03_prod_00872545_20251231_204018, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts
[2025-12-31 20:51:33,671][  INFO][PID:2495379] Releasing VM back to pool
[2025-12-31 20:51:33,680][  INFO][PID:2495379] Retry #2 (on other host)
[2025-12-31 20:51:33,681][  INFO][PID:2495379] Checking that /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16.checker/fedora-rawhide-ppc64le/repodata/repomd.xml exists
[2025-12-31 20:51:33,681][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:51:33,682][  INFO][PID:2495379] VM allocation process starts
[2025-12-31 20:51:33,724][  INFO][PID:2495379] Trying to allocate VM: ResallocHost, ticket_id=597877, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-31 20:51:36,762][  INFO][PID:2495379] Allocated host ResallocHost, ticket_id=597877, hostname=2620:52:6:1161:dead:beef:cafe:c18e, name=vmhost_p09_04_prod_00872556_20251231_204137, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-31 20:51:36,763][  INFO][PID:2495379] Allocating ssh connection to builder
[2025-12-31 20:51:36,763][  INFO][PID:2495379] Checking that builder machine is OK
[2025-12-31 20:51:37,709][  INFO][PID:2495379] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-12-31 20:51:38,197][  INFO][PID:2495379] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-12-31 20:51:38,197][  INFO][PID:2495379] Filling build.info file with builder info
[2025-12-31 20:51:38,325][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:51:38,325][  INFO][PID:2495379] Not re-notifying FE and msg buses for the new host.
[2025-12-31 20:51:38,326][  INFO][PID:2495379] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9965742-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-12-31 20:51:39,229][  INFO][PID:2495379] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c18e' (ED25519) to the list of known hosts.


[2025-12-31 20:51:39,230][  INFO][PID:2495379] Downloading the builder-live.log file, attempt 1
[2025-12-31 20:51:39,231][  INFO][PID:2495379] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c18e copr-rpmbuild-log
[2025-12-31 20:51:44,230][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:51:49,231][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:51:54,232][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:51:59,233][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:52:04,234][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:52:09,235][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:52:14,236][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:52:19,237][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:52:24,238][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:52:29,239][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:52:34,240][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:52:39,241][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:52:44,242][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:52:49,243][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:52:54,244][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:52:59,245][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:53:04,246][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:53:09,246][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:53:14,297][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:53:19,299][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:53:24,300][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:53:29,311][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:53:34,322][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:53:39,324][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:53:44,325][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:53:49,338][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:53:54,411][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:53:59,413][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:54:04,415][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:54:09,416][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:54:14,423][  INFO][PID:2495379] Periodic builder liveness probe: alive
[2025-12-31 20:54:14,424][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:54:19,425][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:54:24,427][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:54:29,428][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:54:34,445][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:54:39,446][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:54:44,536][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:54:49,538][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:54:54,652][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:54:59,654][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:55:04,656][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:55:09,659][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:55:14,661][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:55:19,663][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:55:24,835][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:55:29,967][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:55:34,968][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:55:40,035][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:55:45,037][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:55:50,039][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:55:55,041][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:56:00,042][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:56:05,060][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:56:10,061][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:56:15,062][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:56:20,063][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:56:25,064][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:56:30,065][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:56:35,066][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:56:40,067][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:56:45,096][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:56:50,098][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:56:55,140][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:57:00,142][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:57:05,260][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:57:10,262][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:57:15,264][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:57:20,322][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:57:25,324][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:57:30,538][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:57:35,542][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:57:40,545][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:57:45,546][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:57:50,548][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:57:55,550][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:58:00,556][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:58:05,558][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:58:10,560][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:58:15,562][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:58:20,563][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:58:25,564][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:58:30,567][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:58:35,568][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:58:40,569][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:58:45,571][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:58:50,572][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:58:55,573][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:59:00,574][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:59:05,579][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:59:10,580][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:59:15,581][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:59:20,657][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:59:25,659][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:59:30,660][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:59:35,661][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:59:40,663][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:59:45,665][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:59:50,666][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 20:59:55,667][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:00:00,670][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:00:05,672][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:00:10,673][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:00:15,675][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:00:20,676][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:00:25,845][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:00:30,847][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:00:35,849][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:00:40,851][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:00:45,854][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:00:50,952][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:00:56,143][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:01:01,597][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:01:06,599][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:01:11,600][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:01:16,601][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:01:21,602][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:01:26,603][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:01:31,604][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:01:36,605][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:01:41,606][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:01:46,607][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:01:51,608][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:01:56,609][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:02:01,610][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:02:06,612][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:02:11,613][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:02:16,614][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:02:21,615][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:02:26,616][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:02:31,617][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:02:36,620][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:02:41,621][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:02:46,622][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:02:51,670][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:02:56,769][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:03:01,938][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:03:06,939][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:03:11,940][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:03:16,942][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:03:22,039][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:03:27,064][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:03:32,065][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:03:37,066][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:03:42,068][  INFO][PID:2495379] Checking for cancel request
[2025-12-31 21:03:44,941][  INFO][PID:2495379] Downloading results from builder
[2025-12-31 21:03:44,942][  INFO][PID:2495379] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18e]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16.checker/fedora-rawhide-ppc64le/09965742-ddnet started
[2025-12-31 21:03:44,942][  INFO][PID:2495379] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18e]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16.checker/fedora-rawhide-ppc64le/09965742-ddnet/ &> /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16.checker/fedora-rawhide-ppc64le/09965742-ddnet/build-09965742.rsync.log
[2025-12-31 21:03:45,892][  INFO][PID:2495379] rsyncing finished.
[2025-12-31 21:03:45,893][  INFO][PID:2495379] Releasing VM back to pool
[2025-12-31 21:03:45,901][  INFO][PID:2495379] Searching for 'success' file in resultdir
[2025-12-31 21:03:45,902][ ERROR][PID:2495379] Build failed: Backend process error: No success file => build failure
[2025-12-31 21:03:45,903][  INFO][PID:2495379] Finished build: id=9965742 failed=True timeout=115200 destdir=/var/lib/copr/public_html/results/siddhesh/mbp-gcc-16.checker chroot=fedora-rawhide-ppc64le 
[2025-12-31 21:03:45,904][ ERROR][PID:2495379] Backend process error: No success file => build failure
[2025-12-31 21:03:45,905][  INFO][PID:2495379] Worker failed build, took 727.5793454647064
[2025-12-31 21:03:45,905][  INFO][PID:2495379] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 115200,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "siddhesh",
            "project_name": "mbp-gcc-16.checker",
            "project_dirname": "mbp-gcc-16.checker",
            "submitter": "siddhesh",
            "ended_on": 1767215025.905295,
            "started_on": 1767214298.3259494,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9965742-fedora-rawhide-ppc64le",
            "build_id": 9965742,
            "package_name": "ddnet",
            "package_version": "19.5-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/siddhesh/mbp-gcc-16.checker/ddnet",
            "git_hash": "9b2190b33d20b7027c4e4212bfaa206ccb7e81d1",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "siddhesh/mbp-gcc-16.checker--siddhesh",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/siddhesh/mbp-gcc-16.checker/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/siddhesh/mbp-gcc-16.checker",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/siddhesh/mbp-gcc-16.checker",
            "result_dir": "09965742-ddnet",
            "built_packages": "",
            "id": 9965742,
            "mockchain_macros": {
                "copr_username": "siddhesh",
                "copr_projectname": "mbp-gcc-16.checker",
                "vendor": "Fedora Project COPR (siddhesh/mbp-gcc-16.checker)"
            }
        }
    ]
}
[2025-12-31 21:03:45,967][  INFO][PID:2495379] Sending fedora-messaging bus message in build.end
[2025-12-31 21:03:45,996][  INFO][PID:2495379] Compressing /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16.checker/fedora-rawhide-ppc64le/09965742-ddnet/builder-live.log by gzip
[2025-12-31 21:03:45,997][  INFO][PID:2495379] Running command 'gzip /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16.checker/fedora-rawhide-ppc64le/09965742-ddnet/builder-live.log' as PID 2579881
[2025-12-31 21:03:46,087][  INFO][PID:2495379] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16.checker/fedora-rawhide-ppc64le/09965742-ddnet/builder-live.log)
[2025-12-31 21:03:46,088][  INFO][PID:2495379] Compressing /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16.checker/fedora-rawhide-ppc64le/09965742-ddnet/backend.log by gzip
[2025-12-31 21:03:46,089][  INFO][PID:2495379] Running command 'gzip /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16.checker/fedora-rawhide-ppc64le/09965742-ddnet/backend.log' as PID 2579892