[2026-04-22 09:49:03,202][  INFO][PID:3829948] Marking build as starting
[2026-04-22 09:49:03,302][  INFO][PID:3829948] Checking that /var/lib/copr/public_html/results/ligenix/enterprise-cosmic/epel-9-x86_64/repodata/repomd.xml exists
[2026-04-22 09:49:03,305][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:49:03,307][  INFO][PID:3829948] VM allocation process starts
[2026-04-22 09:49:03,366][  INFO][PID:3829948] Trying to allocate VM: ResallocHost, ticket_id=2456824, requested_tags=['arch_x86_64', 'copr_builder']
[2026-04-22 09:49:08,383][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:49:09,417][  INFO][PID:3829948] Allocated host ResallocHost, ticket_id=2456824, hostname=98.89.36.80, name=aws_x86_64_spot_prod_07811947_20260422_092704, requested_tags=['arch_x86_64', 'copr_builder']
[2026-04-22 09:49:09,419][  INFO][PID:3829948] Allocating ssh connection to builder
[2026-04-22 09:49:09,421][  INFO][PID:3829948] Checking that builder machine is OK
[2026-04-22 09:49:09,781][  INFO][PID:3829948] Installed copr-rpmbuild version: 1.8
[2026-04-22 09:49:09,782][  INFO][PID:3829948] Running remote command: copr-builder-ready epel-9-x86_64
[2026-04-22 09:49:10,043][  INFO][PID:3829948] Checking Red Hat subscription (attempt #1)
Red Hat subscription active
Builder is ready to be used

[2026-04-22 09:49:10,047][  INFO][PID:3829948] Filling build.info file with builder info
[2026-04-22 09:49:10,050][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:49:10,054][  INFO][PID:3829948] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "ligenix",
            "project_name": "enterprise-cosmic",
            "project_dirname": "enterprise-cosmic",
            "submitter": "ligenix",
            "ended_on": null,
            "started_on": 1776851350.0541985,
            "submitted_on": null,
            "status": 3,
            "chroot": "epel-9-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "10355016-epel-9-x86_64",
            "build_id": 10355016,
            "package_name": "cosmic-panel",
            "package_version": "1.0.11-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/ligenix/enterprise-cosmic/cosmic-panel",
            "git_hash": "d42065e224ec837ddf1e882324af790631fedb47",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "ligenix/enterprise-cosmic--ligenix",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/ligenix/enterprise-cosmic/epel-9-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://dl.rockylinux.org/pub/rocky/$releasever/devel/$basearch/os/",
                    "id": "https_dl_rockylinux_org_pub_rocky_releasever_devel_basearch_os",
                    "name": "Additional repo https_dl_rockylinux_org_pub_rocky_releasever_devel_basearch_os"
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [
                "jackserver_plugin",
                "libcamera_plugin"
            ],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/ligenix/enterprise-cosmic",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/ligenix/enterprise-cosmic",
            "result_dir": "10355016-cosmic-panel",
            "built_packages": "",
            "id": 10355016,
            "mockchain_macros": {
                "copr_username": "ligenix",
                "copr_projectname": "enterprise-cosmic",
                "vendor": "Fedora Project COPR (ligenix/enterprise-cosmic)"
            }
        }
    ]
}
[2026-04-22 09:49:10,122][  INFO][PID:3829948] Sending fedora-messaging bus message in build.start
[2026-04-22 09:49:10,794][  INFO][PID:3829948] Sending fedora-messaging bus message in chroot.start
[2026-04-22 09:49:10,827][  INFO][PID:3829948] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10355016-epel-9-x86_64 --chroot epel-9-x86_64 --detached
[2026-04-22 09:49:11,271][  INFO][PID:3829948] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '98.89.36.80' (ED25519) to the list of known hosts.


[2026-04-22 09:49:11,272][  INFO][PID:3829948] Downloading the builder-live.log file, attempt 1
[2026-04-22 09:49:11,275][  INFO][PID:3829948] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.89.36.80 copr-rpmbuild-log
[2026-04-22 09:49:16,287][  INFO][PID:3829948] Periodic builder liveness probe: alive
[2026-04-22 09:49:16,288][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:49:21,290][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:49:26,291][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:49:31,293][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:49:36,294][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:49:41,299][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:49:46,333][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:49:51,334][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:49:56,336][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:50:01,339][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:50:06,347][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:50:11,349][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:50:16,350][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:50:21,356][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:50:26,358][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:50:31,360][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:50:36,362][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:50:41,364][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:50:46,366][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:50:51,367][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:50:56,370][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:51:01,372][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:51:06,376][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:51:11,378][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:51:16,382][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:51:21,383][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:51:26,385][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:51:31,393][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:51:36,397][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:51:41,399][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:51:46,400][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:51:51,402][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:51:56,404][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:52:01,405][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:52:06,408][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:52:11,410][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:52:16,412][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:52:21,413][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:52:26,415][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:52:31,424][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:52:36,428][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:52:41,607][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:52:46,609][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:52:51,611][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:52:56,613][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:53:01,616][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:53:06,617][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:53:11,619][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:53:16,621][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:53:21,623][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:53:26,627][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:53:31,629][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:53:36,632][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:53:41,633][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:53:46,636][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:53:51,640][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:53:56,643][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:54:01,650][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:54:06,652][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:54:11,654][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:54:16,656][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:54:21,658][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:54:26,660][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:54:31,664][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:54:36,666][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:54:41,668][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:54:46,671][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:54:51,672][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:54:56,674][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:55:01,676][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:55:06,679][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:55:11,684][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:55:16,686][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:55:19,996][ ERROR][PID:3829948] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-22 09:55:21,687][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:55:26,689][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:55:30,006][WARNING][PID:3829948] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-22 09:55:31,691][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:55:36,693][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:55:40,009][  INFO][PID:3829948] Downloading the builder-live.log file, attempt 2
[2026-04-22 09:55:40,012][  INFO][PID:3829948] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.89.36.80 copr-rpmbuild-log
[2026-04-22 09:55:41,695][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:55:46,696][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:55:51,698][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:55:56,699][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:56:01,701][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:56:06,702][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:56:11,703][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:56:16,705][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:56:21,706][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:56:26,709][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:56:31,710][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:56:36,712][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:56:40,080][ ERROR][PID:3829948] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-22 09:56:41,713][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:56:46,715][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:56:50,133][WARNING][PID:3829948] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-22 09:56:51,716][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:56:56,717][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:57:00,134][  INFO][PID:3829948] Downloading the builder-live.log file, attempt 3
[2026-04-22 09:57:00,137][  INFO][PID:3829948] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.89.36.80 copr-rpmbuild-log
[2026-04-22 09:57:01,720][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:57:06,721][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:57:11,723][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:57:16,724][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:57:21,726][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:57:26,728][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:57:31,729][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:57:36,731][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:57:41,733][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:57:46,736][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:57:51,737][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:57:56,739][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:58:00,212][ ERROR][PID:3829948] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-22 09:58:01,743][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:58:06,751][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:58:10,308][WARNING][PID:3829948] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-22 09:58:11,754][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:58:16,755][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:58:20,310][  INFO][PID:3829948] Downloading the builder-live.log file, attempt 4
[2026-04-22 09:58:20,312][  INFO][PID:3829948] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.89.36.80 copr-rpmbuild-log
[2026-04-22 09:58:21,756][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:58:26,758][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:58:31,760][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:58:36,762][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:58:41,764][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:58:46,766][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:58:51,769][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:58:56,785][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:59:01,787][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:59:06,788][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:59:11,792][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:59:16,819][  INFO][PID:3829948] Periodic builder liveness probe: alive
[2026-04-22 09:59:16,883][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:59:20,380][ ERROR][PID:3829948] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-22 09:59:21,888][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:59:26,891][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:59:30,396][ ERROR][PID:3829948] Giving up for unstable SSH, failures: 1776851730.0059516, 1776851810.1338282, 1776851890.3081777, 1776851970.3967848
[2026-04-22 09:59:30,406][ ERROR][PID:3829948] Re-try request for task on 'ResallocHost, ticket_id=2456824, hostname=98.89.36.80, name=aws_x86_64_spot_prod_07811947_20260422_092704, requested_tags=['arch_x86_64', 'copr_builder']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2026-04-22 09:59:30,423][  INFO][PID:3829948] VM Release request
[2026-04-22 09:59:30,437][  INFO][PID:3829948] Retry #1 (on other host)
[2026-04-22 09:59:30,438][  INFO][PID:3829948] Checking that /var/lib/copr/public_html/results/ligenix/enterprise-cosmic/epel-9-x86_64/repodata/repomd.xml exists
[2026-04-22 09:59:30,438][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:59:30,439][  INFO][PID:3829948] VM allocation process starts
[2026-04-22 09:59:30,450][  INFO][PID:3829948] Trying to allocate VM: ResallocHost, ticket_id=2456971, requested_tags=['arch_x86_64', 'copr_builder']
[2026-04-22 09:59:33,468][  INFO][PID:3829948] Allocated host ResallocHost, ticket_id=2456971, hostname=54.224.146.93, name=aws_x86_64_reserved_prod_07818711_20260422_095244, requested_tags=['arch_x86_64', 'copr_builder']
[2026-04-22 09:59:33,468][  INFO][PID:3829948] Allocating ssh connection to builder
[2026-04-22 09:59:33,469][  INFO][PID:3829948] Checking that builder machine is OK
[2026-04-22 09:59:33,792][  INFO][PID:3829948] Installed copr-rpmbuild version: 1.8
[2026-04-22 09:59:33,793][  INFO][PID:3829948] Running remote command: copr-builder-ready epel-9-x86_64
[2026-04-22 09:59:34,030][  INFO][PID:3829948] Checking Red Hat subscription (attempt #1)
Red Hat subscription active
Builder is ready to be used

[2026-04-22 09:59:34,031][  INFO][PID:3829948] Filling build.info file with builder info
[2026-04-22 09:59:34,074][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:59:34,075][  INFO][PID:3829948] Not re-notifying FE and msg buses for the new host.
[2026-04-22 09:59:34,075][  INFO][PID:3829948] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10355016-epel-9-x86_64 --chroot epel-9-x86_64 --detached
[2026-04-22 09:59:34,471][  INFO][PID:3829948] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '54.224.146.93' (ED25519) to the list of known hosts.


[2026-04-22 09:59:34,472][  INFO][PID:3829948] Downloading the builder-live.log file, attempt 1
[2026-04-22 09:59:34,474][  INFO][PID:3829948] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.224.146.93 copr-rpmbuild-log
[2026-04-22 09:59:39,473][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:59:44,474][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:59:49,520][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:59:54,797][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 09:59:59,799][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:00:04,801][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:00:09,842][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:00:14,844][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:00:19,845][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:00:24,847][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:00:29,848][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:00:34,850][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:00:39,852][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:00:44,860][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:00:49,865][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:00:54,867][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:00:59,868][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:01:04,870][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:01:09,871][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:01:14,873][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:01:19,875][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:01:24,877][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:01:29,880][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:01:34,884][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:01:39,889][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:01:44,891][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:01:49,895][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:01:54,897][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:01:59,899][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:02:04,901][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:02:09,906][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:02:14,912][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:02:19,916][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:02:24,918][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:02:29,919][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:02:34,922][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:02:39,924][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:02:44,925][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:02:49,927][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:02:54,967][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:02:59,969][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:03:04,972][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:03:09,974][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:03:14,975][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:03:19,977][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:03:24,979][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:03:29,980][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:03:34,982][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:03:39,984][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:03:44,985][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:03:49,989][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:03:54,992][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:03:59,993][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:04:04,995][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:04:09,996][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:04:14,997][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:04:19,999][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:04:25,000][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:04:30,003][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:04:35,004][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:04:40,006][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:04:45,007][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:04:50,009][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:04:55,010][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:05:00,012][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:05:05,014][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:05:10,016][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:05:15,026][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:05:20,042][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:05:25,046][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:05:30,052][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:05:35,059][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:05:40,119][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:05:45,124][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:05:50,129][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:05:55,134][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:06:00,139][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:06:05,141][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:06:10,143][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:06:15,147][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:06:20,151][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:06:25,156][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:06:30,162][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:06:35,164][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:06:40,171][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:06:45,190][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:06:50,208][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:06:55,216][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:07:00,221][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:07:05,252][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:07:10,259][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:07:15,261][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:07:20,270][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:07:25,274][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:07:30,282][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:07:35,287][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:07:40,378][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:07:45,385][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:07:50,387][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:07:55,391][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:08:00,428][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:08:05,430][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:08:10,434][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:08:15,436][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:08:20,440][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:08:25,445][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:08:30,448][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:08:35,455][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:08:40,458][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:08:45,466][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:08:50,481][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:08:55,502][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:09:00,513][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:09:05,521][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:09:10,523][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:09:15,531][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:09:20,553][  INFO][PID:3829948] Periodic builder liveness probe: alive
[2026-04-22 10:09:20,555][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:09:25,565][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:09:30,585][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:09:35,614][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:09:40,616][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:09:45,625][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:09:50,630][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:09:55,641][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:10:00,670][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:10:05,674][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:10:10,679][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:10:15,688][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:10:20,700][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:10:25,710][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:10:30,717][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:10:35,727][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:10:40,737][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:10:45,748][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:10:50,750][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:10:55,763][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:11:00,767][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:11:05,780][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:11:10,788][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:11:15,792][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:11:20,804][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:11:25,826][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:11:30,827][  INFO][PID:3829948] Checking for cancel request
[2026-04-22 10:11:31,208][  INFO][PID:3829948] Downloading results from builder
[2026-04-22 10:11:31,215][  INFO][PID:3829948] rsyncing of mockbuilder@54.224.146.93:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/ligenix/enterprise-cosmic/epel-9-x86_64/10355016-cosmic-panel started
[2026-04-22 10:11:31,241][  INFO][PID:3829948] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@54.224.146.93:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/ligenix/enterprise-cosmic/epel-9-x86_64/10355016-cosmic-panel/ &> /var/lib/copr/public_html/results/ligenix/enterprise-cosmic/epel-9-x86_64/10355016-cosmic-panel/build-10355016.rsync.log
[2026-04-22 10:11:35,240][  INFO][PID:3829948] rsyncing finished.
[2026-04-22 10:11:35,252][  INFO][PID:3829948] VM Release request
[2026-04-22 10:11:35,313][  INFO][PID:3829948] Searching for 'success' file in resultdir
[2026-04-22 10:11:35,321][  INFO][PID:3829948] Going to sign pkgs from source: 10355016-epel-9-x86_64 in chroot: /var/lib/copr/public_html/results/ligenix/enterprise-cosmic/epel-9-x86_64
[2026-04-22 10:11:35,340][  INFO][PID:3829948] Calling '/bin/sign -u ligenix#enterprise-cosmic@copr.fedorahosted.org -p' (attempt #1)
[2026-04-22 10:11:35,656][  INFO][PID:3829948] Calling '/bin/sign -4 -h sha256 -u ligenix#enterprise-cosmic@copr.fedorahosted.org -r /var/lib/copr/public_html/results/ligenix/enterprise-cosmic/epel-9-x86_64/10355016-cosmic-panel/cosmic-panel-1.0.11-1.el9.src.rpm' (attempt #1)
[2026-04-22 10:11:42,784][  INFO][PID:3829948] signed rpm: /var/lib/copr/public_html/results/ligenix/enterprise-cosmic/epel-9-x86_64/10355016-cosmic-panel/cosmic-panel-1.0.11-1.el9.src.rpm
[2026-04-22 10:11:42,785][  INFO][PID:3829948] Calling '/bin/sign -4 -h sha256 -u ligenix#enterprise-cosmic@copr.fedorahosted.org -r /var/lib/copr/public_html/results/ligenix/enterprise-cosmic/epel-9-x86_64/10355016-cosmic-panel/cosmic-panel-debuginfo-1.0.11-1.el9.x86_64.rpm' (attempt #1)
[2026-04-22 10:11:46,056][  INFO][PID:3829948] signed rpm: /var/lib/copr/public_html/results/ligenix/enterprise-cosmic/epel-9-x86_64/10355016-cosmic-panel/cosmic-panel-debuginfo-1.0.11-1.el9.x86_64.rpm
[2026-04-22 10:11:46,059][  INFO][PID:3829948] Calling '/bin/sign -4 -h sha256 -u ligenix#enterprise-cosmic@copr.fedorahosted.org -r /var/lib/copr/public_html/results/ligenix/enterprise-cosmic/epel-9-x86_64/10355016-cosmic-panel/cosmic-panel-1.0.11-1.el9.x86_64.rpm' (attempt #1)
[2026-04-22 10:11:47,215][  INFO][PID:3829948] signed rpm: /var/lib/copr/public_html/results/ligenix/enterprise-cosmic/epel-9-x86_64/10355016-cosmic-panel/cosmic-panel-1.0.11-1.el9.x86_64.rpm
[2026-04-22 10:11:47,225][  INFO][PID:3829948] Calling '/bin/sign -4 -h sha256 -u ligenix#enterprise-cosmic@copr.fedorahosted.org -r /var/lib/copr/public_html/results/ligenix/enterprise-cosmic/epel-9-x86_64/10355016-cosmic-panel/cosmic-panel-debugsource-1.0.11-1.el9.x86_64.rpm' (attempt #1)
[2026-04-22 10:11:49,000][  INFO][PID:3829948] signed rpm: /var/lib/copr/public_html/results/ligenix/enterprise-cosmic/epel-9-x86_64/10355016-cosmic-panel/cosmic-panel-debugsource-1.0.11-1.el9.x86_64.rpm
[2026-04-22 10:11:49,007][  INFO][PID:3829948] Sign done
[2026-04-22 10:11:49,009][  INFO][PID:3829948] Incremental createrepo run, adding 10355016-cosmic-panel into https://download.copr.fedorainfracloud.org/results/ligenix/enterprise-cosmic/epel-9-x86_64, (auto-create-repo=True)
[2026-04-22 10:11:49,026][  INFO][PID:3829948] Running command 'copr-repo --batched /var/lib/copr/public_html/results/ligenix/enterprise-cosmic/epel-9-x86_64 --add 10355016-cosmic-panel --no-appstream-metadata' as PID 4090945
[2026-04-22 10:11:57,814][  INFO][PID:3829948] Finished after 8 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/ligenix/enterprise-cosmic/epel-9-x86_64 --add 10355016-cosmic-panel --no-appstream-metadata)
[2026-04-22 10:11:57,815][  INFO][PID:3829948] Getting build details
[2026-04-22 10:11:57,830][  INFO][PID:3829948] Listing built binary packages in /var/lib/copr/public_html/results/ligenix/enterprise-cosmic/epel-9-x86_64/10355016-cosmic-panel
[2026-04-22 10:11:57,843][  INFO][PID:3829948] Built packages:
['cosmic-panel-debuginfo 1.0.11', 'cosmic-panel 1.0.11', 'cosmic-panel-debugsource 1.0.11']
[2026-04-22 10:11:57,844][  INFO][PID:3829948] build details: {'built_packages': 'cosmic-panel-debuginfo 1.0.11\ncosmic-panel 1.0.11\ncosmic-panel-debugsource 1.0.11'}
[2026-04-22 10:11:57,845][  INFO][PID:3829948] Retrieving pubkey
[2026-04-22 10:11:57,846][  INFO][PID:3829948] Calling '/bin/sign -u ligenix#enterprise-cosmic@copr.fedorahosted.org -p' (attempt #1)
[2026-04-22 10:11:58,191][  INFO][PID:3829948] Added pubkey for user ligenix project enterprise-cosmic into: /var/lib/copr/public_html/results/ligenix/enterprise-cosmic/pubkey.gpg
[2026-04-22 10:11:58,193][  INFO][PID:3829948] Finished build: id=10355016 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/ligenix/enterprise-cosmic chroot=epel-9-x86_64 
[2026-04-22 10:11:58,232][  INFO][PID:3829948] Worker succeeded build, took 744.156893491745
[2026-04-22 10:11:58,236][  INFO][PID:3829948] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "ligenix",
            "project_name": "enterprise-cosmic",
            "project_dirname": "enterprise-cosmic",
            "submitter": "ligenix",
            "ended_on": 1776852718.2321057,
            "started_on": 1776851974.0752122,
            "submitted_on": null,
            "status": 1,
            "chroot": "epel-9-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "10355016-epel-9-x86_64",
            "build_id": 10355016,
            "package_name": "cosmic-panel",
            "package_version": "1.0.11-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/ligenix/enterprise-cosmic/cosmic-panel",
            "git_hash": "d42065e224ec837ddf1e882324af790631fedb47",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "ligenix/enterprise-cosmic--ligenix",
            "results": {
                "packages": [
                    {
                        "name": "cosmic-panel-debuginfo",
                        "epoch": null,
                        "version": "1.0.11",
                        "release": "1.el9",
                        "arch": "x86_64"
                    },
                    {
                        "name": "cosmic-panel",
                        "epoch": null,
                        "version": "1.0.11",
                        "release": "1.el9",
                        "arch": "x86_64"
                    },
                    {
                        "name": "cosmic-panel",
                        "epoch": null,
                        "version": "1.0.11",
                        "release": "1.el9",
                        "arch": "src"
                    },
                    {
                        "name": "cosmic-panel-debugsource",
                        "epoch": null,
                        "version": "1.0.11",
                        "release": "1.el9",
                        "arch": "x86_64"
                    }
                ]
            },
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/ligenix/enterprise-cosmic/epel-9-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://dl.rockylinux.org/pub/rocky/$releasever/devel/$basearch/os/",
                    "id": "https_dl_rockylinux_org_pub_rocky_releasever_devel_basearch_os",
                    "name": "Additional repo https_dl_rockylinux_org_pub_rocky_releasever_devel_basearch_os"
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [
                "jackserver_plugin",
                "libcamera_plugin"
            ],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/ligenix/enterprise-cosmic",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/ligenix/enterprise-cosmic",
            "result_dir": "10355016-cosmic-panel",
            "built_packages": "cosmic-panel-debuginfo 1.0.11\ncosmic-panel 1.0.11\ncosmic-panel-debugsource 1.0.11",
            "id": 10355016,
            "mockchain_macros": {
                "copr_username": "ligenix",
                "copr_projectname": "enterprise-cosmic",
                "vendor": "Fedora Project COPR (ligenix/enterprise-cosmic)"
            }
        }
    ]
}
[2026-04-22 10:11:58,473][  INFO][PID:3829948] Sending fedora-messaging bus message in build.end
[2026-04-22 10:11:58,564][  INFO][PID:3829948] Compressing /var/lib/copr/public_html/results/ligenix/enterprise-cosmic/epel-9-x86_64/10355016-cosmic-panel/builder-live.log by gzip
[2026-04-22 10:11:58,567][  INFO][PID:3829948] Running command 'gzip /var/lib/copr/public_html/results/ligenix/enterprise-cosmic/epel-9-x86_64/10355016-cosmic-panel/builder-live.log' as PID 4092664
[2026-04-22 10:11:58,634][  INFO][PID:3829948] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/ligenix/enterprise-cosmic/epel-9-x86_64/10355016-cosmic-panel/builder-live.log)
[2026-04-22 10:11:58,635][  INFO][PID:3829948] Compressing /var/lib/copr/public_html/results/ligenix/enterprise-cosmic/epel-9-x86_64/10355016-cosmic-panel/backend.log by gzip
[2026-04-22 10:11:58,636][  INFO][PID:3829948] Running command 'gzip /var/lib/copr/public_html/results/ligenix/enterprise-cosmic/epel-9-x86_64/10355016-cosmic-panel/backend.log' as PID 4092679