[2026-04-08 17:55:40,366][  INFO][PID:2002470] Marking build as starting
[2026-04-08 17:55:40,426][  INFO][PID:2002470] Checking that /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64/repodata/repomd.xml exists
[2026-04-08 17:55:40,427][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:55:40,427][  INFO][PID:2002470] VM allocation process starts
[2026-04-08 17:55:40,441][  INFO][PID:2002470] Trying to allocate VM: ResallocHost, ticket_id=2229900, requested_tags=['copr_builder', 'arch_x86_64']
[2026-04-08 17:55:45,442][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:55:50,443][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:55:55,444][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:56:00,445][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:56:05,446][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:56:10,448][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:56:15,449][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:56:20,451][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:56:25,452][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:56:30,453][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:56:35,454][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:56:40,456][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:56:45,461][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:56:50,463][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:56:55,471][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:57:00,474][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:57:05,477][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:57:10,478][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:57:15,480][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:57:20,482][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:57:25,483][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:57:30,485][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:57:35,489][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:57:40,490][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:57:45,492][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:57:50,494][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:57:55,498][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:58:00,499][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:58:05,500][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:58:10,502][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:58:15,504][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:58:20,505][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:58:25,507][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:58:30,512][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:58:35,517][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:58:40,519][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:58:45,521][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:58:50,524][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:58:55,531][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:58:58,576][  INFO][PID:2002470] Allocated host ResallocHost, ticket_id=2229900, hostname=13.222.120.152, name=aws_x86_64_spot_prod_05941334_20260408_175656, requested_tags=['copr_builder', 'arch_x86_64']
[2026-04-08 17:58:58,578][  INFO][PID:2002470] Allocating ssh connection to builder
[2026-04-08 17:58:58,580][  INFO][PID:2002470] Checking that builder machine is OK
[2026-04-08 17:58:58,934][  INFO][PID:2002470] Running remote command: copr-builder-ready fedora-44-x86_64
[2026-04-08 17:58:59,163][  INFO][PID:2002470] Red Hat subscription not needed for fedora-44-x86_64
Builder is ready to be used

[2026-04-08 17:58:59,164][  INFO][PID:2002470] Filling build.info file with builder info
[2026-04-08 17:58:59,175][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:58:59,179][  INFO][PID:2002470] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@CoreOS",
            "project_name": "continuous",
            "project_dirname": "continuous",
            "submitter": "https://api.github.com/users/cgwalters",
            "ended_on": null,
            "started_on": 1775671139.1791768,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-44-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "10302562-fedora-44-x86_64",
            "build_id": 10302562,
            "package_name": "ostree",
            "package_version": "2025.7.38.g20fb19f8-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@CoreOS/continuous/ostree",
            "git_hash": "75c467f33da2bb6c3c61b1a72cb658c7b5c4645d",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@CoreOS/continuous--https://api.github.com/users/cgwalters",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous/fedora-44-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/fedora-44-x86_64/",
                    "id": "copr_rhcontainerbot_bootc",
                    "name": "Additional repo copr_rhcontainerbot_bootc"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@CoreOS/continuous",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous",
            "result_dir": "10302562-ostree",
            "built_packages": "",
            "id": 10302562,
            "mockchain_macros": {
                "copr_username": "@CoreOS",
                "copr_projectname": "continuous",
                "vendor": "Fedora Project COPR (@CoreOS/continuous)"
            }
        }
    ]
}
[2026-04-08 17:58:59,278][  INFO][PID:2002470] Sending fedora-messaging bus message in build.start
[2026-04-08 17:58:59,966][  INFO][PID:2002470] Sending fedora-messaging bus message in chroot.start
[2026-04-08 17:59:00,029][  INFO][PID:2002470] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10302562-fedora-44-x86_64 --chroot fedora-44-x86_64 --detached
[2026-04-08 17:59:00,392][  INFO][PID:2002470] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '13.222.120.152' (ED25519) to the list of known hosts.


[2026-04-08 17:59:00,393][  INFO][PID:2002470] Downloading the builder-live.log file, attempt 1
[2026-04-08 17:59:00,395][  INFO][PID:2002470] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.222.120.152 copr-rpmbuild-log
[2026-04-08 17:59:05,403][  INFO][PID:2002470] Periodic builder liveness probe: alive
[2026-04-08 17:59:05,404][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:59:10,405][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:59:15,412][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:59:20,413][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:59:25,417][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:59:30,418][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:59:35,420][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:59:40,421][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:59:45,422][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:59:50,424][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 17:59:55,425][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:00:00,427][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:00:05,428][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:00:10,430][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:00:13,611][ ERROR][PID:2002470] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-08 18:00:15,431][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:00:20,433][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:00:23,612][WARNING][PID:2002470] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-08 18:00:25,434][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:00:30,435][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:00:33,613][  INFO][PID:2002470] Downloading the builder-live.log file, attempt 2
[2026-04-08 18:00:33,614][  INFO][PID:2002470] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.222.120.152 copr-rpmbuild-log
[2026-04-08 18:00:35,437][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:00:40,446][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:00:45,447][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:00:50,448][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:00:55,449][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:01:00,450][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:01:05,451][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:01:10,453][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:01:15,454][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:01:20,455][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:01:25,460][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:01:30,461][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:01:33,684][ ERROR][PID:2002470] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-08 18:01:35,463][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:01:40,464][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:01:43,702][WARNING][PID:2002470] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-08 18:01:45,465][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:01:50,466][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:01:53,703][  INFO][PID:2002470] Downloading the builder-live.log file, attempt 3
[2026-04-08 18:01:53,704][  INFO][PID:2002470] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.222.120.152 copr-rpmbuild-log
[2026-04-08 18:01:55,467][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:02:00,468][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:02:05,469][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:02:10,474][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:02:15,476][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:02:20,477][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:02:25,478][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:02:30,479][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:02:35,480][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:02:40,481][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:02:45,482][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:02:50,483][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:02:53,771][ ERROR][PID:2002470] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-08 18:02:55,484][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:03:00,485][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:03:03,782][WARNING][PID:2002470] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-08 18:03:05,486][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:03:10,488][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:03:13,783][  INFO][PID:2002470] Downloading the builder-live.log file, attempt 4
[2026-04-08 18:03:13,785][  INFO][PID:2002470] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.222.120.152 copr-rpmbuild-log
[2026-04-08 18:03:15,489][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:03:20,490][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:03:25,492][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:03:30,493][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:03:35,494][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:03:40,496][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:03:45,497][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:03:50,498][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:03:55,500][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:04:00,504][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:04:05,505][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:04:10,506][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:04:13,852][ ERROR][PID:2002470] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-08 18:04:15,508][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:04:20,509][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:04:23,870][ ERROR][PID:2002470] Giving up for unstable SSH, failures: 1775671223.6124094, 1775671303.7022793, 1775671383.782668, 1775671463.870248
[2026-04-08 18:04:23,871][ ERROR][PID:2002470] Re-try request for task on 'ResallocHost, ticket_id=2229900, hostname=13.222.120.152, name=aws_x86_64_spot_prod_05941334_20260408_175656, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2026-04-08 18:04:23,872][  INFO][PID:2002470] Releasing VM back to pool
[2026-04-08 18:04:23,914][  INFO][PID:2002470] Retry #1 (on other host)
[2026-04-08 18:04:23,919][  INFO][PID:2002470] Checking that /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64/repodata/repomd.xml exists
[2026-04-08 18:04:23,927][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:04:23,928][  INFO][PID:2002470] VM allocation process starts
[2026-04-08 18:04:23,950][  INFO][PID:2002470] Trying to allocate VM: ResallocHost, ticket_id=2230064, requested_tags=['copr_builder', 'arch_x86_64']
[2026-04-08 18:04:28,951][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:04:33,952][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:04:38,953][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:04:43,955][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:04:48,956][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:04:53,956][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:04:58,958][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:05:03,959][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:05:08,961][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:05:13,976][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:05:18,979][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:05:23,982][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:05:28,986][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:05:33,987][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:05:38,988][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:05:43,989][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:05:48,990][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:05:53,991][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:05:58,992][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:06:03,993][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:06:08,996][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:06:13,998][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:06:18,999][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:06:24,000][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:06:29,002][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:06:34,003][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:06:39,004][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:06:44,005][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:06:49,014][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:06:54,016][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:06:59,017][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:07:04,018][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:07:09,018][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:07:14,019][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:07:19,021][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:07:24,027][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:07:29,028][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:07:34,034][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:07:39,035][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:07:44,037][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:07:49,039][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:07:54,040][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:07:59,042][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:08:04,043][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:08:09,051][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:08:14,052][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:08:19,053][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:08:24,055][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:08:29,059][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:08:34,063][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:08:39,073][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:08:44,089][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:08:49,090][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:08:54,095][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:08:59,096][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:09:04,104][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:09:09,105][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:09:14,106][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:09:19,111][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:09:24,120][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:09:29,121][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:09:34,122][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:09:39,131][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:09:44,138][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:09:49,139][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:09:54,140][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:09:59,153][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:10:04,155][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:10:09,157][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:10:14,158][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:10:19,159][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:10:24,160][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:10:29,162][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:10:34,163][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:10:39,234][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:10:44,235][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:10:49,251][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:10:54,252][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:10:59,252][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:11:04,254][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:11:09,270][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:11:14,298][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:11:19,299][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:11:24,525][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:11:29,550][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:11:34,586][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:11:39,593][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:11:42,110][  INFO][PID:2002470] Allocated host ResallocHost, ticket_id=2230064, hostname=44.200.198.33, name=aws_x86_64_normal_prod_05940973_20260408_174700, requested_tags=['copr_builder', 'arch_x86_64']
[2026-04-08 18:11:42,110][  INFO][PID:2002470] Allocating ssh connection to builder
[2026-04-08 18:11:42,112][  INFO][PID:2002470] Checking that builder machine is OK
[2026-04-08 18:11:42,501][  INFO][PID:2002470] Running remote command: copr-builder-ready fedora-44-x86_64
[2026-04-08 18:11:42,736][  INFO][PID:2002470] Red Hat subscription not needed for fedora-44-x86_64
Builder is ready to be used

[2026-04-08 18:11:42,737][  INFO][PID:2002470] Filling build.info file with builder info
[2026-04-08 18:11:42,783][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:11:42,784][  INFO][PID:2002470] Not re-notifying FE and msg buses for the new host.
[2026-04-08 18:11:42,785][  INFO][PID:2002470] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10302562-fedora-44-x86_64 --chroot fedora-44-x86_64 --detached
[2026-04-08 18:11:43,151][  INFO][PID:2002470] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '44.200.198.33' (ED25519) to the list of known hosts.


[2026-04-08 18:11:43,153][  INFO][PID:2002470] Downloading the builder-live.log file, attempt 1
[2026-04-08 18:11:43,155][  INFO][PID:2002470] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.200.198.33 copr-rpmbuild-log
[2026-04-08 18:11:48,161][  INFO][PID:2002470] Periodic builder liveness probe: alive
[2026-04-08 18:11:48,161][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:11:53,162][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:11:58,164][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:12:03,183][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:12:08,184][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:12:13,186][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:12:18,266][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:12:23,270][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:12:28,272][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:12:33,273][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:12:38,273][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:12:43,275][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:12:48,280][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:12:53,289][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:12:58,292][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:13:03,293][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:13:08,297][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:13:13,304][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:13:18,310][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:13:23,312][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:13:28,321][  INFO][PID:2002470] Checking for cancel request
[2026-04-08 18:13:31,537][  INFO][PID:2002470] Downloading results from builder
[2026-04-08 18:13:31,544][  INFO][PID:2002470] rsyncing of mockbuilder@44.200.198.33:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64/10302562-ostree started
[2026-04-08 18:13:31,545][  INFO][PID:2002470] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@44.200.198.33:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64/10302562-ostree/ &> /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64/10302562-ostree/build-10302562.rsync.log
[2026-04-08 18:13:32,217][  INFO][PID:2002470] rsyncing finished.
[2026-04-08 18:13:32,218][  INFO][PID:2002470] Releasing VM back to pool
[2026-04-08 18:13:32,234][  INFO][PID:2002470] Searching for 'success' file in resultdir
[2026-04-08 18:13:32,235][  INFO][PID:2002470] Going to sign pkgs from source: 10302562-fedora-44-x86_64 in chroot: /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64
[2026-04-08 18:13:32,236][  INFO][PID:2002470] Calling '/bin/sign -u @CoreOS#continuous@copr.fedorahosted.org -p' (attempt #1)
[2026-04-08 18:13:32,511][  INFO][PID:2002470] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64/10302562-ostree/ostree-2025.7.38.g20fb19f8-1.fc44.src.rpm' (attempt #1)
[2026-04-08 18:13:33,272][  INFO][PID:2002470] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64/10302562-ostree/ostree-2025.7.38.g20fb19f8-1.fc44.src.rpm
[2026-04-08 18:13:33,275][  INFO][PID:2002470] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64/10302562-ostree/ostree-devel-2025.7.38.g20fb19f8-1.fc44.x86_64.rpm' (attempt #1)
[2026-04-08 18:13:33,963][  INFO][PID:2002470] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64/10302562-ostree/ostree-devel-2025.7.38.g20fb19f8-1.fc44.x86_64.rpm
[2026-04-08 18:13:33,964][  INFO][PID:2002470] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64/10302562-ostree/ostree-2025.7.38.g20fb19f8-1.fc44.x86_64.rpm' (attempt #1)
[2026-04-08 18:13:34,668][  INFO][PID:2002470] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64/10302562-ostree/ostree-2025.7.38.g20fb19f8-1.fc44.x86_64.rpm
[2026-04-08 18:13:34,673][  INFO][PID:2002470] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64/10302562-ostree/ostree-tests-debuginfo-2025.7.38.g20fb19f8-1.fc44.x86_64.rpm' (attempt #1)
[2026-04-08 18:13:35,342][  INFO][PID:2002470] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64/10302562-ostree/ostree-tests-debuginfo-2025.7.38.g20fb19f8-1.fc44.x86_64.rpm
[2026-04-08 18:13:35,343][  INFO][PID:2002470] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64/10302562-ostree/ostree-debuginfo-2025.7.38.g20fb19f8-1.fc44.x86_64.rpm' (attempt #1)
[2026-04-08 18:13:36,323][  INFO][PID:2002470] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64/10302562-ostree/ostree-debuginfo-2025.7.38.g20fb19f8-1.fc44.x86_64.rpm
[2026-04-08 18:13:36,324][  INFO][PID:2002470] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64/10302562-ostree/ostree-grub2-2025.7.38.g20fb19f8-1.fc44.x86_64.rpm' (attempt #1)
[2026-04-08 18:13:36,931][  INFO][PID:2002470] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64/10302562-ostree/ostree-grub2-2025.7.38.g20fb19f8-1.fc44.x86_64.rpm
[2026-04-08 18:13:36,932][  INFO][PID:2002470] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64/10302562-ostree/ostree-debugsource-2025.7.38.g20fb19f8-1.fc44.x86_64.rpm' (attempt #1)
[2026-04-08 18:13:37,776][  INFO][PID:2002470] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64/10302562-ostree/ostree-debugsource-2025.7.38.g20fb19f8-1.fc44.x86_64.rpm
[2026-04-08 18:13:37,777][  INFO][PID:2002470] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64/10302562-ostree/ostree-tests-2025.7.38.g20fb19f8-1.fc44.x86_64.rpm' (attempt #1)
[2026-04-08 18:13:39,029][  INFO][PID:2002470] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64/10302562-ostree/ostree-tests-2025.7.38.g20fb19f8-1.fc44.x86_64.rpm
[2026-04-08 18:13:39,030][  INFO][PID:2002470] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64/10302562-ostree/ostree-libs-debuginfo-2025.7.38.g20fb19f8-1.fc44.x86_64.rpm' (attempt #1)
[2026-04-08 18:13:40,320][  INFO][PID:2002470] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64/10302562-ostree/ostree-libs-debuginfo-2025.7.38.g20fb19f8-1.fc44.x86_64.rpm
[2026-04-08 18:13:40,361][  INFO][PID:2002470] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64/10302562-ostree/ostree-libs-2025.7.38.g20fb19f8-1.fc44.x86_64.rpm' (attempt #1)
[2026-04-08 18:13:41,150][  INFO][PID:2002470] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64/10302562-ostree/ostree-libs-2025.7.38.g20fb19f8-1.fc44.x86_64.rpm
[2026-04-08 18:13:41,152][  INFO][PID:2002470] Sign done
[2026-04-08 18:13:41,154][  INFO][PID:2002470] Incremental createrepo run, adding 10302562-ostree into https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous/fedora-44-x86_64, (auto-create-repo=True)
[2026-04-08 18:13:41,161][  INFO][PID:2002470] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64 --add 10302562-ostree --no-appstream-metadata' as PID 2131239
[2026-04-08 18:13:42,988][  INFO][PID:2002470] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64 --add 10302562-ostree --no-appstream-metadata)
[2026-04-08 18:13:43,025][  INFO][PID:2002470] Getting build details
[2026-04-08 18:13:43,026][  INFO][PID:2002470] Listing built binary packages in /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64/10302562-ostree
[2026-04-08 18:13:43,026][  INFO][PID:2002470] Built packages:
['ostree 2025.7.38.g20fb19f8', 'ostree-debuginfo 2025.7.38.g20fb19f8', 'ostree-devel 2025.7.38.g20fb19f8', 'ostree-libs-debuginfo 2025.7.38.g20fb19f8', 'ostree-tests 2025.7.38.g20fb19f8', 'ostree-libs 2025.7.38.g20fb19f8', 'ostree-grub2 2025.7.38.g20fb19f8', 'ostree-debugsource 2025.7.38.g20fb19f8', 'ostree-tests-debuginfo 2025.7.38.g20fb19f8']
[2026-04-08 18:13:43,028][  INFO][PID:2002470] build details: {'built_packages': 'ostree 2025.7.38.g20fb19f8\nostree-debuginfo 2025.7.38.g20fb19f8\nostree-devel 2025.7.38.g20fb19f8\nostree-libs-debuginfo 2025.7.38.g20fb19f8\nostree-tests 2025.7.38.g20fb19f8\nostree-libs 2025.7.38.g20fb19f8\nostree-grub2 2025.7.38.g20fb19f8\nostree-debugsource 2025.7.38.g20fb19f8\nostree-tests-debuginfo 2025.7.38.g20fb19f8'}
[2026-04-08 18:13:43,028][  INFO][PID:2002470] Retrieving pubkey
[2026-04-08 18:13:43,028][  INFO][PID:2002470] Calling '/bin/sign -u @CoreOS#continuous@copr.fedorahosted.org -p' (attempt #1)
[2026-04-08 18:13:43,244][  INFO][PID:2002470] Added pubkey for user @CoreOS project continuous into: /var/lib/copr/public_html/results/@CoreOS/continuous/pubkey.gpg
[2026-04-08 18:13:43,245][  INFO][PID:2002470] Finished build: id=10302562 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@CoreOS/continuous chroot=fedora-44-x86_64 
[2026-04-08 18:13:43,249][  INFO][PID:2002470] Worker succeeded build, took 120.46537256240845
[2026-04-08 18:13:43,250][  INFO][PID:2002470] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@CoreOS",
            "project_name": "continuous",
            "project_dirname": "continuous",
            "submitter": "https://api.github.com/users/cgwalters",
            "ended_on": 1775672023.2495751,
            "started_on": 1775671902.7842026,
            "submitted_on": null,
            "status": 1,
            "chroot": "fedora-44-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "10302562-fedora-44-x86_64",
            "build_id": 10302562,
            "package_name": "ostree",
            "package_version": "2025.7.38.g20fb19f8-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@CoreOS/continuous/ostree",
            "git_hash": "75c467f33da2bb6c3c61b1a72cb658c7b5c4645d",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@CoreOS/continuous--https://api.github.com/users/cgwalters",
            "results": {
                "packages": [
                    {
                        "name": "ostree",
                        "epoch": null,
                        "version": "2025.7.38.g20fb19f8",
                        "release": "1.fc44",
                        "arch": "x86_64"
                    },
                    {
                        "name": "ostree-debuginfo",
                        "epoch": null,
                        "version": "2025.7.38.g20fb19f8",
                        "release": "1.fc44",
                        "arch": "x86_64"
                    },
                    {
                        "name": "ostree-devel",
                        "epoch": null,
                        "version": "2025.7.38.g20fb19f8",
                        "release": "1.fc44",
                        "arch": "x86_64"
                    },
                    {
                        "name": "ostree-libs-debuginfo",
                        "epoch": null,
                        "version": "2025.7.38.g20fb19f8",
                        "release": "1.fc44",
                        "arch": "x86_64"
                    },
                    {
                        "name": "ostree-tests",
                        "epoch": null,
                        "version": "2025.7.38.g20fb19f8",
                        "release": "1.fc44",
                        "arch": "x86_64"
                    },
                    {
                        "name": "ostree-libs",
                        "epoch": null,
                        "version": "2025.7.38.g20fb19f8",
                        "release": "1.fc44",
                        "arch": "x86_64"
                    },
                    {
                        "name": "ostree-grub2",
                        "epoch": null,
                        "version": "2025.7.38.g20fb19f8",
                        "release": "1.fc44",
                        "arch": "x86_64"
                    },
                    {
                        "name": "ostree-debugsource",
                        "epoch": null,
                        "version": "2025.7.38.g20fb19f8",
                        "release": "1.fc44",
                        "arch": "x86_64"
                    },
                    {
                        "name": "ostree-tests-debuginfo",
                        "epoch": null,
                        "version": "2025.7.38.g20fb19f8",
                        "release": "1.fc44",
                        "arch": "x86_64"
                    },
                    {
                        "name": "ostree",
                        "epoch": null,
                        "version": "2025.7.38.g20fb19f8",
                        "release": "1.fc44",
                        "arch": "src"
                    }
                ]
            },
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous/fedora-44-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/fedora-44-x86_64/",
                    "id": "copr_rhcontainerbot_bootc",
                    "name": "Additional repo copr_rhcontainerbot_bootc"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@CoreOS/continuous",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous",
            "result_dir": "10302562-ostree",
            "built_packages": "ostree 2025.7.38.g20fb19f8\nostree-debuginfo 2025.7.38.g20fb19f8\nostree-devel 2025.7.38.g20fb19f8\nostree-libs-debuginfo 2025.7.38.g20fb19f8\nostree-tests 2025.7.38.g20fb19f8\nostree-libs 2025.7.38.g20fb19f8\nostree-grub2 2025.7.38.g20fb19f8\nostree-debugsource 2025.7.38.g20fb19f8\nostree-tests-debuginfo 2025.7.38.g20fb19f8",
            "id": 10302562,
            "mockchain_macros": {
                "copr_username": "@CoreOS",
                "copr_projectname": "continuous",
                "vendor": "Fedora Project COPR (@CoreOS/continuous)"
            }
        }
    ]
}
[2026-04-08 18:13:43,328][  INFO][PID:2002470] Sending fedora-messaging bus message in build.end
[2026-04-08 18:13:43,358][  INFO][PID:2002470] Compressing /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64/10302562-ostree/builder-live.log by gzip
[2026-04-08 18:13:43,359][  INFO][PID:2002470] Running command 'gzip /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64/10302562-ostree/builder-live.log' as PID 2131548
[2026-04-08 18:13:43,553][  INFO][PID:2002470] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64/10302562-ostree/builder-live.log)
[2026-04-08 18:13:43,554][  INFO][PID:2002470] Compressing /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64/10302562-ostree/backend.log by gzip
[2026-04-08 18:13:43,555][  INFO][PID:2002470] Running command 'gzip /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-44-x86_64/10302562-ostree/backend.log' as PID 2131564