[2025-09-11 16:43:09,350][  INFO][PID:4193638] Marking build as starting
[2025-09-11 16:43:09,379][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:43:09,383][  INFO][PID:4193638] VM allocation process starts
[2025-09-11 16:43:09,404][  INFO][PID:4193638] Trying to allocate VM: ResallocHost, ticket_id=5010892, requested_tags=['copr_builder', 'arch_x86_64']
[2025-09-11 16:43:14,406][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:43:19,408][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:43:24,409][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:43:29,410][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:43:34,412][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:43:39,416][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:43:44,417][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:43:49,419][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:43:54,423][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:43:59,426][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:44:04,427][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:44:09,428][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:44:14,429][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:44:17,499][  INFO][PID:4193638] Allocated host ResallocHost, ticket_id=5010892, hostname=54.237.57.1, name=aws_x86_64_spot_prod_06718569_20250911_163725, requested_tags=['copr_builder', 'arch_x86_64']
[2025-09-11 16:44:17,500][  INFO][PID:4193638] Allocating ssh connection to builder
[2025-09-11 16:44:17,500][  INFO][PID:4193638] Checking that builder machine is OK
[2025-09-11 16:44:17,958][  INFO][PID:4193638] Running remote command: copr-builder-ready fedora-rawhide-x86_64
[2025-09-11 16:44:18,150][  INFO][PID:4193638] Red Hat subscription not needed for fedora-rawhide-x86_64
Builder is ready to be used

[2025-09-11 16:44:18,150][  INFO][PID:4193638] Filling build.info file with builder info
[2025-09-11 16:44:18,151][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:44:18,152][  INFO][PID:4193638] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "torsava",
            "project_name": "automatic-obsoletes",
            "project_dirname": "automatic-obsoletes",
            "submitter": "https://src.fedoraproject.org/user/jskarvad",
            "ended_on": null,
            "started_on": 1757609058.1521423,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-rawhide-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "9546602-fedora-rawhide-x86_64",
            "build_id": 9546602,
            "package_name": "uhd",
            "package_version": "4.9.0.0-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/torsava/automatic-obsoletes/uhd",
            "git_hash": "4921d23a46f5933bfa1b5bfb5f24ead7c0b35f2d",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "torsava/automatic-obsoletes--https://src.fedoraproject.org/user/jskarvad",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/torsava/automatic-obsoletes/fedora-rawhide-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/torsava/automatic-obsoletes",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/torsava/automatic-obsoletes",
            "result_dir": "09546602-uhd",
            "built_packages": "",
            "id": 9546602,
            "mockchain_macros": {
                "copr_username": "torsava",
                "copr_projectname": "automatic-obsoletes",
                "vendor": "Fedora Project COPR (torsava/automatic-obsoletes)"
            }
        }
    ]
}
[2025-09-11 16:44:18,178][  INFO][PID:4193638] Sending fedora-messaging bus message in build.start
[2025-09-11 16:44:18,859][  INFO][PID:4193638] Sending fedora-messaging bus message in chroot.start
[2025-09-11 16:44:18,887][  INFO][PID:4193638] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9546602-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached
[2025-09-11 16:44:19,196][  INFO][PID:4193638] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '54.237.57.1' (ED25519) to the list of known hosts.


[2025-09-11 16:44:19,196][  INFO][PID:4193638] Downloading the builder-live.log file, attempt 1
[2025-09-11 16:44:19,198][  INFO][PID:4193638] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.237.57.1 copr-rpmbuild-log
[2025-09-11 16:44:24,206][  INFO][PID:4193638] Periodic builder liveness probe: alive
[2025-09-11 16:44:24,206][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:44:29,207][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:44:34,209][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:44:39,211][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:44:44,212][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:44:49,213][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:44:54,214][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:44:59,215][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:45:04,216][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:45:09,218][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:45:14,219][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:45:19,220][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:45:24,222][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:45:29,223][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:45:34,224][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:45:39,225][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:45:44,226][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:45:49,227][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:45:54,229][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:45:59,230][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:46:04,231][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:46:09,232][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:46:14,234][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:46:19,235][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:46:24,236][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:46:29,237][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:46:34,238][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:46:39,240][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:46:44,248][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:46:49,249][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:46:54,250][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:46:59,251][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:47:04,252][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:47:09,254][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:47:14,255][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:47:19,256][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:47:24,257][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:47:29,258][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:47:34,260][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:47:39,261][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:47:44,262][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:47:49,264][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:47:54,265][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:47:59,266][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:48:04,268][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:48:09,269][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:48:14,270][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:48:19,272][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:48:24,273][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:48:29,283][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:48:34,284][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:48:39,287][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:48:44,289][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:48:49,291][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:48:54,293][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:48:59,295][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:49:04,297][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:49:09,298][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:49:11,783][ ERROR][PID:4193638] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-11 16:49:14,301][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:49:19,302][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:49:21,783][WARNING][PID:4193638] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-09-11 16:49:24,303][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:49:29,305][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:49:31,784][  INFO][PID:4193638] Downloading the builder-live.log file, attempt 2
[2025-09-11 16:49:31,786][  INFO][PID:4193638] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.237.57.1 copr-rpmbuild-log
[2025-09-11 16:49:34,306][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:49:39,307][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:49:44,309][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:49:49,310][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:49:54,311][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:49:59,314][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:50:04,316][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:50:09,317][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:50:14,319][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:50:19,320][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:50:24,324][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:50:29,327][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:50:31,856][ ERROR][PID:4193638] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-11 16:50:34,331][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:50:39,332][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:50:41,857][WARNING][PID:4193638] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-09-11 16:50:44,333][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:50:49,337][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:50:51,858][  INFO][PID:4193638] Downloading the builder-live.log file, attempt 3
[2025-09-11 16:50:51,861][  INFO][PID:4193638] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.237.57.1 copr-rpmbuild-log
[2025-09-11 16:50:54,339][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:50:59,340][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:51:04,342][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:51:09,356][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:51:14,364][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:51:19,366][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:51:24,368][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:51:29,370][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:51:34,374][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:51:39,379][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:51:44,381][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:51:49,382][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:51:51,940][ ERROR][PID:4193638] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-11 16:51:54,387][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:51:59,389][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:52:01,953][WARNING][PID:4193638] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-09-11 16:52:04,391][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:52:09,392][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:52:11,959][  INFO][PID:4193638] Downloading the builder-live.log file, attempt 4
[2025-09-11 16:52:11,963][  INFO][PID:4193638] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.237.57.1 copr-rpmbuild-log
[2025-09-11 16:52:14,394][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:52:19,396][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:52:24,397][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:52:29,398][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:52:34,401][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:52:39,412][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:52:44,414][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:52:49,419][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:52:54,420][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:52:59,422][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:53:04,423][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:53:09,424][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:53:12,041][ ERROR][PID:4193638] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-11 16:53:14,425][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:53:19,428][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:53:22,046][ ERROR][PID:4193638] Giving up for unstable SSH, failures: 1757609361.7838676, 1757609441.8578336, 1757609521.9534545, 1757609602.0457497
[2025-09-11 16:53:22,047][ ERROR][PID:4193638] Re-try request for task on 'ResallocHost, ticket_id=5010892, hostname=54.237.57.1, name=aws_x86_64_spot_prod_06718569_20250911_163725, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-09-11 16:53:22,048][  INFO][PID:4193638] Releasing VM back to pool
[2025-09-11 16:53:22,061][  INFO][PID:4193638] Retry #1 (on other host)
[2025-09-11 16:53:22,062][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:53:22,063][  INFO][PID:4193638] VM allocation process starts
[2025-09-11 16:53:22,078][  INFO][PID:4193638] Trying to allocate VM: ResallocHost, ticket_id=5011133, requested_tags=['copr_builder', 'arch_x86_64']
[2025-09-11 16:53:27,080][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:53:32,082][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:53:37,087][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:53:42,094][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:53:47,100][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:53:52,103][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:53:57,104][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:54:02,105][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:54:07,109][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:54:12,113][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:54:17,115][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:54:22,116][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:54:27,118][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:54:30,193][  INFO][PID:4193638] Allocated host ResallocHost, ticket_id=5011133, hostname=35.172.224.210, name=aws_x86_64_normalreserved_prod_06719139_20250911_165241, requested_tags=['copr_builder', 'arch_x86_64']
[2025-09-11 16:54:30,194][  INFO][PID:4193638] Allocating ssh connection to builder
[2025-09-11 16:54:30,194][  INFO][PID:4193638] Checking that builder machine is OK
[2025-09-11 16:54:30,623][  INFO][PID:4193638] Running remote command: copr-builder-ready fedora-rawhide-x86_64
[2025-09-11 16:54:30,826][  INFO][PID:4193638] Red Hat subscription not needed for fedora-rawhide-x86_64
Builder is ready to be used

[2025-09-11 16:54:30,826][  INFO][PID:4193638] Filling build.info file with builder info
[2025-09-11 16:54:30,829][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:54:30,830][  INFO][PID:4193638] Not re-notifying FE and msg buses for the new host.
[2025-09-11 16:54:30,831][  INFO][PID:4193638] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9546602-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached
[2025-09-11 16:54:31,177][  INFO][PID:4193638] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '35.172.224.210' (ED25519) to the list of known hosts.


[2025-09-11 16:54:31,178][  INFO][PID:4193638] Downloading the builder-live.log file, attempt 1
[2025-09-11 16:54:31,180][  INFO][PID:4193638] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@35.172.224.210 copr-rpmbuild-log
[2025-09-11 16:54:36,196][  INFO][PID:4193638] Periodic builder liveness probe: alive
[2025-09-11 16:54:36,196][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:54:41,197][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:54:46,199][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:54:51,200][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:54:56,202][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:55:01,205][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:55:06,209][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:55:11,210][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:55:16,212][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:55:21,215][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:55:26,217][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:55:31,218][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:55:36,220][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:55:41,227][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:55:46,229][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:55:51,230][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:55:56,231][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:56:01,232][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:56:06,233][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:56:11,234][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:56:16,235][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:56:21,243][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:56:26,248][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:56:31,250][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:56:36,256][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:56:41,258][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:56:46,260][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:56:51,262][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:56:56,264][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:57:01,265][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:57:06,267][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:57:11,269][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:57:16,270][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:57:21,271][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:57:26,272][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:57:31,273][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:57:36,274][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:57:41,275][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:57:46,276][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:57:51,277][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:57:56,279][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:58:01,282][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:58:06,283][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:58:11,285][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:58:16,290][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:58:21,292][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:58:26,295][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:58:31,300][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:58:36,301][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:58:41,303][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:58:46,306][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:58:51,311][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:58:56,313][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:59:01,314][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:59:06,316][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:59:11,317][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:59:16,319][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:59:21,320][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:59:26,321][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:59:31,322][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:59:36,323][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:59:41,327][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:59:46,328][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:59:51,331][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 16:59:56,336][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:00:01,338][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:00:06,340][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:00:11,341][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:00:16,343][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:00:21,344][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:00:26,345][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:00:31,346][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:00:36,348][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:00:41,351][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:00:46,352][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:00:51,353][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:00:56,357][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:01:01,362][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:01:06,364][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:01:11,369][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:01:16,378][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:01:21,380][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:01:26,381][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:01:31,384][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:01:36,385][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:01:41,386][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:01:46,388][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:01:51,389][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:01:56,390][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:02:01,394][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:02:06,399][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:02:11,403][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:02:16,404][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:02:21,405][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:02:26,406][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:02:31,407][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:02:36,409][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:02:41,410][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:02:46,413][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:02:51,416][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:02:56,420][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:03:01,422][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:03:06,423][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:03:11,424][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:03:16,426][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:03:21,427][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:03:26,428][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:03:31,430][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:03:36,431][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:03:41,432][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:03:46,433][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:03:51,434][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:03:56,435][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:04:01,436][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:04:06,438][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:04:11,446][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:04:16,447][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:04:21,448][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:04:26,449][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:04:31,450][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:04:36,462][  INFO][PID:4193638] Periodic builder liveness probe: alive
[2025-09-11 17:04:36,463][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:04:41,464][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:04:46,465][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:04:51,466][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:04:56,467][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:05:01,471][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:05:06,472][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:05:11,473][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:05:16,474][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:05:21,476][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:05:26,477][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:05:31,478][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:05:36,480][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:05:41,482][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:05:46,484][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:05:51,485][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:05:56,486][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:06:01,487][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:06:06,488][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:06:11,489][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:06:16,490][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:06:21,491][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:06:26,492][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:06:31,493][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:06:36,494][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:06:41,495][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:06:46,496][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:06:51,497][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:06:56,499][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:07:01,500][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:07:06,501][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:07:11,502][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:07:16,503][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:07:21,504][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:07:26,505][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:07:31,506][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:07:36,507][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:07:41,512][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:07:46,513][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:07:51,514][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:07:56,516][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:08:01,517][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:08:06,518][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:08:11,519][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:08:16,520][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:08:21,521][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:08:26,522][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:08:31,525][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:08:36,527][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:08:41,528][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:08:46,529][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:08:51,530][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:08:56,531][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:09:01,532][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:09:06,533][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:09:11,534][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:09:16,535][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:09:21,537][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:09:26,538][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:09:31,543][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:09:36,544][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:09:41,545][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:09:46,546][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:09:51,547][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:09:56,548][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:10:01,549][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:10:06,550][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:10:11,552][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:10:16,553][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:10:21,554][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:10:26,555][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:10:31,556][  INFO][PID:4193638] Checking for cancel request
[2025-09-11 17:10:35,882][  INFO][PID:4193638] Downloading results from builder
[2025-09-11 17:10:35,882][  INFO][PID:4193638] rsyncing of mockbuilder@35.172.224.210:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/torsava/automatic-obsoletes/fedora-rawhide-x86_64/09546602-uhd started
[2025-09-11 17:10:35,883][  INFO][PID:4193638] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@35.172.224.210:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/torsava/automatic-obsoletes/fedora-rawhide-x86_64/09546602-uhd/ &> /var/lib/copr/public_html/results/torsava/automatic-obsoletes/fedora-rawhide-x86_64/09546602-uhd/build-09546602.rsync.log
[2025-09-11 17:10:37,361][  INFO][PID:4193638] rsyncing finished.
[2025-09-11 17:10:37,362][  INFO][PID:4193638] Releasing VM back to pool
[2025-09-11 17:10:37,392][  INFO][PID:4193638] Searching for 'success' file in resultdir
[2025-09-11 17:10:37,393][ ERROR][PID:4193638] Build failed: Backend process error: No success file => build failure
[2025-09-11 17:10:37,394][  INFO][PID:4193638] Finished build: id=9546602 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/torsava/automatic-obsoletes chroot=fedora-rawhide-x86_64 
[2025-09-11 17:10:37,396][ ERROR][PID:4193638] Backend process error: No success file => build failure
[2025-09-11 17:10:37,396][  INFO][PID:4193638] Worker failed build, took 966.5660493373871
[2025-09-11 17:10:37,397][  INFO][PID:4193638] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "torsava",
            "project_name": "automatic-obsoletes",
            "project_dirname": "automatic-obsoletes",
            "submitter": "https://src.fedoraproject.org/user/jskarvad",
            "ended_on": 1757610637.3966966,
            "started_on": 1757609670.8306472,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-rawhide-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "9546602-fedora-rawhide-x86_64",
            "build_id": 9546602,
            "package_name": "uhd",
            "package_version": "4.9.0.0-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/torsava/automatic-obsoletes/uhd",
            "git_hash": "4921d23a46f5933bfa1b5bfb5f24ead7c0b35f2d",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "torsava/automatic-obsoletes--https://src.fedoraproject.org/user/jskarvad",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/torsava/automatic-obsoletes/fedora-rawhide-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/torsava/automatic-obsoletes",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/torsava/automatic-obsoletes",
            "result_dir": "09546602-uhd",
            "built_packages": "",
            "id": 9546602,
            "mockchain_macros": {
                "copr_username": "torsava",
                "copr_projectname": "automatic-obsoletes",
                "vendor": "Fedora Project COPR (torsava/automatic-obsoletes)"
            }
        }
    ]
}
[2025-09-11 17:10:37,424][  INFO][PID:4193638] Sending fedora-messaging bus message in build.end
[2025-09-11 17:10:37,451][  INFO][PID:4193638] Compressing /var/lib/copr/public_html/results/torsava/automatic-obsoletes/fedora-rawhide-x86_64/09546602-uhd/builder-live.log by gzip
[2025-09-11 17:10:37,452][  INFO][PID:4193638] Running command 'gzip /var/lib/copr/public_html/results/torsava/automatic-obsoletes/fedora-rawhide-x86_64/09546602-uhd/builder-live.log' as PID 199465
[2025-09-11 17:10:37,550][  INFO][PID:4193638] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/torsava/automatic-obsoletes/fedora-rawhide-x86_64/09546602-uhd/builder-live.log)
[2025-09-11 17:10:37,551][  INFO][PID:4193638] Compressing /var/lib/copr/public_html/results/torsava/automatic-obsoletes/fedora-rawhide-x86_64/09546602-uhd/backend.log by gzip
[2025-09-11 17:10:37,553][  INFO][PID:4193638] Running command 'gzip /var/lib/copr/public_html/results/torsava/automatic-obsoletes/fedora-rawhide-x86_64/09546602-uhd/backend.log' as PID 199477