[2026-04-08 16:28:37,834][ INFO][PID:1401303] Marking build as starting [2026-04-08 16:28:37,875][ INFO][PID:1401303] Checking that /var/lib/copr/public_html/results/@theforeman/develop/rhel-9-x86_64/repodata/repomd.xml exists [2026-04-08 16:28:38,124][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:28:38,125][ INFO][PID:1401303] VM allocation process starts [2026-04-08 16:28:38,141][ INFO][PID:1401303] Trying to allocate VM: ResallocHost, ticket_id=2228366, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-08 16:28:43,142][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:28:48,144][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:28:53,145][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:28:58,146][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:29:03,147][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:29:08,149][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:29:13,150][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:29:18,151][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:29:23,152][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:29:28,153][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:29:33,154][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:29:38,156][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:29:43,157][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:29:46,209][ INFO][PID:1401303] Allocated host ResallocHost, ticket_id=2228366, hostname=3.81.228.97, name=aws_x86_64_spot_prod_05936675_20260408_162539, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-08 16:29:46,210][ INFO][PID:1401303] Allocating ssh connection to builder [2026-04-08 16:29:46,211][ INFO][PID:1401303] Checking that builder machine is OK [2026-04-08 16:29:46,525][ INFO][PID:1401303] Running remote command: copr-builder-ready rhel-9-x86_64 [2026-04-08 16:29:46,730][ INFO][PID:1401303] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2026-04-08 16:29:46,731][ INFO][PID:1401303] Filling build.info file with builder info [2026-04-08 16:29:46,731][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:29:46,733][ INFO][PID:1401303] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@theforeman", "project_name": "develop", "project_dirname": "develop", "submitter": "packit", "ended_on": null, "started_on": 1775665786.732878, "submitted_on": null, "status": 3, "chroot": "rhel-9-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10302336-rhel-9-x86_64", "build_id": 10302336, "package_name": "rubygem-katello", "package_version": "4.21.0-0.3.pre.master.20260408162804971123.master.5952.g3d4ba724b7", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@theforeman/develop/rubygem-katello", "git_hash": "465f61cd240f2d3943279cf5de36bb4116a781ea", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@theforeman/develop--packit", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@theforeman/develop/rhel-9-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://yum.theforeman.org/releases/nightly/el9/x86_64/", "id": "https_yum_theforeman_org_releases_nightly_el9_x86_64", "name": "Additional repo https_yum_theforeman_org_releases_nightly_el9_x86_64" }, { "baseurl": "https://yum.theforeman.org/plugins/nightly/el9/x86_64/", "id": "https_yum_theforeman_org_plugins_nightly_el9_x86_64", "name": "Additional repo https_yum_theforeman_org_plugins_nightly_el9_x86_64" }, { "baseurl": "https://yum.theforeman.org/katello/nightly/katello/el9/x86_64/", "id": "https_yum_theforeman_org_katello_nightly_katello_el9_x86_64", "name": "Additional repo https_yum_theforeman_org_katello_nightly_katello_el9_x86_64" } ], "background": false, "fedora_review": false, "isolation": "default", "modules": { "toggle": [ { "enable": "foreman-devel:el9" } ] }, "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@theforeman/develop", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@theforeman/develop", "result_dir": "10302336-rubygem-katello", "built_packages": "", "id": 10302336, "mockchain_macros": { "copr_username": "@theforeman", "copr_projectname": "develop", "vendor": "Fedora Project COPR (@theforeman/develop)" } } ] } [2026-04-08 16:29:46,773][ INFO][PID:1401303] Sending fedora-messaging bus message in build.start [2026-04-08 16:29:47,447][ INFO][PID:1401303] Sending fedora-messaging bus message in chroot.start [2026-04-08 16:29:47,479][ INFO][PID:1401303] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10302336-rhel-9-x86_64 --chroot rhel-9-x86_64 --detached [2026-04-08 16:29:47,805][ INFO][PID:1401303] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '3.81.228.97' (ED25519) to the list of known hosts. [2026-04-08 16:29:47,805][ INFO][PID:1401303] Downloading the builder-live.log file, attempt 1 [2026-04-08 16:29:47,807][ INFO][PID:1401303] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.81.228.97 copr-rpmbuild-log [2026-04-08 16:29:52,811][ INFO][PID:1401303] Periodic builder liveness probe: alive [2026-04-08 16:29:52,811][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:29:57,812][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:30:02,813][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:30:07,814][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:30:12,816][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:30:17,817][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:30:22,818][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:30:27,819][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:30:32,820][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:30:37,821][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:30:42,822][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:30:47,824][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:30:52,825][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:30:57,826][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:31:02,827][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:31:07,828][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:31:12,829][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:31:17,830][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:31:22,831][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:31:27,834][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:31:32,837][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:31:37,840][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:31:42,841][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:31:47,842][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:31:52,846][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:31:57,847][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:31:59,550][ ERROR][PID:1401303] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-08 16:32:02,848][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:32:07,849][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:32:09,551][WARNING][PID:1401303] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-08 16:32:12,850][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:32:17,851][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:32:19,552][ INFO][PID:1401303] Downloading the builder-live.log file, attempt 2 [2026-04-08 16:32:19,554][ INFO][PID:1401303] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.81.228.97 copr-rpmbuild-log [2026-04-08 16:32:22,852][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:32:27,857][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:32:32,858][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:32:37,860][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:32:42,862][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:32:47,863][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:32:52,865][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:32:57,866][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:33:02,867][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:33:07,868][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:33:12,869][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:33:17,870][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:33:19,621][ ERROR][PID:1401303] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-08 16:33:22,871][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:33:27,872][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:33:29,630][WARNING][PID:1401303] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-08 16:33:32,875][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:33:37,876][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:33:39,631][ INFO][PID:1401303] Downloading the builder-live.log file, attempt 3 [2026-04-08 16:33:39,632][ INFO][PID:1401303] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.81.228.97 copr-rpmbuild-log [2026-04-08 16:33:42,877][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:33:47,879][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:33:52,880][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:33:57,881][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:34:02,883][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:34:07,885][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:34:12,891][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:34:17,893][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:34:22,895][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:34:27,896][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:34:32,897][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:34:37,898][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:34:39,699][ ERROR][PID:1401303] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-08 16:34:42,901][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:34:47,902][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:34:49,706][WARNING][PID:1401303] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-08 16:34:52,904][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:34:57,906][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:34:59,707][ INFO][PID:1401303] Downloading the builder-live.log file, attempt 4 [2026-04-08 16:34:59,710][ INFO][PID:1401303] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.81.228.97 copr-rpmbuild-log [2026-04-08 16:35:02,910][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:35:07,913][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:35:12,915][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:35:17,916][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:35:22,918][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:35:27,920][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:35:32,921][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:35:37,922][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:35:42,931][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:35:47,932][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:35:52,933][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:35:57,934][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:35:59,778][ ERROR][PID:1401303] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-08 16:36:02,935][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:36:07,936][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:36:09,782][ ERROR][PID:1401303] Giving up for unstable SSH, failures: 1775665929.551246, 1775666009.6303158, 1775666089.7060342, 1775666169.7824113 [2026-04-08 16:36:09,783][ ERROR][PID:1401303] Re-try request for task on 'ResallocHost, ticket_id=2228366, hostname=3.81.228.97, name=aws_x86_64_spot_prod_05936675_20260408_162539, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-04-08 16:36:09,784][ INFO][PID:1401303] Releasing VM back to pool [2026-04-08 16:36:09,794][ INFO][PID:1401303] Retry #1 (on other host) [2026-04-08 16:36:09,795][ INFO][PID:1401303] Checking that /var/lib/copr/public_html/results/@theforeman/develop/rhel-9-x86_64/repodata/repomd.xml exists [2026-04-08 16:36:09,796][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:36:09,796][ INFO][PID:1401303] VM allocation process starts [2026-04-08 16:36:09,808][ INFO][PID:1401303] Trying to allocate VM: ResallocHost, ticket_id=2228458, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-08 16:36:14,809][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:36:19,810][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:36:24,811][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:36:29,812][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:36:34,813][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:36:39,814][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:36:44,818][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:36:49,820][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:36:54,821][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:36:59,823][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:37:04,830][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:37:09,832][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:37:14,834][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:37:19,835][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:37:24,837][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:37:29,838][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:37:34,839][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:37:39,840][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:37:44,842][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:37:49,846][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:37:54,847][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:37:59,848][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:38:04,849][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:38:09,851][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:38:14,853][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:38:19,855][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:38:24,856][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:38:29,857][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:38:34,858][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:38:39,859][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:38:44,861][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:38:49,867][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:38:54,881][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:38:59,883][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:39:04,890][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:39:09,957][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:39:14,968][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:39:19,970][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:39:24,972][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:39:29,976][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:39:34,977][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:39:39,978][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:39:44,980][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:39:49,987][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:39:54,989][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:39:59,991][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:40:05,000][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:40:10,003][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:40:15,004][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:40:20,006][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:40:25,011][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:40:27,991][ INFO][PID:1401303] Allocated host ResallocHost, ticket_id=2228458, hostname=54.86.86.4, name=aws_x86_64_normal_prod_05937024_20260408_163638, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-08 16:40:27,992][ INFO][PID:1401303] Allocating ssh connection to builder [2026-04-08 16:40:27,992][ INFO][PID:1401303] Checking that builder machine is OK [2026-04-08 16:40:28,339][ INFO][PID:1401303] Running remote command: copr-builder-ready rhel-9-x86_64 [2026-04-08 16:40:28,547][ INFO][PID:1401303] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2026-04-08 16:40:28,548][ INFO][PID:1401303] Filling build.info file with builder info [2026-04-08 16:40:28,558][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:40:28,559][ INFO][PID:1401303] Not re-notifying FE and msg buses for the new host. [2026-04-08 16:40:28,559][ INFO][PID:1401303] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10302336-rhel-9-x86_64 --chroot rhel-9-x86_64 --detached [2026-04-08 16:40:28,898][ INFO][PID:1401303] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '54.86.86.4' (ED25519) to the list of known hosts. [2026-04-08 16:40:28,903][ INFO][PID:1401303] Downloading the builder-live.log file, attempt 1 [2026-04-08 16:40:29,060][ INFO][PID:1401303] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.86.86.4 copr-rpmbuild-log [2026-04-08 16:40:33,917][ INFO][PID:1401303] Periodic builder liveness probe: alive [2026-04-08 16:40:33,918][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:40:38,921][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:40:43,925][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:40:48,927][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:40:53,928][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:40:58,936][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:41:03,937][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:41:08,938][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:41:13,939][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:41:18,940][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:41:23,942][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:41:28,944][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:41:33,950][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:41:38,951][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:41:43,953][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:41:48,955][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:41:53,956][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:41:58,957][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:42:03,958][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:42:08,959][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:42:13,961][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:42:18,963][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:42:23,965][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:42:28,966][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:42:33,967][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:42:38,968][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:42:43,969][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:42:48,970][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:42:53,971][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:42:58,985][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:43:03,991][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:43:08,992][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:43:13,992][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:43:18,994][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:43:23,995][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:43:28,996][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:43:34,008][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:43:39,009][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:43:44,010][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:43:49,012][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:43:54,013][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:43:59,014][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:44:04,015][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:44:09,032][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:44:14,033][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:44:19,034][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:44:24,037][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:44:29,039][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:44:34,040][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:44:39,043][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:44:44,045][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:44:49,046][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:44:54,047][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:44:59,048][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:45:04,049][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:45:09,050][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:45:14,051][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:45:19,052][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:45:24,056][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:45:29,061][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:45:34,062][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:45:39,063][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:45:44,064][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:45:49,091][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:45:54,092][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:45:59,093][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:46:04,094][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:46:09,096][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:46:14,100][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:46:19,152][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:46:24,153][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:46:29,154][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:46:34,155][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:46:39,157][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:46:44,158][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:46:49,159][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:46:54,169][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:46:59,170][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:47:04,172][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:47:09,173][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:47:14,174][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:47:19,175][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:47:24,176][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:47:29,179][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:47:34,185][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:47:39,186][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:47:44,190][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:47:49,192][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:47:54,196][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:47:59,198][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:48:04,203][ INFO][PID:1401303] Checking for cancel request [2026-04-08 16:48:06,920][ INFO][PID:1401303] Downloading results from builder [2026-04-08 16:48:06,921][ INFO][PID:1401303] rsyncing of mockbuilder@54.86.86.4:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@theforeman/develop/rhel-9-x86_64/10302336-rubygem-katello started [2026-04-08 16:48:06,922][ INFO][PID:1401303] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@54.86.86.4:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@theforeman/develop/rhel-9-x86_64/10302336-rubygem-katello/ &> /var/lib/copr/public_html/results/@theforeman/develop/rhel-9-x86_64/10302336-rubygem-katello/build-10302336.rsync.log [2026-04-08 16:48:07,397][ INFO][PID:1401303] rsyncing finished. [2026-04-08 16:48:07,397][ INFO][PID:1401303] Releasing VM back to pool [2026-04-08 16:48:07,428][ INFO][PID:1401303] Searching for 'success' file in resultdir [2026-04-08 16:48:07,429][ INFO][PID:1401303] Going to sign pkgs from source: 10302336-rhel-9-x86_64 in chroot: /var/lib/copr/public_html/results/@theforeman/develop/rhel-9-x86_64 [2026-04-08 16:48:07,429][ INFO][PID:1401303] Calling '/bin/sign -u @theforeman#develop@copr.fedorahosted.org -p' (attempt #1) [2026-04-08 16:48:07,709][ INFO][PID:1401303] Calling '/bin/sign -4 -h sha256 -u @theforeman#develop@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@theforeman/develop/rhel-9-x86_64/10302336-rubygem-katello/rubygem-katello-doc-4.21.0-0.3.pre.master.20260408162804971123.master.5952.g3d4ba724b7.el9.noarch.rpm' (attempt #1) [2026-04-08 16:48:08,467][ INFO][PID:1401303] signed rpm: /var/lib/copr/public_html/results/@theforeman/develop/rhel-9-x86_64/10302336-rubygem-katello/rubygem-katello-doc-4.21.0-0.3.pre.master.20260408162804971123.master.5952.g3d4ba724b7.el9.noarch.rpm [2026-04-08 16:48:08,468][ INFO][PID:1401303] Calling '/bin/sign -4 -h sha256 -u @theforeman#develop@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@theforeman/develop/rhel-9-x86_64/10302336-rubygem-katello/rubygem-katello-assets-4.21.0-0.3.pre.master.20260408162804971123.master.5952.g3d4ba724b7.el9.noarch.rpm' (attempt #1) [2026-04-08 16:48:09,340][ INFO][PID:1401303] signed rpm: /var/lib/copr/public_html/results/@theforeman/develop/rhel-9-x86_64/10302336-rubygem-katello/rubygem-katello-assets-4.21.0-0.3.pre.master.20260408162804971123.master.5952.g3d4ba724b7.el9.noarch.rpm [2026-04-08 16:48:09,340][ INFO][PID:1401303] Calling '/bin/sign -4 -h sha256 -u @theforeman#develop@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@theforeman/develop/rhel-9-x86_64/10302336-rubygem-katello/rubygem-katello-4.21.0-0.3.pre.master.20260408162804971123.master.5952.g3d4ba724b7.el9.noarch.rpm' (attempt #1) [2026-04-08 16:48:10,392][ INFO][PID:1401303] signed rpm: /var/lib/copr/public_html/results/@theforeman/develop/rhel-9-x86_64/10302336-rubygem-katello/rubygem-katello-4.21.0-0.3.pre.master.20260408162804971123.master.5952.g3d4ba724b7.el9.noarch.rpm [2026-04-08 16:48:10,393][ INFO][PID:1401303] Calling '/bin/sign -4 -h sha256 -u @theforeman#develop@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@theforeman/develop/rhel-9-x86_64/10302336-rubygem-katello/rubygem-katello-4.21.0-0.3.pre.master.20260408162804971123.master.5952.g3d4ba724b7.el9.src.rpm' (attempt #1) [2026-04-08 16:48:11,556][ INFO][PID:1401303] signed rpm: /var/lib/copr/public_html/results/@theforeman/develop/rhel-9-x86_64/10302336-rubygem-katello/rubygem-katello-4.21.0-0.3.pre.master.20260408162804971123.master.5952.g3d4ba724b7.el9.src.rpm [2026-04-08 16:48:11,557][ INFO][PID:1401303] Sign done [2026-04-08 16:48:11,558][ INFO][PID:1401303] Incremental createrepo run, adding 10302336-rubygem-katello into https://download.copr.fedorainfracloud.org/results/@theforeman/develop/rhel-9-x86_64, (auto-create-repo=True) [2026-04-08 16:48:11,561][ INFO][PID:1401303] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@theforeman/develop/rhel-9-x86_64 --add 10302336-rubygem-katello --no-appstream-metadata' as PID 1544890 [2026-04-08 16:48:24,358][ INFO][PID:1401303] Finished after 12 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@theforeman/develop/rhel-9-x86_64 --add 10302336-rubygem-katello --no-appstream-metadata) [2026-04-08 16:48:24,358][ INFO][PID:1401303] Getting build details [2026-04-08 16:48:24,359][ INFO][PID:1401303] Listing built binary packages in /var/lib/copr/public_html/results/@theforeman/develop/rhel-9-x86_64/10302336-rubygem-katello [2026-04-08 16:48:24,359][ INFO][PID:1401303] Built packages: ['rubygem-katello 4.21.0', 'rubygem-katello-doc 4.21.0', 'rubygem-katello-assets 4.21.0'] [2026-04-08 16:48:24,360][ INFO][PID:1401303] build details: {'built_packages': 'rubygem-katello 4.21.0\nrubygem-katello-doc 4.21.0\nrubygem-katello-assets 4.21.0'} [2026-04-08 16:48:24,360][ INFO][PID:1401303] Retrieving pubkey [2026-04-08 16:48:24,361][ INFO][PID:1401303] Calling '/bin/sign -u @theforeman#develop@copr.fedorahosted.org -p' (attempt #1) [2026-04-08 16:48:24,644][ INFO][PID:1401303] Added pubkey for user @theforeman project develop into: /var/lib/copr/public_html/results/@theforeman/develop/pubkey.gpg [2026-04-08 16:48:24,645][ INFO][PID:1401303] Finished build: id=10302336 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@theforeman/develop chroot=rhel-9-x86_64 [2026-04-08 16:48:24,647][ INFO][PID:1401303] Worker succeeded build, took 476.0885338783264 [2026-04-08 16:48:24,648][ INFO][PID:1401303] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@theforeman", "project_name": "develop", "project_dirname": "develop", "submitter": "packit", "ended_on": 1775666904.6478548, "started_on": 1775666428.559321, "submitted_on": null, "status": 1, "chroot": "rhel-9-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10302336-rhel-9-x86_64", "build_id": 10302336, "package_name": "rubygem-katello", "package_version": "4.21.0-0.3.pre.master.20260408162804971123.master.5952.g3d4ba724b7", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@theforeman/develop/rubygem-katello", "git_hash": "465f61cd240f2d3943279cf5de36bb4116a781ea", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@theforeman/develop--packit", "results": { "packages": [ { "name": "rubygem-katello", "epoch": null, "version": "4.21.0", "release": "0.3.pre.master.20260408162804971123.master.5952.g3d4ba724b7.el9", "arch": "noarch" }, { "name": "rubygem-katello-doc", "epoch": null, "version": "4.21.0", "release": "0.3.pre.master.20260408162804971123.master.5952.g3d4ba724b7.el9", "arch": "noarch" }, { "name": "rubygem-katello", "epoch": null, "version": "4.21.0", "release": "0.3.pre.master.20260408162804971123.master.5952.g3d4ba724b7.el9", "arch": "src" }, { "name": "rubygem-katello-assets", "epoch": null, "version": "4.21.0", "release": "0.3.pre.master.20260408162804971123.master.5952.g3d4ba724b7.el9", "arch": "noarch" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@theforeman/develop/rhel-9-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://yum.theforeman.org/releases/nightly/el9/x86_64/", "id": "https_yum_theforeman_org_releases_nightly_el9_x86_64", "name": "Additional repo https_yum_theforeman_org_releases_nightly_el9_x86_64" }, { "baseurl": "https://yum.theforeman.org/plugins/nightly/el9/x86_64/", "id": "https_yum_theforeman_org_plugins_nightly_el9_x86_64", "name": "Additional repo https_yum_theforeman_org_plugins_nightly_el9_x86_64" }, { "baseurl": "https://yum.theforeman.org/katello/nightly/katello/el9/x86_64/", "id": "https_yum_theforeman_org_katello_nightly_katello_el9_x86_64", "name": "Additional repo https_yum_theforeman_org_katello_nightly_katello_el9_x86_64" } ], "background": false, "fedora_review": false, "isolation": "default", "modules": { "toggle": [ { "enable": "foreman-devel:el9" } ] }, "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@theforeman/develop", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@theforeman/develop", "result_dir": "10302336-rubygem-katello", "built_packages": "rubygem-katello 4.21.0\nrubygem-katello-doc 4.21.0\nrubygem-katello-assets 4.21.0", "id": 10302336, "mockchain_macros": { "copr_username": "@theforeman", "copr_projectname": "develop", "vendor": "Fedora Project COPR (@theforeman/develop)" } } ] } [2026-04-08 16:48:24,694][ INFO][PID:1401303] Sending fedora-messaging bus message in build.end [2026-04-08 16:48:24,726][ INFO][PID:1401303] Compressing /var/lib/copr/public_html/results/@theforeman/develop/rhel-9-x86_64/10302336-rubygem-katello/builder-live.log by gzip [2026-04-08 16:48:24,730][ INFO][PID:1401303] Running command 'gzip /var/lib/copr/public_html/results/@theforeman/develop/rhel-9-x86_64/10302336-rubygem-katello/builder-live.log' as PID 1546458 [2026-04-08 16:48:24,818][ INFO][PID:1401303] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@theforeman/develop/rhel-9-x86_64/10302336-rubygem-katello/builder-live.log) [2026-04-08 16:48:24,819][ INFO][PID:1401303] Compressing /var/lib/copr/public_html/results/@theforeman/develop/rhel-9-x86_64/10302336-rubygem-katello/backend.log by gzip [2026-04-08 16:48:24,820][ INFO][PID:1401303] Running command 'gzip /var/lib/copr/public_html/results/@theforeman/develop/rhel-9-x86_64/10302336-rubygem-katello/backend.log' as PID 1546467