[2026-03-09 19:00:17,151][ INFO][PID:1037694] Marking build as starting [2026-03-09 19:00:17,233][ INFO][PID:1037694] Checking that /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-x86_64/repodata/repomd.xml exists [2026-03-09 19:00:17,248][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:00:17,249][ INFO][PID:1037694] VM allocation process starts [2026-03-09 19:00:17,263][ INFO][PID:1037694] Trying to allocate VM: ResallocHost, ticket_id=1782345, requested_tags=['copr_builder', 'arch_x86_64'] [2026-03-09 19:00:22,265][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:00:27,266][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:00:29,294][ INFO][PID:1037694] Allocated host ResallocHost, ticket_id=1782345, hostname=54.237.247.167, name=aws_x86_64_spot_prod_02955062_20260309_185450, requested_tags=['copr_builder', 'arch_x86_64'] [2026-03-09 19:00:29,295][ INFO][PID:1037694] Allocating ssh connection to builder [2026-03-09 19:00:29,295][ INFO][PID:1037694] Checking that builder machine is OK [2026-03-09 19:00:29,649][ INFO][PID:1037694] Running remote command: copr-builder-ready fedora-eln-x86_64 [2026-03-09 19:00:29,872][ INFO][PID:1037694] Red Hat subscription not needed for fedora-eln-x86_64 Builder is ready to be used [2026-03-09 19:00:29,873][ INFO][PID:1037694] Filling build.info file with builder info [2026-03-09 19:00:29,874][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:00:29,875][ INFO][PID:1037694] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@CoreOS", "project_name": "continuous", "project_dirname": "continuous", "submitter": "https://api.github.com/users/jmarrero", "ended_on": null, "started_on": 1773082829.8757186, "submitted_on": null, "status": 3, "chroot": "fedora-eln-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10204731-fedora-eln-x86_64", "build_id": 10204731, "package_name": "rpm-ostree", "package_version": "2026.1.12.g13421c58-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@CoreOS/continuous/rpm-ostree", "git_hash": "4f884043a5c16963a50771eb56939af660212aa6", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@CoreOS/continuous--https://api.github.com/users/jmarrero", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous/fedora-eln-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/fedora-eln-x86_64/", "id": "copr_rhcontainerbot_bootc", "name": "Additional repo copr_rhcontainerbot_bootc" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@CoreOS/continuous", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous", "result_dir": "10204731-rpm-ostree", "built_packages": "", "id": 10204731, "mockchain_macros": { "copr_username": "@CoreOS", "copr_projectname": "continuous", "vendor": "Fedora Project COPR (@CoreOS/continuous)" } } ] } [2026-03-09 19:00:29,969][ INFO][PID:1037694] Sending fedora-messaging bus message in build.start [2026-03-09 19:00:30,654][ INFO][PID:1037694] Sending fedora-messaging bus message in chroot.start [2026-03-09 19:00:30,681][ INFO][PID:1037694] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10204731-fedora-eln-x86_64 --chroot fedora-eln-x86_64 --detached [2026-03-09 19:00:31,047][ INFO][PID:1037694] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '54.237.247.167' (ED25519) to the list of known hosts. [2026-03-09 19:00:31,048][ INFO][PID:1037694] Downloading the builder-live.log file, attempt 1 [2026-03-09 19:00:31,050][ INFO][PID:1037694] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.237.247.167 copr-rpmbuild-log [2026-03-09 19:00:36,062][ INFO][PID:1037694] Periodic builder liveness probe: alive [2026-03-09 19:00:36,062][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:00:41,063][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:00:46,064][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:00:51,066][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:00:56,066][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:01:01,068][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:01:06,069][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:01:11,072][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:01:16,076][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:01:21,079][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:01:26,081][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:01:31,083][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:01:36,085][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:01:41,087][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:01:46,088][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:01:51,089][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:01:56,090][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:02:01,091][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:02:06,092][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:02:11,093][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:02:16,094][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:02:21,095][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:02:26,097][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:02:31,098][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:02:36,099][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:02:41,100][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:02:46,101][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:02:51,102][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:02:56,103][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:03:01,105][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:03:06,106][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:03:11,107][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:03:16,108][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:03:21,110][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:03:26,111][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:03:31,112][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:03:36,113][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:03:41,114][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:03:46,115][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:03:51,118][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:03:56,121][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:04:01,125][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:04:06,126][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:04:11,127][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:04:16,128][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:04:21,129][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:04:26,130][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:04:31,132][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:04:36,133][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:04:41,134][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:04:46,135][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:04:51,136][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:04:53,029][ ERROR][PID:1037694] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-03-09 19:04:56,137][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:05:01,138][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:05:03,030][WARNING][PID:1037694] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-03-09 19:05:06,139][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:05:11,142][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:05:13,031][ INFO][PID:1037694] Downloading the builder-live.log file, attempt 2 [2026-03-09 19:05:13,035][ INFO][PID:1037694] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.237.247.167 copr-rpmbuild-log [2026-03-09 19:05:16,143][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:05:21,146][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:05:26,152][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:05:31,154][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:05:36,157][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:05:41,158][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:05:46,159][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:05:51,160][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:05:56,162][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:06:01,163][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:06:06,164][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:06:11,165][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:06:13,117][ ERROR][PID:1037694] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-03-09 19:06:16,167][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:06:21,168][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:06:23,141][WARNING][PID:1037694] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-03-09 19:06:26,169][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:06:31,171][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:06:33,143][ INFO][PID:1037694] Downloading the builder-live.log file, attempt 3 [2026-03-09 19:06:33,144][ INFO][PID:1037694] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.237.247.167 copr-rpmbuild-log [2026-03-09 19:06:36,172][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:06:41,174][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:06:46,175][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:06:51,177][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:06:56,179][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:07:01,181][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:07:06,182][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:07:11,183][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:07:16,184][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:07:21,185][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:07:26,186][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:07:31,188][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:07:33,212][ ERROR][PID:1037694] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-03-09 19:07:36,189][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:07:41,190][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:07:43,218][WARNING][PID:1037694] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-03-09 19:07:46,191][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:07:51,192][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:07:53,219][ INFO][PID:1037694] Downloading the builder-live.log file, attempt 4 [2026-03-09 19:07:53,220][ INFO][PID:1037694] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.237.247.167 copr-rpmbuild-log [2026-03-09 19:07:56,194][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:08:01,196][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:08:06,198][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:08:11,200][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:08:16,203][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:08:21,207][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:08:26,208][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:08:31,211][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:08:36,219][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:08:41,238][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:08:46,263][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:08:51,264][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:08:53,292][ ERROR][PID:1037694] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-03-09 19:08:56,266][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:09:01,267][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:09:03,303][ ERROR][PID:1037694] Giving up for unstable SSH, failures: 1773083103.0305717, 1773083183.1419373, 1773083263.218141, 1773083343.303755 [2026-03-09 19:09:03,305][ ERROR][PID:1037694] Re-try request for task on 'ResallocHost, ticket_id=1782345, hostname=54.237.247.167, name=aws_x86_64_spot_prod_02955062_20260309_185450, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-03-09 19:09:03,305][ INFO][PID:1037694] Releasing VM back to pool [2026-03-09 19:09:03,318][ INFO][PID:1037694] Retry #1 (on other host) [2026-03-09 19:09:03,319][ INFO][PID:1037694] Checking that /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-x86_64/repodata/repomd.xml exists [2026-03-09 19:09:03,344][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:09:03,347][ INFO][PID:1037694] VM allocation process starts [2026-03-09 19:09:03,363][ INFO][PID:1037694] Trying to allocate VM: ResallocHost, ticket_id=1782460, requested_tags=['copr_builder', 'arch_x86_64'] [2026-03-09 19:09:08,364][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:09:13,365][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:09:15,394][ INFO][PID:1037694] Allocated host ResallocHost, ticket_id=1782460, hostname=23.20.160.121, name=aws_x86_64_normalreserved_prod_02955813_20260309_190605, requested_tags=['copr_builder', 'arch_x86_64'] [2026-03-09 19:09:15,394][ INFO][PID:1037694] Allocating ssh connection to builder [2026-03-09 19:09:15,395][ INFO][PID:1037694] Checking that builder machine is OK [2026-03-09 19:09:15,730][ INFO][PID:1037694] Running remote command: copr-builder-ready fedora-eln-x86_64 [2026-03-09 19:09:15,954][ INFO][PID:1037694] Red Hat subscription not needed for fedora-eln-x86_64 Builder is ready to be used [2026-03-09 19:09:15,955][ INFO][PID:1037694] Filling build.info file with builder info [2026-03-09 19:09:16,176][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:09:16,177][ INFO][PID:1037694] Not re-notifying FE and msg buses for the new host. [2026-03-09 19:09:16,178][ INFO][PID:1037694] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10204731-fedora-eln-x86_64 --chroot fedora-eln-x86_64 --detached [2026-03-09 19:09:16,545][ INFO][PID:1037694] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '23.20.160.121' (ED25519) to the list of known hosts. [2026-03-09 19:09:16,546][ INFO][PID:1037694] Downloading the builder-live.log file, attempt 1 [2026-03-09 19:09:16,547][ INFO][PID:1037694] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@23.20.160.121 copr-rpmbuild-log [2026-03-09 19:09:21,546][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:09:26,547][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:09:31,548][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:09:36,550][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:09:41,551][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:09:46,552][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:09:51,553][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:09:56,554][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:10:01,555][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:10:06,556][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:10:11,557][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:10:16,558][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:10:21,559][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:10:26,560][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:10:31,561][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:10:36,574][ INFO][PID:1037694] Periodic builder liveness probe: alive [2026-03-09 19:10:36,578][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:10:41,581][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:10:46,582][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:10:51,583][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:10:56,584][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:11:01,585][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:11:06,586][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:11:11,586][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:11:16,587][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:11:21,588][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:11:26,589][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:11:31,590][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:11:36,591][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:11:41,592][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:11:46,593][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:11:51,594][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:11:56,595][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:12:01,596][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:12:06,598][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:12:11,598][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:12:16,599][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:12:21,600][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:12:26,601][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:12:31,602][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:12:36,603][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:12:41,604][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:12:46,605][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:12:51,606][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:12:56,607][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:13:01,608][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:13:06,609][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:13:11,636][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:13:16,637][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:13:21,638][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:13:26,639][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:13:31,640][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:13:36,641][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:13:41,642][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:13:46,645][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:13:51,646][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:13:56,654][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:14:01,655][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:14:06,656][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:14:11,657][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:14:16,658][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:14:21,659][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:14:26,660][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:14:31,697][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:14:36,697][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:14:41,698][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:14:46,699][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:14:51,700][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:14:56,701][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:15:01,702][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:15:06,703][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:15:11,704][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:15:16,705][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:15:21,707][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:15:26,709][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:15:31,710][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:15:36,712][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:15:41,714][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:15:46,715][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:15:51,717][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:15:56,718][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:16:01,721][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:16:06,729][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:16:11,732][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:16:16,734][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:16:21,736][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:16:26,737][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:16:31,739][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:16:36,741][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:16:41,742][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:16:46,743][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:16:51,822][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:16:56,823][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:17:01,824][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:17:06,840][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:17:11,841][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:17:16,842][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:17:21,843][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:17:26,844][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:17:31,850][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:17:36,851][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:17:41,852][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:17:46,853][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:17:51,854][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:17:56,856][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:18:01,883][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:18:06,884][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:18:11,885][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:18:16,886][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:18:21,888][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:18:26,889][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:18:31,890][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:18:36,930][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:18:41,944][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:18:46,956][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:18:51,960][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:18:56,964][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:19:01,967][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:19:06,968][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:19:11,969][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:19:16,970][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:19:21,971][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:19:26,973][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:19:31,975][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:19:36,976][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:19:41,977][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:19:46,978][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:19:51,979][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:19:56,980][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:20:01,982][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:20:06,983][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:20:11,984][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:20:16,985][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:20:21,988][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:20:26,990][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:20:31,991][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:20:37,006][ INFO][PID:1037694] Periodic builder liveness probe: alive [2026-03-09 19:20:37,007][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:20:42,007][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:20:47,048][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:20:52,049][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:20:57,054][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:21:02,055][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:21:07,060][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:21:12,063][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:21:17,065][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:21:22,067][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:21:27,071][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:21:32,073][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:21:37,074][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:21:42,075][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:21:47,076][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:21:52,077][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:21:57,078][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:22:02,079][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:22:07,080][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:22:12,081][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:22:17,082][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:22:22,083][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:22:27,084][ INFO][PID:1037694] Checking for cancel request [2026-03-09 19:22:30,617][ INFO][PID:1037694] Downloading results from builder [2026-03-09 19:22:30,617][ INFO][PID:1037694] rsyncing of mockbuilder@23.20.160.121:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-x86_64/10204731-rpm-ostree started [2026-03-09 19:22:30,618][ INFO][PID:1037694] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@23.20.160.121:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-x86_64/10204731-rpm-ostree/ &> /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-x86_64/10204731-rpm-ostree/build-10204731.rsync.log [2026-03-09 19:22:31,653][ INFO][PID:1037694] rsyncing finished. [2026-03-09 19:22:31,653][ INFO][PID:1037694] Releasing VM back to pool [2026-03-09 19:22:31,661][ INFO][PID:1037694] Searching for 'success' file in resultdir [2026-03-09 19:22:31,662][ INFO][PID:1037694] Going to sign pkgs from source: 10204731-fedora-eln-x86_64 in chroot: /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-x86_64 [2026-03-09 19:22:31,662][ INFO][PID:1037694] Calling '/bin/sign -u @CoreOS#continuous@copr.fedorahosted.org -p' (attempt #1) [2026-03-09 19:22:31,937][ INFO][PID:1037694] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-x86_64/10204731-rpm-ostree/rpm-ostree-libs-2026.1.12.g13421c58-1.eln155.x86_64.rpm' (attempt #1) [2026-03-09 19:22:32,654][ INFO][PID:1037694] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-x86_64/10204731-rpm-ostree/rpm-ostree-libs-2026.1.12.g13421c58-1.eln155.x86_64.rpm [2026-03-09 19:22:32,654][ INFO][PID:1037694] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-x86_64/10204731-rpm-ostree/rpm-ostree-2026.1.12.g13421c58-1.eln155.src.rpm' (attempt #1) [2026-03-09 19:22:33,701][ INFO][PID:1037694] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-x86_64/10204731-rpm-ostree/rpm-ostree-2026.1.12.g13421c58-1.eln155.src.rpm [2026-03-09 19:22:33,701][ INFO][PID:1037694] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-x86_64/10204731-rpm-ostree/rpm-ostree-debugsource-2026.1.12.g13421c58-1.eln155.x86_64.rpm' (attempt #1) [2026-03-09 19:22:35,005][ INFO][PID:1037694] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-x86_64/10204731-rpm-ostree/rpm-ostree-debugsource-2026.1.12.g13421c58-1.eln155.x86_64.rpm [2026-03-09 19:22:35,005][ INFO][PID:1037694] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-x86_64/10204731-rpm-ostree/rpm-ostree-debuginfo-2026.1.12.g13421c58-1.eln155.x86_64.rpm' (attempt #1) [2026-03-09 19:22:36,408][ INFO][PID:1037694] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-x86_64/10204731-rpm-ostree/rpm-ostree-debuginfo-2026.1.12.g13421c58-1.eln155.x86_64.rpm [2026-03-09 19:22:36,408][ INFO][PID:1037694] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-x86_64/10204731-rpm-ostree/rpm-ostree-2026.1.12.g13421c58-1.eln155.x86_64.rpm' (attempt #1) [2026-03-09 19:22:37,280][ INFO][PID:1037694] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-x86_64/10204731-rpm-ostree/rpm-ostree-2026.1.12.g13421c58-1.eln155.x86_64.rpm [2026-03-09 19:22:37,280][ INFO][PID:1037694] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-x86_64/10204731-rpm-ostree/rpm-ostree-devel-2026.1.12.g13421c58-1.eln155.x86_64.rpm' (attempt #1) [2026-03-09 19:22:37,898][ INFO][PID:1037694] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-x86_64/10204731-rpm-ostree/rpm-ostree-devel-2026.1.12.g13421c58-1.eln155.x86_64.rpm [2026-03-09 19:22:37,899][ INFO][PID:1037694] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-x86_64/10204731-rpm-ostree/rpm-ostree-libs-debuginfo-2026.1.12.g13421c58-1.eln155.x86_64.rpm' (attempt #1) [2026-03-09 19:22:38,624][ INFO][PID:1037694] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-x86_64/10204731-rpm-ostree/rpm-ostree-libs-debuginfo-2026.1.12.g13421c58-1.eln155.x86_64.rpm [2026-03-09 19:22:38,624][ INFO][PID:1037694] Sign done [2026-03-09 19:22:38,625][ INFO][PID:1037694] Incremental createrepo run, adding 10204731-rpm-ostree into https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous/fedora-eln-x86_64, (auto-create-repo=True) [2026-03-09 19:22:38,626][ INFO][PID:1037694] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-x86_64 --add 10204731-rpm-ostree --no-appstream-metadata' as PID 1179072 [2026-03-09 19:22:39,578][ INFO][PID:1037694] Finished after 0 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-x86_64 --add 10204731-rpm-ostree --no-appstream-metadata) [2026-03-09 19:22:39,579][ INFO][PID:1037694] Getting build details [2026-03-09 19:22:39,579][ INFO][PID:1037694] Listing built binary packages in /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-x86_64/10204731-rpm-ostree [2026-03-09 19:22:39,579][ INFO][PID:1037694] Built packages: ['rpm-ostree-libs 2026.1.12.g13421c58', 'rpm-ostree-devel 2026.1.12.g13421c58', 'rpm-ostree-debugsource 2026.1.12.g13421c58', 'rpm-ostree-libs-debuginfo 2026.1.12.g13421c58', 'rpm-ostree-debuginfo 2026.1.12.g13421c58', 'rpm-ostree 2026.1.12.g13421c58'] [2026-03-09 19:22:39,580][ INFO][PID:1037694] build details: {'built_packages': 'rpm-ostree-libs 2026.1.12.g13421c58\nrpm-ostree-devel 2026.1.12.g13421c58\nrpm-ostree-debugsource 2026.1.12.g13421c58\nrpm-ostree-libs-debuginfo 2026.1.12.g13421c58\nrpm-ostree-debuginfo 2026.1.12.g13421c58\nrpm-ostree 2026.1.12.g13421c58'} [2026-03-09 19:22:39,580][ INFO][PID:1037694] Retrieving pubkey [2026-03-09 19:22:39,581][ INFO][PID:1037694] Calling '/bin/sign -u @CoreOS#continuous@copr.fedorahosted.org -p' (attempt #1) [2026-03-09 19:22:39,880][ INFO][PID:1037694] Added pubkey for user @CoreOS project continuous into: /var/lib/copr/public_html/results/@CoreOS/continuous/pubkey.gpg [2026-03-09 19:22:39,880][ INFO][PID:1037694] Finished build: id=10204731 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@CoreOS/continuous chroot=fedora-eln-x86_64 [2026-03-09 19:22:39,882][ INFO][PID:1037694] Worker succeeded build, took 803.7045929431915 [2026-03-09 19:22:39,882][ INFO][PID:1037694] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@CoreOS", "project_name": "continuous", "project_dirname": "continuous", "submitter": "https://api.github.com/users/jmarrero", "ended_on": 1773084159.8822653, "started_on": 1773083356.1776724, "submitted_on": null, "status": 1, "chroot": "fedora-eln-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10204731-fedora-eln-x86_64", "build_id": 10204731, "package_name": "rpm-ostree", "package_version": "2026.1.12.g13421c58-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@CoreOS/continuous/rpm-ostree", "git_hash": "4f884043a5c16963a50771eb56939af660212aa6", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@CoreOS/continuous--https://api.github.com/users/jmarrero", "results": { "packages": [ { "name": "rpm-ostree-libs", "epoch": null, "version": "2026.1.12.g13421c58", "release": "1.eln155", "arch": "x86_64" }, { "name": "rpm-ostree-devel", "epoch": null, "version": "2026.1.12.g13421c58", "release": "1.eln155", "arch": "x86_64" }, { "name": "rpm-ostree-debugsource", "epoch": null, "version": "2026.1.12.g13421c58", "release": "1.eln155", "arch": "x86_64" }, { "name": "rpm-ostree-libs-debuginfo", "epoch": null, "version": "2026.1.12.g13421c58", "release": "1.eln155", "arch": "x86_64" }, { "name": "rpm-ostree-debuginfo", "epoch": null, "version": "2026.1.12.g13421c58", "release": "1.eln155", "arch": "x86_64" }, { "name": "rpm-ostree", "epoch": null, "version": "2026.1.12.g13421c58", "release": "1.eln155", "arch": "src" }, { "name": "rpm-ostree", "epoch": null, "version": "2026.1.12.g13421c58", "release": "1.eln155", "arch": "x86_64" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous/fedora-eln-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/fedora-eln-x86_64/", "id": "copr_rhcontainerbot_bootc", "name": "Additional repo copr_rhcontainerbot_bootc" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@CoreOS/continuous", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous", "result_dir": "10204731-rpm-ostree", "built_packages": "rpm-ostree-libs 2026.1.12.g13421c58\nrpm-ostree-devel 2026.1.12.g13421c58\nrpm-ostree-debugsource 2026.1.12.g13421c58\nrpm-ostree-libs-debuginfo 2026.1.12.g13421c58\nrpm-ostree-debuginfo 2026.1.12.g13421c58\nrpm-ostree 2026.1.12.g13421c58", "id": 10204731, "mockchain_macros": { "copr_username": "@CoreOS", "copr_projectname": "continuous", "vendor": "Fedora Project COPR (@CoreOS/continuous)" } } ] } [2026-03-09 19:22:39,957][ INFO][PID:1037694] Sending fedora-messaging bus message in build.end [2026-03-09 19:22:39,989][ INFO][PID:1037694] Compressing /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-x86_64/10204731-rpm-ostree/builder-live.log by gzip [2026-03-09 19:22:39,991][ INFO][PID:1037694] Running command 'gzip /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-x86_64/10204731-rpm-ostree/builder-live.log' as PID 1179174 [2026-03-09 19:22:40,064][ INFO][PID:1037694] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-x86_64/10204731-rpm-ostree/builder-live.log) [2026-03-09 19:22:40,065][ INFO][PID:1037694] Compressing /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-x86_64/10204731-rpm-ostree/backend.log by gzip [2026-03-09 19:22:40,066][ INFO][PID:1037694] Running command 'gzip /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-x86_64/10204731-rpm-ostree/backend.log' as PID 1179175