[2026-04-02 18:17:43,825][ INFO][PID:3159216] Marking build as starting [2026-04-02 18:17:43,946][ INFO][PID:3159216] Checking that /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-x86_64/repodata/repomd.xml exists [2026-04-02 18:17:44,053][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:17:44,053][ INFO][PID:3159216] VM allocation process starts [2026-04-02 18:17:44,066][ INFO][PID:3159216] Trying to allocate VM: ResallocHost, ticket_id=2153683, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-02 18:17:49,067][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:17:54,068][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:17:59,069][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:18:04,071][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:18:09,073][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:18:14,074][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:18:19,075][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:18:24,076][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:18:29,077][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:18:34,078][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:18:39,079][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:18:44,080][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:18:49,081][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:18:54,082][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:18:59,083][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:19:04,084][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:19:09,085][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:19:14,086][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:19:19,087][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:19:24,088][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:19:29,089][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:19:34,094][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:19:39,095][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:19:44,096][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:19:49,098][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:19:54,099][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:19:59,100][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:20:04,101][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:20:09,107][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:20:14,108][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:20:19,109][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:20:24,110][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:20:29,111][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:20:34,112][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:20:39,112][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:20:44,113][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:20:49,114][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:20:54,115][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:20:59,116][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:21:04,117][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:21:09,118][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:21:14,119][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:21:19,120][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:21:24,123][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:21:29,124][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:21:34,125][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:21:39,127][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:21:44,128][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:21:49,129][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:21:54,130][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:21:59,131][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:22:04,132][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:22:09,133][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:22:14,134][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:22:19,135][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:22:24,136][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:22:29,137][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:22:34,138][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:22:39,139][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:22:44,140][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:22:49,141][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:22:54,142][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:22:59,143][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:23:04,145][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:23:09,146][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:23:14,147][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:23:19,148][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:23:24,149][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:23:29,150][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:23:34,151][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:23:39,152][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:23:44,153][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:23:49,154][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:23:54,155][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:23:59,156][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:24:04,157][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:24:09,158][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:24:14,159][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:24:19,160][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:24:24,161][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:24:29,162][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:24:34,163][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:24:39,164][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:24:44,165][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:24:49,166][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:24:54,168][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:24:59,169][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:25:04,170][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:25:09,171][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:25:14,173][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:25:19,174][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:25:24,174][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:25:29,176][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:25:34,177][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:25:39,178][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:25:44,179][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:25:49,179][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:25:54,180][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:25:59,181][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:26:02,249][ INFO][PID:3159216] Allocated host ResallocHost, ticket_id=2153683, hostname=98.80.187.4, name=aws_x86_64_spot_prod_04488488_20260402_182117, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-02 18:26:02,249][ INFO][PID:3159216] Allocating ssh connection to builder [2026-04-02 18:26:02,250][ INFO][PID:3159216] Checking that builder machine is OK [2026-04-02 18:26:02,613][ INFO][PID:3159216] Running remote command: copr-builder-ready centos-stream-9-x86_64 [2026-04-02 18:26:02,821][ INFO][PID:3159216] Red Hat subscription not needed for centos-stream-9-x86_64 Builder is ready to be used [2026-04-02 18:26:02,822][ INFO][PID:3159216] Filling build.info file with builder info [2026-04-02 18:26:02,822][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:26:02,823][ INFO][PID:3159216] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@CoreOS", "project_name": "continuous", "project_dirname": "continuous", "submitter": "https://api.github.com/users/cgwalters", "ended_on": null, "started_on": 1775154362.8233874, "submitted_on": null, "status": 3, "chroot": "centos-stream-9-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10288004-centos-stream-9-x86_64", "build_id": 10288004, "package_name": "ostree", "package_version": "2025.7.34.g55d1aa5b-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@CoreOS/continuous/ostree", "git_hash": "97f77c58054bfa783572facc0550f17c38bf2382", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@CoreOS/continuous--https://api.github.com/users/cgwalters", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous/centos-stream-9-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/centos-stream-9-x86_64/", "id": "copr_rhcontainerbot_bootc", "name": "Additional repo copr_rhcontainerbot_bootc" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@CoreOS/continuous", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous", "result_dir": "10288004-ostree", "built_packages": "", "id": 10288004, "mockchain_macros": { "copr_username": "@CoreOS", "copr_projectname": "continuous", "vendor": "Fedora Project COPR (@CoreOS/continuous)" } } ] } [2026-04-02 18:26:02,938][ INFO][PID:3159216] Sending fedora-messaging bus message in build.start [2026-04-02 18:26:03,476][ INFO][PID:3159216] Sending fedora-messaging bus message in chroot.start [2026-04-02 18:26:03,504][ INFO][PID:3159216] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10288004-centos-stream-9-x86_64 --chroot centos-stream-9-x86_64 --detached [2026-04-02 18:26:03,845][ INFO][PID:3159216] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '98.80.187.4' (ED25519) to the list of known hosts. [2026-04-02 18:26:03,845][ INFO][PID:3159216] Downloading the builder-live.log file, attempt 1 [2026-04-02 18:26:03,847][ INFO][PID:3159216] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.80.187.4 copr-rpmbuild-log [2026-04-02 18:26:08,855][ INFO][PID:3159216] Periodic builder liveness probe: alive [2026-04-02 18:26:08,855][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:26:09,135][ ERROR][PID:3159216] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-02 18:26:13,856][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:26:18,857][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:26:19,136][WARNING][PID:3159216] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-02 18:26:23,858][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:26:28,859][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:26:29,136][ INFO][PID:3159216] Downloading the builder-live.log file, attempt 2 [2026-04-02 18:26:29,138][ INFO][PID:3159216] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.80.187.4 copr-rpmbuild-log [2026-04-02 18:26:33,860][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:26:38,861][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:26:43,862][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:26:48,863][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:26:53,864][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:26:58,865][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:27:03,866][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:27:08,867][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:27:13,868][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:27:18,869][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:27:23,870][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:27:28,871][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:27:29,206][ ERROR][PID:3159216] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-02 18:27:33,872][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:27:38,873][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:27:39,215][WARNING][PID:3159216] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-02 18:27:43,874][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:27:48,875][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:27:49,216][ INFO][PID:3159216] Downloading the builder-live.log file, attempt 3 [2026-04-02 18:27:49,217][ INFO][PID:3159216] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.80.187.4 copr-rpmbuild-log [2026-04-02 18:27:53,876][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:27:58,877][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:28:03,878][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:28:08,879][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:28:13,880][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:28:18,881][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:28:23,882][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:28:28,883][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:28:33,884][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:28:38,885][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:28:43,886][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:28:48,887][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:28:49,276][ ERROR][PID:3159216] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-02 18:28:53,888][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:28:58,889][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:28:59,305][WARNING][PID:3159216] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-02 18:29:03,890][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:29:08,891][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:29:09,305][ INFO][PID:3159216] Downloading the builder-live.log file, attempt 4 [2026-04-02 18:29:09,307][ INFO][PID:3159216] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.80.187.4 copr-rpmbuild-log [2026-04-02 18:29:13,894][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:29:18,895][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:29:23,896][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:29:28,897][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:29:33,898][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:29:38,899][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:29:43,900][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:29:48,901][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:29:53,902][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:29:58,903][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:30:03,904][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:30:08,908][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:30:09,373][ ERROR][PID:3159216] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-02 18:30:13,909][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:30:18,910][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:30:19,384][ ERROR][PID:3159216] Giving up for unstable SSH, failures: 1775154379.1360357, 1775154459.215567, 1775154539.3049803, 1775154619.3847582 [2026-04-02 18:30:19,385][ ERROR][PID:3159216] Re-try request for task on 'ResallocHost, ticket_id=2153683, hostname=98.80.187.4, name=aws_x86_64_spot_prod_04488488_20260402_182117, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-04-02 18:30:19,386][ INFO][PID:3159216] Releasing VM back to pool [2026-04-02 18:30:19,396][ INFO][PID:3159216] Retry #1 (on other host) [2026-04-02 18:30:19,396][ INFO][PID:3159216] Checking that /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-x86_64/repodata/repomd.xml exists [2026-04-02 18:30:19,397][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:30:19,397][ INFO][PID:3159216] VM allocation process starts [2026-04-02 18:30:19,411][ INFO][PID:3159216] Trying to allocate VM: ResallocHost, ticket_id=2153746, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-02 18:30:24,412][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:30:29,413][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:30:34,414][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:30:39,415][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:30:44,416][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:30:49,417][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:30:54,418][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:30:59,418][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:31:04,419][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:31:09,420][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:31:14,421][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:31:19,422][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:31:24,423][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:31:29,424][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:31:34,425][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:31:39,426][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:31:44,427][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:31:47,509][ INFO][PID:3159216] Allocated host ResallocHost, ticket_id=2153746, hostname=34.226.212.228, name=aws_x86_64_normalreserved_prod_04488619_20260402_182730, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-02 18:31:47,849][ INFO][PID:3159216] Allocating ssh connection to builder [2026-04-02 18:31:47,849][ INFO][PID:3159216] Checking that builder machine is OK [2026-04-02 18:31:48,187][ INFO][PID:3159216] Running remote command: copr-builder-ready centos-stream-9-x86_64 [2026-04-02 18:31:48,393][ INFO][PID:3159216] Red Hat subscription not needed for centos-stream-9-x86_64 Builder is ready to be used [2026-04-02 18:31:48,394][ INFO][PID:3159216] Filling build.info file with builder info [2026-04-02 18:31:48,408][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:31:48,409][ INFO][PID:3159216] Not re-notifying FE and msg buses for the new host. [2026-04-02 18:31:48,409][ INFO][PID:3159216] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10288004-centos-stream-9-x86_64 --chroot centos-stream-9-x86_64 --detached [2026-04-02 18:31:48,740][ INFO][PID:3159216] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '34.226.212.228' (ED25519) to the list of known hosts. [2026-04-02 18:31:48,741][ INFO][PID:3159216] Downloading the builder-live.log file, attempt 1 [2026-04-02 18:31:48,742][ INFO][PID:3159216] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@34.226.212.228 copr-rpmbuild-log [2026-04-02 18:31:53,742][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:31:58,743][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:32:03,744][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:32:08,745][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:32:13,746][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:32:18,746][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:32:23,747][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:32:28,748][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:32:33,749][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:32:38,750][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:32:43,751][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:32:48,752][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:32:53,753][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:32:58,754][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:33:03,755][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:33:08,756][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:33:13,757][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:33:18,758][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:33:23,759][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:33:28,760][ INFO][PID:3159216] Checking for cancel request [2026-04-02 18:33:30,434][ INFO][PID:3159216] Downloading results from builder [2026-04-02 18:33:30,435][ INFO][PID:3159216] rsyncing of mockbuilder@34.226.212.228:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-x86_64/10288004-ostree started [2026-04-02 18:33:30,436][ INFO][PID:3159216] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@34.226.212.228:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-x86_64/10288004-ostree/ &> /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-x86_64/10288004-ostree/build-10288004.rsync.log [2026-04-02 18:33:31,760][ INFO][PID:3159216] rsyncing finished. [2026-04-02 18:33:31,761][ INFO][PID:3159216] Releasing VM back to pool [2026-04-02 18:33:31,771][ INFO][PID:3159216] Searching for 'success' file in resultdir [2026-04-02 18:33:31,772][ INFO][PID:3159216] Going to sign pkgs from source: 10288004-centos-stream-9-x86_64 in chroot: /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-x86_64 [2026-04-02 18:33:31,773][ INFO][PID:3159216] Calling '/bin/sign -u @CoreOS#continuous@copr.fedorahosted.org -p' (attempt #1) [2026-04-02 18:33:32,056][ INFO][PID:3159216] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-x86_64/10288004-ostree/ostree-libs-2025.7.34.g55d1aa5b-1.el9.x86_64.rpm' (attempt #1) [2026-04-02 18:33:33,188][ INFO][PID:3159216] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-x86_64/10288004-ostree/ostree-libs-2025.7.34.g55d1aa5b-1.el9.x86_64.rpm [2026-04-02 18:33:33,188][ INFO][PID:3159216] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-x86_64/10288004-ostree/ostree-grub2-2025.7.34.g55d1aa5b-1.el9.x86_64.rpm' (attempt #1) [2026-04-02 18:33:33,912][ INFO][PID:3159216] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-x86_64/10288004-ostree/ostree-grub2-2025.7.34.g55d1aa5b-1.el9.x86_64.rpm [2026-04-02 18:33:33,912][ INFO][PID:3159216] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-x86_64/10288004-ostree/ostree-debugsource-2025.7.34.g55d1aa5b-1.el9.x86_64.rpm' (attempt #1) [2026-04-02 18:33:34,654][ INFO][PID:3159216] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-x86_64/10288004-ostree/ostree-debugsource-2025.7.34.g55d1aa5b-1.el9.x86_64.rpm [2026-04-02 18:33:34,654][ INFO][PID:3159216] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-x86_64/10288004-ostree/ostree-devel-2025.7.34.g55d1aa5b-1.el9.x86_64.rpm' (attempt #1) [2026-04-02 18:33:35,390][ INFO][PID:3159216] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-x86_64/10288004-ostree/ostree-devel-2025.7.34.g55d1aa5b-1.el9.x86_64.rpm [2026-04-02 18:33:35,390][ INFO][PID:3159216] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-x86_64/10288004-ostree/ostree-libs-debuginfo-2025.7.34.g55d1aa5b-1.el9.x86_64.rpm' (attempt #1) [2026-04-02 18:33:36,173][ INFO][PID:3159216] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-x86_64/10288004-ostree/ostree-libs-debuginfo-2025.7.34.g55d1aa5b-1.el9.x86_64.rpm [2026-04-02 18:33:36,174][ INFO][PID:3159216] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-x86_64/10288004-ostree/ostree-2025.7.34.g55d1aa5b-1.el9.x86_64.rpm' (attempt #1) [2026-04-02 18:33:36,913][ INFO][PID:3159216] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-x86_64/10288004-ostree/ostree-2025.7.34.g55d1aa5b-1.el9.x86_64.rpm [2026-04-02 18:33:36,914][ INFO][PID:3159216] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-x86_64/10288004-ostree/ostree-debuginfo-2025.7.34.g55d1aa5b-1.el9.x86_64.rpm' (attempt #1) [2026-04-02 18:33:37,472][ INFO][PID:3159216] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-x86_64/10288004-ostree/ostree-debuginfo-2025.7.34.g55d1aa5b-1.el9.x86_64.rpm [2026-04-02 18:33:37,473][ INFO][PID:3159216] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-x86_64/10288004-ostree/ostree-2025.7.34.g55d1aa5b-1.el9.src.rpm' (attempt #1) [2026-04-02 18:33:38,241][ INFO][PID:3159216] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-x86_64/10288004-ostree/ostree-2025.7.34.g55d1aa5b-1.el9.src.rpm [2026-04-02 18:33:38,242][ INFO][PID:3159216] Sign done [2026-04-02 18:33:38,242][ INFO][PID:3159216] Incremental createrepo run, adding 10288004-ostree into https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous/centos-stream-9-x86_64, (auto-create-repo=True) [2026-04-02 18:33:38,243][ INFO][PID:3159216] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-x86_64 --add 10288004-ostree --no-appstream-metadata' as PID 3229803 [2026-04-02 18:33:39,364][ INFO][PID:3159216] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-x86_64 --add 10288004-ostree --no-appstream-metadata) [2026-04-02 18:33:39,365][ INFO][PID:3159216] Getting build details [2026-04-02 18:33:39,366][ INFO][PID:3159216] Listing built binary packages in /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-x86_64/10288004-ostree [2026-04-02 18:33:39,366][ INFO][PID:3159216] Built packages: ['ostree-devel 2025.7.34.g55d1aa5b', 'ostree-libs-debuginfo 2025.7.34.g55d1aa5b', 'ostree 2025.7.34.g55d1aa5b', 'ostree-debuginfo 2025.7.34.g55d1aa5b', 'ostree-debugsource 2025.7.34.g55d1aa5b', 'ostree-libs 2025.7.34.g55d1aa5b', 'ostree-grub2 2025.7.34.g55d1aa5b'] [2026-04-02 18:33:39,367][ INFO][PID:3159216] build details: {'built_packages': 'ostree-devel 2025.7.34.g55d1aa5b\nostree-libs-debuginfo 2025.7.34.g55d1aa5b\nostree 2025.7.34.g55d1aa5b\nostree-debuginfo 2025.7.34.g55d1aa5b\nostree-debugsource 2025.7.34.g55d1aa5b\nostree-libs 2025.7.34.g55d1aa5b\nostree-grub2 2025.7.34.g55d1aa5b'} [2026-04-02 18:33:39,367][ INFO][PID:3159216] Retrieving pubkey [2026-04-02 18:33:39,368][ INFO][PID:3159216] Calling '/bin/sign -u @CoreOS#continuous@copr.fedorahosted.org -p' (attempt #1) [2026-04-02 18:33:39,642][ INFO][PID:3159216] Added pubkey for user @CoreOS project continuous into: /var/lib/copr/public_html/results/@CoreOS/continuous/pubkey.gpg [2026-04-02 18:33:39,643][ INFO][PID:3159216] Finished build: id=10288004 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@CoreOS/continuous chroot=centos-stream-9-x86_64 [2026-04-02 18:33:39,645][ INFO][PID:3159216] Worker succeeded build, took 111.23595881462097 [2026-04-02 18:33:39,646][ INFO][PID:3159216] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@CoreOS", "project_name": "continuous", "project_dirname": "continuous", "submitter": "https://api.github.com/users/cgwalters", "ended_on": 1775154819.645472, "started_on": 1775154708.4095132, "submitted_on": null, "status": 1, "chroot": "centos-stream-9-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10288004-centos-stream-9-x86_64", "build_id": 10288004, "package_name": "ostree", "package_version": "2025.7.34.g55d1aa5b-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@CoreOS/continuous/ostree", "git_hash": "97f77c58054bfa783572facc0550f17c38bf2382", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@CoreOS/continuous--https://api.github.com/users/cgwalters", "results": { "packages": [ { "name": "ostree-devel", "epoch": null, "version": "2025.7.34.g55d1aa5b", "release": "1.el9", "arch": "x86_64" }, { "name": "ostree-libs-debuginfo", "epoch": null, "version": "2025.7.34.g55d1aa5b", "release": "1.el9", "arch": "x86_64" }, { "name": "ostree", "epoch": null, "version": "2025.7.34.g55d1aa5b", "release": "1.el9", "arch": "x86_64" }, { "name": "ostree-debuginfo", "epoch": null, "version": "2025.7.34.g55d1aa5b", "release": "1.el9", "arch": "x86_64" }, { "name": "ostree-debugsource", "epoch": null, "version": "2025.7.34.g55d1aa5b", "release": "1.el9", "arch": "x86_64" }, { "name": "ostree-libs", "epoch": null, "version": "2025.7.34.g55d1aa5b", "release": "1.el9", "arch": "x86_64" }, { "name": "ostree", "epoch": null, "version": "2025.7.34.g55d1aa5b", "release": "1.el9", "arch": "src" }, { "name": "ostree-grub2", "epoch": null, "version": "2025.7.34.g55d1aa5b", "release": "1.el9", "arch": "x86_64" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous/centos-stream-9-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/centos-stream-9-x86_64/", "id": "copr_rhcontainerbot_bootc", "name": "Additional repo copr_rhcontainerbot_bootc" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@CoreOS/continuous", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous", "result_dir": "10288004-ostree", "built_packages": "ostree-devel 2025.7.34.g55d1aa5b\nostree-libs-debuginfo 2025.7.34.g55d1aa5b\nostree 2025.7.34.g55d1aa5b\nostree-debuginfo 2025.7.34.g55d1aa5b\nostree-debugsource 2025.7.34.g55d1aa5b\nostree-libs 2025.7.34.g55d1aa5b\nostree-grub2 2025.7.34.g55d1aa5b", "id": 10288004, "mockchain_macros": { "copr_username": "@CoreOS", "copr_projectname": "continuous", "vendor": "Fedora Project COPR (@CoreOS/continuous)" } } ] } [2026-04-02 18:33:39,764][ INFO][PID:3159216] Sending fedora-messaging bus message in build.end [2026-04-02 18:33:39,796][ INFO][PID:3159216] Compressing /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-x86_64/10288004-ostree/builder-live.log by gzip [2026-04-02 18:33:39,797][ INFO][PID:3159216] Running command 'gzip /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-x86_64/10288004-ostree/builder-live.log' as PID 3229908 [2026-04-02 18:33:39,827][ INFO][PID:3159216] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-x86_64/10288004-ostree/builder-live.log) [2026-04-02 18:33:39,828][ INFO][PID:3159216] Compressing /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-x86_64/10288004-ostree/backend.log by gzip [2026-04-02 18:33:39,829][ INFO][PID:3159216] Running command 'gzip /var/lib/copr/public_html/results/@CoreOS/continuous/centos-stream-9-x86_64/10288004-ostree/backend.log' as PID 3229910