[2025-12-18 15:40:36,121][ INFO][PID:1567357] Marking build as starting [2025-12-18 15:40:36,208][ INFO][PID:1567357] Checking that /var/lib/copr/public_html/results/nmstate/nmstate-git/fedora-43-x86_64/repodata/repomd.xml exists [2025-12-18 15:40:36,224][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:40:36,225][ INFO][PID:1567357] VM allocation process starts [2025-12-18 15:40:36,243][ INFO][PID:1567357] Trying to allocate VM: ResallocHost, ticket_id=425180, requested_tags=['copr_builder', 'arch_x86_64'] [2025-12-18 15:40:41,245][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:40:46,247][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:40:51,250][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:40:56,253][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:41:01,255][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:41:06,260][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:41:11,263][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:41:16,266][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:41:21,269][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:41:26,274][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:41:31,276][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:41:36,277][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:41:41,278][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:41:46,281][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:41:51,284][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:41:56,290][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:42:01,294][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:42:06,295][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:42:11,297][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:42:16,298][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:42:21,299][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:42:26,301][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:42:31,303][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:42:36,305][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:42:41,307][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:42:46,309][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:42:51,310][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:42:56,312][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:43:01,315][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:43:06,319][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:43:11,324][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:43:16,329][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:43:21,332][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:43:26,335][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:43:31,340][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:43:36,349][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:43:41,350][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:43:46,353][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:43:51,356][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:43:56,361][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:44:01,362][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:44:06,369][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:44:11,373][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:44:16,377][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:44:21,380][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:44:26,385][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:44:31,388][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:44:36,391][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:44:41,397][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:44:46,403][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:44:51,409][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:44:56,411][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:45:01,414][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:45:06,417][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:45:11,418][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:45:16,420][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:45:21,425][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:45:26,427][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:45:31,430][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:45:36,434][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:45:41,441][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:45:46,454][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:45:51,455][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:45:56,462][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:46:01,469][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:46:06,477][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:46:11,484][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:46:16,486][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:46:21,488][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:46:26,503][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:46:31,506][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:46:36,516][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:46:41,519][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:46:46,520][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:46:51,521][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:46:56,526][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:47:01,532][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:47:06,534][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:47:11,535][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:47:16,542][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:47:21,546][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:47:26,549][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:47:31,550][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:47:36,551][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:47:41,649][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:47:46,658][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:47:51,665][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:47:56,667][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:47:58,576][ INFO][PID:1567357] Allocated host ResallocHost, ticket_id=425180, hostname=100.27.22.195, name=aws_x86_64_spot_prod_00678610_20251218_154531, requested_tags=['copr_builder', 'arch_x86_64'] [2025-12-18 15:47:58,576][ INFO][PID:1567357] Allocating ssh connection to builder [2025-12-18 15:47:58,577][ INFO][PID:1567357] Checking that builder machine is OK [2025-12-18 15:47:59,066][ INFO][PID:1567357] Running remote command: copr-builder-ready fedora-43-x86_64 [2025-12-18 15:47:59,274][ INFO][PID:1567357] Red Hat subscription not needed for fedora-43-x86_64 Builder is ready to be used [2025-12-18 15:47:59,274][ INFO][PID:1567357] Filling build.info file with builder info [2025-12-18 15:47:59,275][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:47:59,277][ INFO][PID:1567357] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "nmstate", "project_name": "nmstate-git", "project_dirname": "nmstate-git", "submitter": "https://api.github.com/users/cathay4t", "ended_on": null, "started_on": 1766072879.2769632, "submitted_on": null, "status": 3, "chroot": "fedora-43-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9931235-fedora-43-x86_64", "build_id": 9931235, "package_name": "nmstate", "package_version": "2.2.58-0.20251218.2699git1ee9d54e", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/nmstate/nmstate-git/nmstate", "git_hash": "5d50bada1aac556b41d4349be1b5100ccfeb94a1", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "nmstate/nmstate-git--https://api.github.com/users/cathay4t", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/nmstate/nmstate-git/fedora-43-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "bootstrap": "off", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/nmstate/nmstate-git", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/nmstate/nmstate-git", "result_dir": "09931235-nmstate", "built_packages": "", "id": 9931235, "mockchain_macros": { "copr_username": "nmstate", "copr_projectname": "nmstate-git", "vendor": "Fedora Project COPR (nmstate/nmstate-git)" } } ] } [2025-12-18 15:47:59,342][ INFO][PID:1567357] Sending fedora-messaging bus message in build.start [2025-12-18 15:48:00,223][ INFO][PID:1567357] Sending fedora-messaging bus message in chroot.start [2025-12-18 15:48:00,257][ INFO][PID:1567357] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9931235-fedora-43-x86_64 --chroot fedora-43-x86_64 --detached [2025-12-18 15:48:00,678][ INFO][PID:1567357] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '100.27.22.195' (ED25519) to the list of known hosts. [2025-12-18 15:48:00,687][ INFO][PID:1567357] Downloading the builder-live.log file, attempt 1 [2025-12-18 15:48:00,690][ INFO][PID:1567357] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.27.22.195 copr-rpmbuild-log [2025-12-18 15:48:05,713][ INFO][PID:1567357] Periodic builder liveness probe: alive [2025-12-18 15:48:05,714][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:48:10,717][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:48:15,723][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:48:20,726][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:48:25,731][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:48:30,737][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:48:35,741][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:48:40,743][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:48:45,750][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:48:50,756][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:48:55,759][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:49:00,768][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:49:05,770][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:49:10,772][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:49:15,780][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:49:20,782][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:49:25,783][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:49:30,787][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:49:35,788][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:49:40,793][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:49:45,799][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:49:50,801][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:49:55,803][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:50:00,806][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:50:05,817][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:50:10,820][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:50:15,828][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:50:20,835][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:50:25,997][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:50:31,014][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:50:36,028][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:50:41,045][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:50:46,050][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:50:51,058][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:50:56,070][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:51:01,074][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:51:06,173][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:51:11,321][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:51:15,759][ ERROR][PID:1567357] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-18 15:51:16,324][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:51:21,329][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:51:25,761][WARNING][PID:1567357] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-18 15:51:26,388][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:51:31,417][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:51:35,772][ INFO][PID:1567357] Downloading the builder-live.log file, attempt 2 [2025-12-18 15:51:35,774][ INFO][PID:1567357] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.27.22.195 copr-rpmbuild-log [2025-12-18 15:51:36,446][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:51:41,504][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:51:46,812][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:51:51,816][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:51:56,827][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:52:01,833][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:52:06,834][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:52:11,837][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:52:16,838][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:52:21,840][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:52:26,841][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:52:31,842][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:52:35,843][ ERROR][PID:1567357] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-18 15:52:36,848][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:52:41,851][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:52:45,848][WARNING][PID:1567357] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-18 15:52:46,852][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:52:51,855][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:52:55,854][ INFO][PID:1567357] Downloading the builder-live.log file, attempt 3 [2025-12-18 15:52:55,858][ INFO][PID:1567357] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.27.22.195 copr-rpmbuild-log [2025-12-18 15:52:56,861][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:53:01,863][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:53:06,864][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:53:11,866][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:53:16,867][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:53:21,869][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:53:26,870][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:53:31,872][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:53:36,879][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:53:41,885][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:53:46,890][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:53:51,894][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:53:55,943][ ERROR][PID:1567357] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-18 15:53:56,910][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:54:01,930][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:54:06,005][WARNING][PID:1567357] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-18 15:54:06,933][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:54:11,937][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:54:16,006][ INFO][PID:1567357] Downloading the builder-live.log file, attempt 4 [2025-12-18 15:54:16,007][ INFO][PID:1567357] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.27.22.195 copr-rpmbuild-log [2025-12-18 15:54:16,941][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:54:21,948][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:54:26,992][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:54:32,000][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:54:37,004][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:54:42,008][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:54:47,155][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:54:52,209][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:54:57,220][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:55:02,241][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:55:07,260][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:55:12,261][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:55:16,080][ ERROR][PID:1567357] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-18 15:55:17,269][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:55:22,271][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:55:26,085][ ERROR][PID:1567357] Giving up for unstable SSH, failures: 1766073085.7614021, 1766073165.847943, 1766073246.005115, 1766073326.0850093 [2025-12-18 15:55:26,087][ ERROR][PID:1567357] Re-try request for task on 'ResallocHost, ticket_id=425180, hostname=100.27.22.195, name=aws_x86_64_spot_prod_00678610_20251218_154531, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-12-18 15:55:26,088][ INFO][PID:1567357] Releasing VM back to pool [2025-12-18 15:55:26,113][ INFO][PID:1567357] Retry #1 (on other host) [2025-12-18 15:55:26,114][ INFO][PID:1567357] Checking that /var/lib/copr/public_html/results/nmstate/nmstate-git/fedora-43-x86_64/repodata/repomd.xml exists [2025-12-18 15:55:26,117][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:55:26,124][ INFO][PID:1567357] VM allocation process starts [2025-12-18 15:55:26,145][ INFO][PID:1567357] Trying to allocate VM: ResallocHost, ticket_id=425679, requested_tags=['copr_builder', 'arch_x86_64'] [2025-12-18 15:55:31,147][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:55:36,149][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:55:41,150][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:55:46,152][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:55:51,157][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:55:56,159][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:56:01,160][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:56:04,252][ INFO][PID:1567357] Allocated host ResallocHost, ticket_id=425679, hostname=44.201.217.83, name=aws_x86_64_normalreserved_prod_00678554_20251218_154434, requested_tags=['copr_builder', 'arch_x86_64'] [2025-12-18 15:56:04,277][ INFO][PID:1567357] Allocating ssh connection to builder [2025-12-18 15:56:04,280][ INFO][PID:1567357] Checking that builder machine is OK [2025-12-18 15:56:04,630][ INFO][PID:1567357] Running remote command: copr-builder-ready fedora-43-x86_64 [2025-12-18 15:56:04,863][ INFO][PID:1567357] Red Hat subscription not needed for fedora-43-x86_64 Builder is ready to be used [2025-12-18 15:56:04,864][ INFO][PID:1567357] Filling build.info file with builder info [2025-12-18 15:56:04,874][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:56:04,876][ INFO][PID:1567357] Not re-notifying FE and msg buses for the new host. [2025-12-18 15:56:04,877][ INFO][PID:1567357] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9931235-fedora-43-x86_64 --chroot fedora-43-x86_64 --detached [2025-12-18 15:56:05,254][ INFO][PID:1567357] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '44.201.217.83' (ED25519) to the list of known hosts. [2025-12-18 15:56:05,255][ INFO][PID:1567357] Downloading the builder-live.log file, attempt 1 [2025-12-18 15:56:05,258][ INFO][PID:1567357] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.201.217.83 copr-rpmbuild-log [2025-12-18 15:56:10,255][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:56:15,257][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:56:20,259][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:56:25,261][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:56:30,263][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:56:35,264][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:56:40,266][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:56:45,268][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:56:50,273][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:56:55,275][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:57:00,276][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:57:05,278][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:57:10,280][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:57:15,281][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:57:20,283][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:57:25,284][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:57:30,286][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:57:35,288][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:57:40,290][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:57:45,295][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:57:50,296][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:57:55,297][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:58:00,299][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:58:05,302][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:58:10,326][ INFO][PID:1567357] Periodic builder liveness probe: alive [2025-12-18 15:58:10,328][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:58:15,332][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:58:20,336][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:58:25,340][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:58:30,345][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:58:35,346][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:58:40,348][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:58:45,351][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:58:50,356][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:58:55,358][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:59:00,360][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:59:05,410][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:59:10,411][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:59:15,416][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:59:20,419][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:59:25,421][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:59:30,424][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:59:35,427][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:59:40,442][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:59:45,443][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:59:50,463][ INFO][PID:1567357] Checking for cancel request [2025-12-18 15:59:55,475][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:00:00,477][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:00:05,478][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:00:10,480][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:00:15,482][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:00:20,484][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:00:25,593][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:00:30,596][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:00:35,604][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:00:40,605][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:00:45,607][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:00:50,608][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:00:55,611][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:01:00,615][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:01:05,619][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:01:10,621][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:01:15,623][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:01:20,624][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:01:25,625][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:01:30,626][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:01:35,628][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:01:40,871][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:01:45,872][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:01:50,875][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:01:55,878][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:02:00,887][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:02:05,889][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:02:10,891][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:02:15,896][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:02:20,897][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:02:25,899][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:02:30,904][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:02:35,907][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:02:40,909][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:02:45,911][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:02:50,913][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:02:55,914][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:03:00,915][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:03:05,916][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:03:10,918][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:03:15,920][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:03:20,924][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:03:25,925][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:03:30,926][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:03:35,945][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:03:40,949][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:03:45,951][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:03:50,953][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:03:55,956][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:04:00,962][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:04:05,969][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:04:10,971][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:04:16,002][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:04:21,017][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:04:26,100][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:04:31,155][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:04:36,165][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:04:41,215][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:04:46,375][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:04:51,381][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:04:56,503][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:05:01,533][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:05:06,638][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:05:11,653][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:05:16,748][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:05:21,791][ INFO][PID:1567357] Checking for cancel request [2025-12-18 16:05:21,838][ INFO][PID:1567357] Downloading results from builder [2025-12-18 16:05:21,840][ INFO][PID:1567357] rsyncing of mockbuilder@44.201.217.83:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/nmstate/nmstate-git/fedora-43-x86_64/09931235-nmstate started [2025-12-18 16:05:21,843][ INFO][PID:1567357] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@44.201.217.83:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/nmstate/nmstate-git/fedora-43-x86_64/09931235-nmstate/ &> /var/lib/copr/public_html/results/nmstate/nmstate-git/fedora-43-x86_64/09931235-nmstate/build-09931235.rsync.log [2025-12-18 16:05:23,825][ INFO][PID:1567357] rsyncing finished. [2025-12-18 16:05:23,830][ INFO][PID:1567357] Releasing VM back to pool [2025-12-18 16:05:23,854][ INFO][PID:1567357] Searching for 'success' file in resultdir [2025-12-18 16:05:23,856][ INFO][PID:1567357] Going to sign pkgs from source: 9931235-fedora-43-x86_64 in chroot: /var/lib/copr/public_html/results/nmstate/nmstate-git/fedora-43-x86_64 [2025-12-18 16:05:23,857][ INFO][PID:1567357] Calling '/bin/sign -u nmstate#nmstate-git@copr.fedorahosted.org -p' (attempt #1) [2025-12-18 16:05:24,042][ INFO][PID:1567357] Calling '/bin/sign -4 -h sha256 -u nmstate#nmstate-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/nmstate/nmstate-git/fedora-43-x86_64/09931235-nmstate/nmstate-static-2.2.58-0.20251218.2699git1ee9d54e.fc43.x86_64.rpm' (attempt #1) [2025-12-18 16:05:27,416][ INFO][PID:1567357] signed rpm: /var/lib/copr/public_html/results/nmstate/nmstate-git/fedora-43-x86_64/09931235-nmstate/nmstate-static-2.2.58-0.20251218.2699git1ee9d54e.fc43.x86_64.rpm [2025-12-18 16:05:27,418][ INFO][PID:1567357] Calling '/bin/sign -4 -h sha256 -u nmstate#nmstate-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/nmstate/nmstate-git/fedora-43-x86_64/09931235-nmstate/nmstate-2.2.58-0.20251218.2699git1ee9d54e.fc43.x86_64.rpm' (attempt #1) [2025-12-18 16:05:28,385][ INFO][PID:1567357] signed rpm: /var/lib/copr/public_html/results/nmstate/nmstate-git/fedora-43-x86_64/09931235-nmstate/nmstate-2.2.58-0.20251218.2699git1ee9d54e.fc43.x86_64.rpm [2025-12-18 16:05:28,386][ INFO][PID:1567357] Calling '/bin/sign -4 -h sha256 -u nmstate#nmstate-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/nmstate/nmstate-git/fedora-43-x86_64/09931235-nmstate/python3-libnmstate-2.2.58-0.20251218.2699git1ee9d54e.fc43.x86_64.rpm' (attempt #1) [2025-12-18 16:05:28,991][ INFO][PID:1567357] signed rpm: /var/lib/copr/public_html/results/nmstate/nmstate-git/fedora-43-x86_64/09931235-nmstate/python3-libnmstate-2.2.58-0.20251218.2699git1ee9d54e.fc43.x86_64.rpm [2025-12-18 16:05:28,991][ INFO][PID:1567357] Calling '/bin/sign -4 -h sha256 -u nmstate#nmstate-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/nmstate/nmstate-git/fedora-43-x86_64/09931235-nmstate/nmstate-devel-2.2.58-0.20251218.2699git1ee9d54e.fc43.x86_64.rpm' (attempt #1) [2025-12-18 16:05:29,702][ INFO][PID:1567357] signed rpm: /var/lib/copr/public_html/results/nmstate/nmstate-git/fedora-43-x86_64/09931235-nmstate/nmstate-devel-2.2.58-0.20251218.2699git1ee9d54e.fc43.x86_64.rpm [2025-12-18 16:05:29,703][ INFO][PID:1567357] Calling '/bin/sign -4 -h sha256 -u nmstate#nmstate-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/nmstate/nmstate-git/fedora-43-x86_64/09931235-nmstate/nmstate-2.2.58-0.20251218.2699git1ee9d54e.fc43.src.rpm' (attempt #1) [2025-12-18 16:05:31,047][ INFO][PID:1567357] signed rpm: /var/lib/copr/public_html/results/nmstate/nmstate-git/fedora-43-x86_64/09931235-nmstate/nmstate-2.2.58-0.20251218.2699git1ee9d54e.fc43.src.rpm [2025-12-18 16:05:31,047][ INFO][PID:1567357] Calling '/bin/sign -4 -h sha256 -u nmstate#nmstate-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/nmstate/nmstate-git/fedora-43-x86_64/09931235-nmstate/nmstate-libs-2.2.58-0.20251218.2699git1ee9d54e.fc43.x86_64.rpm' (attempt #1) [2025-12-18 16:05:32,229][ INFO][PID:1567357] signed rpm: /var/lib/copr/public_html/results/nmstate/nmstate-git/fedora-43-x86_64/09931235-nmstate/nmstate-libs-2.2.58-0.20251218.2699git1ee9d54e.fc43.x86_64.rpm [2025-12-18 16:05:32,230][ INFO][PID:1567357] Sign done [2025-12-18 16:05:32,231][ INFO][PID:1567357] Incremental createrepo run, adding 09931235-nmstate into https://download.copr.fedorainfracloud.org/results/nmstate/nmstate-git/fedora-43-x86_64, (auto-create-repo=True) [2025-12-18 16:05:32,232][ INFO][PID:1567357] Running command 'copr-repo --batched /var/lib/copr/public_html/results/nmstate/nmstate-git/fedora-43-x86_64 --add 09931235-nmstate --no-appstream-metadata' as PID 1834807 [2025-12-18 16:05:33,532][ INFO][PID:1567357] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/nmstate/nmstate-git/fedora-43-x86_64 --add 09931235-nmstate --no-appstream-metadata) [2025-12-18 16:05:33,533][ INFO][PID:1567357] Getting build details [2025-12-18 16:05:33,534][ INFO][PID:1567357] Listing built binary packages in /var/lib/copr/public_html/results/nmstate/nmstate-git/fedora-43-x86_64/09931235-nmstate [2025-12-18 16:05:33,535][ INFO][PID:1567357] Built packages: ['nmstate-libs 2.2.58', 'nmstate-devel 2.2.58', 'nmstate 2.2.58', 'python3-libnmstate 2.2.58', 'nmstate-static 2.2.58'] [2025-12-18 16:05:33,535][ INFO][PID:1567357] build details: {'built_packages': 'nmstate-libs 2.2.58\nnmstate-devel 2.2.58\nnmstate 2.2.58\npython3-libnmstate 2.2.58\nnmstate-static 2.2.58'} [2025-12-18 16:05:33,536][ INFO][PID:1567357] Retrieving pubkey [2025-12-18 16:05:33,537][ INFO][PID:1567357] Calling '/bin/sign -u nmstate#nmstate-git@copr.fedorahosted.org -p' (attempt #1) [2025-12-18 16:05:33,845][ INFO][PID:1567357] Added pubkey for user nmstate project nmstate-git into: /var/lib/copr/public_html/results/nmstate/nmstate-git/pubkey.gpg [2025-12-18 16:05:33,846][ INFO][PID:1567357] Finished build: id=9931235 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/nmstate/nmstate-git chroot=fedora-43-x86_64 [2025-12-18 16:05:33,848][ INFO][PID:1567357] Worker succeeded build, took 568.9715256690979 [2025-12-18 16:05:33,849][ INFO][PID:1567357] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "nmstate", "project_name": "nmstate-git", "project_dirname": "nmstate-git", "submitter": "https://api.github.com/users/cathay4t", "ended_on": 1766073933.8482969, "started_on": 1766073364.8767712, "submitted_on": null, "status": 1, "chroot": "fedora-43-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9931235-fedora-43-x86_64", "build_id": 9931235, "package_name": "nmstate", "package_version": "2.2.58-0.20251218.2699git1ee9d54e", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/nmstate/nmstate-git/nmstate", "git_hash": "5d50bada1aac556b41d4349be1b5100ccfeb94a1", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "nmstate/nmstate-git--https://api.github.com/users/cathay4t", "results": { "packages": [ { "name": "nmstate-libs", "epoch": null, "version": "2.2.58", "release": "0.20251218.2699git1ee9d54e.fc43", "arch": "x86_64" }, { "name": "nmstate", "epoch": null, "version": "2.2.58", "release": "0.20251218.2699git1ee9d54e.fc43", "arch": "src" }, { "name": "nmstate-devel", "epoch": null, "version": "2.2.58", "release": "0.20251218.2699git1ee9d54e.fc43", "arch": "x86_64" }, { "name": "nmstate", "epoch": null, "version": "2.2.58", "release": "0.20251218.2699git1ee9d54e.fc43", "arch": "x86_64" }, { "name": "python3-libnmstate", "epoch": null, "version": "2.2.58", "release": "0.20251218.2699git1ee9d54e.fc43", "arch": "x86_64" }, { "name": "nmstate-static", "epoch": null, "version": "2.2.58", "release": "0.20251218.2699git1ee9d54e.fc43", "arch": "x86_64" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/nmstate/nmstate-git/fedora-43-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "bootstrap": "off", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/nmstate/nmstate-git", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/nmstate/nmstate-git", "result_dir": "09931235-nmstate", "built_packages": "nmstate-libs 2.2.58\nnmstate-devel 2.2.58\nnmstate 2.2.58\npython3-libnmstate 2.2.58\nnmstate-static 2.2.58", "id": 9931235, "mockchain_macros": { "copr_username": "nmstate", "copr_projectname": "nmstate-git", "vendor": "Fedora Project COPR (nmstate/nmstate-git)" } } ] } [2025-12-18 16:05:33,920][ INFO][PID:1567357] Sending fedora-messaging bus message in build.end [2025-12-18 16:05:33,972][ INFO][PID:1567357] Compressing /var/lib/copr/public_html/results/nmstate/nmstate-git/fedora-43-x86_64/09931235-nmstate/builder-live.log by gzip [2025-12-18 16:05:33,973][ INFO][PID:1567357] Running command 'gzip /var/lib/copr/public_html/results/nmstate/nmstate-git/fedora-43-x86_64/09931235-nmstate/builder-live.log' as PID 1835019 [2025-12-18 16:05:34,132][ INFO][PID:1567357] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/nmstate/nmstate-git/fedora-43-x86_64/09931235-nmstate/builder-live.log) [2025-12-18 16:05:34,135][ INFO][PID:1567357] Compressing /var/lib/copr/public_html/results/nmstate/nmstate-git/fedora-43-x86_64/09931235-nmstate/backend.log by gzip [2025-12-18 16:05:34,137][ INFO][PID:1567357] Running command 'gzip /var/lib/copr/public_html/results/nmstate/nmstate-git/fedora-43-x86_64/09931235-nmstate/backend.log' as PID 1835042