[2025-12-12 13:48:08,105][ INFO][PID:412251] Marking build as starting [2025-12-12 13:48:08,225][ INFO][PID:412251] Checking that /var/lib/copr/public_html/results/jwakely/boost-190-rebuild.checker/fedora-rawhide-x86_64/repodata/repomd.xml exists [2025-12-12 13:48:08,228][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:48:08,232][ INFO][PID:412251] VM allocation process starts [2025-12-12 13:48:08,269][ INFO][PID:412251] Trying to allocate VM: ResallocHost, ticket_id=304104, requested_tags=['copr_builder', 'arch_x86_64'] [2025-12-12 13:48:13,273][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:48:14,316][ INFO][PID:412251] Allocated host ResallocHost, ticket_id=304104, hostname=54.83.161.35, name=aws_x86_64_spot_prod_00496704_20251212_134042, requested_tags=['copr_builder', 'arch_x86_64'] [2025-12-12 13:48:14,318][ INFO][PID:412251] Allocating ssh connection to builder [2025-12-12 13:48:14,319][ INFO][PID:412251] Checking that builder machine is OK [2025-12-12 13:48:14,675][ INFO][PID:412251] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2025-12-12 13:48:14,920][ INFO][PID:412251] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2025-12-12 13:48:14,921][ INFO][PID:412251] Filling build.info file with builder info [2025-12-12 13:48:14,922][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:48:14,924][ INFO][PID:412251] Sending build state back to frontend: { "builds": [ { "timeout": 115200, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "jwakely", "project_name": "boost-190-rebuild.checker", "project_dirname": "boost-190-rebuild.checker", "submitter": "jwakely", "ended_on": null, "started_on": 1765547294.9243257, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9902728-fedora-rawhide-x86_64", "build_id": 9902728, "package_name": "FlightGear", "package_version": "2024.1.3-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/jwakely/boost-190-rebuild.checker/FlightGear", "git_hash": "65168568f795abf082413d0ba30c298860bfcb65", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "jwakely/boost-190-rebuild.checker--jwakely", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/jwakely/boost-190-rebuild.checker/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/jwakely/boost-190-rebuild.checker", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/jwakely/boost-190-rebuild.checker", "result_dir": "09902728-FlightGear", "built_packages": "", "id": 9902728, "mockchain_macros": { "copr_username": "jwakely", "copr_projectname": "boost-190-rebuild.checker", "vendor": "Fedora Project COPR (jwakely/boost-190-rebuild.checker)" } } ] } [2025-12-12 13:48:15,022][ INFO][PID:412251] Sending fedora-messaging bus message in build.start [2025-12-12 13:48:16,404][ INFO][PID:412251] Sending fedora-messaging bus message in chroot.start [2025-12-12 13:48:16,455][ INFO][PID:412251] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9902728-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2025-12-12 13:48:16,893][ INFO][PID:412251] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '54.83.161.35' (ED25519) to the list of known hosts. [2025-12-12 13:48:16,897][ INFO][PID:412251] Downloading the builder-live.log file, attempt 1 [2025-12-12 13:48:16,903][ INFO][PID:412251] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.83.161.35 copr-rpmbuild-log [2025-12-12 13:48:21,906][ INFO][PID:412251] Periodic builder liveness probe: alive [2025-12-12 13:48:21,907][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:48:26,908][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:48:31,911][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:48:36,914][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:48:41,916][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:48:46,918][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:48:51,919][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:48:56,923][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:49:01,925][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:49:06,926][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:49:11,928][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:49:16,931][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:49:21,936][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:49:26,946][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:49:31,948][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:49:36,951][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:49:41,953][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:49:46,956][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:49:51,958][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:49:56,961][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:50:01,963][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:50:06,965][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:50:11,966][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:50:16,968][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:50:21,970][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:50:26,971][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:50:31,975][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:50:36,978][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:50:41,979][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:50:46,981][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:50:51,982][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:50:56,988][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:51:01,990][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:51:06,996][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:51:12,001][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:51:17,003][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:51:22,005][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:51:27,006][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:51:32,007][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:51:37,010][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:51:42,011][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:51:47,015][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:51:52,017][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:51:57,018][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:52:02,020][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:52:07,025][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:52:12,027][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:52:17,028][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:52:22,029][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:52:27,032][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:52:32,034][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:52:37,035][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:52:42,043][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:52:47,045][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:52:52,046][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:52:57,047][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:53:02,050][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:53:07,053][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:53:12,055][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:53:16,125][ ERROR][PID:412251] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-12 13:53:17,056][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:53:22,057][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:53:26,126][WARNING][PID:412251] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-12 13:53:27,062][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:53:32,063][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:53:36,127][ INFO][PID:412251] Downloading the builder-live.log file, attempt 2 [2025-12-12 13:53:36,129][ INFO][PID:412251] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.83.161.35 copr-rpmbuild-log [2025-12-12 13:53:37,064][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:53:42,066][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:53:47,067][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:53:52,071][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:53:57,076][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:54:02,077][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:54:07,079][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:54:12,080][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:54:17,083][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:54:22,085][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:54:27,086][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:54:32,087][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:54:36,197][ ERROR][PID:412251] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-12 13:54:37,088][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:54:42,090][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:54:46,198][WARNING][PID:412251] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-12 13:54:47,093][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:54:52,094][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:54:56,199][ INFO][PID:412251] Downloading the builder-live.log file, attempt 3 [2025-12-12 13:54:56,201][ INFO][PID:412251] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.83.161.35 copr-rpmbuild-log [2025-12-12 13:54:57,096][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:55:02,101][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:55:07,106][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:55:12,107][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:55:17,108][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:55:22,110][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:55:27,111][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:55:32,112][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:55:37,113][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:55:42,114][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:55:47,115][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:55:52,116][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:55:56,273][ ERROR][PID:412251] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-12 13:55:57,117][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:56:02,118][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:56:06,274][WARNING][PID:412251] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-12 13:56:07,119][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:56:12,120][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:56:16,275][ INFO][PID:412251] Downloading the builder-live.log file, attempt 4 [2025-12-12 13:56:16,277][ INFO][PID:412251] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.83.161.35 copr-rpmbuild-log [2025-12-12 13:56:17,121][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:56:22,123][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:56:27,124][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:56:32,125][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:56:37,126][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:56:42,127][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:56:47,128][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:56:52,129][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:56:57,130][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:57:02,131][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:57:07,132][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:57:12,133][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:57:16,344][ ERROR][PID:412251] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-12 13:57:17,134][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:57:22,135][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:57:26,345][ ERROR][PID:412251] Giving up for unstable SSH, failures: 1765547606.1261985, 1765547686.1986406, 1765547766.274793, 1765547846.3453066 [2025-12-12 13:57:26,347][ ERROR][PID:412251] Re-try request for task on 'ResallocHost, ticket_id=304104, hostname=54.83.161.35, name=aws_x86_64_spot_prod_00496704_20251212_134042, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-12-12 13:57:26,347][ INFO][PID:412251] Releasing VM back to pool [2025-12-12 13:57:26,366][ INFO][PID:412251] Retry #1 (on other host) [2025-12-12 13:57:26,369][ INFO][PID:412251] Checking that /var/lib/copr/public_html/results/jwakely/boost-190-rebuild.checker/fedora-rawhide-x86_64/repodata/repomd.xml exists [2025-12-12 13:57:26,370][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:57:26,371][ INFO][PID:412251] VM allocation process starts [2025-12-12 13:57:26,383][ INFO][PID:412251] Trying to allocate VM: ResallocHost, ticket_id=304354, requested_tags=['copr_builder', 'arch_x86_64'] [2025-12-12 13:57:29,404][ INFO][PID:412251] Allocated host ResallocHost, ticket_id=304354, hostname=100.48.80.28, name=aws_x86_64_normalreserved_prod_00496868_20251212_134749, requested_tags=['copr_builder', 'arch_x86_64'] [2025-12-12 13:57:29,405][ INFO][PID:412251] Allocating ssh connection to builder [2025-12-12 13:57:29,405][ INFO][PID:412251] Checking that builder machine is OK [2025-12-12 13:57:29,763][ INFO][PID:412251] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2025-12-12 13:57:29,982][ INFO][PID:412251] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2025-12-12 13:57:29,983][ INFO][PID:412251] Filling build.info file with builder info [2025-12-12 13:57:29,984][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:57:29,985][ INFO][PID:412251] Not re-notifying FE and msg buses for the new host. [2025-12-12 13:57:29,985][ INFO][PID:412251] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9902728-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2025-12-12 13:57:30,343][ INFO][PID:412251] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '100.48.80.28' (ED25519) to the list of known hosts. [2025-12-12 13:57:30,344][ INFO][PID:412251] Downloading the builder-live.log file, attempt 1 [2025-12-12 13:57:30,347][ INFO][PID:412251] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.48.80.28 copr-rpmbuild-log [2025-12-12 13:57:35,347][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:57:40,348][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:57:45,349][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:57:50,350][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:57:55,351][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:58:00,352][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:58:05,353][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:58:10,354][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:58:15,355][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:58:20,356][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:58:25,367][ INFO][PID:412251] Periodic builder liveness probe: alive [2025-12-12 13:58:25,368][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:58:30,368][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:58:35,369][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:58:40,370][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:58:45,372][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:58:50,373][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:58:55,374][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:59:00,375][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:59:05,377][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:59:10,378][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:59:15,379][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:59:20,380][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:59:25,389][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:59:30,390][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:59:35,391][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:59:40,393][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:59:45,394][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:59:50,395][ INFO][PID:412251] Checking for cancel request [2025-12-12 13:59:55,396][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:00:00,397][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:00:05,398][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:00:10,399][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:00:15,400][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:00:20,402][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:00:25,403][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:00:30,404][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:00:35,405][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:00:40,406][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:00:45,407][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:00:50,408][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:00:55,410][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:01:00,411][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:01:05,412][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:01:10,414][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:01:15,415][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:01:20,416][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:01:25,417][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:01:30,419][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:01:35,431][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:01:40,432][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:01:45,433][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:01:50,434][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:01:55,435][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:02:00,436][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:02:05,437][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:02:10,439][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:02:15,440][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:02:20,442][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:02:25,443][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:02:30,444][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:02:35,450][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:02:40,451][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:02:45,455][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:02:50,457][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:02:55,459][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:03:00,460][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:03:05,461][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:03:10,462][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:03:15,468][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:03:20,475][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:03:25,476][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:03:30,477][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:03:35,478][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:03:40,479][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:03:45,480][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:03:50,481][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:03:55,486][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:04:00,487][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:04:05,488][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:04:10,489][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:04:15,490][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:04:20,491][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:04:25,492][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:04:30,494][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:04:35,506][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:04:40,509][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:04:45,511][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:04:50,512][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:04:55,513][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:05:00,514][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:05:05,515][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:05:10,516][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:05:15,517][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:05:20,519][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:05:25,525][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:05:30,526][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:05:35,527][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:05:40,528][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:05:45,529][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:05:50,530][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:05:55,531][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:06:00,532][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:06:05,533][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:06:10,534][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:06:15,535][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:06:20,536][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:06:25,537][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:06:30,539][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:06:35,540][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:06:40,541][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:06:45,543][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:06:50,544][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:06:55,545][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:07:00,548][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:07:05,549][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:07:10,555][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:07:15,566][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:07:20,567][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:07:25,568][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:07:30,570][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:07:35,572][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:07:40,573][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:07:45,574][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:07:50,575][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:07:55,576][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:08:00,578][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:08:05,579][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:08:10,580][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:08:15,582][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:08:20,585][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:08:28,690][ INFO][PID:412251] Periodic builder liveness probe: alive [2025-12-12 14:08:29,061][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:08:34,063][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:08:39,065][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:08:44,066][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:08:49,067][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:08:54,082][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:08:59,084][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:09:04,085][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:09:09,087][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:09:14,090][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:09:19,093][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:09:24,098][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:09:29,099][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:09:34,101][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:09:39,103][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:09:44,104][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:09:49,129][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:09:54,132][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:09:59,135][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:10:04,143][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:10:09,146][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:10:14,147][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:10:19,156][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:10:24,157][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:10:29,159][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:10:34,160][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:10:39,167][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:10:44,174][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:10:49,178][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:10:54,182][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:10:59,187][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:11:04,188][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:11:09,189][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:11:14,198][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:11:19,202][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:11:24,209][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:11:29,215][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:11:34,218][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:11:39,225][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:11:44,227][ INFO][PID:412251] Checking for cancel request [2025-12-12 14:11:46,505][ INFO][PID:412251] Downloading results from builder [2025-12-12 14:11:46,692][ INFO][PID:412251] rsyncing of mockbuilder@100.48.80.28:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/jwakely/boost-190-rebuild.checker/fedora-rawhide-x86_64/09902728-FlightGear started [2025-12-12 14:11:46,951][ INFO][PID:412251] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@100.48.80.28:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/jwakely/boost-190-rebuild.checker/fedora-rawhide-x86_64/09902728-FlightGear/ &> /var/lib/copr/public_html/results/jwakely/boost-190-rebuild.checker/fedora-rawhide-x86_64/09902728-FlightGear/build-09902728.rsync.log [2025-12-12 14:11:49,351][ INFO][PID:412251] rsyncing finished. [2025-12-12 14:11:49,374][ INFO][PID:412251] Releasing VM back to pool [2025-12-12 14:11:50,185][ INFO][PID:412251] Searching for 'success' file in resultdir [2025-12-12 14:11:50,260][ INFO][PID:412251] Going to sign pkgs from source: 9902728-fedora-rawhide-x86_64 in chroot: /var/lib/copr/public_html/results/jwakely/boost-190-rebuild.checker/fedora-rawhide-x86_64 [2025-12-12 14:11:50,335][ INFO][PID:412251] Calling '/bin/sign -u jwakely#boost-190-rebuild.checker@copr.fedorahosted.org -p' (attempt #1) [2025-12-12 14:11:50,741][ INFO][PID:412251] Calling '/bin/sign -4 -h sha256 -u jwakely#boost-190-rebuild.checker@copr.fedorahosted.org -r /var/lib/copr/public_html/results/jwakely/boost-190-rebuild.checker/fedora-rawhide-x86_64/09902728-FlightGear/FlightGear-2024.1.3-1.fc44.src.rpm' (attempt #1) [2025-12-12 14:11:54,687][ INFO][PID:412251] signed rpm: /var/lib/copr/public_html/results/jwakely/boost-190-rebuild.checker/fedora-rawhide-x86_64/09902728-FlightGear/FlightGear-2024.1.3-1.fc44.src.rpm [2025-12-12 14:11:54,699][ INFO][PID:412251] Calling '/bin/sign -4 -h sha256 -u jwakely#boost-190-rebuild.checker@copr.fedorahosted.org -r /var/lib/copr/public_html/results/jwakely/boost-190-rebuild.checker/fedora-rawhide-x86_64/09902728-FlightGear/FlightGear-debuginfo-2024.1.3-1.fc44.x86_64.rpm' (attempt #1) [2025-12-12 14:12:13,189][ INFO][PID:412251] signed rpm: /var/lib/copr/public_html/results/jwakely/boost-190-rebuild.checker/fedora-rawhide-x86_64/09902728-FlightGear/FlightGear-debuginfo-2024.1.3-1.fc44.x86_64.rpm [2025-12-12 14:12:13,191][ INFO][PID:412251] Calling '/bin/sign -4 -h sha256 -u jwakely#boost-190-rebuild.checker@copr.fedorahosted.org -r /var/lib/copr/public_html/results/jwakely/boost-190-rebuild.checker/fedora-rawhide-x86_64/09902728-FlightGear/FlightGear-debugsource-2024.1.3-1.fc44.x86_64.rpm' (attempt #1) [2025-12-12 14:12:14,884][ INFO][PID:412251] signed rpm: /var/lib/copr/public_html/results/jwakely/boost-190-rebuild.checker/fedora-rawhide-x86_64/09902728-FlightGear/FlightGear-debugsource-2024.1.3-1.fc44.x86_64.rpm [2025-12-12 14:12:14,889][ INFO][PID:412251] Calling '/bin/sign -4 -h sha256 -u jwakely#boost-190-rebuild.checker@copr.fedorahosted.org -r /var/lib/copr/public_html/results/jwakely/boost-190-rebuild.checker/fedora-rawhide-x86_64/09902728-FlightGear/FlightGear-2024.1.3-1.fc44.x86_64.rpm' (attempt #1) [2025-12-12 14:12:17,175][ INFO][PID:412251] signed rpm: /var/lib/copr/public_html/results/jwakely/boost-190-rebuild.checker/fedora-rawhide-x86_64/09902728-FlightGear/FlightGear-2024.1.3-1.fc44.x86_64.rpm [2025-12-12 14:12:17,177][ INFO][PID:412251] Sign done [2025-12-12 14:12:17,240][ INFO][PID:412251] Incremental createrepo run, adding 09902728-FlightGear into https://download.copr.fedorainfracloud.org/results/jwakely/boost-190-rebuild.checker/fedora-rawhide-x86_64, (auto-create-repo=True) [2025-12-12 14:12:17,335][ INFO][PID:412251] Running command 'copr-repo --batched /var/lib/copr/public_html/results/jwakely/boost-190-rebuild.checker/fedora-rawhide-x86_64 --add 09902728-FlightGear --no-appstream-metadata' as PID 611048 [2025-12-12 14:12:20,946][ INFO][PID:412251] Finished after 3 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/jwakely/boost-190-rebuild.checker/fedora-rawhide-x86_64 --add 09902728-FlightGear --no-appstream-metadata) [2025-12-12 14:12:21,414][ INFO][PID:412251] Getting build details [2025-12-12 14:12:21,418][ INFO][PID:412251] Listing built binary packages in /var/lib/copr/public_html/results/jwakely/boost-190-rebuild.checker/fedora-rawhide-x86_64/09902728-FlightGear [2025-12-12 14:12:21,419][ INFO][PID:412251] Built packages: ['FlightGear-debugsource 2024.1.3', 'FlightGear 2024.1.3', 'FlightGear-debuginfo 2024.1.3'] [2025-12-12 14:12:21,591][ INFO][PID:412251] build details: {'built_packages': 'FlightGear-debugsource 2024.1.3\nFlightGear 2024.1.3\nFlightGear-debuginfo 2024.1.3'} [2025-12-12 14:12:21,603][ INFO][PID:412251] Retrieving pubkey [2025-12-12 14:12:21,607][ INFO][PID:412251] Calling '/bin/sign -u jwakely#boost-190-rebuild.checker@copr.fedorahosted.org -p' (attempt #1) [2025-12-12 14:12:21,882][ INFO][PID:412251] Added pubkey for user jwakely project boost-190-rebuild.checker into: /var/lib/copr/public_html/results/jwakely/boost-190-rebuild.checker/pubkey.gpg [2025-12-12 14:12:21,893][ INFO][PID:412251] Finished build: id=9902728 failed=False timeout=115200 destdir=/var/lib/copr/public_html/results/jwakely/boost-190-rebuild.checker chroot=fedora-rawhide-x86_64 [2025-12-12 14:12:21,996][ INFO][PID:412251] Worker succeeded build, took 892.0086884498596 [2025-12-12 14:12:22,018][ INFO][PID:412251] Sending build state back to frontend: { "builds": [ { "timeout": 115200, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "jwakely", "project_name": "boost-190-rebuild.checker", "project_dirname": "boost-190-rebuild.checker", "submitter": "jwakely", "ended_on": 1765548741.9941692, "started_on": 1765547849.9854808, "submitted_on": null, "status": 1, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9902728-fedora-rawhide-x86_64", "build_id": 9902728, "package_name": "FlightGear", "package_version": "2024.1.3-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/jwakely/boost-190-rebuild.checker/FlightGear", "git_hash": "65168568f795abf082413d0ba30c298860bfcb65", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "jwakely/boost-190-rebuild.checker--jwakely", "results": { "packages": [ { "name": "FlightGear", "epoch": null, "version": "2024.1.3", "release": "1.fc44", "arch": "src" }, { "name": "FlightGear-debugsource", "epoch": null, "version": "2024.1.3", "release": "1.fc44", "arch": "x86_64" }, { "name": "FlightGear", "epoch": null, "version": "2024.1.3", "release": "1.fc44", "arch": "x86_64" }, { "name": "FlightGear-debuginfo", "epoch": null, "version": "2024.1.3", "release": "1.fc44", "arch": "x86_64" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/jwakely/boost-190-rebuild.checker/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/jwakely/boost-190-rebuild.checker", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/jwakely/boost-190-rebuild.checker", "result_dir": "09902728-FlightGear", "built_packages": "FlightGear-debugsource 2024.1.3\nFlightGear 2024.1.3\nFlightGear-debuginfo 2024.1.3", "id": 9902728, "mockchain_macros": { "copr_username": "jwakely", "copr_projectname": "boost-190-rebuild.checker", "vendor": "Fedora Project COPR (jwakely/boost-190-rebuild.checker)" } } ] } [2025-12-12 14:12:23,459][ INFO][PID:412251] Sending fedora-messaging bus message in build.end [2025-12-12 14:12:25,061][ INFO][PID:412251] Compressing /var/lib/copr/public_html/results/jwakely/boost-190-rebuild.checker/fedora-rawhide-x86_64/09902728-FlightGear/builder-live.log by gzip [2025-12-12 14:12:25,065][ INFO][PID:412251] Running command 'gzip /var/lib/copr/public_html/results/jwakely/boost-190-rebuild.checker/fedora-rawhide-x86_64/09902728-FlightGear/builder-live.log' as PID 612039 [2025-12-12 14:12:25,280][ INFO][PID:412251] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/jwakely/boost-190-rebuild.checker/fedora-rawhide-x86_64/09902728-FlightGear/builder-live.log) [2025-12-12 14:12:25,283][ INFO][PID:412251] Compressing /var/lib/copr/public_html/results/jwakely/boost-190-rebuild.checker/fedora-rawhide-x86_64/09902728-FlightGear/backend.log by gzip [2025-12-12 14:12:25,285][ INFO][PID:412251] Running command 'gzip /var/lib/copr/public_html/results/jwakely/boost-190-rebuild.checker/fedora-rawhide-x86_64/09902728-FlightGear/backend.log' as PID 612058