[2025-09-09 13:49:32,978][ INFO][PID:2994933] Marking build as starting [2025-09-09 13:49:33,039][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:49:33,040][ INFO][PID:2994933] VM allocation process starts [2025-09-09 13:49:33,054][ INFO][PID:2994933] Trying to allocate VM: ResallocHost, ticket_id=4983060, requested_tags=['copr_builder', 'arch_x86_64'] [2025-09-09 13:49:38,056][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:49:43,057][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:49:48,058][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:49:53,059][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:49:58,060][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:50:03,061][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:50:08,062][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:50:13,063][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:50:18,064][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:50:23,065][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:50:28,066][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:50:33,067][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:50:38,068][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:50:43,069][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:50:48,070][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:50:53,071][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:50:58,072][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:51:03,073][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:51:08,074][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:51:13,075][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:51:18,076][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:51:23,077][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:51:28,079][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:51:33,079][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:51:38,080][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:51:43,081][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:51:48,083][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:51:53,084][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:51:58,084][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:52:03,085][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:52:08,086][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:52:13,087][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:52:18,088][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:52:23,089][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:52:28,090][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:52:33,091][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:52:38,092][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:52:43,093][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:52:48,094][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:52:53,095][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:52:58,096][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:53:03,098][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:53:08,099][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:53:13,101][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:53:18,102][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:53:23,103][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:53:28,104][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:53:33,105][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:53:38,106][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:53:43,107][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:53:48,108][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:53:53,109][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:53:58,111][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:54:03,112][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:54:08,112][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:54:13,114][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:54:18,114][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:54:23,115][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:54:28,116][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:54:33,117][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:54:38,161][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:54:43,244][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:54:48,282][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:54:53,358][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:54:58,402][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:55:03,482][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:55:08,563][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:55:13,580][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:55:18,643][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:55:23,738][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:55:28,786][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:55:33,792][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:55:38,912][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:55:44,010][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:55:49,090][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:55:54,162][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:55:59,169][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:56:04,209][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:56:09,215][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:56:14,384][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:56:19,456][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:56:24,663][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:56:29,664][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:56:34,665][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:56:39,683][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:56:44,724][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:56:49,730][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:56:54,907][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:57:00,003][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:57:05,018][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:57:10,139][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:57:15,246][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:57:20,249][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:57:25,310][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:57:30,382][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:57:35,403][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:57:40,502][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:57:45,544][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:57:50,597][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:57:55,611][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:58:00,750][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:58:05,849][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:58:10,899][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:58:15,946][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:58:21,061][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:58:26,201][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:58:31,291][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:58:36,308][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:58:41,348][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:58:46,357][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:58:51,364][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:58:56,418][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:59:01,462][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:59:06,569][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:59:11,713][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:59:16,825][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:59:21,905][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:59:26,929][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:59:32,067][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:59:37,192][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:59:42,252][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:59:47,292][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:59:52,318][ INFO][PID:2994933] Checking for cancel request [2025-09-09 13:59:57,361][ INFO][PID:2994933] Checking for cancel request [2025-09-09 14:00:02,429][ INFO][PID:2994933] Checking for cancel request [2025-09-09 14:00:07,532][ INFO][PID:2994933] Checking for cancel request [2025-09-09 14:00:12,546][ INFO][PID:2994933] Checking for cancel request [2025-09-09 14:00:17,668][ INFO][PID:2994933] Checking for cancel request [2025-09-09 14:00:22,730][ INFO][PID:2994933] Checking for cancel request [2025-09-09 14:00:27,760][ INFO][PID:2994933] Checking for cancel request [2025-09-09 14:00:32,784][ INFO][PID:2994933] Checking for cancel request [2025-09-09 14:00:37,800][ INFO][PID:2994933] Checking for cancel request [2025-09-09 14:00:42,920][ INFO][PID:2994933] Checking for cancel request [2025-09-09 14:00:48,006][ INFO][PID:2994933] Checking for cancel request [2025-09-09 14:00:51,371][ INFO][PID:2994933] Allocated host ResallocHost, ticket_id=4983060, hostname=34.239.149.195, name=aws_x86_64_normal_prod_06681888_20250909_135555, requested_tags=['copr_builder', 'arch_x86_64'] [2025-09-09 14:00:51,371][ INFO][PID:2994933] Allocating ssh connection to builder [2025-09-09 14:00:51,372][ INFO][PID:2994933] Checking that builder machine is OK [2025-09-09 14:00:51,853][ INFO][PID:2994933] Running remote command: copr-builder-ready fedora-43-x86_64 [2025-09-09 14:00:52,069][ INFO][PID:2994933] Red Hat subscription not needed for fedora-43-x86_64 Builder is ready to be used [2025-09-09 14:00:52,070][ INFO][PID:2994933] Filling build.info file with builder info [2025-09-09 14:00:52,071][ INFO][PID:2994933] Checking for cancel request [2025-09-09 14:00:52,072][ INFO][PID:2994933] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@copr", "project_name": "PyPI", "project_dirname": "PyPI", "submitter": "ksurma", "ended_on": null, "started_on": 1757426452.0726326, "submitted_on": null, "status": 3, "chroot": "fedora-43-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9535643-fedora-43-x86_64", "build_id": 9535643, "package_name": "python-dkist-processing-common", "package_version": "11.5.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@copr/PyPI/python-dkist-processing-common", "git_hash": "efe0aff7aff798f22ac957eb2ae47d8599e254bc", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@copr/PyPI--ksurma", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/PyPI/fedora-43-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@copr/PyPI", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@copr/PyPI", "result_dir": "09535643-python-dkist-processing-common", "built_packages": "", "id": 9535643, "mockchain_macros": { "copr_username": "@copr", "copr_projectname": "PyPI", "vendor": "Fedora Project COPR (@copr/PyPI)" } } ] } [2025-09-09 14:00:52,108][ INFO][PID:2994933] Sending fedora-messaging bus message in build.start [2025-09-09 14:00:52,936][ INFO][PID:2994933] Sending fedora-messaging bus message in chroot.start [2025-09-09 14:00:52,962][ INFO][PID:2994933] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9535643-fedora-43-x86_64 --chroot fedora-43-x86_64 --detached [2025-09-09 14:00:53,310][ INFO][PID:2994933] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '34.239.149.195' (ED25519) to the list of known hosts. [2025-09-09 14:00:53,311][ INFO][PID:2994933] Downloading the builder-live.log file, attempt 1 [2025-09-09 14:00:53,312][ INFO][PID:2994933] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@34.239.149.195 copr-rpmbuild-log [2025-09-09 14:00:58,323][ INFO][PID:2994933] Periodic builder liveness probe: alive [2025-09-09 14:00:58,324][ INFO][PID:2994933] Checking for cancel request [2025-09-09 14:01:03,325][ INFO][PID:2994933] Checking for cancel request [2025-09-09 14:01:08,327][ INFO][PID:2994933] Checking for cancel request [2025-09-09 14:01:13,328][ INFO][PID:2994933] Checking for cancel request [2025-09-09 14:01:18,331][ INFO][PID:2994933] Checking for cancel request [2025-09-09 14:01:23,343][ INFO][PID:2994933] Checking for cancel request [2025-09-09 14:01:28,427][ INFO][PID:2994933] Checking for cancel request [2025-09-09 14:01:33,570][ INFO][PID:2994933] Checking for cancel request [2025-09-09 14:01:38,596][ INFO][PID:2994933] Checking for cancel request [2025-09-09 14:01:43,669][ INFO][PID:2994933] Checking for cancel request [2025-09-09 14:01:48,736][ INFO][PID:2994933] Checking for cancel request [2025-09-09 14:01:52,277][ INFO][PID:2994933] Downloading results from builder [2025-09-09 14:01:52,278][ INFO][PID:2994933] rsyncing of mockbuilder@34.239.149.195:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@copr/PyPI/fedora-43-x86_64/09535643-python-dkist-processing-common started [2025-09-09 14:01:52,279][ INFO][PID:2994933] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@34.239.149.195:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@copr/PyPI/fedora-43-x86_64/09535643-python-dkist-processing-common/ &> /var/lib/copr/public_html/results/@copr/PyPI/fedora-43-x86_64/09535643-python-dkist-processing-common/build-09535643.rsync.log [2025-09-09 14:01:59,176][ INFO][PID:2994933] rsyncing finished. [2025-09-09 14:01:59,177][ INFO][PID:2994933] Releasing VM back to pool [2025-09-09 14:01:59,187][ INFO][PID:2994933] Searching for 'success' file in resultdir [2025-09-09 14:01:59,188][ ERROR][PID:2994933] Build failed: Backend process error: No success file => build failure [2025-09-09 14:01:59,189][ INFO][PID:2994933] Finished build: id=9535643 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/@copr/PyPI chroot=fedora-43-x86_64 [2025-09-09 14:01:59,190][ ERROR][PID:2994933] Backend process error: No success file => build failure [2025-09-09 14:01:59,191][ INFO][PID:2994933] Worker failed build, took 67.11880111694336 [2025-09-09 14:01:59,192][ INFO][PID:2994933] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@copr", "project_name": "PyPI", "project_dirname": "PyPI", "submitter": "ksurma", "ended_on": 1757426519.1914337, "started_on": 1757426452.0726326, "submitted_on": null, "status": 0, "chroot": "fedora-43-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9535643-fedora-43-x86_64", "build_id": 9535643, "package_name": "python-dkist-processing-common", "package_version": "11.5.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@copr/PyPI/python-dkist-processing-common", "git_hash": "efe0aff7aff798f22ac957eb2ae47d8599e254bc", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@copr/PyPI--ksurma", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/PyPI/fedora-43-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@copr/PyPI", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@copr/PyPI", "result_dir": "09535643-python-dkist-processing-common", "built_packages": "", "id": 9535643, "mockchain_macros": { "copr_username": "@copr", "copr_projectname": "PyPI", "vendor": "Fedora Project COPR (@copr/PyPI)" } } ] } [2025-09-09 14:01:59,223][ INFO][PID:2994933] Sending fedora-messaging bus message in build.end [2025-09-09 14:01:59,247][ INFO][PID:2994933] Compressing /var/lib/copr/public_html/results/@copr/PyPI/fedora-43-x86_64/09535643-python-dkist-processing-common/builder-live.log by gzip [2025-09-09 14:01:59,248][ INFO][PID:2994933] Running command 'gzip /var/lib/copr/public_html/results/@copr/PyPI/fedora-43-x86_64/09535643-python-dkist-processing-common/builder-live.log' as PID 3068524 [2025-09-09 14:01:59,254][ INFO][PID:2994933] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@copr/PyPI/fedora-43-x86_64/09535643-python-dkist-processing-common/builder-live.log) [2025-09-09 14:01:59,255][ INFO][PID:2994933] Compressing /var/lib/copr/public_html/results/@copr/PyPI/fedora-43-x86_64/09535643-python-dkist-processing-common/backend.log by gzip [2025-09-09 14:01:59,256][ INFO][PID:2994933] Running command 'gzip /var/lib/copr/public_html/results/@copr/PyPI/fedora-43-x86_64/09535643-python-dkist-processing-common/backend.log' as PID 3068525