[2025-12-15 14:24:30,273][ INFO][PID:361875] Marking build as starting [2025-12-15 14:24:30,580][ INFO][PID:361875] Checking for cancel request [2025-12-15 14:24:30,601][ INFO][PID:361875] VM allocation process starts [2025-12-15 14:24:30,683][ INFO][PID:361875] Trying to allocate VM: ResallocHost, ticket_id=350000, requested_tags=['copr_builder', 'arch_noarch'] [2025-12-15 14:24:35,692][ INFO][PID:361875] Checking for cancel request [2025-12-15 14:24:40,694][ INFO][PID:361875] Checking for cancel request [2025-12-15 14:24:45,700][ INFO][PID:361875] Checking for cancel request [2025-12-15 14:24:50,710][ INFO][PID:361875] Checking for cancel request [2025-12-15 14:24:55,717][ INFO][PID:361875] Checking for cancel request [2025-12-15 14:25:00,728][ INFO][PID:361875] Checking for cancel request [2025-12-15 14:25:05,730][ INFO][PID:361875] Checking for cancel request [2025-12-15 14:25:10,735][ INFO][PID:361875] Checking for cancel request [2025-12-15 14:25:15,742][ INFO][PID:361875] Checking for cancel request [2025-12-15 14:25:20,745][ INFO][PID:361875] Checking for cancel request [2025-12-15 14:25:25,748][ INFO][PID:361875] Checking for cancel request [2025-12-15 14:25:30,752][ INFO][PID:361875] Checking for cancel request [2025-12-15 14:25:35,769][ INFO][PID:361875] Checking for cancel request [2025-12-15 14:25:39,015][ INFO][PID:361875] Allocated host ResallocHost, ticket_id=350000, hostname=2620:52:6:1161:dead:beef:cafe:c110, name=vmhost_p09_02_prod_00563453_20251215_141713, requested_tags=['copr_builder', 'arch_noarch'] [2025-12-15 14:25:39,017][ INFO][PID:361875] Allocating ssh connection to builder [2025-12-15 14:25:39,018][ INFO][PID:361875] Checking that builder machine is OK [2025-12-15 14:26:39,110][ ERROR][PID:361875] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c110 port 22: Connection timed out [2025-12-15 14:26:49,193][ ERROR][PID:361875] Re-try request for task on 'ResallocHost, ticket_id=350000, hostname=2620:52:6:1161:dead:beef:cafe:c110, name=vmhost_p09_02_prod_00563453_20251215_141713, requested_tags=['copr_builder', 'arch_noarch']': Unable to finish after 1 SSH attempts [2025-12-15 14:26:49,226][ INFO][PID:361875] Releasing VM back to pool [2025-12-15 14:26:49,274][ INFO][PID:361875] Retry #1 (on other host) [2025-12-15 14:26:49,278][ INFO][PID:361875] Checking for cancel request [2025-12-15 14:26:49,290][ INFO][PID:361875] VM allocation process starts [2025-12-15 14:26:49,371][ INFO][PID:361875] Trying to allocate VM: ResallocHost, ticket_id=350013, requested_tags=['copr_builder', 'arch_noarch'] [2025-12-15 14:26:54,391][ INFO][PID:361875] Checking for cancel request [2025-12-15 14:26:59,437][ INFO][PID:361875] Checking for cancel request [2025-12-15 14:27:01,500][ INFO][PID:361875] Allocated host ResallocHost, ticket_id=350013, hostname=98.94.46.194, name=aws_aarch64_normalreserved_prod_00563637_20251215_142146, requested_tags=['copr_builder', 'arch_noarch'] [2025-12-15 14:27:01,501][ INFO][PID:361875] Allocating ssh connection to builder [2025-12-15 14:27:01,502][ INFO][PID:361875] Checking that builder machine is OK [2025-12-15 14:27:01,986][ INFO][PID:361875] Running remote command: copr-builder-ready srpm-builds [2025-12-15 14:27:02,350][ INFO][PID:361875] Red Hat subscription not needed for srpm-builds Builder is ready to be used [2025-12-15 14:27:02,352][ INFO][PID:361875] Filling build.info file with builder info [2025-12-15 14:27:02,387][ INFO][PID:361875] Checking for cancel request [2025-12-15 14:27:02,389][ INFO][PID:361875] Not re-notifying FE and msg buses for the new host. [2025-12-15 14:27:02,389][ INFO][PID:361875] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --srpm --task-url https://copr.fedorainfracloud.org/backend/get-srpm-build-task/9911349 --detached [2025-12-15 14:27:02,811][ INFO][PID:361875] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '98.94.46.194' (ED25519) to the list of known hosts. [2025-12-15 14:27:02,814][ INFO][PID:361875] Downloading the builder-live.log file, attempt 1 [2025-12-15 14:27:02,817][ INFO][PID:361875] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.94.46.194 copr-rpmbuild-log [2025-12-15 14:27:03,158][ INFO][PID:361875] Downloading results from builder [2025-12-15 14:27:03,159][ INFO][PID:361875] rsyncing of mockbuilder@98.94.46.194:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@python/python3.14-c9s/srpm-builds/09911349 started [2025-12-15 14:27:03,168][ INFO][PID:361875] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@98.94.46.194:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@python/python3.14-c9s/srpm-builds/09911349/ &> /var/lib/copr/public_html/results/@python/python3.14-c9s/srpm-builds/09911349/build-09911349.rsync.log [2025-12-15 14:27:03,485][ INFO][PID:361875] rsyncing finished. [2025-12-15 14:27:03,487][ INFO][PID:361875] Releasing VM back to pool [2025-12-15 14:27:03,520][ INFO][PID:361875] Searching for 'success' file in resultdir [2025-12-15 14:27:03,523][ ERROR][PID:361875] Build failed: Backend process error: No success file => build failure [2025-12-15 14:27:03,528][ INFO][PID:361875] Finished build: id=9911349 failed=True timeout=108000 destdir=/var/lib/copr/public_html/results/@python/python3.14-c9s chroot=srpm-builds [2025-12-15 14:27:03,540][ ERROR][PID:361875] Backend process error: No success file => build failure [2025-12-15 14:27:03,543][ INFO][PID:361875] Worker failed build, took 1.153886318206787 [2025-12-15 14:27:03,547][ INFO][PID:361875] Sending build state back to frontend: { "builds": [ { "timeout": 108000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": null, "enable_net": true, "project_owner": "@python", "project_name": "python3.14-c9s", "project_dirname": "python3.14-c9s", "submitter": "thrnciar", "ended_on": 1765808823.5430398, "started_on": 1765808822.3891535, "submitted_on": null, "status": 0, "chroot": "srpm-builds", "arch": null, "buildroot_pkgs": null, "task_id": "9911349", "build_id": 9911349, "package_name": "python3.14-setuptools", "package_version": null, "git_repo": null, "git_hash": null, "git_branch": null, "source_type": 2, "source_json": "{\"url\": \"https://copr.fedorainfracloud.org/tmp/tmp3fnswm8h/python3.14-setuptools-78.1.1-1.el9.src.rpm\", \"pkg\": \"python3.14-setuptools-78.1.1-1.el9.src.rpm\", \"tmp\": \"tmp3fnswm8h\"}", "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": null, "sandbox": "@python/python3.14-c9s--thrnciar", "results": null, "appstream": false, "allow_user_ssh": null, "ssh_public_keys": null, "storage": null, "repos": [], "background": false, "destdir": "/var/lib/copr/public_html/results/@python/python3.14-c9s", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@python/python3.14-c9s", "result_dir": "09911349", "built_packages": "", "tags": [ "arch_noarch" ], "id": 9911349, "mockchain_macros": { "copr_username": "@python", "copr_projectname": "python3.14-c9s", "vendor": "Fedora Project COPR (@python/python3.14-c9s)" } } ] } [2025-12-15 14:27:03,662][ INFO][PID:361875] Sending fedora-messaging bus message in build.end [2025-12-15 14:27:05,049][ INFO][PID:361875] Compressing /var/lib/copr/public_html/results/@python/python3.14-c9s/srpm-builds/09911349/builder-live.log by gzip [2025-12-15 14:27:05,054][ INFO][PID:361875] Running command 'gzip /var/lib/copr/public_html/results/@python/python3.14-c9s/srpm-builds/09911349/builder-live.log' as PID 393058 [2025-12-15 14:27:05,057][ INFO][PID:361875] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@python/python3.14-c9s/srpm-builds/09911349/builder-live.log) [2025-12-15 14:27:05,060][ INFO][PID:361875] Compressing /var/lib/copr/public_html/results/@python/python3.14-c9s/srpm-builds/09911349/backend.log by gzip [2025-12-15 14:27:05,064][ INFO][PID:361875] Running command 'gzip /var/lib/copr/public_html/results/@python/python3.14-c9s/srpm-builds/09911349/backend.log' as PID 393059