[2026-08-25 17:11:09,138][ INFO][PID:3282788] Marking build as starting [2026-08-25 17:11:09,198][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:11:09,209][ INFO][PID:3282788] VM allocation process starts [2026-08-25 17:11:09,264][ INFO][PID:3282788] Trying to allocate VM: ResallocHost, ticket_id=4625787, requested_tags=['arch_noarch', 'copr_builder'] [2026-08-25 17:11:14,280][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:11:19,289][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:11:24,300][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:11:29,303][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:11:34,306][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:11:39,310][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:11:44,325][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:11:49,347][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:11:54,350][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:11:59,390][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:12:04,413][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:12:09,418][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:12:14,427][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:12:19,435][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:12:24,440][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:12:29,443][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:12:34,446][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:12:39,451][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:12:44,461][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:12:49,485][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:12:54,514][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:12:59,531][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:13:04,536][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:13:09,545][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:13:14,553][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:13:19,569][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:13:24,594][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:13:29,605][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:13:34,609][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:13:39,611][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:13:44,621][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:13:49,645][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:13:54,649][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:13:59,668][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:14:04,672][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:14:09,683][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:14:14,686][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:14:19,710][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:14:24,730][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:14:29,738][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:14:34,742][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:14:39,751][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:14:44,778][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:14:49,796][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:14:54,802][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:14:59,817][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:15:04,827][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:15:09,842][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:15:14,846][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:15:19,855][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:15:24,869][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:15:29,881][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:15:34,887][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:15:39,889][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:15:44,895][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:15:49,899][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:15:54,901][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:15:59,914][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:16:04,917][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:16:09,931][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:16:14,945][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:16:19,947][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:16:24,964][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:16:28,011][ INFO][PID:3282788] Allocated host ResallocHost, ticket_id=4625787, hostname=18.212.129.221, name=aws_x86_64_spot_prod_20907153_20260825_170752, requested_tags=['arch_noarch', 'copr_builder'] [2026-08-25 17:16:28,012][ INFO][PID:3282788] Allocating ssh connection to builder [2026-08-25 17:16:28,015][ INFO][PID:3282788] Checking that builder machine is OK [2026-08-25 17:17:28,125][ ERROR][PID:3282788] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 18.212.129.221 port 22: Connection timed out [2026-08-25 17:17:38,166][ ERROR][PID:3282788] Re-try request for task on 'ResallocHost, ticket_id=4625787, hostname=18.212.129.221, name=aws_x86_64_spot_prod_20907153_20260825_170752, requested_tags=['arch_noarch', 'copr_builder']': Unable to finish after 1 SSH attempts [2026-08-25 17:17:38,193][ INFO][PID:3282788] VM Release request [2026-08-25 17:17:38,225][ INFO][PID:3282788] Retry #1 (on other host) [2026-08-25 17:17:38,228][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:17:38,231][ INFO][PID:3282788] VM allocation process starts [2026-08-25 17:17:38,249][ INFO][PID:3282788] Trying to allocate VM: ResallocHost, ticket_id=4626032, requested_tags=['arch_noarch', 'copr_builder'] [2026-08-25 17:17:43,254][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:17:48,262][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:17:53,274][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:17:58,283][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:18:03,305][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:18:08,313][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:18:13,317][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:18:18,325][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:18:23,330][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:18:28,337][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:18:33,340][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:18:38,344][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:18:43,360][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:18:48,378][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:18:53,389][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:18:58,405][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:19:03,413][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:19:08,416][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:19:13,421][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:19:18,428][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:19:23,432][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:19:28,438][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:19:33,442][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:19:38,445][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:19:43,453][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:19:48,454][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:19:53,458][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:19:56,738][ INFO][PID:3282788] Allocated host ResallocHost, ticket_id=4626032, hostname=2620:52:6:1161:dead:beef:cafe:c164, name=vmhost_p09_02_prod_20907137_20260825_170748, requested_tags=['arch_noarch', 'copr_builder'] [2026-08-25 17:19:56,739][ INFO][PID:3282788] Allocating ssh connection to builder [2026-08-25 17:19:56,744][ INFO][PID:3282788] Checking that builder machine is OK [2026-08-25 17:19:57,676][ INFO][PID:3282788] Installed copr-rpmbuild version: 1.9 [2026-08-25 17:19:57,677][ INFO][PID:3282788] Running remote command: copr-builder-ready srpm-builds [2026-08-25 17:19:58,155][ INFO][PID:3282788] Red Hat subscription not needed for srpm-builds Builder is ready to be used [2026-08-25 17:19:58,161][ INFO][PID:3282788] Filling build.info file with builder info [2026-08-25 17:19:58,168][ INFO][PID:3282788] Checking for cancel request [2026-08-25 17:19:58,176][ INFO][PID:3282788] Not re-notifying FE and msg buses for the new host. [2026-08-25 17:19:58,187][ INFO][PID:3282788] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --srpm --task-url https://copr.fedorainfracloud.org/backend/get-srpm-build-task/10901742 --detached [2026-08-25 17:19:59,337][ INFO][PID:3282788] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c164' (ED25519) to the list of known hosts. [2026-08-25 17:19:59,346][ INFO][PID:3282788] Downloading the builder-live.log file, attempt 1 [2026-08-25 17:19:59,363][ INFO][PID:3282788] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c164 copr-rpmbuild-log [2026-08-25 17:20:03,409][ INFO][PID:3282788] Downloading results from builder [2026-08-25 17:20:03,410][ INFO][PID:3282788] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c164]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@python/Cython_rawhide/srpm-builds/10901742 started [2026-08-25 17:20:03,422][ INFO][PID:3282788] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c164]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@python/Cython_rawhide/srpm-builds/10901742/ &> /var/lib/copr/public_html/results/@python/Cython_rawhide/srpm-builds/10901742/build-10901742.rsync.log [2026-08-25 17:20:04,454][ INFO][PID:3282788] rsyncing finished. [2026-08-25 17:20:04,459][ INFO][PID:3282788] VM Release request [2026-08-25 17:20:04,535][ INFO][PID:3282788] Searching for 'success' file in resultdir [2026-08-25 17:20:04,543][ INFO][PID:3282788] Getting build details [2026-08-25 17:20:04,547][ INFO][PID:3282788] Retrieving SRPM info from /var/lib/copr/public_html/results/@python/Cython_rawhide/srpm-builds/10901742 [2026-08-25 17:20:04,552][ INFO][PID:3282788] SRPM URL: https://download.copr.fedorainfracloud.org/results/@python/Cython_rawhide/srpm-builds/10901742/python-cupy-rocm-14.1.1-3.src.rpm [2026-08-25 17:20:04,557][ INFO][PID:3282788] build details: {'srpm_url': 'https://download.copr.fedorainfracloud.org/results/@python/Cython_rawhide/srpm-builds/10901742/python-cupy-rocm-14.1.1-3.src.rpm', 'pkg_name': 'python-cupy-rocm', 'pkg_version': '14.1.1-3'} [2026-08-25 17:20:04,564][ INFO][PID:3282788] Finished build: id=10901742 failed=False timeout=108000 destdir=/var/lib/copr/public_html/results/@python/Cython_rawhide chroot=srpm-builds [2026-08-25 17:20:04,573][ INFO][PID:3282788] Worker succeeded build, took 6.3977906703948975 [2026-08-25 17:20:04,583][ INFO][PID:3282788] Sending build state back to frontend: { "builds": [ { "timeout": 108000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": null, "enable_net": true, "project_owner": "@python", "project_name": "Cython_rawhide", "project_dirname": "Cython_rawhide", "submitter": "lbalhar", "ended_on": 1787678404.5736852, "started_on": 1787678398.1758945, "submitted_on": null, "status": 1, "chroot": "srpm-builds", "arch": null, "buildroot_pkgs": null, "task_id": "10901742", "build_id": 10901742, "package_name": "python-cupy-rocm", "package_version": null, "git_repo": null, "git_hash": null, "git_branch": null, "source_type": 10, "source_json": "{\"clone_url\": \"https://src.fedoraproject.org/rpms/python-cupy-rocm.git\", \"distgit\": \"fedora\", \"committish\": \"rawhide\"}", "pkg_name": "python-cupy-rocm", "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": "https://download.copr.fedorainfracloud.org/results/@python/Cython_rawhide/srpm-builds/10901742/python-cupy-rocm-14.1.1-3.src.rpm", "uses_devel_repo": null, "sandbox": "@python/Cython_rawhide--lbalhar", "results": { "architecture_specific_tags": { "fedora-rawhide": { "exclusivearch": [ "x86_64" ] } }, "name": "python-cupy-rocm", "epoch": null, "version": "14.1.1", "release": "3" }, "appstream": false, "allow_user_ssh": null, "ssh_public_keys": null, "storage": null, "repos": [], "background": true, "distributions_in_build": [ "fedora-rawhide" ], "distributions_in_project": [ "fedora-rawhide" ], "destdir": "/var/lib/copr/public_html/results/@python/Cython_rawhide", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@python/Cython_rawhide", "result_dir": "10901742", "built_packages": "", "tags": [ "arch_noarch" ], "rpmeta_prediction": null, "pkg_version": "14.1.1-3", "id": 10901742, "mockchain_macros": { "copr_username": "@python", "copr_projectname": "Cython_rawhide", "vendor": "Fedora Project COPR (@python/Cython_rawhide)" } } ] } [2026-08-25 17:20:04,738][ INFO][PID:3282788] Sending fedora-messaging bus message in build.end [2026-08-25 17:20:07,885][ INFO][PID:3282788] Compressing /var/lib/copr/public_html/results/@python/Cython_rawhide/srpm-builds/10901742/builder-live.log by gzip [2026-08-25 17:20:07,893][ INFO][PID:3282788] Running command 'gzip /var/lib/copr/public_html/results/@python/Cython_rawhide/srpm-builds/10901742/builder-live.log' as PID 3392344 [2026-08-25 17:20:07,912][ INFO][PID:3282788] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@python/Cython_rawhide/srpm-builds/10901742/builder-live.log) [2026-08-25 17:20:07,917][ INFO][PID:3282788] Compressing /var/lib/copr/public_html/results/@python/Cython_rawhide/srpm-builds/10901742/backend.log by gzip [2026-08-25 17:20:07,930][ INFO][PID:3282788] Running command 'gzip /var/lib/copr/public_html/results/@python/Cython_rawhide/srpm-builds/10901742/backend.log' as PID 3392353