[2025-10-23 15:19:45,649][ INFO][PID:3612144] Marking build as starting [2025-10-23 15:19:45,681][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:19:45,688][ INFO][PID:3612144] VM allocation process starts [2025-10-23 15:19:45,725][ INFO][PID:3612144] Trying to allocate VM: ResallocHost, ticket_id=5818495, requested_tags=['copr_builder', 'arch_x86_64'] [2025-10-23 15:19:50,733][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:19:55,734][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:20:00,736][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:20:05,738][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:20:10,740][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:20:15,743][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:20:20,747][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:20:25,751][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:20:30,753][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:20:35,754][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:20:40,756][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:20:45,763][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:20:50,766][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:20:55,771][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:21:00,774][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:21:05,776][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:21:10,781][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:21:15,782][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:21:20,783][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:21:25,787][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:21:30,791][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:21:35,793][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:21:40,794][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:21:45,795][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:21:50,796][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:21:55,797][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:22:00,800][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:22:05,802][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:22:10,803][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:22:15,804][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:22:20,805][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:22:25,809][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:22:30,811][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:22:35,815][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:22:40,817][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:22:45,820][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:22:50,823][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:22:55,824][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:23:00,826][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:23:05,827][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:23:10,829][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:23:15,831][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:23:20,834][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:23:25,839][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:23:30,840][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:23:35,841][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:23:40,845][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:23:45,846][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:23:50,847][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:23:55,849][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:24:00,851][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:24:05,852][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:24:10,854][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:24:15,863][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:24:20,864][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:24:25,865][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:24:30,866][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:24:35,869][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:24:40,872][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:24:45,876][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:24:50,877][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:24:55,882][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:25:00,883][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:25:05,886][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:25:10,888][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:25:15,891][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:25:20,896][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:25:25,898][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:25:30,899][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:25:35,902][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:25:40,911][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:25:45,914][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:25:50,916][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:25:55,918][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:26:00,928][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:26:05,932][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:26:10,934][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:26:15,944][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:26:20,947][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:26:25,950][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:26:30,954][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:26:35,957][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:26:40,959][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:26:45,963][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:26:50,967][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:26:55,970][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:27:00,972][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:27:03,975][ INFO][PID:3612144] Allocated host ResallocHost, ticket_id=5818495, hostname=2620:52:3:1:dead:beef:cafe:c119, name=copr_hv_x86_64_01_prod_07621896_20251023_152454, requested_tags=['copr_builder', 'arch_x86_64'] [2025-10-23 15:27:03,976][ INFO][PID:3612144] Allocating ssh connection to builder [2025-10-23 15:27:03,977][ INFO][PID:3612144] Checking that builder machine is OK [2025-10-23 15:27:04,644][ INFO][PID:3612144] Running remote command: copr-builder-ready centos-stream-10-x86_64 [2025-10-23 15:27:05,012][ INFO][PID:3612144] Red Hat subscription not needed for centos-stream-10-x86_64 Builder is ready to be used [2025-10-23 15:27:05,014][ INFO][PID:3612144] Filling build.info file with builder info [2025-10-23 15:27:05,015][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:27:05,017][ INFO][PID:3612144] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@rocm-packagers-sig", "project_name": "CS10", "project_dirname": "CS10", "submitter": "https://src.fedoraproject.org/user/trix", "ended_on": null, "started_on": 1761233225.017466, "submitted_on": null, "status": 3, "chroot": "centos-stream-10-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9724718-centos-stream-10-x86_64", "build_id": 9724718, "package_name": "hipblas", "package_version": "7.0.2-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@rocm-packagers-sig/CS10/hipblas", "git_hash": "5e831c7d2590cd5cc1e9e8eda41d8d84d768d693", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@rocm-packagers-sig/CS10--https://src.fedoraproject.org/user/trix", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@rocm-packagers-sig/CS10/centos-stream-10-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@rocm-packagers-sig/CS10", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@rocm-packagers-sig/CS10", "result_dir": "09724718-hipblas", "built_packages": "", "id": 9724718, "mockchain_macros": { "copr_username": "@rocm-packagers-sig", "copr_projectname": "CS10", "vendor": "Fedora Project COPR (@rocm-packagers-sig/CS10)" } } ] } [2025-10-23 15:27:05,062][ INFO][PID:3612144] Sending fedora-messaging bus message in build.start [2025-10-23 15:27:06,840][ INFO][PID:3612144] Sending fedora-messaging bus message in chroot.start [2025-10-23 15:27:06,868][ INFO][PID:3612144] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9724718-centos-stream-10-x86_64 --chroot centos-stream-10-x86_64 --detached [2025-10-23 15:27:07,544][ INFO][PID:3612144] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c119' (ED25519) to the list of known hosts. [2025-10-23 15:27:07,546][ INFO][PID:3612144] Downloading the builder-live.log file, attempt 1 [2025-10-23 15:27:07,552][ INFO][PID:3612144] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c119 copr-rpmbuild-log [2025-10-23 15:27:12,570][ INFO][PID:3612144] Periodic builder liveness probe: alive [2025-10-23 15:27:12,571][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:27:17,575][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:27:22,576][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:27:27,577][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:27:32,578][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:27:37,581][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:27:42,585][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:27:47,587][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:27:52,589][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:27:57,592][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:28:02,594][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:28:07,598][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:28:12,601][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:28:17,604][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:28:22,608][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:28:27,613][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:28:32,614][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:28:37,618][ INFO][PID:3612144] Checking for cancel request [2025-10-23 15:28:39,993][ INFO][PID:3612144] Downloading results from builder [2025-10-23 15:28:39,997][ INFO][PID:3612144] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c119]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@rocm-packagers-sig/CS10/centos-stream-10-x86_64/09724718-hipblas started [2025-10-23 15:28:39,999][ INFO][PID:3612144] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c119]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@rocm-packagers-sig/CS10/centos-stream-10-x86_64/09724718-hipblas/ &> /var/lib/copr/public_html/results/@rocm-packagers-sig/CS10/centos-stream-10-x86_64/09724718-hipblas/build-09724718.rsync.log [2025-10-23 15:28:40,481][ INFO][PID:3612144] rsyncing finished. [2025-10-23 15:28:40,483][ INFO][PID:3612144] Releasing VM back to pool [2025-10-23 15:28:40,513][ INFO][PID:3612144] Searching for 'success' file in resultdir [2025-10-23 15:28:40,514][ ERROR][PID:3612144] Build failed: Backend process error: No success file => build failure [2025-10-23 15:28:40,515][ INFO][PID:3612144] Finished build: id=9724718 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/@rocm-packagers-sig/CS10 chroot=centos-stream-10-x86_64 [2025-10-23 15:28:40,521][ ERROR][PID:3612144] Backend process error: No success file => build failure [2025-10-23 15:28:40,522][ INFO][PID:3612144] Worker failed build, took 95.50526928901672 [2025-10-23 15:28:40,529][ INFO][PID:3612144] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@rocm-packagers-sig", "project_name": "CS10", "project_dirname": "CS10", "submitter": "https://src.fedoraproject.org/user/trix", "ended_on": 1761233320.5227354, "started_on": 1761233225.017466, "submitted_on": null, "status": 0, "chroot": "centos-stream-10-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9724718-centos-stream-10-x86_64", "build_id": 9724718, "package_name": "hipblas", "package_version": "7.0.2-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@rocm-packagers-sig/CS10/hipblas", "git_hash": "5e831c7d2590cd5cc1e9e8eda41d8d84d768d693", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@rocm-packagers-sig/CS10--https://src.fedoraproject.org/user/trix", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@rocm-packagers-sig/CS10/centos-stream-10-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@rocm-packagers-sig/CS10", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@rocm-packagers-sig/CS10", "result_dir": "09724718-hipblas", "built_packages": "", "id": 9724718, "mockchain_macros": { "copr_username": "@rocm-packagers-sig", "copr_projectname": "CS10", "vendor": "Fedora Project COPR (@rocm-packagers-sig/CS10)" } } ] } [2025-10-23 15:28:40,588][ INFO][PID:3612144] Sending fedora-messaging bus message in build.end [2025-10-23 15:28:40,650][ INFO][PID:3612144] Compressing /var/lib/copr/public_html/results/@rocm-packagers-sig/CS10/centos-stream-10-x86_64/09724718-hipblas/builder-live.log by gzip [2025-10-23 15:28:40,657][ INFO][PID:3612144] Running command 'gzip /var/lib/copr/public_html/results/@rocm-packagers-sig/CS10/centos-stream-10-x86_64/09724718-hipblas/builder-live.log' as PID 3692384 [2025-10-23 15:28:40,664][ INFO][PID:3612144] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@rocm-packagers-sig/CS10/centos-stream-10-x86_64/09724718-hipblas/builder-live.log) [2025-10-23 15:28:40,666][ INFO][PID:3612144] Compressing /var/lib/copr/public_html/results/@rocm-packagers-sig/CS10/centos-stream-10-x86_64/09724718-hipblas/backend.log by gzip