[2025-12-27 01:23:26,773][ INFO][PID:2690089] Marking build as starting [2025-12-27 01:23:26,828][ INFO][PID:2690089] Checking that /var/lib/copr/public_html/results/rezso/ML/epel-10-x86_64/repodata/repomd.xml exists [2025-12-27 01:23:26,837][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:23:26,838][ INFO][PID:2690089] VM allocation process starts [2025-12-27 01:23:26,850][ INFO][PID:2690089] Trying to allocate VM: ResallocHost, ticket_id=527900, requested_tags=['copr_builder', 'arch_x86_64'] [2025-12-27 01:23:29,868][ INFO][PID:2690089] Allocated host ResallocHost, ticket_id=527900, hostname=3.80.56.152, name=aws_x86_64_spot_prod_00785496_20251227_011857, requested_tags=['copr_builder', 'arch_x86_64'] [2025-12-27 01:23:29,868][ INFO][PID:2690089] Allocating ssh connection to builder [2025-12-27 01:23:29,869][ INFO][PID:2690089] Checking that builder machine is OK [2025-12-27 01:23:30,178][ INFO][PID:2690089] Running remote command: copr-builder-ready epel-10-x86_64 [2025-12-27 01:23:30,380][ INFO][PID:2690089] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2025-12-27 01:23:30,381][ INFO][PID:2690089] Filling build.info file with builder info [2025-12-27 01:23:30,381][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:23:30,382][ INFO][PID:2690089] Sending build state back to frontend: { "builds": [ { "timeout": 172800, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "rezso", "project_name": "ML", "project_dirname": "ML", "submitter": "rezso", "ended_on": null, "started_on": 1766798610.3825207, "submitted_on": null, "status": 3, "chroot": "epel-10-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9952969-epel-10-x86_64", "build_id": 9952969, "package_name": "fbgemm", "package_version": "1.5.0-20251224.0.git0d921d96", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rezso/ML/fbgemm", "git_hash": "60c8082a42d7eb913a237e9a53e870acc2c04188", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rezso/ML--rezso", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rezso/ML/epel-10-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/rezso/CUDA/epel-10-x86_64/", "id": "copr_rezso_CUDA", "name": "Additional repo copr_rezso_CUDA" }, { "baseurl": "https://developer.download.nvidia.com/compute/cuda/repos/rhel9/x86_64", "id": "https_developer_download_nvidia_com_compute_cuda_repos_rhel9_x86_64", "name": "Additional repo https_developer_download_nvidia_com_compute_cuda_repos_rhel9_x86_64" }, { "baseurl": "https://developer.download.nvidia.com/compute/cuda/repos/rhel9/sbsa", "id": "https_developer_download_nvidia_com_compute_cuda_repos_rhel9_sbsa", "name": "Additional repo https_developer_download_nvidia_com_compute_cuda_repos_rhel9_sbsa" } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rezso/ML", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rezso/ML", "result_dir": "09952969-fbgemm", "built_packages": "", "id": 9952969, "mockchain_macros": { "copr_username": "rezso", "copr_projectname": "ML", "vendor": "Fedora Project COPR (rezso/ML)" } } ] } [2025-12-27 01:23:30,449][ INFO][PID:2690089] Sending fedora-messaging bus message in build.start [2025-12-27 01:23:31,086][ INFO][PID:2690089] Sending fedora-messaging bus message in chroot.start [2025-12-27 01:23:31,115][ INFO][PID:2690089] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9952969-epel-10-x86_64 --chroot epel-10-x86_64 --detached [2025-12-27 01:23:31,466][ INFO][PID:2690089] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '3.80.56.152' (ED25519) to the list of known hosts. [2025-12-27 01:23:31,467][ INFO][PID:2690089] Downloading the builder-live.log file, attempt 1 [2025-12-27 01:23:31,469][ INFO][PID:2690089] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.80.56.152 copr-rpmbuild-log [2025-12-27 01:23:36,473][ INFO][PID:2690089] Periodic builder liveness probe: alive [2025-12-27 01:23:36,473][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:23:41,474][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:23:46,475][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:23:51,477][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:23:56,478][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:24:01,479][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:24:06,480][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:24:11,481][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:24:16,482][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:24:21,483][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:24:26,484][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:24:31,545][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:24:36,615][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:24:41,637][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:24:46,756][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:24:51,757][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:24:56,758][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:25:01,759][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:25:06,760][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:25:11,761][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:25:16,932][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:25:21,937][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:25:26,943][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:25:31,944][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:25:36,991][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:25:42,001][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:25:47,004][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:25:52,007][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:25:57,009][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:26:02,011][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:26:07,012][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:26:12,013][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:26:17,014][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:26:22,016][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:26:27,019][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:26:32,020][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:26:37,035][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:26:42,249][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:26:47,252][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:26:52,256][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:26:57,259][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:27:02,261][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:27:07,262][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:27:12,263][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:27:17,266][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:27:22,267][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:27:27,272][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:27:32,273][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:27:37,274][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:27:42,275][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:27:47,278][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:27:52,279][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:27:57,280][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:28:02,280][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:28:07,281][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:28:12,283][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:28:17,284][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:28:22,285][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:28:27,286][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:28:32,287][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:28:37,289][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:28:42,290][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:28:47,336][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:28:52,392][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:28:57,393][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:29:02,394][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:29:07,395][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:29:12,396][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:29:17,397][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:29:22,399][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:29:27,725][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:29:32,726][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:29:37,728][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:29:42,729][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:29:47,731][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:29:52,732][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:29:57,733][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:30:02,734][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:30:07,735][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:30:12,736][ INFO][PID:2690089] Checking for cancel request [2025-12-27 01:30:13,876][ INFO][PID:2690089] Downloading results from builder [2025-12-27 01:30:13,877][ INFO][PID:2690089] rsyncing of mockbuilder@3.80.56.152:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/rezso/ML/epel-10-x86_64/09952969-fbgemm started [2025-12-27 01:30:13,878][ INFO][PID:2690089] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@3.80.56.152:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/rezso/ML/epel-10-x86_64/09952969-fbgemm/ &> /var/lib/copr/public_html/results/rezso/ML/epel-10-x86_64/09952969-fbgemm/build-09952969.rsync.log [2025-12-27 01:30:14,307][ INFO][PID:2690089] rsyncing finished. [2025-12-27 01:30:14,309][ INFO][PID:2690089] Releasing VM back to pool [2025-12-27 01:30:14,323][ INFO][PID:2690089] Searching for 'success' file in resultdir [2025-12-27 01:30:14,323][ INFO][PID:2690089] Going to sign pkgs from source: 9952969-epel-10-x86_64 in chroot: /var/lib/copr/public_html/results/rezso/ML/epel-10-x86_64 [2025-12-27 01:30:14,324][ INFO][PID:2690089] Calling '/bin/sign -u rezso#ML@copr.fedorahosted.org -p' (attempt #1) [2025-12-27 01:30:14,509][ INFO][PID:2690089] Calling '/bin/sign -4 -h sha256 -u rezso#ML@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rezso/ML/epel-10-x86_64/09952969-fbgemm/fbgemm-debugsource-1.5.0-20251224.0.git0d921d96.el10.x86_64.rpm' (attempt #1) [2025-12-27 01:30:15,139][ INFO][PID:2690089] signed rpm: /var/lib/copr/public_html/results/rezso/ML/epel-10-x86_64/09952969-fbgemm/fbgemm-debugsource-1.5.0-20251224.0.git0d921d96.el10.x86_64.rpm [2025-12-27 01:30:15,139][ INFO][PID:2690089] Calling '/bin/sign -4 -h sha256 -u rezso#ML@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rezso/ML/epel-10-x86_64/09952969-fbgemm/fbgemm-debuginfo-1.5.0-20251224.0.git0d921d96.el10.x86_64.rpm' (attempt #1) [2025-12-27 01:30:16,458][ INFO][PID:2690089] signed rpm: /var/lib/copr/public_html/results/rezso/ML/epel-10-x86_64/09952969-fbgemm/fbgemm-debuginfo-1.5.0-20251224.0.git0d921d96.el10.x86_64.rpm [2025-12-27 01:30:16,459][ INFO][PID:2690089] Calling '/bin/sign -4 -h sha256 -u rezso#ML@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rezso/ML/epel-10-x86_64/09952969-fbgemm/fbgemm-devel-1.5.0-20251224.0.git0d921d96.el10.x86_64.rpm' (attempt #1) [2025-12-27 01:30:17,012][ INFO][PID:2690089] signed rpm: /var/lib/copr/public_html/results/rezso/ML/epel-10-x86_64/09952969-fbgemm/fbgemm-devel-1.5.0-20251224.0.git0d921d96.el10.x86_64.rpm [2025-12-27 01:30:17,013][ INFO][PID:2690089] Calling '/bin/sign -4 -h sha256 -u rezso#ML@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rezso/ML/epel-10-x86_64/09952969-fbgemm/fbgemm-1.5.0-20251224.0.git0d921d96.el10.x86_64.rpm' (attempt #1) [2025-12-27 01:30:17,617][ INFO][PID:2690089] signed rpm: /var/lib/copr/public_html/results/rezso/ML/epel-10-x86_64/09952969-fbgemm/fbgemm-1.5.0-20251224.0.git0d921d96.el10.x86_64.rpm [2025-12-27 01:30:17,618][ INFO][PID:2690089] Calling '/bin/sign -4 -h sha256 -u rezso#ML@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rezso/ML/epel-10-x86_64/09952969-fbgemm/fbgemm-1.5.0-20251224.0.git0d921d96.el10.src.rpm' (attempt #1) [2025-12-27 01:30:18,266][ INFO][PID:2690089] signed rpm: /var/lib/copr/public_html/results/rezso/ML/epel-10-x86_64/09952969-fbgemm/fbgemm-1.5.0-20251224.0.git0d921d96.el10.src.rpm [2025-12-27 01:30:18,267][ INFO][PID:2690089] Sign done [2025-12-27 01:30:18,268][ INFO][PID:2690089] Incremental createrepo run, adding 09952969-fbgemm into https://download.copr.fedorainfracloud.org/results/rezso/ML/epel-10-x86_64, (auto-create-repo=True) [2025-12-27 01:30:18,269][ INFO][PID:2690089] Running command 'copr-repo --batched /var/lib/copr/public_html/results/rezso/ML/epel-10-x86_64 --add 09952969-fbgemm --no-appstream-metadata' as PID 2728648 [2025-12-27 01:30:19,307][ INFO][PID:2690089] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/rezso/ML/epel-10-x86_64 --add 09952969-fbgemm --no-appstream-metadata) [2025-12-27 01:30:19,308][ INFO][PID:2690089] Getting build details [2025-12-27 01:30:19,309][ INFO][PID:2690089] Listing built binary packages in /var/lib/copr/public_html/results/rezso/ML/epel-10-x86_64/09952969-fbgemm [2025-12-27 01:30:19,310][ INFO][PID:2690089] Built packages: ['fbgemm-devel 1.5.0', 'fbgemm-debuginfo 1.5.0', 'fbgemm 1.5.0', 'fbgemm-debugsource 1.5.0'] [2025-12-27 01:30:19,310][ INFO][PID:2690089] build details: {'built_packages': 'fbgemm-devel 1.5.0\nfbgemm-debuginfo 1.5.0\nfbgemm 1.5.0\nfbgemm-debugsource 1.5.0'} [2025-12-27 01:30:19,311][ INFO][PID:2690089] Retrieving pubkey [2025-12-27 01:30:19,311][ INFO][PID:2690089] Calling '/bin/sign -u rezso#ML@copr.fedorahosted.org -p' (attempt #1) [2025-12-27 01:30:19,515][ INFO][PID:2690089] Added pubkey for user rezso project ML into: /var/lib/copr/public_html/results/rezso/ML/pubkey.gpg [2025-12-27 01:30:19,516][ INFO][PID:2690089] Finished build: id=9952969 failed=False timeout=172800 destdir=/var/lib/copr/public_html/results/rezso/ML chroot=epel-10-x86_64 [2025-12-27 01:30:19,518][ INFO][PID:2690089] Worker succeeded build, took 409.1358153820038 [2025-12-27 01:30:19,519][ INFO][PID:2690089] Sending build state back to frontend: { "builds": [ { "timeout": 172800, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "rezso", "project_name": "ML", "project_dirname": "ML", "submitter": "rezso", "ended_on": 1766799019.518336, "started_on": 1766798610.3825207, "submitted_on": null, "status": 1, "chroot": "epel-10-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9952969-epel-10-x86_64", "build_id": 9952969, "package_name": "fbgemm", "package_version": "1.5.0-20251224.0.git0d921d96", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rezso/ML/fbgemm", "git_hash": "60c8082a42d7eb913a237e9a53e870acc2c04188", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rezso/ML--rezso", "results": { "packages": [ { "name": "fbgemm-devel", "epoch": null, "version": "1.5.0", "release": "20251224.0.git0d921d96.el10", "arch": "x86_64" }, { "name": "fbgemm", "epoch": null, "version": "1.5.0", "release": "20251224.0.git0d921d96.el10", "arch": "src" }, { "name": "fbgemm-debuginfo", "epoch": null, "version": "1.5.0", "release": "20251224.0.git0d921d96.el10", "arch": "x86_64" }, { "name": "fbgemm", "epoch": null, "version": "1.5.0", "release": "20251224.0.git0d921d96.el10", "arch": "x86_64" }, { "name": "fbgemm-debugsource", "epoch": null, "version": "1.5.0", "release": "20251224.0.git0d921d96.el10", "arch": "x86_64" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rezso/ML/epel-10-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/rezso/CUDA/epel-10-x86_64/", "id": "copr_rezso_CUDA", "name": "Additional repo copr_rezso_CUDA" }, { "baseurl": "https://developer.download.nvidia.com/compute/cuda/repos/rhel9/x86_64", "id": "https_developer_download_nvidia_com_compute_cuda_repos_rhel9_x86_64", "name": "Additional repo https_developer_download_nvidia_com_compute_cuda_repos_rhel9_x86_64" }, { "baseurl": "https://developer.download.nvidia.com/compute/cuda/repos/rhel9/sbsa", "id": "https_developer_download_nvidia_com_compute_cuda_repos_rhel9_sbsa", "name": "Additional repo https_developer_download_nvidia_com_compute_cuda_repos_rhel9_sbsa" } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rezso/ML", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rezso/ML", "result_dir": "09952969-fbgemm", "built_packages": "fbgemm-devel 1.5.0\nfbgemm-debuginfo 1.5.0\nfbgemm 1.5.0\nfbgemm-debugsource 1.5.0", "id": 9952969, "mockchain_macros": { "copr_username": "rezso", "copr_projectname": "ML", "vendor": "Fedora Project COPR (rezso/ML)" } } ] } [2025-12-27 01:30:19,580][ INFO][PID:2690089] Sending fedora-messaging bus message in build.end [2025-12-27 01:30:19,609][ INFO][PID:2690089] Compressing /var/lib/copr/public_html/results/rezso/ML/epel-10-x86_64/09952969-fbgemm/builder-live.log by gzip [2025-12-27 01:30:19,610][ INFO][PID:2690089] Running command 'gzip /var/lib/copr/public_html/results/rezso/ML/epel-10-x86_64/09952969-fbgemm/builder-live.log' as PID 2728810 [2025-12-27 01:30:19,622][ INFO][PID:2690089] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rezso/ML/epel-10-x86_64/09952969-fbgemm/builder-live.log) [2025-12-27 01:30:19,623][ INFO][PID:2690089] Compressing /var/lib/copr/public_html/results/rezso/ML/epel-10-x86_64/09952969-fbgemm/backend.log by gzip [2025-12-27 01:30:19,623][ INFO][PID:2690089] Running command 'gzip /var/lib/copr/public_html/results/rezso/ML/epel-10-x86_64/09952969-fbgemm/backend.log' as PID 2728812