[2026-02-20 13:35:24,373][ INFO][PID:249866] Marking build as starting [2026-02-20 13:35:24,417][ INFO][PID:249866] Checking that /var/lib/copr/public_html/results/@vespa/vespa/epel-8-x86_64/repodata/repomd.xml exists [2026-02-20 13:35:24,418][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:35:24,419][ INFO][PID:249866] VM allocation process starts [2026-02-20 13:35:24,431][ INFO][PID:249866] Trying to allocate VM: ResallocHost, ticket_id=1535648, requested_tags=['copr_builder', 'arch_x86_64'] [2026-02-20 13:35:29,433][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:35:30,485][ INFO][PID:249866] Allocated host ResallocHost, ticket_id=1535648, hostname=18.209.159.191, name=aws_x86_64_normalreserved_prod_02489476_20260220_132047, requested_tags=['copr_builder', 'arch_x86_64'] [2026-02-20 13:35:30,487][ INFO][PID:249866] Allocating ssh connection to builder [2026-02-20 13:35:30,489][ INFO][PID:249866] Checking that builder machine is OK [2026-02-20 13:35:30,836][ INFO][PID:249866] Running remote command: copr-builder-ready epel-8-x86_64 [2026-02-20 13:35:31,086][ INFO][PID:249866] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2026-02-20 13:35:31,087][ INFO][PID:249866] Filling build.info file with builder info [2026-02-20 13:35:31,143][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:35:31,144][ INFO][PID:249866] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "@vespa", "project_name": "vespa", "project_dirname": "vespa", "submitter": "https://api.github.com/users/ean", "ended_on": null, "started_on": 1771594531.1444392, "submitted_on": null, "status": 3, "chroot": "epel-8-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10154787-epel-8-x86_64", "build_id": 10154787, "package_name": "vespa-ann-benchmark", "package_version": "8.646.22-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@vespa/vespa/vespa-ann-benchmark", "git_hash": "14df43fe195cf9f3e49c4745118f2c23625d55f8", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@vespa/vespa--https://api.github.com/users/ean", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@vespa/vespa/epel-8-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://copr-be.cloud.fedoraproject.org/results/@vespa/vespa/epel-8-$basearch/", "id": "https_copr_be_cloud_fedoraproject_org_results_vespa_vespa_epel_8_basearch", "name": "Additional repo https_copr_be_cloud_fedoraproject_org_results_vespa_vespa_epel_8_basearch" }, { "baseurl": "http://download.fedoraproject.org/pub/epel/8/Everything/$basearch", "id": "http_download_fedoraproject_org_pub_epel_8_Everything_basearch", "name": "Additional repo http_download_fedoraproject_org_pub_epel_8_Everything_basearch" }, { "baseurl": "https://developer.download.nvidia.com/compute/cuda/repos/rhel8/x86_64", "id": "https_developer_download_nvidia_com_compute_cuda_repos_rhel8_x86_64", "name": "Additional repo https_developer_download_nvidia_com_compute_cuda_repos_rhel8_x86_64" }, { "baseurl": "https://dl.cloudsmith.io/public/vespa/open-source-rpms/rpm/el/8/$basearch", "id": "https_dl_cloudsmith_io_public_vespa_open_source_rpms_rpm_el_8_basearch", "name": "Additional repo https_dl_cloudsmith_io_public_vespa_open_source_rpms_rpm_el_8_basearch" } ], "background": true, "bootstrap": "off", "fedora_review": false, "isolation": "default", "modules": { "toggle": [ { "enable": "maven:3.8" } ] }, "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@vespa/vespa", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@vespa/vespa", "result_dir": "10154787-vespa-ann-benchmark", "built_packages": "", "id": 10154787, "mockchain_macros": { "copr_username": "@vespa", "copr_projectname": "vespa", "vendor": "Fedora Project COPR (@vespa/vespa)" } } ] } [2026-02-20 13:35:31,196][ INFO][PID:249866] Sending fedora-messaging bus message in build.start [2026-02-20 13:35:31,691][ INFO][PID:249866] Sending fedora-messaging bus message in chroot.start [2026-02-20 13:35:31,715][ INFO][PID:249866] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10154787-epel-8-x86_64 --chroot epel-8-x86_64 --detached [2026-02-20 13:35:32,065][ INFO][PID:249866] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '18.209.159.191' (ED25519) to the list of known hosts. [2026-02-20 13:35:32,066][ INFO][PID:249866] Downloading the builder-live.log file, attempt 1 [2026-02-20 13:35:32,067][ INFO][PID:249866] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@18.209.159.191 copr-rpmbuild-log [2026-02-20 13:35:37,071][ INFO][PID:249866] Periodic builder liveness probe: alive [2026-02-20 13:35:37,485][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:35:42,486][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:35:47,487][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:35:52,488][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:35:57,489][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:36:02,490][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:36:07,492][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:36:12,493][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:36:17,494][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:36:22,497][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:36:27,498][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:36:32,499][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:36:37,500][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:36:42,823][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:36:47,824][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:36:52,825][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:36:57,826][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:37:03,011][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:37:08,237][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:37:16,222][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:37:21,223][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:37:27,054][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:37:36,630][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:37:43,086][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:37:51,206][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:37:57,038][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:38:13,686][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:38:18,688][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:38:24,726][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:38:29,737][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:38:34,739][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:38:39,740][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:38:44,741][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:38:49,742][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:38:55,158][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:39:00,159][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:39:05,367][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:39:10,368][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:39:15,369][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:39:20,413][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:39:25,414][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:39:30,432][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:39:35,434][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:39:40,516][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:39:45,584][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:39:50,586][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:39:55,587][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:40:05,008][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:40:11,166][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:40:17,622][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:40:22,624][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:40:27,625][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:40:32,627][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:40:37,636][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:40:42,711][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:40:47,817][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:40:52,970][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:40:58,021][ INFO][PID:249866] Checking for cancel request [2026-02-20 13:41:00,592][ INFO][PID:249866] Downloading results from builder [2026-02-20 13:41:00,592][ INFO][PID:249866] rsyncing of mockbuilder@18.209.159.191:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@vespa/vespa/epel-8-x86_64/10154787-vespa-ann-benchmark started [2026-02-20 13:41:00,593][ INFO][PID:249866] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@18.209.159.191:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@vespa/vespa/epel-8-x86_64/10154787-vespa-ann-benchmark/ &> /var/lib/copr/public_html/results/@vespa/vespa/epel-8-x86_64/10154787-vespa-ann-benchmark/build-10154787.rsync.log [2026-02-20 13:41:04,041][ INFO][PID:249866] rsyncing finished. [2026-02-20 13:41:04,042][ INFO][PID:249866] Releasing VM back to pool [2026-02-20 13:41:04,054][ INFO][PID:249866] Searching for 'success' file in resultdir [2026-02-20 13:41:04,055][ INFO][PID:249866] Going to sign pkgs from source: 10154787-epel-8-x86_64 in chroot: /var/lib/copr/public_html/results/@vespa/vespa/epel-8-x86_64 [2026-02-20 13:41:04,056][ INFO][PID:249866] Calling '/bin/sign -u @vespa#vespa@copr.fedorahosted.org -p' (attempt #1) [2026-02-20 13:41:04,330][ INFO][PID:249866] Calling '/bin/sign -4 -h sha256 -u @vespa#vespa@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@vespa/vespa/epel-8-x86_64/10154787-vespa-ann-benchmark/vespa-ann-benchmark-8.646.22-1.el8.src.rpm' (attempt #1) [2026-02-20 13:41:05,153][ INFO][PID:249866] signed rpm: /var/lib/copr/public_html/results/@vespa/vespa/epel-8-x86_64/10154787-vespa-ann-benchmark/vespa-ann-benchmark-8.646.22-1.el8.src.rpm [2026-02-20 13:41:05,154][ INFO][PID:249866] Calling '/bin/sign -4 -h sha256 -u @vespa#vespa@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@vespa/vespa/epel-8-x86_64/10154787-vespa-ann-benchmark/vespa-ann-benchmark-8.646.22-1.el8.x86_64.rpm' (attempt #1) [2026-02-20 13:41:16,191][ INFO][PID:249866] signed rpm: /var/lib/copr/public_html/results/@vespa/vespa/epel-8-x86_64/10154787-vespa-ann-benchmark/vespa-ann-benchmark-8.646.22-1.el8.x86_64.rpm [2026-02-20 13:41:16,192][ INFO][PID:249866] Calling '/bin/sign -4 -h sha256 -u @vespa#vespa@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@vespa/vespa/epel-8-x86_64/10154787-vespa-ann-benchmark/vespa-ann-benchmark-debugsource-8.646.22-1.el8.x86_64.rpm' (attempt #1) [2026-02-20 13:41:16,800][ INFO][PID:249866] signed rpm: /var/lib/copr/public_html/results/@vespa/vespa/epel-8-x86_64/10154787-vespa-ann-benchmark/vespa-ann-benchmark-debugsource-8.646.22-1.el8.x86_64.rpm [2026-02-20 13:41:16,805][ INFO][PID:249866] Calling '/bin/sign -4 -h sha256 -u @vespa#vespa@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@vespa/vespa/epel-8-x86_64/10154787-vespa-ann-benchmark/vespa-ann-benchmark-debuginfo-8.646.22-1.el8.x86_64.rpm' (attempt #1) [2026-02-20 13:42:44,835][ INFO][PID:249866] signed rpm: /var/lib/copr/public_html/results/@vespa/vespa/epel-8-x86_64/10154787-vespa-ann-benchmark/vespa-ann-benchmark-debuginfo-8.646.22-1.el8.x86_64.rpm [2026-02-20 13:42:44,953][ INFO][PID:249866] Sign done [2026-02-20 13:42:45,158][ INFO][PID:249866] Incremental createrepo run, adding 10154787-vespa-ann-benchmark into https://download.copr.fedorainfracloud.org/results/@vespa/vespa/epel-8-x86_64, (auto-create-repo=True) [2026-02-20 13:42:45,161][ INFO][PID:249866] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@vespa/vespa/epel-8-x86_64 --add 10154787-vespa-ann-benchmark --no-appstream-metadata' as PID 288460 [2026-02-20 13:42:54,429][ INFO][PID:249866] Finished after 9 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@vespa/vespa/epel-8-x86_64 --add 10154787-vespa-ann-benchmark --no-appstream-metadata) [2026-02-20 13:42:54,437][ INFO][PID:249866] Getting build details [2026-02-20 13:42:54,439][ INFO][PID:249866] Listing built binary packages in /var/lib/copr/public_html/results/@vespa/vespa/epel-8-x86_64/10154787-vespa-ann-benchmark [2026-02-20 13:42:54,441][ INFO][PID:249866] Built packages: ['vespa-ann-benchmark-debugsource 8.646.22', 'vespa-ann-benchmark-debuginfo 8.646.22', 'vespa-ann-benchmark 8.646.22'] [2026-02-20 13:42:54,443][ INFO][PID:249866] build details: {'built_packages': 'vespa-ann-benchmark-debugsource 8.646.22\nvespa-ann-benchmark-debuginfo 8.646.22\nvespa-ann-benchmark 8.646.22'} [2026-02-20 13:42:54,445][ INFO][PID:249866] Retrieving pubkey [2026-02-20 13:42:54,447][ INFO][PID:249866] Calling '/bin/sign -u @vespa#vespa@copr.fedorahosted.org -p' (attempt #1) [2026-02-20 13:42:54,776][ INFO][PID:249866] Added pubkey for user @vespa project vespa into: /var/lib/copr/public_html/results/@vespa/vespa/pubkey.gpg [2026-02-20 13:42:54,982][ INFO][PID:249866] Finished build: id=10154787 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@vespa/vespa chroot=epel-8-x86_64 [2026-02-20 13:42:54,985][ INFO][PID:249866] Worker succeeded build, took 443.8413472175598 [2026-02-20 13:42:54,986][ INFO][PID:249866] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "@vespa", "project_name": "vespa", "project_dirname": "vespa", "submitter": "https://api.github.com/users/ean", "ended_on": 1771594974.9857864, "started_on": 1771594531.1444392, "submitted_on": null, "status": 1, "chroot": "epel-8-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10154787-epel-8-x86_64", "build_id": 10154787, "package_name": "vespa-ann-benchmark", "package_version": "8.646.22-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@vespa/vespa/vespa-ann-benchmark", "git_hash": "14df43fe195cf9f3e49c4745118f2c23625d55f8", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@vespa/vespa--https://api.github.com/users/ean", "results": { "packages": [ { "name": "vespa-ann-benchmark-debugsource", "epoch": null, "version": "8.646.22", "release": "1.el8", "arch": "x86_64" }, { "name": "vespa-ann-benchmark-debuginfo", "epoch": null, "version": "8.646.22", "release": "1.el8", "arch": "x86_64" }, { "name": "vespa-ann-benchmark", "epoch": null, "version": "8.646.22", "release": "1.el8", "arch": "src" }, { "name": "vespa-ann-benchmark", "epoch": null, "version": "8.646.22", "release": "1.el8", "arch": "x86_64" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@vespa/vespa/epel-8-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://copr-be.cloud.fedoraproject.org/results/@vespa/vespa/epel-8-$basearch/", "id": "https_copr_be_cloud_fedoraproject_org_results_vespa_vespa_epel_8_basearch", "name": "Additional repo https_copr_be_cloud_fedoraproject_org_results_vespa_vespa_epel_8_basearch" }, { "baseurl": "http://download.fedoraproject.org/pub/epel/8/Everything/$basearch", "id": "http_download_fedoraproject_org_pub_epel_8_Everything_basearch", "name": "Additional repo http_download_fedoraproject_org_pub_epel_8_Everything_basearch" }, { "baseurl": "https://developer.download.nvidia.com/compute/cuda/repos/rhel8/x86_64", "id": "https_developer_download_nvidia_com_compute_cuda_repos_rhel8_x86_64", "name": "Additional repo https_developer_download_nvidia_com_compute_cuda_repos_rhel8_x86_64" }, { "baseurl": "https://dl.cloudsmith.io/public/vespa/open-source-rpms/rpm/el/8/$basearch", "id": "https_dl_cloudsmith_io_public_vespa_open_source_rpms_rpm_el_8_basearch", "name": "Additional repo https_dl_cloudsmith_io_public_vespa_open_source_rpms_rpm_el_8_basearch" } ], "background": true, "bootstrap": "off", "fedora_review": false, "isolation": "default", "modules": { "toggle": [ { "enable": "maven:3.8" } ] }, "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@vespa/vespa", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@vespa/vespa", "result_dir": "10154787-vespa-ann-benchmark", "built_packages": "vespa-ann-benchmark-debugsource 8.646.22\nvespa-ann-benchmark-debuginfo 8.646.22\nvespa-ann-benchmark 8.646.22", "id": 10154787, "mockchain_macros": { "copr_username": "@vespa", "copr_projectname": "vespa", "vendor": "Fedora Project COPR (@vespa/vespa)" } } ] } [2026-02-20 13:42:55,246][ INFO][PID:249866] Sending fedora-messaging bus message in build.end [2026-02-20 13:42:55,541][ INFO][PID:249866] Compressing /var/lib/copr/public_html/results/@vespa/vespa/epel-8-x86_64/10154787-vespa-ann-benchmark/builder-live.log by gzip [2026-02-20 13:42:55,547][ INFO][PID:249866] Running command 'gzip /var/lib/copr/public_html/results/@vespa/vespa/epel-8-x86_64/10154787-vespa-ann-benchmark/builder-live.log' as PID 290228 [2026-02-20 13:42:55,619][ INFO][PID:249866] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@vespa/vespa/epel-8-x86_64/10154787-vespa-ann-benchmark/builder-live.log) [2026-02-20 13:42:55,620][ INFO][PID:249866] Compressing /var/lib/copr/public_html/results/@vespa/vespa/epel-8-x86_64/10154787-vespa-ann-benchmark/backend.log by gzip [2026-02-20 13:42:55,631][ INFO][PID:249866] Running command 'gzip /var/lib/copr/public_html/results/@vespa/vespa/epel-8-x86_64/10154787-vespa-ann-benchmark/backend.log' as PID 290234