Most Efficient Large Language Models for AI PC
==============================================

This page is regularly updated to help you identify the best-performing LLMs on the
Intel® Core™ Ultra processor family and AI PCs.
The current data is as of OpenVINO 2025.3, 3 September 2025.

The tables below list the key performance indicators for inference on built-in GPUs.



.. tab-set::

   .. tab-item:: 7-255H

      .. data-table::
         :class: modeldata stripe
         :name: supportedModelsTable_V1
         :header-rows: 1
         :file:  ../../_static/benchmarks_files/llm_models_7-255H.csv
         :data-column-hidden: [3,4,6]
         :data-order: [[ 0, "asc" ]]
         :data-page-length: 10

   .. tab-item:: 7-258V

      .. data-table::
         :class: modeldata stripe
         :name: supportedModelsTable_V2
         :header-rows: 1
         :file:  ../../_static/benchmarks_files/llm_models_7-258V.csv
         :data-column-hidden: [3,4,6]
         :data-order: [[ 0, "asc" ]]

   .. tab-item:: 7-165H

      .. data-table::
         :class: modeldata stripe
         :name: supportedModelsTable_V3
         :header-rows: 1
         :file:  ../../_static/benchmarks_files/llm_models_7-165H.csv
         :data-column-hidden: [3,4,6]
         :data-order: [[ 0, "asc" ]]


.. grid:: 1 1 2 2
   :gutter: 4

   .. grid-item::

      All models listed here were tested with the following parameters:

      *  Framework: PyTorch
      *  Beam: 1
      *  Batch size: 1

   
   .. grid-item::

      .. button-link:: https://docs.openvino.ai/2025/_static/download/benchmark_genai_platform_list.pdf
         :color: primary
         :outline:
         :expand:

         :material-regular:`download;1.5em` Get system descriptions [PDF]

      .. button-link:: ../../_static/benchmarks_files/llm_models_7-258V.csv 
         :color: primary
         :outline:
         :expand:

         :material-regular:`download;1.5em` Get the 7-258V table [CSV]
      
      .. button-link:: ../../_static/benchmarks_files/llm_models_7-255H.csv 
         :color: primary
         :outline:
         :expand:

         :material-regular:`download;1.5em` Get the 7-255H table [CSV]

      .. button-link:: ../../_static/benchmarks_files/llm_models_7-165H.csv 
         :color: primary
         :outline:
         :expand:

         :material-regular:`download;1.5em` Get the 7-165H table [CSV]

