ai tigerlake

Intel Core i7-1185G7 testing with a Dell XPS 13 9310 0DXP1F (3.7.0 BIOS) and Intel Xe TGL GT2 15GB on Ubuntu 23.10 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2406026-NE-AITIGERLA50&gru.

Llama.cpp

Model: Meta-Llama-3-8B-Instruct-Q8_0.gguf

Llamafile

Test: mistral-7b-instruct-v0.2.Q5_K_M - Acceleration: CPU

Whisper.cpp

Model: ggml-base.en - Input: 2016 State of the Union

Whisper.cpp

Model: ggml-small.en - Input: 2016 State of the Union

Phoronix Test Suite v10.8.5