tgl tgl

Intel Core i7-1185G7 testing with a Dell XPS 13 9310 0DXP1F (3.7.0 BIOS) and Intel Xe TGL GT2 15GB on Ubuntu 23.10 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2402202-NE-TGLTGL07808&grr&sor.

Llama.cpp

Model: llama-2-70b-chat.Q5_0.gguf

Llamafile

Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU

Intel Open Image Denoise

Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

NAMD

Input: STMV with 1,066,628 Atoms

Llamafile

Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU

Intel Open Image Denoise

Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only

Intel Open Image Denoise

Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only

Llama.cpp

Model: llama-2-13b.Q4_0.gguf

VkFFT

Test: FFT + iFFT C2C 1D batched in single precision

CacheBench

Test: Read / Modify / Write

CacheBench

Test: Write

CacheBench

Test: Read

VkFFT

Test: FFT + iFFT C2C 1D batched in single precision, no reshuffling

NAMD

Input: ATPase with 327,506 Atoms

Llamafile

Test: llava-v1.5-7b-q4 - Acceleration: CPU

Llama.cpp

Model: llama-2-7b.Q4_0.gguf

VkFFT

Test: FFT + iFFT C2C 1D batched in half precision

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Standard

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Standard

ONNX Runtime

Model: GPT-2 - Device: CPU - Executor: Parallel

ONNX Runtime

Model: GPT-2 - Device: CPU - Executor: Parallel

ONNX Runtime

Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard

ONNX Runtime

Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard

ONNX Runtime

Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel

ONNX Runtime

Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel

ONNX Runtime

Model: yolov4 - Device: CPU - Executor: Parallel

ONNX Runtime

Model: yolov4 - Device: CPU - Executor: Parallel

ONNX Runtime

Model: GPT-2 - Device: CPU - Executor: Standard

ONNX Runtime

Model: GPT-2 - Device: CPU - Executor: Standard

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Parallel

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Parallel

ONNX Runtime

Model: T5 Encoder - Device: CPU - Executor: Parallel

ONNX Runtime

Model: T5 Encoder - Device: CPU - Executor: Parallel

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Standard

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Standard

ONNX Runtime

Model: yolov4 - Device: CPU - Executor: Standard

ONNX Runtime

Model: yolov4 - Device: CPU - Executor: Standard

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard

ONNX Runtime

Model: T5 Encoder - Device: CPU - Executor: Standard

ONNX Runtime

Model: T5 Encoder - Device: CPU - Executor: Standard

ONNX Runtime

Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel

ONNX Runtime

Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel

ONNX Runtime

Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel

ONNX Runtime

Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel

ONNX Runtime

Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard

ONNX Runtime

Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard

ONNX Runtime

Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard

ONNX Runtime

Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Parallel

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Parallel

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Standard

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Standard

VkFFT

Test: FFT + iFFT C2C Bluestein in single precision

Libplacebo

Test: gaussian

Libplacebo

Test: av1_grain_lap

Libplacebo

Test: hdr_lut

Libplacebo

Test: hdr_peakdetect

Libplacebo

Test: polar_nocompute

Libplacebo

Test: deband_heavy

dav1d

Video Input: Summer Nature 4K

VkFFT

Test: FFT + iFFT C2C multidimensional in single precision

dav1d

Video Input: Chimera 1080p 10-bit

dav1d

Video Input: Chimera 1080p

LZ4 Compression

Compression Level: 3 - Decompression Speed

LZ4 Compression

Compression Level: 3 - Compression Speed

LZ4 Compression

Compression Level: 1 - Decompression Speed

LZ4 Compression

Compression Level: 1 - Compression Speed

LZ4 Compression

Compression Level: 9 - Decompression Speed

LZ4 Compression

Compression Level: 9 - Compression Speed

VkFFT

Test: FFT + iFFT R2C / C2R

dav1d

Video Input: Summer Nature 1080p

Phoronix Test Suite v10.8.5