AMD EPYC 4th Gen AVX-512 Comparison

AMD EPYC 9654 Genoa AVX-512 benchmark comparison by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2212195-NE-AVXCOMPAR69&grw&sro.

SMHasher

Hash: FarmHash32 x86_64 AVX

JPEG XL libjxl

Input: JPEG - Quality: 90

JPEG XL libjxl

Input: JPEG - Quality: 100

JPEG XL libjxl

Input: PNG - Quality: 90

Darmstadt Automotive Parallel Heterogeneous Suite

Backend: OpenMP - Kernel: NDT Mapping

Darmstadt Automotive Parallel Heterogeneous Suite

Backend: OpenMP - Kernel: Points2Image

miniBUDE

Implementation: OpenMP - Input Deck: BM1

miniBUDE

Implementation: OpenMP - Input Deck: BM1

miniBUDE

Implementation: OpenMP - Input Deck: BM2

miniBUDE

Implementation: OpenMP - Input Deck: BM2

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

TensorFlow

Device: CPU - Batch Size: 16 - Model: AlexNet

TensorFlow

Device: CPU - Batch Size: 16 - Model: GoogLeNet

LeelaChessZero

Backend: BLAS

LeelaChessZero

Backend: Eigen

Numenta Anomaly Benchmark

Detector: Bayesian Changepoint

Numenta Anomaly Benchmark

Detector: Windowed Gaussian

Numenta Anomaly Benchmark

Detector: Relative Entropy

Numpy Benchmark

AI Benchmark Alpha

Device Inference Score

AI Benchmark Alpha

Device Training Score

AI Benchmark Alpha

Device AI Score

Mobile Neural Network

Model: resnet-v2-50

Mobile Neural Network

Model: SqueezeNetV1.0

Mobile Neural Network

Model: inception-v3

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Standard

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Standard

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Standard

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard

NCNN

Target: CPU - Model: mnasnet

NCNN

Target: CPU - Model: efficientnet-b0

NCNN

Target: CPU - Model: blazeface

NCNN

Target: CPU - Model: googlenet

NCNN

Target: CPU - Model: resnet50

NCNN

Target: CPU - Model: regnety_400m

NCNN

Target: CPU - Model: vision_transformer

NCNN

Target: CPU - Model: FastestDet

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU

oneDNN

Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU

oneDNN

Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Mesh Time

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Execution Time

CP2K Molecular Dynamics

Input: Fayalite-FIST

Cpuminer-Opt

Algorithm: scrypt

Cpuminer-Opt

Algorithm: Quad SHA-256, Pyrite

Cpuminer-Opt

Algorithm: x25x

Cpuminer-Opt

Algorithm: Garlicoin

Cpuminer-Opt

Algorithm: Skeincoin

Cpuminer-Opt

Algorithm: LBC, LBRY Credits

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon Obj

Embree

Binary: Pathtracer ISPC - Model: Crown

Intel Open Image Denoise

Run: RT.hdr_alb_nrm.3840x2160

Intel Open Image Denoise

Run: RT.ldr_alb_nrm.3840x2160

Intel Open Image Denoise

Run: RTLightmap.hdr.4096x4096

OpenVKL

Benchmark: vklBenchmark ISPC

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

simdjson

Throughput Test: PartialTweets

simdjson

Throughput Test: LargeRandom

simdjson

Throughput Test: Kostya

simdjson

Throughput Test: DistinctUserID

simdjson

Throughput Test: TopTweet

AI Benchmark Alpha

Device AI Score

AI Benchmark Alpha

CPU Peak Freq (Highest CPU Core Frequency) Monitor

AI Benchmark Alpha

CPU Power Consumption Monitor

AI Benchmark Alpha

CPU Temperature Monitor

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Neural Magic DeepSparse

CPU Power Consumption Monitor

Neural Magic DeepSparse

CPU Temperature Monitor

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Neural Magic DeepSparse

CPU Power Consumption Monitor

Neural Magic DeepSparse

CPU Temperature Monitor

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Neural Magic DeepSparse

CPU Power Consumption Monitor

Neural Magic DeepSparse

CPU Temperature Monitor