AMD EPYC 4th Gen AVX-512 Comparison

AMD EPYC 9654 Genoa AVX-512 benchmark comparison by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2212195-NE-AVXCOMPAR69&sro&gru.

AMD EPYC 4th Gen AVX-512 ComparisonProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerVulkanCompilerFile-SystemScreen ResolutionAVX-512 OnAVX-512 Off2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads)AMD Titanite_4G (RTI1002E BIOS)AMD Device 14a41520GB800GB INTEL SSDPF21Q800GBASPEEDVGA HDMIBroadcom NetXtreme BCM5720 PCIeUbuntu 22.106.1.0-phx (x86_64)GNOME Shell 43.0X Server 1.21.1.41.3.224GCC 12.2.0 + Clang 15.0.2-1ext41920x1080OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseEnvironment Details- AVX-512 On: CXXFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512" CFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512" - AVX-512 Off: CXXFLAGS="-O3 -march=native -mno-avx512f" CFLAGS="-O3 -march=native -mno-avx512f" Compiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa10110d Python Details- Python 3.10.7Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

AMD EPYC 4th Gen AVX-512 Comparisonminibude: OpenMP - BM1minibude: OpenMP - BM2openvino: Face Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUembree: Pathtracer ISPC - Asian Dragon Objembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Crownsvt-av1: Preset 13 - Bosphorus 4Ksvt-av1: Preset 12 - Bosphorus 4Ksimdjson: PartialTweetssimdjson: LargeRandsimdjson: Kostyasimdjson: DistinctUserIDsimdjson: TopTweetminibude: OpenMP - BM1minibude: OpenMP - BM2oidn: RT.hdr_alb_nrm.3840x2160oidn: RT.ldr_alb_nrm.3840x2160oidn: RTLightmap.hdr.4096x4096tensorflow: CPU - 16 - ResNet-50tensorflow: CPU - 16 - AlexNettensorflow: CPU - 16 - GoogLeNetonnx: fcn-resnet101-11 - CPU - Standardonnx: super-resolution-10 - CPU - Standardonnx: bertsquad-12 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Standardopenvkl: vklBenchmark ISPCospray: gravity_spheres_volume/dim_512/ao/real_timeospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: gravity_spheres_volume/dim_512/pathtracer/real_timedeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamcpuminer-opt: scryptcpuminer-opt: Quad SHA-256, Pyritecpuminer-opt: x25xcpuminer-opt: Garlicoincpuminer-opt: Skeincoincpuminer-opt: LBC, LBRY Creditssmhasher: FarmHash32 x86_64 AVXjpegxl: JPEG - 90jpegxl: JPEG - 100jpegxl: PNG - 90lczero: BLASlczero: Eigengromacs: MPI CPU - water_GMX50_bareai-benchmark: Device Inference Scoreai-benchmark: Device Training Scoreai-benchmark: Device AI Scorenumpy: daphne: OpenMP - NDT Mappingdaphne: OpenMP - Points2Imagesmhasher: FarmHash32 x86_64 AVXospray-studio: 1 - 1080p - 1 - Path Tracerospray-studio: 1 - 1080p - 16 - Path Tracerospray-studio: 1 - 1080p - 32 - Path Tracerospray-studio: 1 - 4K - 1 - Path Tracerospray-studio: 1 - 4K - 16 - Path Tracerospray-studio: 1 - 4K - 32 - Path Tracerospray-studio: 2 - 1080p - 1 - Path Tracerospray-studio: 2 - 1080p - 16 - Path Tracerospray-studio: 2 - 1080p - 32 - Path Tracerospray-studio: 2 - 4K - 1 - Path Tracerospray-studio: 2 - 4K - 16 - Path Tracerospray-studio: 2 - 4K - 32 - Path Tracerospray-studio: 3 - 1080p - 1 - Path Tracerospray-studio: 3 - 1080p - 16 - Path Tracerospray-studio: 3 - 1080p - 32 - Path Tracerospray-studio: 3 - 4K - 1 - Path Tracerospray-studio: 3 - 4K - 16 - Path Tracerospray-studio: 3 - 4K - 32 - Path Traceronednn: Convolution Batch Shapes Auto - f32 - CPUonednn: Deconvolution Batch shapes_1d - f32 - CPUonednn: Deconvolution Batch shapes_3d - f32 - CPUonednn: Recurrent Neural Network Training - f32 - CPUonednn: Recurrent Neural Network Training - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUmnn: resnet-v2-50mnn: SqueezeNetV1.0mnn: inception-v3ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - resnet50ncnn: CPU - regnety_400mncnn: CPU - vision_transformerncnn: CPU - FastestDetopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamnumenta-nab: Bayesian Changepointnumenta-nab: Windowed Gaussiannumenta-nab: Relative Entropyopenfoam: drivaerFastback, Medium Mesh Size - Mesh Timeopenfoam: drivaerFastback, Medium Mesh Size - Execution Timecp2k: Fayalite-FISTAVX-512 OnAVX-512 Off291.982346.081102.04193.93148967.98170652.7143.3443.3419800.209988.4411202.627452.969065.34956.88184.4701212.9364180.9315246.572245.5556.701.264.186.866.527299.5458652.0053.513.511.6622.15157.2960.1727174015161051133244.156643.071154.218784.9988616.6804187.08371195.93671953.025534.5206100.5458761.2241189.5611857.226534.25184800.6122606807696.06715531951330106695039794.449.550.749.959077909618.764351027016211575.661371.1813677.76449484326.38714823534698581927118546154238447646049385188081772804560869411070221840.51616722.58750.9895911962.061955.392361.2715.4418.57945.81242.3057.7125.8872.8066.34247.3274.9358.95469.29246.980.550.361100.251101.009.634.794.286.435.2950.1111.7586155.34625.341380.082649.032828.96099.9408125.78605.2712111.728229.189216.6774.7279.898135.77418113.637331122.725202.604255.66143.9494.97108449.49151239.6025.5025.749672.944110.496065.763782.085135.56445.59153.4476176.8831151.0558239.881233.9445.141.043.395.255.385065.0966391.5193.503.511.7212.7555.1131.122506288499918115526.379425.135440.511773.5380509.4462177.53871005.16151410.805130.606271.0437490.3658157.819690.872230.52672946.0813229605784.2548827142754349174036483.709.130.729.528423816218.467182110662887548.831335.6311521.3826.4121812871574971011321226471842924586172211524229852143413682084113398267850.53768222.83541.763364953.984989.131715.7624.0989.14630.43644.1962.8629.0076.1367.48270.1286.1660.731088.50503.501.210.571864.931845.9519.6911.667.9012.679.33107.6213.5907187.85405.628295.334767.911832.664714.0655195.16566.3313138.586132.750517.3894.88210.035144.3478135.216481198.408OpenBenchmarking.org

CPU Temperature Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgCelsiusCPU Temperature MonitorPhoronix Test Suite System MonitoringAVX-512 OffAVX-512 On1428425670Min: 35.5 / Avg: 51.26 / Max: 73.75Min: 30.13 / Avg: 49.97 / Max: 73.38

CPU Power Consumption Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringAVX-512 OffAVX-512 On130260390520650Min: 106.95 / Avg: 449.58 / Max: 735.32Min: 26.37 / Avg: 434.8 / Max: 766.01

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OffAVX-512 On60120180240300SE +/- 1.06, N = 8SE +/- 0.23, N = 10202.60291.981. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM2

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 OffAVX-512 On80160240320400SE +/- 1.27, N = 3SE +/- 0.46, N = 4255.66346.081. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgBillion Interactions/s Per Watt, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OffAVX-512 On0.23420.46840.70260.93681.1710.4891.041

miniBUDE

Implementation: OpenMP - Input Deck: BM2

OpenBenchmarking.orgBillion Interactions/s Per Watt, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 OffAVX-512 On0.15620.31240.46860.62480.7810.4530.694

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Face Detection FP16 - Device: CPUAVX-512 OffAVX-512 On20406080100SE +/- 0.01, N = 3SE +/- 0.07, N = 343.94102.04-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Face Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On4080120160200SE +/- 0.02, N = 3SE +/- 0.05, N = 394.97193.93-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUAVX-512 OffAVX-512 On30K60K90K120K150KSE +/- 1130.85, N = 4SE +/- 1328.20, N = 3108449.49148967.98-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On40K80K120K160K200KSE +/- 1455.37, N = 3SE +/- 127.59, N = 3151239.60170652.71-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Detection FP16 - Device: CPUAVX-512 OffAVX-512 On1020304050SE +/- 0.22, N = 3SE +/- 0.20, N = 325.5043.34-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Detection FP32 - Device: CPUAVX-512 OffAVX-512 On1020304050SE +/- 0.04, N = 3SE +/- 0.18, N = 325.7443.34-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On4K8K12K16K20KSE +/- 1.81, N = 3SE +/- 12.72, N = 39672.9419800.20-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16 - Device: CPUAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 4.29, N = 3SE +/- 6.96, N = 34110.499988.44-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 1.39, N = 3SE +/- 2.53, N = 36065.7611202.62-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16 - Device: CPUAVX-512 OffAVX-512 On16003200480064008000SE +/- 10.17, N = 3SE +/- 3.52, N = 33782.087452.96-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 2.17, N = 3SE +/- 4.01, N = 35135.569065.34-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Machine Translation EN To DE FP16 - Device: CPUAVX-512 OffAVX-512 On2004006008001000SE +/- 3.04, N = 3SE +/- 4.00, N = 3445.59956.88-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: Asian Dragon ObjAVX-512 OffAVX-512 On4080120160200SE +/- 0.36, N = 4SE +/- 0.62, N = 4153.45184.47MIN: 130.31 / MAX: 166.17MIN: 178.83 / MAX: 196.34

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 OffAVX-512 On0.15910.31820.47730.63640.79550.4310.707

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 OffAVX-512 On50100150200250SE +/- 0.21, N = 8SE +/- 0.22, N = 9176.88212.94MIN: 170.19 / MAX: 190MIN: 207.72 / MAX: 227.11

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: Asian Dragon ObjAVX-512 OffAVX-512 On0.16310.32620.48930.65240.81550.4810.725

Embree

Binary: Pathtracer ISPC - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: CrownAVX-512 OffAVX-512 On4080120160200SE +/- 0.25, N = 7SE +/- 0.62, N = 8151.06180.93MIN: 114.4 / MAX: 176.43MIN: 124.41 / MAX: 209.74

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 4KAVX-512 OffAVX-512 On50100150200250SE +/- 4.01, N = 15SE +/- 4.74, N = 15239.88246.57

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 4KAVX-512 OffAVX-512 On50100150200250SE +/- 3.57, N = 15SE +/- 4.78, N = 15233.94245.56

Embree

Binary: Pathtracer ISPC - Model: Crown

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: CrownAVX-512 OffAVX-512 On0.11790.23580.35370.47160.58950.3440.524

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 4KAVX-512 OffAVX-512 On0.34040.68081.02121.36161.7020.9861.513

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 4KAVX-512 OffAVX-512 On0.3150.630.9451.261.5750.9681.400

simdjson

Throughput Test: PartialTweets

OpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 2.0Throughput Test: PartialTweetsAVX-512 OffAVX-512 On0.00720.01440.02160.02880.0360.0230.032

simdjson

Throughput Test: PartialTweets

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: PartialTweetsAVX-512 OffAVX-512 On246810SE +/- 0.01, N = 3SE +/- 0.04, N = 35.146.70-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native

simdjson

Throughput Test: LargeRandom

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: LargeRandomAVX-512 OffAVX-512 On0.28350.5670.85051.1341.4175SE +/- 0.00, N = 3SE +/- 0.00, N = 31.041.26-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native

simdjson

Throughput Test: Kostya

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: KostyaAVX-512 OffAVX-512 On0.94051.8812.82153.7624.7025SE +/- 0.00, N = 3SE +/- 0.02, N = 33.394.18-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native

simdjson

Throughput Test: DistinctUserID

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: DistinctUserIDAVX-512 OffAVX-512 On246810SE +/- 0.01, N = 3SE +/- 0.02, N = 35.256.86-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native

simdjson

Throughput Test: LargeRandom

OpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 2.0Throughput Test: LargeRandomAVX-512 OffAVX-512 On0.00140.00280.00420.00560.0070.0050.006

simdjson

Throughput Test: Kostya

OpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 2.0Throughput Test: KostyaAVX-512 OffAVX-512 On0.00450.0090.01350.0180.02250.0150.020

simdjson

Throughput Test: DistinctUserID

OpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 2.0Throughput Test: DistinctUserIDAVX-512 OffAVX-512 On0.00740.01480.02220.02960.0370.0240.033

simdjson

Throughput Test: TopTweet

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: TopTweetAVX-512 OffAVX-512 On246810SE +/- 0.01, N = 3SE +/- 0.08, N = 45.386.52-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native

simdjson

Throughput Test: TopTweet

OpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 2.0Throughput Test: TopTweetAVX-512 OffAVX-512 On0.0070.0140.0210.0280.0350.0240.031

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OffAVX-512 On16003200480064008000SE +/- 26.42, N = 8SE +/- 5.79, N = 105065.107299.551. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM2

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 31.65, N = 3SE +/- 11.62, N = 46391.528652.011. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

Intel Open Image Denoise

Run: RT.hdr_alb_nrm.3840x2160

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 1.4.0Run: RT.hdr_alb_nrm.3840x2160AVX-512 OffAVX-512 On0.78981.57962.36943.15923.949SE +/- 0.03, N = 5SE +/- 0.01, N = 53.503.51

Intel Open Image Denoise

Run: RT.hdr_alb_nrm.3840x2160

OpenBenchmarking.orgImages / Sec Per Watt, More Is BetterIntel Open Image Denoise 1.4.0Run: RT.hdr_alb_nrm.3840x2160AVX-512 OffAVX-512 On0.00270.00540.00810.01080.01350.0100.012

Intel Open Image Denoise

Run: RT.ldr_alb_nrm.3840x2160

OpenBenchmarking.orgImages / Sec Per Watt, More Is BetterIntel Open Image Denoise 1.4.0Run: RT.ldr_alb_nrm.3840x2160AVX-512 OffAVX-512 On0.00270.00540.00810.01080.01350.0100.012

Intel Open Image Denoise

Run: RTLightmap.hdr.4096x4096

OpenBenchmarking.orgImages / Sec Per Watt, More Is BetterIntel Open Image Denoise 1.4.0Run: RTLightmap.hdr.4096x4096AVX-512 OffAVX-512 On0.00110.00220.00330.00440.00550.0040.005

Intel Open Image Denoise

Run: RT.ldr_alb_nrm.3840x2160

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 1.4.0Run: RT.ldr_alb_nrm.3840x2160AVX-512 OffAVX-512 On0.78981.57962.36943.15923.949SE +/- 0.01, N = 5SE +/- 0.01, N = 53.513.51

Intel Open Image Denoise

Run: RTLightmap.hdr.4096x4096

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 1.4.0Run: RTLightmap.hdr.4096x4096AVX-512 OffAVX-512 On0.3870.7741.1611.5481.935SE +/- 0.01, N = 3SE +/- 0.01, N = 31.721.66

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: ResNet-50AVX-512 OffAVX-512 On510152025SE +/- 0.01, N = 3SE +/- 0.11, N = 312.7522.15

TensorFlow

Device: CPU - Batch Size: 16 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: AlexNetAVX-512 OffAVX-512 On306090120150SE +/- 0.19, N = 3SE +/- 2.35, N = 1255.11157.29

TensorFlow

Device: CPU - Batch Size: 16 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: GoogLeNetAVX-512 OffAVX-512 On1326395265SE +/- 0.25, N = 3SE +/- 1.01, N = 1531.1260.17

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: ResNet-50AVX-512 OffAVX-512 On0.01620.03240.04860.06480.0810.0380.072

TensorFlow

Device: CPU - Batch Size: 16 - Model: AlexNet

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: AlexNetAVX-512 OffAVX-512 On0.11810.23620.35430.47240.59050.1730.525

TensorFlow

Device: CPU - Batch Size: 16 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: GoogLeNetAVX-512 OffAVX-512 On0.04390.08780.13170.17560.21950.1040.195

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Minute Per Watt, More Is BetterONNX Runtime 1.11Model: fcn-resnet101-11 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 On0.12330.24660.36990.49320.61650.4970.548

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Minute Per Watt, More Is BetterONNX Runtime 1.11Model: super-resolution-10 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 On71421283523.5728.54

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Minute Per Watt, More Is BetterONNX Runtime 1.11Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 On0.53531.07061.60592.14122.67652.0512.379

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: fcn-resnet101-11 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 On60120180240300SE +/- 2.36, N = 12SE +/- 0.44, N = 3250271-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: super-resolution-10 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 On16003200480064008000SE +/- 260.54, N = 12SE +/- 5.46, N = 362887401-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Minute Per Watt, More Is BetterONNX Runtime 1.11Model: bertsquad-12 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 On0.31340.62680.94021.25361.5671.3151.393

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: bertsquad-12 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 On110220330440550SE +/- 3.11, N = 3SE +/- 1.86, N = 3499516-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 On2004006008001000SE +/- 20.83, N = 12SE +/- 39.92, N = 129181051-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenVKL

Benchmark: vklBenchmark ISPC

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ISPCAVX-512 OffAVX-512 On30060090012001500SE +/- 8.11, N = 3SE +/- 13.58, N = 311551332MIN: 251 / MAX: 5181MIN: 329 / MAX: 4770

OpenVKL

Benchmark: vklBenchmark ISPC

OpenBenchmarking.orgItems / Sec Per Watt, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ISPCAVX-512 OffAVX-512 On0.64191.28381.92572.56763.20952.3552.853

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX-512 OffAVX-512 On1020304050SE +/- 0.02, N = 3SE +/- 0.21, N = 326.3844.16

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 OffAVX-512 On1020304050SE +/- 0.04, N = 3SE +/- 0.10, N = 325.1443.07

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 OffAVX-512 On0.01670.03340.05010.06680.08350.0410.074

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 OffAVX-512 On1224364860SE +/- 0.03, N = 3SE +/- 0.05, N = 340.5154.22

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX-512 OffAVX-512 On0.01710.03420.05130.06840.08550.0430.076

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 OffAVX-512 On0.02050.0410.06150.0820.10250.0650.091

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On20406080100SE +/- 0.27, N = 3SE +/- 0.45, N = 373.5485.00

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On130260390520650SE +/- 0.33, N = 3SE +/- 1.92, N = 3509.45616.68

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On4080120160200SE +/- 0.29, N = 3SE +/- 0.11, N = 3177.54187.08

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On30060090012001500SE +/- 0.78, N = 3SE +/- 2.39, N = 31005.161195.94

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On400800120016002000SE +/- 0.17, N = 3SE +/- 4.32, N = 31410.811953.03

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On816243240SE +/- 0.03, N = 3SE +/- 0.03, N = 330.6134.52

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On20406080100SE +/- 0.17, N = 3SE +/- 0.17, N = 371.04100.55

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On160320480640800SE +/- 0.61, N = 3SE +/- 0.79, N = 3490.37761.22

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On4080120160200SE +/- 0.17, N = 3SE +/- 0.22, N = 3157.82189.56

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On2004006008001000SE +/- 1.12, N = 3SE +/- 0.77, N = 3690.87857.23

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On816243240SE +/- 0.10, N = 3SE +/- 0.08, N = 330.5334.25

Cpuminer-Opt

Algorithm: scrypt

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: scryptAVX-512 OffAVX-512 On10002000300040005000SE +/- 0.31, N = 3SE +/- 0.45, N = 32946.084800.61-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: scrypt

OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: scryptAVX-512 OffAVX-512 On2468105.2798.076

Cpuminer-Opt

Algorithm: Quad SHA-256, Pyrite

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Quad SHA-256, PyriteAVX-512 OffAVX-512 On500K1000K1500K2000K2500KSE +/- 276.83, N = 3SE +/- 9040.25, N = 313229602260680-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Quad SHA-256, Pyrite

OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: Quad SHA-256, PyriteAVX-512 OffAVX-512 On80016002400320040002252.993657.53

Cpuminer-Opt

Algorithm: x25x

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: x25xAVX-512 OffAVX-512 On16003200480064008000SE +/- 14.41, N = 3SE +/- 16.58, N = 35784.257696.06-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: x25x

OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: x25xAVX-512 OffAVX-512 On36912159.97113.548

Cpuminer-Opt

Algorithm: Garlicoin

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: GarlicoinAVX-512 OffAVX-512 On15K30K45K60K75KSE +/- 13.33, N = 3SE +/- 89.69, N = 34882771553-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Garlicoin

OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: GarlicoinAVX-512 OffAVX-512 On30609012015083.22119.97

Cpuminer-Opt

Algorithm: Skeincoin

OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: SkeincoinAVX-512 OffAVX-512 On70014002100280035002381.943137.56

Cpuminer-Opt

Algorithm: LBC, LBRY Credits

OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: LBC, LBRY CreditsAVX-512 OffAVX-512 On400800120016002000802.761658.51

Cpuminer-Opt

Algorithm: Skeincoin

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: SkeincoinAVX-512 OffAVX-512 On400K800K1200K1600K2000KSE +/- 3964.01, N = 3SE +/- 13005.55, N = 314275431951330-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: LBC, LBRY Credits

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: LBC, LBRY CreditsAVX-512 OffAVX-512 On200K400K600K800K1000KSE +/- 667.26, N = 3SE +/- 7645.47, N = 34917401066950-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

AI Benchmark Alpha

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off306837104285AVX-512 On240036554107OpenBenchmarking.orgMegahertz, More Is BetterAI Benchmark Alpha 0.1.2CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off350736983967AVX-512 On240035593801OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off258931354299AVX-512 On240031093928OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off369237124154AVX-512 On240035413702OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off262329874137AVX-512 On240028683737OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off255229383959AVX-512 On240030033730OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off368637114893AVX-512 On240035513868OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off367837024150AVX-512 On240035713764OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off256832144450AVX-512 On240029453885OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off306836414426AVX-512 On240035273821OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off253529083834AVX-512 On240028793730OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off308936794336AVX-512 On240035333703OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

TensorFlow

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off369437134254AVX-512 On240036644099OpenBenchmarking.orgMegahertz, More Is BetterTensorFlow 2.10CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

TensorFlow

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off369437324340AVX-512 On240034583812OpenBenchmarking.orgMegahertz, More Is BetterTensorFlow 2.10CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

TensorFlow

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off369437274474AVX-512 On240035864161OpenBenchmarking.orgMegahertz, More Is BetterTensorFlow 2.10CPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000

LeelaChessZero

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off338337004961AVX-512 On240036843952OpenBenchmarking.orgMegahertz, More Is BetterLeelaChessZero 0.28CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

LeelaChessZero

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off369436994052AVX-512 On240036854074OpenBenchmarking.orgMegahertz, More Is BetterLeelaChessZero 0.28CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Embree

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off289935084437AVX-512 On240029743695OpenBenchmarking.orgMegahertz, More Is BetterEmbree 3.13CPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000

Embree

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off288935924020AVX-512 On240033723699OpenBenchmarking.orgMegahertz, More Is BetterEmbree 3.13CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Embree

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off272634465379AVX-512 On240029283696OpenBenchmarking.orgMegahertz, More Is BetterEmbree 3.13CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

OpenVKL

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOpenVKL 1.3.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2621 / Avg: 3373.13 / Max: 4085Min: 2400 / Avg: 3408.84 / Max: 3732

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off277130734018AVX-512 On240030813695OpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.10CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off276830834016AVX-512 On240030513695OpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.10CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off276631044475AVX-512 On240030553720OpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.10CPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off270829973911AVX-512 On240029393695OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off269629794041AVX-512 On240029303699OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off280229784050AVX-512 On240029043702OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off269630013902AVX-512 On240029503701OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off270929373983AVX-512 On240028883699OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off276929893982AVX-512 On240028763752OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off270229953808AVX-512 On240028593697OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off278329933739AVX-512 On240029223700OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off277129723740AVX-512 On240029353696OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off271230043940AVX-512 On240028683857OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off272129603862AVX-512 On240029063696OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off272630074349AVX-512 On240029073700OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off270530013951AVX-512 On240029313701OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off272129714031AVX-512 On240029263699OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off271529724286AVX-512 On240029233697OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off272129964398AVX-512 On240029373698OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off275229564184AVX-512 On240029103697OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off272729733711AVX-512 On240029433701OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off286033483869AVX-512 On240031823695OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off293335263802AVX-512 On240033943729OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off356936664064AVX-512 On240030083695OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off358136233818AVX-512 On240035713711OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off358236274223AVX-512 On240035683704OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off357036124005AVX-512 On240035073700OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Mobile Neural Network

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterMobile Neural Network 2.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3694 / Avg: 3699.72 / Max: 4041Min: 2400 / Avg: 3679.28 / Max: 3704

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off293330583896AVX-512 On240030093697OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off300131554285AVX-512 On240031123695OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off325633514121AVX-512 On240031053697OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off287830303783AVX-512 On240030793830OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off289530683848AVX-512 On240030023696OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off272929334111AVX-512 On240030603703OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

NCNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterNCNN 20220729CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3563 / Avg: 3574.38 / Max: 3815Min: 2400 / Avg: 3565.67 / Max: 3699

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off265229064086AVX-512 On240031263696OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off292030813713AVX-512 On240031293696OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off299231934056AVX-512 On240036053828OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off347636743707AVX-512 On240036303754OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off270931503863AVX-512 On240034803726OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off272931003993AVX-512 On240034663698OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off293030703969AVX-512 On240030373696OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off267228483946AVX-512 On240030603695OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off298830684270AVX-512 On240030363900OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off257127304230AVX-512 On240029723706OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off279929423941AVX-512 On240030993699OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off259229663926AVX-512 On240032563707OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

GROMACS

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off287533584145AVX-512 On240031683725OpenBenchmarking.orgMegahertz, More Is BetterGROMACS 2022.1CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

ONNX Runtime

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterONNX Runtime 1.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3047 / Avg: 3611.53 / Max: 4291Min: 2400 / Avg: 3577.02 / Max: 3696

ONNX Runtime

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterONNX Runtime 1.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On8001600240032004000Min: 3693 / Avg: 3701.93 / Max: 4397Min: 2400 / Avg: 3664.92 / Max: 3710

ONNX Runtime

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off369437013978AVX-512 On240036633709OpenBenchmarking.orgMegahertz, More Is BetterONNX Runtime 1.11CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

ONNX Runtime

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterONNX Runtime 1.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3593 / Avg: 3607.6 / Max: 4285Min: 2400 / Avg: 3571.99 / Max: 3770

Numpy Benchmark

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off369437024024AVX-512 On240036733705OpenBenchmarking.orgMegahertz, More Is BetterNumpy BenchmarkCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

miniBUDE

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off310735054044AVX-512 On240029133739OpenBenchmarking.orgMegahertz, More Is BetterminiBUDE 20210901CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

miniBUDE

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off290532883891AVX-512 On240032013697OpenBenchmarking.orgMegahertz, More Is BetterminiBUDE 20210901CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

SVT-AV1

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off369437284349AVX-512 On240032023756OpenBenchmarking.orgMegahertz, More Is BetterSVT-AV1 1.4CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

SVT-AV1

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off369437183985AVX-512 On240032743770OpenBenchmarking.orgMegahertz, More Is BetterSVT-AV1 1.4CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Numenta Anomaly Benchmark

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off369437074079AVX-512 On240035323699OpenBenchmarking.orgMegahertz, More Is BetterNumenta Anomaly Benchmark 1.1CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Numenta Anomaly Benchmark

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off369437183948AVX-512 On240032373715OpenBenchmarking.orgMegahertz, More Is BetterNumenta Anomaly Benchmark 1.1CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

Numenta Anomaly Benchmark

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off369437023768AVX-512 On240034373911OpenBenchmarking.orgMegahertz, More Is BetterNumenta Anomaly Benchmark 1.1CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

Intel Open Image Denoise

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off271836264090AVX-512 On240031243699OpenBenchmarking.orgMegahertz, More Is BetterIntel Open Image Denoise 1.4.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Intel Open Image Denoise

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off285436103919AVX-512 On240032123702OpenBenchmarking.orgMegahertz, More Is BetterIntel Open Image Denoise 1.4.0CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

Intel Open Image Denoise

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off301736364215AVX-512 On240032163699OpenBenchmarking.orgMegahertz, More Is BetterIntel Open Image Denoise 1.4.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Darmstadt Automotive Parallel Heterogeneous Suite

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off369437194426AVX-512 On240035163702OpenBenchmarking.orgMegahertz, More Is BetterDarmstadt Automotive Parallel Heterogeneous SuiteCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Darmstadt Automotive Parallel Heterogeneous Suite

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterDarmstadt Automotive Parallel Heterogeneous SuiteCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On8001600240032004000Min: 3694 / Avg: 3698.64 / Max: 4768Min: 2400 / Avg: 3647.5 / Max: 3715

simdjson

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off369437024016AVX-512 On240036393702OpenBenchmarking.orgMegahertz, More Is Bettersimdjson 2.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

simdjson

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off369437013788AVX-512 On240036013700OpenBenchmarking.orgMegahertz, More Is Bettersimdjson 2.0CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

simdjson

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off369437043981AVX-512 On240036253702OpenBenchmarking.orgMegahertz, More Is Bettersimdjson 2.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

simdjson

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off369437033925AVX-512 On240036433754OpenBenchmarking.orgMegahertz, More Is Bettersimdjson 2.0CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

simdjson

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off369437013912AVX-512 On240036403701OpenBenchmarking.orgMegahertz, More Is Bettersimdjson 2.0CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

OpenFOAM

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off291732653714AVX-512 On240031863701OpenBenchmarking.orgMegahertz, More Is BetterOpenFOAM 10CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

CP2K Molecular Dynamics

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off356936653808AVX-512 On240036613700OpenBenchmarking.orgMegahertz, More Is BetterCP2K Molecular Dynamics 8.2CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

JPEG XL libjxl

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off366937013814AVX-512 On240036573712OpenBenchmarking.orgMegahertz, More Is BetterJPEG XL libjxl 0.7CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

JPEG XL libjxl

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterJPEG XL libjxl 0.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On8001600240032004000Min: 3414 / Avg: 3701.38 / Max: 4381Min: 2400 / Avg: 3682.16 / Max: 4023

JPEG XL libjxl

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 Off243936963828AVX-512 On240036433712OpenBenchmarking.orgMegahertz, More Is BetterJPEG XL libjxl 0.7CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

SMHasher

Hash: FarmHash32 x86_64 AVX

OpenBenchmarking.orgMiB/sec, More Is BetterSMHasher 2022-08-22Hash: FarmHash32 x86_64 AVXAVX-512 OffAVX-512 On9K18K27K36K45KSE +/- 28.78, N = 5SE +/- 0.46, N = 536483.7039794.44-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -flto=auto -fno-fat-lto-objects

JPEG XL libjxl

Input: JPEG - Quality: 90

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 90AVX-512 OffAVX-512 On3691215SE +/- 0.03, N = 3SE +/- 0.04, N = 39.139.55-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -fno-rtti -funwind-tables -O2 -fPIE -pie -lm -latomic

JPEG XL libjxl

Input: JPEG - Quality: 100

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 100AVX-512 OffAVX-512 On0.16650.3330.49950.6660.8325SE +/- 0.01, N = 9SE +/- 0.01, N = 90.720.74-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -fno-rtti -funwind-tables -O2 -fPIE -pie -lm -latomic

JPEG XL libjxl

Input: PNG - Quality: 90

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 90AVX-512 OffAVX-512 On3691215SE +/- 0.02, N = 3SE +/- 0.02, N = 39.529.95-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -fno-rtti -funwind-tables -O2 -fPIE -pie -lm -latomic

JPEG XL libjxl

Input: JPEG - Quality: 90

OpenBenchmarking.orgMP/s Per Watt, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 90AVX-512 OffAVX-512 On0.00970.01940.02910.03880.04850.0390.043

JPEG XL libjxl

Input: JPEG - Quality: 100

OpenBenchmarking.orgMP/s Per Watt, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 100AVX-512 OffAVX-512 On0.00070.00140.00210.00280.00350.0030.003

JPEG XL libjxl

Input: PNG - Quality: 90

OpenBenchmarking.orgMP/s Per Watt, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 90AVX-512 OffAVX-512 On0.01010.02020.03030.04040.05050.0410.045

LeelaChessZero

Backend: BLAS

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.28Backend: BLASAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 21.53, N = 3SE +/- 103.04, N = 484239077-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -flto -O3 -march=native -pthread

LeelaChessZero

Backend: Eigen

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.28Backend: EigenAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 43.59, N = 3SE +/- 45.37, N = 381629096-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -flto -O3 -march=native -pthread

LeelaChessZero

Backend: BLAS

OpenBenchmarking.orgNodes Per Second Per Watt, More Is BetterLeelaChessZero 0.28Backend: BLASAVX-512 OffAVX-512 On61218243021.9323.78

LeelaChessZero

Backend: Eigen

OpenBenchmarking.orgNodes Per Second Per Watt, More Is BetterLeelaChessZero 0.28Backend: EigenAVX-512 OffAVX-512 On61218243021.2924.89

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2022.1Implementation: MPI CPU - Input: water_GMX50_bareAVX-512 OffAVX-512 On510152025SE +/- 0.10, N = 3SE +/- 0.24, N = 318.4718.76-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

OpenBenchmarking.orgNs Per Day Per Watt, More Is BetterGROMACS 2022.1Implementation: MPI CPU - Input: water_GMX50_bareAVX-512 OffAVX-512 On0.00790.01580.02370.03160.03950.0330.035

AI Benchmark Alpha

Device AI Score

OpenBenchmarking.orgScore Per Watt, More Is BetterAI Benchmark Alpha 0.1.2Device AI ScoreAVX-512 OffAVX-512 On5101520259.34920.522

AI Benchmark Alpha

Device Inference Score

OpenBenchmarking.orgScore, More Is BetterAI Benchmark Alpha 0.1.2Device Inference ScoreAVX-512 OffAVX-512 On800160024003200400018213510

AI Benchmark Alpha

Device Training Score

OpenBenchmarking.orgScore, More Is BetterAI Benchmark Alpha 0.1.2Device Training ScoreAVX-512 OffAVX-512 On600120018002400300010662701

Numpy Benchmark

OpenBenchmarking.orgScore Per Watt, More Is BetterNumpy BenchmarkAVX-512 OffAVX-512 On0.60461.20921.81382.41843.0232.4742.687

AI Benchmark Alpha

Device AI Score

OpenBenchmarking.orgScore, More Is BetterAI Benchmark Alpha 0.1.2Device AI ScoreAVX-512 OffAVX-512 On1300260039005200650028876211

Numpy Benchmark

OpenBenchmarking.orgScore, More Is BetterNumpy BenchmarkAVX-512 OffAVX-512 On120240360480600SE +/- 0.59, N = 3SE +/- 2.18, N = 3548.83575.66

Darmstadt Automotive Parallel Heterogeneous Suite

Backend: OpenMP - Kernel: NDT Mapping

OpenBenchmarking.orgTest Cases Per Minute, More Is BetterDarmstadt Automotive Parallel Heterogeneous SuiteBackend: OpenMP - Kernel: NDT MappingAVX-512 OffAVX-512 On30060090012001500SE +/- 8.66, N = 3SE +/- 5.94, N = 31335.631371.181. (CXX) g++ options: -O3 -std=c++11 -fopenmp

Darmstadt Automotive Parallel Heterogeneous Suite

Backend: OpenMP - Kernel: Points2Image

OpenBenchmarking.orgTest Cases Per Minute, More Is BetterDarmstadt Automotive Parallel Heterogeneous SuiteBackend: OpenMP - Kernel: Points2ImageAVX-512 OffAVX-512 On3K6K9K12K15KSE +/- 269.82, N = 15SE +/- 126.17, N = 1511521.3813677.761. (CXX) g++ options: -O3 -std=c++11 -fopenmp

Darmstadt Automotive Parallel Heterogeneous Suite

Backend: OpenMP - Kernel: NDT Mapping

OpenBenchmarking.orgTest Cases Per Minute Per Watt, More Is BetterDarmstadt Automotive Parallel Heterogeneous SuiteBackend: OpenMP - Kernel: NDT MappingAVX-512 OffAVX-512 On2468105.4556.416

Darmstadt Automotive Parallel Heterogeneous Suite

Backend: OpenMP - Kernel: Points2Image

OpenBenchmarking.orgTest Cases Per Minute Per Watt, More Is BetterDarmstadt Automotive Parallel Heterogeneous SuiteBackend: OpenMP - Kernel: Points2ImageAVX-512 OffAVX-512 On122436486042.1952.82

AI Benchmark Alpha

CPU Temperature Monitor

MinAvgMaxAVX-512 Off36.440.649.3AVX-512 On30.139.247.0OpenBenchmarking.orgCelsius, Fewer Is BetterAI Benchmark Alpha 0.1.2CPU Temperature Monitor1428425670

Neural Magic DeepSparse

CPU Temperature Monitor

MinAvgMaxAVX-512 Off36.845.252.4AVX-512 On32.443.751.5OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature Monitor1530456075

Neural Magic DeepSparse

CPU Temperature Monitor

MinAvgMaxAVX-512 Off41.851.560.0AVX-512 On38.649.457.0OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature Monitor1632486480

Neural Magic DeepSparse

CPU Temperature Monitor

MinAvgMaxAVX-512 Off43.050.554.3AVX-512 On39.048.052.4OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature Monitor1530456075

Neural Magic DeepSparse

CPU Temperature Monitor

MinAvgMaxAVX-512 Off43.954.459.1AVX-512 On39.951.255.5OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature Monitor1632486480

Neural Magic DeepSparse

CPU Temperature Monitor

MinAvgMaxAVX-512 Off44.454.959.1AVX-512 On38.151.957.3OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature Monitor1632486480

Neural Magic DeepSparse

CPU Temperature Monitor

MinAvgMaxAVX-512 Off43.950.755.5AVX-512 On38.947.853.8OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature Monitor1530456075

Neural Magic DeepSparse

CPU Temperature Monitor

MinAvgMaxAVX-512 Off43.050.656.9AVX-512 On38.148.554.8OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature Monitor1632486480

Neural Magic DeepSparse

CPU Temperature Monitor

MinAvgMaxAVX-512 Off43.551.559.1AVX-512 On39.351.958.3OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature Monitor1632486480

Neural Magic DeepSparse

CPU Temperature Monitor

MinAvgMaxAVX-512 Off44.452.155.6AVX-512 On39.850.154.6OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature Monitor1530456075

Neural Magic DeepSparse

CPU Temperature Monitor

MinAvgMaxAVX-512 Off44.954.461.8AVX-512 On40.152.957.9OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature Monitor20406080100

Neural Magic DeepSparse

CPU Temperature Monitor

MinAvgMaxAVX-512 Off43.550.756.9AVX-512 On40.648.754.3OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature Monitor1632486480

TensorFlow

CPU Temperature Monitor

MinAvgMaxAVX-512 Off40.943.453.5AVX-512 On36.841.748.6OpenBenchmarking.orgCelsius, Fewer Is BetterTensorFlow 2.10CPU Temperature Monitor1530456075

TensorFlow

CPU Temperature Monitor

MinAvgMaxAVX-512 Off39.041.047.5AVX-512 On35.040.548.9OpenBenchmarking.orgCelsius, Fewer Is BetterTensorFlow 2.10CPU Temperature Monitor1428425670

TensorFlow

CPU Temperature Monitor

MinAvgMaxAVX-512 Off38.640.550.4AVX-512 On34.641.748.9OpenBenchmarking.orgCelsius, Fewer Is BetterTensorFlow 2.10CPU Temperature Monitor1428425670

LeelaChessZero

CPU Temperature Monitor

MinAvgMaxAVX-512 Off47.557.464.5AVX-512 On36.852.063.1OpenBenchmarking.orgCelsius, Fewer Is BetterLeelaChessZero 0.28CPU Temperature Monitor20406080100

LeelaChessZero

CPU Temperature Monitor

MinAvgMaxAVX-512 Off37.339.956.9AVX-512 On32.453.461.0OpenBenchmarking.orgCelsius, Fewer Is BetterLeelaChessZero 0.28CPU Temperature Monitor20406080100

Embree

CPU Temperature Monitor

MinAvgMaxAVX-512 Off41.845.851.1AVX-512 On35.540.447.0OpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 3.13CPU Temperature Monitor1530456075

Embree

CPU Temperature Monitor

MinAvgMaxAVX-512 Off39.942.449.3AVX-512 On34.638.446.6OpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 3.13CPU Temperature Monitor1428425670

Embree

CPU Temperature Monitor

MinAvgMaxAVX-512 Off39.545.852.0AVX-512 On33.340.548.0OpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 3.13CPU Temperature Monitor1530456075

OpenVKL

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVKL 1.3.1CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 42.63 / Avg: 52.24 / Max: 60.88Min: 41.25 / Avg: 49.91 / Max: 58.25

OSPRay

CPU Temperature Monitor

MinAvgMaxAVX-512 Off45.359.865.0AVX-512 On39.956.259.5OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.10CPU Temperature Monitor20406080100

OSPRay

CPU Temperature Monitor

MinAvgMaxAVX-512 Off48.460.363.5AVX-512 On41.856.860.4OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.10CPU Temperature Monitor20406080100

OSPRay

CPU Temperature Monitor

MinAvgMaxAVX-512 Off47.561.364.9AVX-512 On42.957.860.9OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.10CPU Temperature Monitor20406080100

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 Off41.858.964.5AVX-512 On36.456.362.3OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature Monitor20406080100

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 Off46.660.764.9AVX-512 On43.558.465.0OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature Monitor20406080100

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 Off46.661.368.0AVX-512 On44.059.064.0OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature Monitor20406080100

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 Off48.060.264.0AVX-512 On44.157.962.3OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature Monitor20406080100

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 Off46.662.065.4AVX-512 On43.859.764.9OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature Monitor20406080100

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 Off47.560.366.3AVX-512 On44.960.365.4OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature Monitor20406080100

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 Off47.059.964.0AVX-512 On44.957.761.8OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature Monitor20406080100

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 Off46.660.664.9AVX-512 On43.858.462.6OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature Monitor20406080100

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 Off46.661.365.8AVX-512 On43.858.963.1OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature Monitor20406080100

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 Off46.659.964.0AVX-512 On44.457.061.4OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature Monitor20406080100

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 Off46.161.665.4AVX-512 On43.559.764.0OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature Monitor20406080100

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 Off47.559.964.1AVX-512 On45.359.864.9OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature Monitor20406080100

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 Off46.660.364.5AVX-512 On44.158.462.3OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature Monitor20406080100

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 Off47.060.864.9AVX-512 On43.858.765.4OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature Monitor20406080100

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 Off46.661.366.3AVX-512 On43.859.364.0OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature Monitor20406080100

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 Off46.660.064.0AVX-512 On44.958.262.8OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature Monitor20406080100

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 Off46.661.664.9AVX-512 On44.659.964.9OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature Monitor20406080100

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 Off47.060.865.4AVX-512 On44.657.962.6OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature Monitor20406080100

oneDNN

CPU Temperature Monitor

MinAvgMaxAVX-512 Off43.547.753.8AVX-512 On40.946.051.1OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature Monitor1530456075

oneDNN

CPU Temperature Monitor

MinAvgMaxAVX-512 Off39.543.847.0AVX-512 On37.343.546.1OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature Monitor1428425670

oneDNN

CPU Temperature Monitor

MinAvgMaxAVX-512 Off39.041.443.9AVX-512 On35.939.344.4OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature Monitor1224364860

oneDNN

CPU Temperature Monitor

MinAvgMaxAVX-512 Off38.645.950.1AVX-512 On35.546.050.6OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature Monitor1428425670

oneDNN

CPU Temperature Monitor

MinAvgMaxAVX-512 Off42.646.650.6AVX-512 On37.846.751.5OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature Monitor1530456075

oneDNN

CPU Temperature Monitor

MinAvgMaxAVX-512 Off42.646.849.8AVX-512 On37.845.848.9OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature Monitor1428425670

Mobile Neural Network

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterMobile Neural Network 2.1CPU Temperature MonitorAVX-512 OffAVX-512 On1122334455Min: 40.38 / Avg: 49.52 / Max: 52.88Min: 35.88 / Avg: 48.36 / Max: 52

Cpuminer-Opt

CPU Temperature Monitor

MinAvgMaxAVX-512 Off39.552.456.9AVX-512 On34.152.258.3OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature Monitor1632486480

Cpuminer-Opt

CPU Temperature Monitor

MinAvgMaxAVX-512 Off46.657.961.4AVX-512 On43.058.662.8OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature Monitor20406080100

Cpuminer-Opt

CPU Temperature Monitor

MinAvgMaxAVX-512 Off46.658.260.9AVX-512 On42.057.160.4OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature Monitor20406080100

Cpuminer-Opt

CPU Temperature Monitor

MinAvgMaxAVX-512 Off45.857.160.9AVX-512 On41.356.360.9OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature Monitor20406080100

Cpuminer-Opt

CPU Temperature Monitor

MinAvgMaxAVX-512 Off47.058.761.8AVX-512 On41.357.962.8OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature Monitor20406080100

Cpuminer-Opt

CPU Temperature Monitor

MinAvgMaxAVX-512 Off47.059.262.3AVX-512 On42.459.063.5OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature Monitor20406080100

NCNN

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNCNN 20220729CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 43 / Avg: 46.1 / Max: 50.13Min: 38.63 / Avg: 44.45 / Max: 48

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 Off41.356.261.9AVX-512 On35.957.364.1OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 Off47.062.566.8AVX-512 On43.058.161.9OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 Off49.359.962.6AVX-512 On42.155.459.5OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 Off48.059.262.3AVX-512 On41.852.255.1OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 Off47.058.267.6AVX-512 On39.557.465.9OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 Off46.158.766.8AVX-512 On42.158.067.3OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 Off45.863.067.1AVX-512 On42.659.462.8OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 Off49.860.061.8AVX-512 On43.060.964.5OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 Off48.061.164.0AVX-512 On44.457.960.1OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 Off48.959.962.3AVX-512 On42.159.062.4OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 Off46.658.061.4AVX-512 On43.856.859.6OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 Off46.156.361.4AVX-512 On42.658.461.9OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature Monitor20406080100

GROMACS

CPU Temperature Monitor

MinAvgMaxAVX-512 Off43.054.864.5AVX-512 On43.356.162.6OpenBenchmarking.orgCelsius, Fewer Is BetterGROMACS 2022.1CPU Temperature Monitor20406080100

ONNX Runtime

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterONNX Runtime 1.11CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 43 / Avg: 53.38 / Max: 59.25Min: 37.75 / Avg: 51.09 / Max: 57.5

ONNX Runtime

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterONNX Runtime 1.11CPU Temperature MonitorAVX-512 OffAVX-512 On1122334455Min: 39.5 / Avg: 43.19 / Max: 53Min: 36.38 / Avg: 39.9 / Max: 42.63

ONNX Runtime

CPU Temperature Monitor

MinAvgMaxAVX-512 Off39.048.452.0AVX-512 On34.646.548.9OpenBenchmarking.orgCelsius, Fewer Is BetterONNX Runtime 1.11CPU Temperature Monitor1530456075

ONNX Runtime

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterONNX Runtime 1.11CPU Temperature MonitorAVX-512 OffAVX-512 On1122334455Min: 38.13 / Avg: 50.46 / Max: 57.25Min: 32.75 / Avg: 48.03 / Max: 50.63

Numpy Benchmark

CPU Temperature Monitor

MinAvgMaxAVX-512 Off36.437.943.5AVX-512 On32.836.340.4OpenBenchmarking.orgCelsius, Fewer Is BetterNumpy BenchmarkCPU Temperature Monitor1224364860

miniBUDE

CPU Temperature Monitor

MinAvgMaxAVX-512 Off38.645.552.4AVX-512 On31.538.547.4OpenBenchmarking.orgCelsius, Fewer Is BetterminiBUDE 20210901CPU Temperature Monitor1530456075

miniBUDE

CPU Temperature Monitor

MinAvgMaxAVX-512 Off40.453.060.1AVX-512 On32.847.756.0OpenBenchmarking.orgCelsius, Fewer Is BetterminiBUDE 20210901CPU Temperature Monitor1632486480

SVT-AV1

CPU Temperature Monitor

MinAvgMaxAVX-512 Off39.042.449.3AVX-512 On32.436.849.3OpenBenchmarking.orgCelsius, Fewer Is BetterSVT-AV1 1.4CPU Temperature Monitor1428425670

SVT-AV1

CPU Temperature Monitor

MinAvgMaxAVX-512 Off37.840.548.1AVX-512 On30.634.643.0OpenBenchmarking.orgCelsius, Fewer Is BetterSVT-AV1 1.4CPU Temperature Monitor1428425670

Numenta Anomaly Benchmark

CPU Temperature Monitor

MinAvgMaxAVX-512 Off38.643.249.9AVX-512 On32.440.450.1OpenBenchmarking.orgCelsius, Fewer Is BetterNumenta Anomaly Benchmark 1.1CPU Temperature Monitor1428425670

Numenta Anomaly Benchmark

CPU Temperature Monitor

MinAvgMaxAVX-512 Off37.842.860.4AVX-512 On32.439.253.3OpenBenchmarking.orgCelsius, Fewer Is BetterNumenta Anomaly Benchmark 1.1CPU Temperature Monitor20406080100

Numenta Anomaly Benchmark

CPU Temperature Monitor

MinAvgMaxAVX-512 Off37.841.550.4AVX-512 On31.538.847.0OpenBenchmarking.orgCelsius, Fewer Is BetterNumenta Anomaly Benchmark 1.1CPU Temperature Monitor1428425670

Intel Open Image Denoise

CPU Temperature Monitor

MinAvgMaxAVX-512 Off36.841.647.0AVX-512 On32.438.144.9OpenBenchmarking.orgCelsius, Fewer Is BetterIntel Open Image Denoise 1.4.0CPU Temperature Monitor1428425670

Intel Open Image Denoise

CPU Temperature Monitor

MinAvgMaxAVX-512 Off39.543.348.4AVX-512 On32.838.244.1OpenBenchmarking.orgCelsius, Fewer Is BetterIntel Open Image Denoise 1.4.0CPU Temperature Monitor1428425670

Intel Open Image Denoise

CPU Temperature Monitor

MinAvgMaxAVX-512 Off39.944.749.8AVX-512 On32.839.846.4OpenBenchmarking.orgCelsius, Fewer Is BetterIntel Open Image Denoise 1.4.0CPU Temperature Monitor1428425670

Darmstadt Automotive Parallel Heterogeneous Suite

CPU Temperature Monitor

MinAvgMaxAVX-512 Off37.839.449.5AVX-512 On32.435.436.4OpenBenchmarking.orgCelsius, Fewer Is BetterDarmstadt Automotive Parallel Heterogeneous SuiteCPU Temperature Monitor1428425670

Darmstadt Automotive Parallel Heterogeneous Suite

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterDarmstadt Automotive Parallel Heterogeneous SuiteCPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 36.75 / Avg: 39.2 / Max: 49.75Min: 31.25 / Avg: 38.03 / Max: 47.5

simdjson

CPU Temperature Monitor

MinAvgMaxAVX-512 Off39.051.060.1AVX-512 On36.440.547.5OpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 2.0CPU Temperature Monitor1632486480

simdjson

CPU Temperature Monitor

MinAvgMaxAVX-512 Off37.847.049.8AVX-512 On33.336.737.8OpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 2.0CPU Temperature Monitor1428425670

simdjson

CPU Temperature Monitor

MinAvgMaxAVX-512 Off37.346.348.6AVX-512 On33.336.437.3OpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 2.0CPU Temperature Monitor1428425670

simdjson

CPU Temperature Monitor

MinAvgMaxAVX-512 Off37.346.948.1AVX-512 On32.436.237.3OpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 2.0CPU Temperature Monitor1428425670

simdjson

CPU Temperature Monitor

MinAvgMaxAVX-512 Off36.846.247.5AVX-512 On32.436.137.3OpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 2.0CPU Temperature Monitor1428425670

OpenFOAM

CPU Temperature Monitor

MinAvgMaxAVX-512 Off47.064.970.3AVX-512 On41.362.668.5OpenBenchmarking.orgCelsius, Fewer Is BetterOpenFOAM 10CPU Temperature Monitor20406080100

CP2K Molecular Dynamics

CPU Temperature Monitor

MinAvgMaxAVX-512 Off42.144.456.9AVX-512 On42.144.553.5OpenBenchmarking.orgCelsius, Fewer Is BetterCP2K Molecular Dynamics 8.2CPU Temperature Monitor1632486480

JPEG XL libjxl

CPU Temperature Monitor

MinAvgMaxAVX-512 Off36.839.448.9AVX-512 On35.039.746.6OpenBenchmarking.orgCelsius, Fewer Is BetterJPEG XL libjxl 0.7CPU Temperature Monitor1428425670

JPEG XL libjxl

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterJPEG XL libjxl 0.7CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 35.5 / Avg: 36.56 / Max: 46.63Min: 32.75 / Avg: 36.48 / Max: 49.75

JPEG XL libjxl

CPU Temperature Monitor

MinAvgMaxAVX-512 Off35.936.744.9AVX-512 On32.437.049.3OpenBenchmarking.orgCelsius, Fewer Is BetterJPEG XL libjxl 0.7CPU Temperature Monitor1428425670

SMHasher

Hash: FarmHash32 x86_64 AVX

OpenBenchmarking.orgcycles/hash, Fewer Is BetterSMHasher 2022-08-22Hash: FarmHash32 x86_64 AVXAVX-512 OffAVX-512 On612182430SE +/- 0.00, N = 5SE +/- 0.00, N = 526.4126.39-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -flto=auto -fno-fat-lto-objects

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerAVX-512 OffAVX-512 On4080120160200SE +/- 0.33, N = 3SE +/- 0.33, N = 3181148-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path TracerAVX-512 OffAVX-512 On6001200180024003000SE +/- 1.20, N = 3SE +/- 2.33, N = 328712353-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerAVX-512 OffAVX-512 On12002400360048006000SE +/- 6.56, N = 3SE +/- 3.71, N = 357494698-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerAVX-512 OffAVX-512 On150300450600750SE +/- 2.08, N = 3SE +/- 1.00, N = 3710581-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 24.46, N = 3SE +/- 10.17, N = 3113219271-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerAVX-512 OffAVX-512 On5K10K15K20K25KSE +/- 27.41, N = 3SE +/- 13.75, N = 32264718546-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerAVX-512 OffAVX-512 On4080120160200SE +/- 0.33, N = 3SE +/- 0.00, N = 3184154-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path TracerAVX-512 OffAVX-512 On6001200180024003000SE +/- 0.88, N = 3SE +/- 9.17, N = 329242384-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerAVX-512 OffAVX-512 On13002600390052006500SE +/- 8.25, N = 3SE +/- 6.24, N = 358614764-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerAVX-512 OffAVX-512 On160320480640800SE +/- 0.67, N = 3SE +/- 1.00, N = 3722604-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 15.51, N = 3SE +/- 2.19, N = 3115249385-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerAVX-512 OffAVX-512 On5K10K15K20K25KSE +/- 30.02, N = 3SE +/- 20.34, N = 32298518808-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerAVX-512 OffAVX-512 On50100150200250SE +/- 0.58, N = 3SE +/- 0.00, N = 3214177-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path TracerAVX-512 OffAVX-512 On7001400210028003500SE +/- 7.00, N = 3SE +/- 3.06, N = 334132804-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerAVX-512 OffAVX-512 On15003000450060007500SE +/- 5.51, N = 3SE +/- 9.54, N = 368205608-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerAVX-512 OffAVX-512 On2004006008001000SE +/- 1.15, N = 3SE +/- 1.53, N = 3841694-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerAVX-512 OffAVX-512 On3K6K9K12K15KSE +/- 22.81, N = 3SE +/- 27.14, N = 31339811070-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerAVX-512 OffAVX-512 On6K12K18K24K30KSE +/- 15.62, N = 3SE +/- 21.63, N = 32678522184-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPUAVX-512 OffAVX-512 On0.1210.2420.3630.4840.605SE +/- 0.004200, N = 15SE +/- 0.004067, N = 70.5376820.516167-mno-avx512f - MIN: 0.42-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.421. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPUAVX-512 OffAVX-512 On510152025SE +/- 0.06, N = 3SE +/- 0.16, N = 322.8422.59-mno-avx512f - MIN: 20.22-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 19.61. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPUAVX-512 OffAVX-512 On0.39680.79361.19041.58721.984SE +/- 0.004550, N = 9SE +/- 0.001906, N = 91.7633600.989591-mno-avx512f - MIN: 1.55-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.91. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPUAVX-512 OffAVX-512 On11002200330044005500SE +/- 60.12, N = 4SE +/- 20.13, N = 54953.981962.06-mno-avx512f - MIN: 4690.85-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 1899.341. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPUAVX-512 OffAVX-512 On11002200330044005500SE +/- 41.71, N = 3SE +/- 19.67, N = 154989.131955.39-mno-avx512f - MIN: 4767.22-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 1769.71. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPUAVX-512 OffAVX-512 On5001000150020002500SE +/- 22.32, N = 3SE +/- 24.41, N = 41715.762361.27-mno-avx512f - MIN: 1607.13-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 2265.71. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

Mobile Neural Network

Model: resnet-v2-50

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: resnet-v2-50AVX-512 OffAVX-512 On612182430SE +/- 0.08, N = 8SE +/- 0.08, N = 924.1015.44-mno-avx512f - MIN: 23.44 / MAX: 71.32-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 14.79 / MAX: 54.051. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: SqueezeNetV1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: SqueezeNetV1.0AVX-512 OffAVX-512 On3691215SE +/- 0.091, N = 8SE +/- 0.147, N = 99.1468.579-mno-avx512f - MIN: 7.72 / MAX: 19.03-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 6.67 / MAX: 21.51. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: inception-v3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: inception-v3AVX-512 OffAVX-512 On1020304050SE +/- 0.13, N = 8SE +/- 0.23, N = 930.4445.81-mno-avx512f - MIN: 28.75 / MAX: 109.22-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 44.13 / MAX: 87.281. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

NCNN

Target: CPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: mnasnetAVX-512 OffAVX-512 On1020304050SE +/- 0.49, N = 3SE +/- 0.26, N = 844.1942.30-mno-avx512f - MIN: 41.56 / MAX: 148.98-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 39.64 / MAX: 571.781. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: efficientnet-b0AVX-512 OffAVX-512 On1428425670SE +/- 0.31, N = 3SE +/- 0.35, N = 862.8657.71-mno-avx512f - MIN: 59.46 / MAX: 154.82-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 54.52 / MAX: 522.741. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: blazefaceAVX-512 OffAVX-512 On714212835SE +/- 0.54, N = 3SE +/- 0.18, N = 829.0025.88-mno-avx512f - MIN: 26.03 / MAX: 144.12-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 24.45 / MAX: 112.371. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: googlenetAVX-512 OffAVX-512 On20406080100SE +/- 1.35, N = 3SE +/- 0.76, N = 876.1372.80-mno-avx512f - MIN: 70.13 / MAX: 155.61-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 67.13 / MAX: 388.521. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: resnet50AVX-512 OffAVX-512 On1530456075SE +/- 0.89, N = 3SE +/- 0.50, N = 867.4866.34-mno-avx512f - MIN: 63.4 / MAX: 170.14-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 62.92 / MAX: 194.741. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: regnety_400mAVX-512 OffAVX-512 On60120180240300SE +/- 3.75, N = 3SE +/- 2.25, N = 8270.12247.32-mno-avx512f - MIN: 245.47 / MAX: 498.8-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 232.61 / MAX: 506.551. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: vision_transformer

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: vision_transformerAVX-512 OffAVX-512 On20406080100SE +/- 5.82, N = 3SE +/- 1.59, N = 886.1674.93-mno-avx512f - MIN: 73.72 / MAX: 1760.74-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 65.04 / MAX: 2154.621. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: FastestDet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: FastestDetAVX-512 OffAVX-512 On1428425670SE +/- 2.90, N = 3SE +/- 0.49, N = 860.7358.95-mno-avx512f - MIN: 52.89 / MAX: 236.85-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 55.11 / MAX: 282.721. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Face Detection FP16 - Device: CPUAVX-512 OffAVX-512 On2004006008001000SE +/- 0.51, N = 3SE +/- 0.24, N = 31088.50469.29-mno-avx512f - MIN: 937.5 / MAX: 1231.55-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 410.93 / MAX: 547.331. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Face Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On110220330440550SE +/- 0.07, N = 3SE +/- 0.01, N = 3503.50246.98-mno-avx512f - MIN: 402.47 / MAX: 569.65-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 204.5 / MAX: 299.541. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUAVX-512 OffAVX-512 On0.27230.54460.81691.08921.3615SE +/- 0.01, N = 4SE +/- 0.00, N = 31.210.55-mno-avx512f - MIN: 0.98 / MAX: 47.37-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.5 / MAX: 29.571. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On0.12830.25660.38490.51320.6415SE +/- 0.00, N = 3SE +/- 0.00, N = 30.570.36-mno-avx512f - MIN: 0.52 / MAX: 47.93-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.34 / MAX: 33.71. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Detection FP16 - Device: CPUAVX-512 OffAVX-512 On400800120016002000SE +/- 15.65, N = 3SE +/- 4.83, N = 31864.931100.25-mno-avx512f - MIN: 1371.29 / MAX: 2532.74-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 783.9 / MAX: 1824.921. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Detection FP32 - Device: CPUAVX-512 OffAVX-512 On400800120016002000SE +/- 3.32, N = 3SE +/- 4.44, N = 31845.951101.00-mno-avx512f - MIN: 1386.31 / MAX: 2798-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 840.82 / MAX: 1792.511. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On510152025SE +/- 0.01, N = 3SE +/- 0.01, N = 319.699.63-mno-avx512f - MIN: 16.4 / MAX: 74.85-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 8.29 / MAX: 57.531. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16 - Device: CPUAVX-512 OffAVX-512 On3691215SE +/- 0.01, N = 3SE +/- 0.01, N = 311.664.79-mno-avx512f - MIN: 9.72 / MAX: 43.7-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 3.98 / MAX: 28.791. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On246810SE +/- 0.00, N = 3SE +/- 0.00, N = 37.904.28-mno-avx512f - MIN: 6.37 / MAX: 41.53-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 3.5 / MAX: 42.621. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16 - Device: CPUAVX-512 OffAVX-512 On3691215SE +/- 0.03, N = 3SE +/- 0.00, N = 312.676.43-mno-avx512f - MIN: 9.58 / MAX: 77.91-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 5.22 / MAX: 61.261. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUAVX-512 OffAVX-512 On3691215SE +/- 0.00, N = 3SE +/- 0.00, N = 39.335.29-mno-avx512f - MIN: 7.39 / MAX: 57.57-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 4.36 / MAX: 45.251. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Machine Translation EN To DE FP16 - Device: CPUAVX-512 OffAVX-512 On20406080100SE +/- 0.74, N = 3SE +/- 0.21, N = 3107.6250.11-mno-avx512f - MIN: 83.48 / MAX: 216.07-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 38.98 / MAX: 166.691. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On3691215SE +/- 0.05, N = 3SE +/- 0.06, N = 313.5911.76

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On4080120160200SE +/- 0.10, N = 3SE +/- 0.47, N = 3187.85155.35

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On1.26632.53263.79895.06526.3315SE +/- 0.0091, N = 3SE +/- 0.0031, N = 35.62825.3413

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On20406080100SE +/- 0.05, N = 3SE +/- 0.14, N = 395.3380.08

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On1530456075SE +/- 0.02, N = 3SE +/- 0.11, N = 367.9149.03

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On816243240SE +/- 0.04, N = 3SE +/- 0.03, N = 332.6628.96

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On48121620SE +/- 0.0334, N = 3SE +/- 0.0172, N = 314.06559.9408

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On4080120160200SE +/- 0.23, N = 3SE +/- 0.11, N = 3195.17125.79

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On246810SE +/- 0.0068, N = 3SE +/- 0.0061, N = 36.33135.2712

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On306090120150SE +/- 0.25, N = 3SE +/- 0.12, N = 3138.59111.73

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On816243240SE +/- 0.11, N = 3SE +/- 0.07, N = 332.7529.19

Numenta Anomaly Benchmark

Detector: Bayesian Changepoint

OpenBenchmarking.orgSeconds, Fewer Is BetterNumenta Anomaly Benchmark 1.1Detector: Bayesian ChangepointAVX-512 OffAVX-512 On48121620SE +/- 0.19, N = 5SE +/- 0.21, N = 417.3916.68

Numenta Anomaly Benchmark

Detector: Windowed Gaussian

OpenBenchmarking.orgSeconds, Fewer Is BetterNumenta Anomaly Benchmark 1.1Detector: Windowed GaussianAVX-512 OffAVX-512 On1.09852.1973.29554.3945.4925SE +/- 0.044, N = 7SE +/- 0.032, N = 154.8824.727

Numenta Anomaly Benchmark

Detector: Relative Entropy

OpenBenchmarking.orgSeconds, Fewer Is BetterNumenta Anomaly Benchmark 1.1Detector: Relative EntropyAVX-512 OffAVX-512 On3691215SE +/- 0.082, N = 5SE +/- 0.089, N = 510.0359.898

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Mesh Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Mesh TimeAVX-512 OffAVX-512 On306090120150144.35135.771. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Execution Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Execution TimeAVX-512 OffAVX-512 On306090120150135.22113.641. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

CP2K Molecular Dynamics

Input: Fayalite-FIST

OpenBenchmarking.orgSeconds, Fewer Is BetterCP2K Molecular Dynamics 8.2Input: Fayalite-FISTAVX-512 OffAVX-512 On300600900120015001198.411122.73

AI Benchmark Alpha

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off130.7308.8452.7AVX-512 On52.9302.7502.0OpenBenchmarking.orgWatts, Fewer Is BetterAI Benchmark Alpha 0.1.2CPU Power Consumption Monitor130260390520650

Neural Magic DeepSparse

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off111.5321.8409.9AVX-512 On50.9306.4407.9OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption Monitor110220330440550

Neural Magic DeepSparse

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off216508705AVX-512 On53479679OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption Monitor2004006008001000

Neural Magic DeepSparse

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off197.4352.2401.6AVX-512 On37.8324.6394.5OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption Monitor110220330440550

Neural Magic DeepSparse

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off217552659AVX-512 On49517625OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption Monitor2004006008001000

Neural Magic DeepSparse

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off216558637AVX-512 On56531630OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption Monitor2004006008001000

Neural Magic DeepSparse

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off110.4350.8422.9AVX-512 On49.8321.8419.4OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption Monitor110220330440550

Neural Magic DeepSparse

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off124.0352.9412.6AVX-512 On57.7334.2406.1OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption Monitor110220330440550

Neural Magic DeepSparse

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off114503700AVX-512 On54537700OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption Monitor2004006008001000

Neural Magic DeepSparse

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off202.0364.8414.2AVX-512 On52.3341.3408.7OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption Monitor110220330440550

Neural Magic DeepSparse

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off217552656AVX-512 On28553664OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption Monitor2004006008001000

Neural Magic DeepSparse

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off210.0351.1423.9AVX-512 On30.2328.4418.5OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption Monitor110220330440550

TensorFlow

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off165.7338.8379.7AVX-512 On53.5307.1397.4OpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.10CPU Power Consumption Monitor110220330440550

TensorFlow

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off169.7318.9350.5AVX-512 On48.9299.7409.2OpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.10CPU Power Consumption Monitor110220330440550

TensorFlow

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off156.1298.9329.3AVX-512 On53.1308.0379.5OpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.10CPU Power Consumption Monitor100200300400500

LeelaChessZero

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off153.2384.0522.8AVX-512 On55.6381.7514.0OpenBenchmarking.orgWatts, Fewer Is BetterLeelaChessZero 0.28CPU Power Consumption Monitor130260390520650

LeelaChessZero

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off112.5383.3519.6AVX-512 On56.3365.4500.1OpenBenchmarking.orgWatts, Fewer Is BetterLeelaChessZero 0.28CPU Power Consumption Monitor130260390520650

Embree

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off132410637AVX-512 On50301635OpenBenchmarking.orgWatts, Fewer Is BetterEmbree 3.13CPU Power Consumption Monitor2004006008001000

Embree

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off217319632AVX-512 On56254632OpenBenchmarking.orgWatts, Fewer Is BetterEmbree 3.13CPU Power Consumption Monitor2004006008001000

Embree

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off174439660AVX-512 On54346646OpenBenchmarking.orgWatts, Fewer Is BetterEmbree 3.13CPU Power Consumption Monitor2004006008001000

OpenVKL

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off114491692AVX-512 On56467670OpenBenchmarking.orgWatts, Fewer Is BetterOpenVKL 1.3.1CPU Power Consumption Monitor2004006008001000

OSPRay

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off222618662AVX-512 On56580633OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.10CPU Power Consumption Monitor2004006008001000

OSPRay

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off177620662AVX-512 On56582632OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.10CPU Power Consumption Monitor2004006008001000

OSPRay

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off221628677AVX-512 On58593646OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.10CPU Power Consumption Monitor2004006008001000

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off218614692AVX-512 On55593680OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption Monitor2004006008001000

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off223622699AVX-512 On56599685OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption Monitor2004006008001000

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off222629702AVX-512 On58606687OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption Monitor2004006008001000

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off225610697AVX-512 On51590687OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption Monitor2004006008001000

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off223638703AVX-512 On56618684OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption Monitor2004006008001000

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off128610701AVX-512 On58623687OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption Monitor2004006008001000

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off203613697AVX-512 On59591670OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption Monitor2004006008001000

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off116621701AVX-512 On29599684OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption Monitor2004006008001000

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off224627702AVX-512 On54604686OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption Monitor2004006008001000

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off223609696AVX-512 On55578672OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption Monitor2004006008001000

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off114635701AVX-512 On57616688OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption Monitor2004006008001000

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off224609700AVX-512 On60616683OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption Monitor2004006008001000

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off223621696AVX-512 On38597682OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption Monitor2004006008001000

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off223621699AVX-512 On31602684OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption Monitor2004006008001000

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off222630700AVX-512 On58611684OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption Monitor2004006008001000

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off221612698AVX-512 On39591684OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption Monitor2004006008001000

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off114637703AVX-512 On60618690OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption Monitor2004006008001000

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off224620702AVX-512 On57590687OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption Monitor2004006008001000

oneDNN

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off216.4379.5540.9AVX-512 On54.1327.3548.8OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 2.7CPU Power Consumption Monitor140280420560700

oneDNN

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off215.5392.5509.7AVX-512 On52.1376.1492.5OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 2.7CPU Power Consumption Monitor130260390520650

oneDNN

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off215.2323.9475.6AVX-512 On54.0248.8512.8OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 2.7CPU Power Consumption Monitor130260390520650

oneDNN

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off215.2412.5499.6AVX-512 On55.5418.6541.1OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 2.7CPU Power Consumption Monitor140280420560700

oneDNN

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off195.7412.5498.9AVX-512 On52.5419.2543.1OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 2.7CPU Power Consumption Monitor140280420560700

oneDNN

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off204.0413.9482.1AVX-512 On55.2413.8581.1OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 2.7CPU Power Consumption Monitor160320480640800

Mobile Neural Network

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterMobile Neural Network 2.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On60120180240300Min: 165 / Avg: 334.93 / Max: 346.27Min: 53.81 / Avg: 327.57 / Max: 340

Cpuminer-Opt

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off215558618AVX-512 On55594682OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption Monitor2004006008001000

Cpuminer-Opt

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off134587654AVX-512 On57618724OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption Monitor2004006008001000

Cpuminer-Opt

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off221580645AVX-512 On39568650OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption Monitor2004006008001000

Cpuminer-Opt

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off220587657AVX-512 On57596694OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption Monitor2004006008001000

Cpuminer-Opt

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off221599665AVX-512 On58622720OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption Monitor2004006008001000

Cpuminer-Opt

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off222613684AVX-512 On59643743OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption Monitor2004006008001000

NCNN

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNCNN 20220729CPU Power Consumption MonitorAVX-512 OffAVX-512 On80160240320400Min: 199.1 / Avg: 400.13 / Max: 450.41Min: 54.96 / Avg: 396.44 / Max: 451.5

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off218585645AVX-512 On54639725OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor2004006008001000

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off216662733AVX-512 On58612687OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor2004006008001000

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off219592636AVX-512 On48566622OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor2004006008001000

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off217592630AVX-512 On29514564OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor2004006008001000

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off114579650AVX-512 On56605699OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor2004006008001000

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off215593665AVX-512 On38607700OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor2004006008001000

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off216684729AVX-512 On57639696OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor2004006008001000

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off221598639AVX-512 On58660712OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor2004006008001000

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off214634676AVX-512 On33598646OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor2004006008001000

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off217613655AVX-512 On59633690OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor2004006008001000

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off218588640AVX-512 On51588657OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor2004006008001000

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off213595648AVX-512 On57636701OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption Monitor2004006008001000

GROMACS

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off216553700AVX-512 On58535698OpenBenchmarking.orgWatts, Fewer Is BetterGROMACS 2022.1CPU Power Consumption Monitor2004006008001000

ONNX Runtime

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On90180270360450Min: 211.3 / Avg: 502.96 / Max: 528.22Min: 51.68 / Avg: 494.16 / Max: 531.99

ONNX Runtime

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On50100150200250Min: 132.49 / Avg: 266.8 / Max: 278.02Min: 53.19 / Avg: 259.31 / Max: 268.38

ONNX Runtime

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off193.6379.6388.9AVX-512 On50.3370.5385.5OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.11CPU Power Consumption Monitor100200300400500

ONNX Runtime

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On80160240320400Min: 107.66 / Avg: 447.6 / Max: 464.67Min: 51.25 / Avg: 441.77 / Max: 464.82

Numpy Benchmark

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off110.9221.9228.1AVX-512 On54.1214.2222.9OpenBenchmarking.orgWatts, Fewer Is BetterNumpy BenchmarkCPU Power Consumption Monitor60120180240300

miniBUDE

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off212414630AVX-512 On52281624OpenBenchmarking.orgWatts, Fewer Is BetterminiBUDE 20210901CPU Power Consumption Monitor2004006008001000

miniBUDE

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off211564661AVX-512 On54499647OpenBenchmarking.orgWatts, Fewer Is BetterminiBUDE 20210901CPU Power Consumption Monitor2004006008001000

SVT-AV1

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off108.8243.3325.0AVX-512 On52.7162.9323.1OpenBenchmarking.orgWatts, Fewer Is BetterSVT-AV1 1.4CPU Power Consumption Monitor80160240320400

SVT-AV1

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off127.1241.8338.9AVX-512 On52.7175.4338.1OpenBenchmarking.orgWatts, Fewer Is BetterSVT-AV1 1.4CPU Power Consumption Monitor80160240320400

Numenta Anomaly Benchmark

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off137.1251.1391.0AVX-512 On55.1216.0378.8OpenBenchmarking.orgWatts, Fewer Is BetterNumenta Anomaly Benchmark 1.1CPU Power Consumption Monitor100200300400500

Numenta Anomaly Benchmark

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off212.5259.2394.2AVX-512 On53.3184.7388.1OpenBenchmarking.orgWatts, Fewer Is BetterNumenta Anomaly Benchmark 1.1CPU Power Consumption Monitor110220330440550

Numenta Anomaly Benchmark

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off213.2250.8339.2AVX-512 On53.6202.8367.2OpenBenchmarking.orgWatts, Fewer Is BetterNumenta Anomaly Benchmark 1.1CPU Power Consumption Monitor100200300400500

Intel Open Image Denoise

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off206.5366.7574.9AVX-512 On48.8287.6572.9OpenBenchmarking.orgWatts, Fewer Is BetterIntel Open Image Denoise 1.4.0CPU Power Consumption Monitor140280420560700

Intel Open Image Denoise

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off208.7365.6577.3AVX-512 On52.1288.6574.3OpenBenchmarking.orgWatts, Fewer Is BetterIntel Open Image Denoise 1.4.0CPU Power Consumption Monitor140280420560700

Intel Open Image Denoise

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off207.2399.0572.6AVX-512 On52.8325.6574.0OpenBenchmarking.orgWatts, Fewer Is BetterIntel Open Image Denoise 1.4.0CPU Power Consumption Monitor140280420560700

Darmstadt Automotive Parallel Heterogeneous Suite

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off215.0244.8282.7AVX-512 On37.8213.7282.2OpenBenchmarking.orgWatts, Fewer Is BetterDarmstadt Automotive Parallel Heterogeneous SuiteCPU Power Consumption Monitor70140210280350

Darmstadt Automotive Parallel Heterogeneous Suite

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterDarmstadt Automotive Parallel Heterogeneous SuiteCPU Power Consumption MonitorAVX-512 OffAVX-512 On50100150200250Min: 136.19 / Avg: 273.1 / Max: 289.31Min: 49.36 / Avg: 258.94 / Max: 283.12

simdjson

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off113.7224.4230.2AVX-512 On50.2211.4225.1OpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 2.0CPU Power Consumption Monitor60120180240300

simdjson

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off111.6222.5224.6AVX-512 On53.8207.0220.8OpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 2.0CPU Power Consumption Monitor60120180240300

simdjson

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off112.5223.5225.7AVX-512 On54.4209.9221.6OpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 2.0CPU Power Consumption Monitor60120180240300

simdjson

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off111.3221.2223.7AVX-512 On35.8209.0219.1OpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 2.0CPU Power Consumption Monitor60120180240300

simdjson

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off111.2221.5223.4AVX-512 On55.3209.4219.2OpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 2.0CPU Power Consumption Monitor60120180240300

OpenFOAM

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off220674735AVX-512 On57662731OpenBenchmarking.orgWatts, Fewer Is BetterOpenFOAM 10CPU Power Consumption Monitor2004006008001000

CP2K Molecular Dynamics

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off118.3361.5403.0AVX-512 On58.1358.0402.6OpenBenchmarking.orgWatts, Fewer Is BetterCP2K Molecular Dynamics 8.2CPU Power Consumption Monitor110220330440550

JPEG XL libjxl

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off142.6233.9323.3AVX-512 On54.8223.4308.1OpenBenchmarking.orgWatts, Fewer Is BetterJPEG XL libjxl 0.7CPU Power Consumption Monitor80160240320400

JPEG XL libjxl

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterJPEG XL libjxl 0.7CPU Power Consumption MonitorAVX-512 OffAVX-512 On50100150200250Min: 110.34 / Avg: 222.62 / Max: 261.2Min: 28.84 / Avg: 217.33 / Max: 256.47

JPEG XL libjxl

CPU Power Consumption Monitor

MinAvgMaxAVX-512 Off134.0232.4317.2AVX-512 On56.1222.2318.2OpenBenchmarking.orgWatts, Fewer Is BetterJPEG XL libjxl 0.7CPU Power Consumption Monitor80160240320400

Phoronix Test Suite v10.8.5