AMD Ryzen 9 7950X / Ryzen 9 9950X AVX-512 Comparison

AMD Ryzen 9 7950X and Ryzen 9 9950X AVX-512 on/off comparison benchmarks by Michael Larabel for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2408145-NE-RYZEN999549
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Limit displaying results to tests within:

CPU Massive 5 Tests
Creator Workloads 6 Tests
HPC - High Performance Computing 12 Tests
Machine Learning 9 Tests
Molecular Dynamics 2 Tests
Multi-Core 8 Tests
NVIDIA GPU Compute 2 Tests
Intel oneAPI 6 Tests
Python Tests 5 Tests
Raytracing 2 Tests
Renderers 2 Tests
Scientific Computing 2 Tests
Server CPU Tests 3 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Multi-Way Comparison

Condense Comparison
Transpose Comparison

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
Ryzen 9 9950X: AVX-512 On
August 11
  5 Hours, 44 Minutes
Ryzen 9 9950X: AVX-512 Off
August 12
  5 Hours, 22 Minutes
Ryzen 9 7950X: AVX-512 On
August 12
  5 Hours, 35 Minutes
Ryzen 9 7950X: AVX-512 Off
August 12
  5 Hours, 39 Minutes
Invert Hiding All Results Option
  5 Hours, 35 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


AMD Ryzen 9 7950X / Ryzen 9 9950X AVX-512 ComparisonOpenBenchmarking.orgPhoronix Test SuiteAMD Ryzen 9 9950X 16-Core @ 5.75GHz (16 Cores / 32 Threads)AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads)ASUS ROG STRIX X670E-E GAMING WIFI (2124 BIOS)AMD Device 14d82 x 16GB DDR5-6000MT/s G Skill F5-6000J3038F16G2000GB Corsair MP700 PROAMD Radeon RX 7900 GRE 16GBAMD Navi 31 HDMI/DPDELL U2723QEIntel I225-V + Intel Wi-Fi 6EUbuntu 24.046.10.0-phx (x86_64)GNOME Shell 46.0X Server + Wayland4.6 Mesa 24.2~git2406040600.8112d4~oibaf~n (git-8112d44 2024-06-04 noble-oibaf-ppa) (LLVM 17.0.6 DRM 3.57)GCC 13.2.0ext43840x2160ProcessorsMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLCompilerFile-SystemScreen ResolutionAMD Ryzen 9 7950X / Ryzen 9 9950X AVX-512 Comparison BenchmarksSystem Logs- Transparent Huge Pages: madvise- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Ryzen 9 9950X: AVX-512 On: Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xb40401a- Ryzen 9 9950X: AVX-512 Off: Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xb40401a- Ryzen 9 7950X: AVX-512 On: Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xa601206- Ryzen 9 7950X: AVX-512 Off: Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xa601206- Python 3.12.3- Ryzen 9 9950X: AVX-512 On: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Ryzen 9 9950X: AVX-512 Off: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Ryzen 9 7950X: AVX-512 On: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Ryzen 9 7950X: AVX-512 Off: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

lczero: BLASlczero: Eigenminibude: OpenMP - BM1minibude: OpenMP - BM1namd: ATPase with 327,506 Atomsnamd: STMV with 1,066,628 Atomssimdjson: Kostyasimdjson: TopTweetsimdjson: LargeRandsimdjson: PartialTweetssimdjson: DistinctUserIDembree: Pathtracer ISPC - Crownembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Asian Dragon Objopenvkl: vklBenchmarkCPU ISPCospray: particle_volume/pathtracer/real_timeospray: gravity_spheres_volume/dim_512/ao/real_timeospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: gravity_spheres_volume/dim_512/pathtracer/real_timey-cruncher: 1By-cruncher: 500Monednn: IP Shapes 1D - CPUonednn: IP Shapes 3D - CPUonednn: Deconvolution Batch shapes_1d - CPUonednn: Deconvolution Batch shapes_3d - CPUonednn: Recurrent Neural Network Training - CPUonednn: Recurrent Neural Network Inference - CPUospray-studio: 1 - 4K - 1 - Path Tracer - CPUospray-studio: 3 - 4K - 1 - Path Tracer - CPUospray-studio: 1 - 4K - 16 - Path Tracer - CPUospray-studio: 1 - 4K - 32 - Path Tracer - CPUospray-studio: 3 - 4K - 16 - Path Tracer - CPUospray-studio: 3 - 4K - 32 - Path Tracer - CPUnumpy: gromacs: MPI CPU - water_GMX50_barepytorch: CPU - 1 - ResNet-50pytorch: CPU - 64 - ResNet-50tensorflow: CPU - 1 - ResNet-50tensorflow: CPU - 64 - ResNet-50mnn: resnet-v2-50xnnpack: QU8MobileNetV2xnnpack: QU8MobileNetV3Largeopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUonnx: CaffeNet 12-int8 - CPU - Standardonnx: CaffeNet 12-int8 - CPU - Standardonnx: fcn-resnet101-11 - CPU - Standardonnx: fcn-resnet101-11 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Standardonnx: ResNet50 v1-12-int8 - CPU - Standardonnx: ResNet50 v1-12-int8 - CPU - Standardonnx: super-resolution-10 - CPU - Standardonnx: super-resolution-10 - CPU - StandardRyzen 9 9950XRyzen 9 7950X AVX-512 On AVX-512 Off AVX-512 On AVX-512 Off2202201929.75377.1903.483380.987077.4712.952.0712.3813.0536.651541.351535.5071765277.2809.727009.5327711.030016.4907.5700.6648753.075301.788461.36386759.934404.6973225382954022105798634761245961054.923.13585.1457.8916.8251.7410.048785115423.29342.81109.2973.12908.968.774938.981.532327.186.82638.6712.50177.1145.102133.763.721867.608.43962.9216.563027.682.5955883.540.25872.9401.145954.85488205.98055.507818.0181571.4681.74942227.6464.39253205162961.72738.4691.697570.484926.4310.331.909.9910.4434.627239.532734.0814656261.1566.706626.469209.0837620.2309.0731.058556.167212.411922.597611258.80635.7323594423559958117712703641383971010.592.66970.1447.0512.9838.9911.31785611776.801168.9460.69131.60521.7015.292015.673.92675.8523.57476.8816.7477.69102.86792.0310.061201.7313.18346.4346.111034.547.6719062.580.75803.4421.244003.60032277.75149.806520.0769447.2382.23540151.0236.621281711771328.05053.1223.058770.825816.0110.481.819.4710.2833.766534.711129.5469647239.2978.076467.937309.1796216.0297.6961.006613.115082.753462.388301245.28629.598400447356761113160579271154740794.792.74074.4650.2316.2344.0810.875807109414.33556.00101.5178.75795.7010.023357.782.281454.5210.97481.0416.58138.7957.561667.924.771680.429.36775.1220.612059.523.8736493.600.4695.7311.436823.54775281.86747.852520.8958419.1862.38498144.7776.90690168142960.03738.4011.493540.426144.807.641.587.207.5928.782831.037826.7169507210.8504.442334.208256.3575518.0578.3951.211956.602932.802512.724631303.16664.154513160208527716680599475195460731.832.59263.2343.8712.2219.7312.65587011306.871158.0162.80127.26483.5916.502015.993.94674.7723.67359.2622.2276.77104.11791.2610.081166.2413.57326.3048.981048.497.6117640.840.80605.7711.650243.41636292.70747.847320.8995299.6693.33639137.1267.29254OpenBenchmarking.org

LeelaChessZero

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.31.1Backend: BLASAVX-512 OnAVX-512 Off50100150200250SE +/- 1.76, N = 3SE +/- 2.40, N = 3SE +/- 1.65, N = 6SE +/- 0.33, N = 32202051711681. (CXX) g++ options: -flto -pthread

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.31.1Backend: EigenAVX-512 OnAVX-512 Off50100150200250SE +/- 1.76, N = 3SE +/- 1.53, N = 3SE +/- 2.03, N = 3SE +/- 1.67, N = 32201621771421. (CXX) g++ options: -flto -pthread

miniBUDE

MiniBUDE is a mini application for the the core computation of the Bristol University Docking Engine (BUDE). This test profile currently makes use of the OpenMP implementation of miniBUDE for CPU benchmarking. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OnAVX-512 Off400800120016002000SE +/- 1.54, N = 5SE +/- 0.52, N = 3SE +/- 0.05, N = 4SE +/- 8.36, N = 31929.75961.731328.05960.041. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OnAVX-512 Off20406080100SE +/- 0.06, N = 5SE +/- 0.02, N = 3SE +/- 0.00, N = 4SE +/- 0.33, N = 377.1938.4753.1238.401. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

NAMD

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgns/day, More Is BetterNAMD 3.0b6Input: ATPase with 327,506 AtomsAVX-512 OnAVX-512 Off0.78381.56762.35143.13523.919SE +/- 0.02808, N = 3SE +/- 0.01059, N = 3SE +/- 0.02678, N = 3SE +/- 0.00219, N = 33.483381.697573.058771.49354

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgns/day, More Is BetterNAMD 3.0b6Input: STMV with 1,066,628 AtomsAVX-512 OnAVX-512 Off0.22210.44420.66630.88841.1105SE +/- 0.00150, N = 3SE +/- 0.00040, N = 3SE +/- 0.00092, N = 3SE +/- 0.00052, N = 30.987070.484920.825810.42614

simdjson

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: KostyaAVX-512 OnAVX-512 Off246810SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 37.476.436.014.801. (CXX) g++ options: -O3 -lrt

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: TopTweetAVX-512 OnAVX-512 Off3691215SE +/- 0.14, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 3SE +/- 0.01, N = 312.9510.3310.487.641. (CXX) g++ options: -O3 -lrt

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: LargeRandomAVX-512 OnAVX-512 Off0.46580.93161.39741.86322.329SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 32.071.901.811.581. (CXX) g++ options: -O3 -lrt

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: PartialTweetsAVX-512 OnAVX-512 Off3691215SE +/- 0.12, N = 15SE +/- 0.08, N = 9SE +/- 0.02, N = 3SE +/- 0.07, N = 312.389.999.477.201. (CXX) g++ options: -O3 -lrt

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: DistinctUserIDAVX-512 OnAVX-512 Off3691215SE +/- 0.07, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 313.0510.4410.287.591. (CXX) g++ options: -O3 -lrt

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownAVX-512 OnAVX-512 Off816243240SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 336.6534.6333.7728.78

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 OnAVX-512 Off918273645SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 341.3539.5334.7131.04

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon ObjAVX-512 OnAVX-512 Off816243240SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 335.5134.0829.5526.72

OpenVKL

OpenVKL is the Intel Open Volume Kernel Library that offers high-performance volume computation kernels and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCAVX-512 OnAVX-512 Off160320480640800SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3765656647507

OSPRay

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.2Benchmark: particle_volume/pathtracer/real_timeAVX-512 OnAVX-512 Off60120180240300SE +/- 0.40, N = 3SE +/- 0.58, N = 3SE +/- 0.60, N = 3SE +/- 0.33, N = 3277.28261.16239.30210.85

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX-512 OnAVX-512 Off3691215SE +/- 0.00263, N = 3SE +/- 0.00321, N = 3SE +/- 0.01996, N = 3SE +/- 0.00077, N = 39.727006.706628.076464.44233

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 OnAVX-512 Off3691215SE +/- 0.01315, N = 3SE +/- 0.01723, N = 3SE +/- 0.00679, N = 3SE +/- 0.00671, N = 39.532776.469207.937304.20825

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 OnAVX-512 Off3691215SE +/- 0.00324, N = 3SE +/- 0.00447, N = 3SE +/- 0.01877, N = 3SE +/- 0.00125, N = 311.030009.083769.179626.35755

Y-Cruncher

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.5Pi Digits To Calculate: 1BAVX-512 OnAVX-512 Off510152025SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 316.0318.0616.4920.23

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.5Pi Digits To Calculate: 500MAVX-512 OnAVX-512 Off3691215SE +/- 0.002, N = 5SE +/- 0.008, N = 5SE +/- 0.007, N = 5SE +/- 0.009, N = 57.5709.0737.6968.395

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: IP Shapes 1D - Engine: CPUAVX-512 OnAVX-512 Off0.27270.54540.81811.09081.3635SE +/- 0.006767, N = 6SE +/- 0.002635, N = 4SE +/- 0.000816, N = 4SE +/- 0.000909, N = 40.6648751.0585501.0066101.2119501. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: IP Shapes 3D - Engine: CPUAVX-512 OnAVX-512 Off246810SE +/- 0.00113, N = 5SE +/- 0.00900, N = 5SE +/- 0.00401, N = 5SE +/- 0.00179, N = 53.075306.167213.115086.602931. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Deconvolution Batch shapes_1d - Engine: CPUAVX-512 OnAVX-512 Off0.63061.26121.89182.52243.153SE +/- 0.00399, N = 3SE +/- 0.00490, N = 3SE +/- 0.00663, N = 3SE +/- 0.00224, N = 31.788462.411922.753462.802511. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Deconvolution Batch shapes_3d - Engine: CPUAVX-512 OnAVX-512 Off0.6131.2261.8392.4523.065SE +/- 0.00309, N = 9SE +/- 0.01154, N = 9SE +/- 0.00055, N = 9SE +/- 0.00474, N = 91.363862.597612.388302.724631. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Recurrent Neural Network Training - Engine: CPUAVX-512 OnAVX-512 Off30060090012001500SE +/- 1.13, N = 3SE +/- 0.50, N = 3SE +/- 0.97, N = 3SE +/- 0.80, N = 3759.931258.801245.281303.161. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Recurrent Neural Network Inference - Engine: CPUAVX-512 OnAVX-512 Off140280420560700SE +/- 0.61, N = 3SE +/- 0.28, N = 3SE +/- 0.67, N = 3SE +/- 0.46, N = 3404.70635.73629.60664.151. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OSPRay Studio

Intel OSPRay Studio is an open-source, interactive visualization and ray-tracing software package. OSPRay Studio makes use of Intel OSPRay, a portable ray-tracing engine for high-performance, high-fidelity visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off11002200330044005500SE +/- 1.00, N = 3SE +/- 2.03, N = 3SE +/- 2.85, N = 3SE +/- 5.00, N = 33225359440045131

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off13002600390052006500SE +/- 1.53, N = 3SE +/- 4.33, N = 3SE +/- 10.17, N = 3SE +/- 9.87, N = 33829423547356020

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off20K40K60K80K100KSE +/- 42.15, N = 3SE +/- 25.03, N = 3SE +/- 142.41, N = 3SE +/- 106.67, N = 354022599586761185277

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off40K80K120K160K200KSE +/- 68.30, N = 3SE +/- 147.11, N = 3SE +/- 209.54, N = 3SE +/- 116.94, N = 3105798117712131605166805

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off20K40K60K80K100KSE +/- 49.41, N = 3SE +/- 36.23, N = 3SE +/- 199.04, N = 3SE +/- 91.66, N = 363476703647927199475

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OnAVX-512 Off40K80K120K160K200KSE +/- 55.03, N = 3SE +/- 188.82, N = 3SE +/- 26.96, N = 3SE +/- 475.57, N = 3124596138397154740195460

Numpy Benchmark

This is a test to obtain the general Numpy performance. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgScore, More Is BetterNumpy BenchmarkAVX-512 OnAVX-512 Off2004006008001000SE +/- 6.93, N = 3SE +/- 2.31, N = 3SE +/- 6.26, N = 3SE +/- 2.88, N = 31054.921010.59794.79731.83

GROMACS

The GROMACS (GROningen MAchine for Chemical Simulations) molecular dynamics package testing with the water_GMX50 data. This test profile allows selecting between CPU and GPU-based GROMACS builds. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2024Implementation: MPI CPU - Input: water_GMX50_bareAVX-512 OnAVX-512 Off0.70541.41082.11622.82163.527SE +/- 0.004, N = 3SE +/- 0.004, N = 3SE +/- 0.001, N = 3SE +/- 0.006, N = 33.1352.6692.7402.5921. (CXX) g++ options: -O3 -lm

PyTorch

This is a benchmark of PyTorch making use of pytorch-benchmark [https://github.com/LukasHedegaard/pytorch-benchmark]. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 1 - Model: ResNet-50AVX-512 OnAVX-512 Off20406080100SE +/- 0.88, N = 4SE +/- 0.81, N = 4SE +/- 0.54, N = 3SE +/- 0.33, N = 385.1470.1474.4663.23

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 64 - Model: ResNet-50AVX-512 OnAVX-512 Off1326395265SE +/- 0.41, N = 3SE +/- 0.36, N = 3SE +/- 0.30, N = 3SE +/- 0.11, N = 357.8947.0550.2343.87

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: ResNet-50AVX-512 OnAVX-512 Off48121620SE +/- 0.04, N = 5SE +/- 0.01, N = 5SE +/- 0.03, N = 5SE +/- 0.02, N = 416.8212.9816.2312.22

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: ResNet-50AVX-512 OnAVX-512 Off1224364860SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 351.7438.9944.0819.73

Mobile Neural Network

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.9.b11b7037dModel: resnet-v2-50AVX-512 OnAVX-512 Off3691215SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 310.0511.3210.8812.661. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

XNNPACK

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgus, Fewer Is BetterXNNPACK 2cd86bModel: QU8MobileNetV2AVX-512 OnAVX-512 Off2004006008001000SE +/- 3.93, N = 3SE +/- 0.58, N = 3SE +/- 0.67, N = 3SE +/- 1.45, N = 37858568078701. (CXX) g++ options: -O3 -lrt -lm

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgus, Fewer Is BetterXNNPACK 2cd86bModel: QU8MobileNetV3LargeAVX-512 OnAVX-512 Off30060090012001500SE +/- 3.38, N = 3SE +/- 3.84, N = 3SE +/- 1.15, N = 3SE +/- 2.03, N = 310941130115411771. (CXX) g++ options: -O3 -lrt -lm

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off612182430SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 323.296.8014.336.871. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off30060090012001500SE +/- 0.13, N = 3SE +/- 3.79, N = 3SE +/- 0.04, N = 3SE +/- 0.43, N = 3342.811168.94556.001158.011. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off20406080100SE +/- 0.34, N = 3SE +/- 0.20, N = 3SE +/- 1.04, N = 3SE +/- 0.10, N = 3109.2960.69101.5162.801. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off306090120150SE +/- 0.22, N = 3SE +/- 0.43, N = 3SE +/- 0.82, N = 3SE +/- 0.21, N = 373.12131.6078.75127.261. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off2004006008001000SE +/- 0.91, N = 3SE +/- 2.33, N = 3SE +/- 6.59, N = 3SE +/- 1.66, N = 3908.96521.70795.70483.591. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off48121620SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.08, N = 3SE +/- 0.05, N = 38.7715.2910.0216.501. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16 - Device: CPUAVX-512 OnAVX-512 Off11002200330044005500SE +/- 7.46, N = 3SE +/- 7.10, N = 3SE +/- 2.51, N = 3SE +/- 4.63, N = 34938.982015.673357.782015.991. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16 - Device: CPUAVX-512 OnAVX-512 Off0.88651.7732.65953.5464.4325SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 31.533.922.283.941. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off5001000150020002500SE +/- 1.07, N = 3SE +/- 0.69, N = 3SE +/- 0.51, N = 3SE +/- 0.19, N = 32327.18675.851454.52674.771. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off612182430SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 36.8223.5710.9723.671. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPUAVX-512 OnAVX-512 Off140280420560700SE +/- 3.09, N = 3SE +/- 3.66, N = 3SE +/- 1.08, N = 3SE +/- 0.48, N = 3638.67476.88481.04359.261. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPUAVX-512 OnAVX-512 Off510152025SE +/- 0.06, N = 3SE +/- 0.13, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 312.5016.7416.5822.221. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPUAVX-512 OnAVX-512 Off4080120160200SE +/- 0.57, N = 3SE +/- 0.38, N = 3SE +/- 0.72, N = 3SE +/- 0.41, N = 3177.1177.69138.7976.771. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPUAVX-512 OnAVX-512 Off20406080100SE +/- 0.15, N = 3SE +/- 0.49, N = 3SE +/- 0.30, N = 3SE +/- 0.55, N = 345.10102.8657.56104.111. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off5001000150020002500SE +/- 5.99, N = 3SE +/- 3.56, N = 3SE +/- 10.71, N = 3SE +/- 8.20, N = 32133.76792.031667.92791.261. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPUAVX-512 OnAVX-512 Off3691215SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.11, N = 33.7210.064.7710.081. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPUAVX-512 OnAVX-512 Off400800120016002000SE +/- 3.92, N = 3SE +/- 2.28, N = 3SE +/- 2.92, N = 3SE +/- 2.29, N = 31867.601201.731680.421166.241. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPUAVX-512 OnAVX-512 Off3691215SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 38.4313.189.3613.571. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16 - Device: CPUAVX-512 OnAVX-512 Off2004006008001000SE +/- 1.39, N = 3SE +/- 0.29, N = 3SE +/- 4.65, N = 3SE +/- 0.62, N = 3962.92346.43775.12326.301. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16 - Device: CPUAVX-512 OnAVX-512 Off1122334455SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.13, N = 3SE +/- 0.09, N = 316.5646.1120.6148.981. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPUAVX-512 OnAVX-512 Off6001200180024003000SE +/- 2.87, N = 3SE +/- 0.29, N = 3SE +/- 1.23, N = 3SE +/- 1.51, N = 33027.681034.542059.521048.491. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPUAVX-512 OnAVX-512 Off246810SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 32.597.673.877.611. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUAVX-512 OnAVX-512 Off12K24K36K48K60KSE +/- 40.07, N = 3SE +/- 18.06, N = 3SE +/- 34.76, N = 3SE +/- 30.09, N = 355883.5419062.5836493.6017640.841. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUAVX-512 OnAVX-512 Off0.180.360.540.720.9SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.250.750.400.801. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: StandardAVX-512 OnAVX-512 Off2004006008001000SE +/- 7.80, N = 15SE +/- 0.45, N = 3SE +/- 3.29, N = 3SE +/- 0.54, N = 3872.94803.44695.73605.771. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: StandardAVX-512 OnAVX-512 Off1.09232.18463.27694.36925.4615SE +/- 0.01446, N = 3SE +/- 0.00187, N = 3SE +/- 0.00354, N = 3SE +/- 0.00295, N = 34.854883.600323.547753.416361. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardAVX-512 OnAVX-512 Off1224364860SE +/- 0.61, N = 3SE +/- 0.22, N = 3SE +/- 0.15, N = 3SE +/- 0.28, N = 355.5149.8147.8547.851. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: StandardAVX-512 OnAVX-512 Off120240360480600SE +/- 0.98, N = 3SE +/- 1.07, N = 3SE +/- 1.03, N = 3SE +/- 0.27, N = 3571.47447.24419.19299.671. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: StandardAVX-512 OnAVX-512 Off50100150200250SE +/- 0.18, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.52, N = 3227.65151.02144.78137.131. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgMegahertzCPU Peak Freq (Highest CPU Core Frequency) MonitorPhoronix Test Suite System MonitoringAVX-512 OffAVX-512 On10002000300040005000Min: 545 / Avg: 4954.31 / Max: 5725Min: 545 / Avg: 5001.33 / Max: 5725Min: 600 / Avg: 4986.91 / Max: 5728Min: 2477 / Avg: 5097.18 / Max: 5799

CPU Power Consumption Monitor

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringAVX-512 OnAVX-512 Off4080120160200Min: 22.78 / Avg: 148.64 / Max: 205.19Min: 13.82 / Avg: 152.26 / Max: 203.94Min: 10.68 / Avg: 169.29 / Max: 237.09Min: 11.34 / Avg: 172.33 / Max: 237.26

CPU Temperature Monitor

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsiusCPU Temperature MonitorPhoronix Test Suite System MonitoringAVX-512 OnAVX-512 Off20406080100Min: 40.5 / Avg: 73.15 / Max: 89.13Min: 39.5 / Avg: 75.07 / Max: 94.5Min: 37.63 / Avg: 80.57 / Max: 96.13Min: 37.25 / Avg: 83.51 / Max: 95.88

74 Results Shown

LeelaChessZero:
  BLAS
  Eigen
miniBUDE:
  OpenMP - BM1:
    GFInst/s
    Billion Interactions/s
NAMD:
  ATPase with 327,506 Atoms
  STMV with 1,066,628 Atoms
simdjson:
  Kostya
  TopTweet
  LargeRand
  PartialTweets
  DistinctUserID
Embree:
  Pathtracer ISPC - Crown
  Pathtracer ISPC - Asian Dragon
  Pathtracer ISPC - Asian Dragon Obj
OpenVKL
OSPRay:
  particle_volume/pathtracer/real_time
  gravity_spheres_volume/dim_512/ao/real_time
  gravity_spheres_volume/dim_512/scivis/real_time
  gravity_spheres_volume/dim_512/pathtracer/real_time
Y-Cruncher:
  1B
  500M
oneDNN:
  IP Shapes 1D - CPU
  IP Shapes 3D - CPU
  Deconvolution Batch shapes_1d - CPU
  Deconvolution Batch shapes_3d - CPU
  Recurrent Neural Network Training - CPU
  Recurrent Neural Network Inference - CPU
OSPRay Studio:
  1 - 4K - 1 - Path Tracer - CPU
  3 - 4K - 1 - Path Tracer - CPU
  1 - 4K - 16 - Path Tracer - CPU
  1 - 4K - 32 - Path Tracer - CPU
  3 - 4K - 16 - Path Tracer - CPU
  3 - 4K - 32 - Path Tracer - CPU
Numpy Benchmark
GROMACS
PyTorch:
  CPU - 1 - ResNet-50
  CPU - 64 - ResNet-50
TensorFlow:
  CPU - 1 - ResNet-50
  CPU - 64 - ResNet-50
Mobile Neural Network
XNNPACK:
  QU8MobileNetV2
  QU8MobileNetV3Large
OpenVINO:
  Face Detection FP16 - CPU:
    FPS
    ms
  Person Detection FP16 - CPU:
    FPS
    ms
  Vehicle Detection FP16 - CPU:
    FPS
    ms
  Face Detection Retail FP16 - CPU:
    FPS
    ms
  Weld Porosity Detection FP16 - CPU:
    FPS
    ms
  Road Segmentation ADAS FP16-INT8 - CPU:
    FPS
    ms
  Machine Translation EN To DE FP16 - CPU:
    FPS
    ms
  Person Vehicle Bike Detection FP16 - CPU:
    FPS
    ms
  Noise Suppression Poconet-Like FP16 - CPU:
    FPS
    ms
  Handwritten English Recognition FP16 - CPU:
    FPS
    ms
  Person Re-Identification Retail FP16 - CPU:
    FPS
    ms
  Age Gender Recognition Retail 0013 FP16 - CPU:
    FPS
    ms
ONNX Runtime:
  CaffeNet 12-int8 - CPU - Standard
  fcn-resnet101-11 - CPU - Standard
  ArcFace ResNet-100 - CPU - Standard
  ResNet50 v1-12-int8 - CPU - Standard
  super-resolution-10 - CPU - Standard
CPU Peak Freq (Highest CPU Core Frequency) Monitor:
  Phoronix Test Suite System Monitoring:
    Megahertz
    Watts
    Celsius