AMD Ryzen 9 7950X / Ryzen 9 9950X AVX-512 Comparison

AMD Ryzen 9 7950X and Ryzen 9 9950X AVX-512 on/off comparison benchmarks by Michael Larabel for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2408145-NE-RYZEN999549
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Limit displaying results to tests within:

CPU Massive 5 Tests
Creator Workloads 6 Tests
HPC - High Performance Computing 12 Tests
Machine Learning 9 Tests
Molecular Dynamics 2 Tests
Multi-Core 8 Tests
NVIDIA GPU Compute 2 Tests
Intel oneAPI 6 Tests
Python Tests 5 Tests
Raytracing 2 Tests
Renderers 2 Tests
Scientific Computing 2 Tests
Server CPU Tests 3 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Multi-Way Comparison

Condense Comparison
Transpose Comparison

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
Ryzen 9 9950X: AVX-512 On
August 11
  5 Hours, 44 Minutes
Ryzen 9 9950X: AVX-512 Off
August 12
  5 Hours, 22 Minutes
Ryzen 9 7950X: AVX-512 On
August 12
  5 Hours, 35 Minutes
Ryzen 9 7950X: AVX-512 Off
August 12
  5 Hours, 39 Minutes
Invert Hiding All Results Option
  5 Hours, 35 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

Ryzen 9 9950X: AVX-512 On

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xb40401a
Python Notes: Python 3.12.3
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Ryzen 9 9950X: AVX-512 Off

Processor: AMD Ryzen 9 9950X 16-Core @ 5.75GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG STRIX X670E-E GAMING WIFI (2124 BIOS), Chipset: AMD Device 14d8, Memory: 2 x 16GB DDR5-6000MT/s G Skill F5-6000J3038F16G, Disk: 2000GB Corsair MP700 PRO, Graphics: AMD Radeon RX 7900 GRE 16GB, Audio: AMD Navi 31 HDMI/DP, Monitor: DELL U2723QE, Network: Intel I225-V + Intel Wi-Fi 6E

OS: Ubuntu 24.04, Kernel: 6.10.0-phx (x86_64), Desktop: GNOME Shell 46.0, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 24.2~git2406040600.8112d4~oibaf~n (git-8112d44 2024-06-04 noble-oibaf-ppa) (LLVM 17.0.6 DRM 3.57), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 3840x2160

Ryzen 9 7950X: AVX-512 On

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xa601206
Python Notes: Python 3.12.3
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Ryzen 9 7950X: AVX-512 Off

Changed Processor to AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads).

AMD Ryzen 9 7950X / Ryzen 9 9950X AVX-512 ComparisonOpenBenchmarking.orgPhoronix Test SuiteAMD Ryzen 9 9950X 16-Core @ 5.75GHz (16 Cores / 32 Threads)AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads)ASUS ROG STRIX X670E-E GAMING WIFI (2124 BIOS)AMD Device 14d82 x 16GB DDR5-6000MT/s G Skill F5-6000J3038F16G2000GB Corsair MP700 PROAMD Radeon RX 7900 GRE 16GBAMD Navi 31 HDMI/DPDELL U2723QEIntel I225-V + Intel Wi-Fi 6EUbuntu 24.046.10.0-phx (x86_64)GNOME Shell 46.0X Server + Wayland4.6 Mesa 24.2~git2406040600.8112d4~oibaf~n (git-8112d44 2024-06-04 noble-oibaf-ppa) (LLVM 17.0.6 DRM 3.57)GCC 13.2.0ext43840x2160ProcessorsMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLCompilerFile-SystemScreen ResolutionAMD Ryzen 9 7950X / Ryzen 9 9950X AVX-512 Comparison BenchmarksSystem Logs- Transparent Huge Pages: madvise- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Ryzen 9 9950X: AVX-512 On: Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xb40401a- Ryzen 9 9950X: AVX-512 Off: Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xb40401a- Ryzen 9 7950X: AVX-512 On: Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xa601206- Ryzen 9 7950X: AVX-512 Off: Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xa601206- Python 3.12.3- Ryzen 9 9950X: AVX-512 On: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Ryzen 9 9950X: AVX-512 Off: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Ryzen 9 7950X: AVX-512 On: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Ryzen 9 7950X: AVX-512 Off: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

openvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUtensorflow: CPU - 64 - ResNet-50openvino: Face Detection Retail FP16 - CPUopenvino: Face Detection Retail FP16 - CPUnamd: ATPase with 327,506 Atomsnamd: STMV with 1,066,628 Atomsopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: gravity_spheres_volume/dim_512/ao/real_timeonednn: IP Shapes 3D - CPUminibude: OpenMP - BM1minibude: OpenMP - BM1onednn: Deconvolution Batch shapes_3d - CPUonnx: ResNet50 v1-12-int8 - CPU - Standardopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUonednn: IP Shapes 1D - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUospray: gravity_spheres_volume/dim_512/pathtracer/real_timesimdjson: PartialTweetssimdjson: DistinctUserIDonednn: Recurrent Neural Network Training - CPUsimdjson: TopTweetonnx: super-resolution-10 - CPU - Standardonednn: Recurrent Neural Network Inference - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUospray-studio: 1 - 4K - 1 - Path Tracer - CPUospray-studio: 1 - 4K - 16 - Path Tracer - CPUospray-studio: 1 - 4K - 32 - Path Tracer - CPUospray-studio: 3 - 4K - 1 - Path Tracer - CPUospray-studio: 3 - 4K - 32 - Path Tracer - CPUospray-studio: 3 - 4K - 16 - Path Tracer - CPUonednn: Deconvolution Batch shapes_1d - CPUsimdjson: Kostyalczero: Eigenopenvkl: vklBenchmarkCPU ISPCnumpy: onnx: CaffeNet 12-int8 - CPU - Standardonnx: fcn-resnet101-11 - CPU - Standardtensorflow: CPU - 1 - ResNet-50pytorch: CPU - 1 - ResNet-50embree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Asian Dragon Objpytorch: CPU - 64 - ResNet-50ospray: particle_volume/pathtracer/real_timesimdjson: LargeRandlczero: BLASembree: Pathtracer ISPC - Crowny-cruncher: 1Bmnn: resnet-v2-50gromacs: MPI CPU - water_GMX50_barey-cruncher: 500Monnx: ArcFace ResNet-100 - CPU - Standardxnnpack: QU8MobileNetV2xnnpack: QU8MobileNetV3Largeonnx: super-resolution-10 - CPU - Standardonnx: ResNet50 v1-12-int8 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Standardonnx: fcn-resnet101-11 - CPU - Standardonnx: CaffeNet 12-int8 - CPU - StandardRyzen 9 9950XRyzen 9 7950X AVX-512 On AVX-512 Off AVX-512 On AVX-512 Off6.822327.1823.29342.810.2555883.542.5916.56962.923027.683.722133.7651.741.534938.983.483380.9870745.10177.119.532779.727003.0753077.1901929.7531.36386571.4688.77908.960.664875109.2973.12638.6712.5011.030012.3813.05759.93412.95227.646404.6978.431867.603225540221057983829124596634761.788467.472207651054.92872.9404.8548816.8285.1441.351535.507157.89277.2802.0722036.651516.49010.0483.1357.57055.507878511544.392531.7494218.0181205.9801.1459523.57675.856.801168.940.7519062.587.6746.11346.431034.5410.06792.0338.993.922015.671.697570.48492102.8677.696.469206.706626.1672138.469961.7272.59761447.23815.29521.701.0585560.69131.60476.8816.749.083769.9910.441258.8010.33151.023635.73213.181201.733594599581177124235138397703642.411926.431626561010.59803.4423.6003212.9870.1439.532734.081447.05261.1561.9020534.627220.23011.3172.6699.07349.806585611776.621282.2354020.0769277.7511.2440010.971454.5214.33556.000.436493.603.8720.61775.122059.524.771667.9244.082.283357.783.058770.8258157.56138.797.937308.076463.1150853.1221328.0502.38830419.18610.02795.701.00661101.5178.75481.0416.589.179629.4710.281245.2810.48144.777629.5989.361680.424004676111316054735154740792712.753466.01177647794.79695.7313.5477516.2374.4634.711129.546950.23239.2971.8117133.766516.02910.8752.7407.69647.852580710946.906902.3849820.8958281.8671.4368223.67674.776.871158.010.8017640.847.6148.98326.301048.4910.08791.2619.733.942015.991.493540.42614104.1176.774.208254.442336.6029338.401960.0372.72463299.66916.50483.591.2119562.80127.26359.2622.226.357557.207.591303.167.64137.126664.15413.571166.245131852771668056020195460994752.802514.80142507731.83605.7713.4163612.2263.2331.037826.716943.87210.8501.5816828.782818.05712.6552.5928.39547.847387011307.292543.3363920.8995292.7071.65024OpenBenchmarking.org

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16 - Device: CPUAVX-512 OffAVX-512 On612182430SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 323.6710.9723.576.821. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3619 / Avg: 4222.63 / Max: 5720Min: 600 / Avg: 4670.17 / Max: 5589Min: 545 / Avg: 4758.4 / Max: 5549Min: 545 / Avg: 4892.56 / Max: 5546
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 21.13 / Avg: 214.35 / Max: 230.02Min: 21.26 / Avg: 208.13 / Max: 223.31Min: 18.98 / Avg: 187.87 / Max: 201.1Min: 29.11 / Avg: 177.79 / Max: 190.01
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 48.5 / Avg: 89.3 / Max: 92Min: 49 / Avg: 88 / Max: 90.75Min: 47.5 / Avg: 80.7 / Max: 83Min: 49.25 / Avg: 76.56 / Max: 78.63

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16 - Device: CPUAVX-512 OffAVX-512 On5001000150020002500SE +/- 0.19, N = 3SE +/- 0.51, N = 3SE +/- 0.69, N = 3SE +/- 1.07, N = 3674.771454.52675.852327.181. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection FP16 - Device: CPUAVX-512 OffAVX-512 On612182430SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 36.8023.296.8714.331. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection FP16 - Device: CPUAVX-512 OffAVX-512 On30060090012001500SE +/- 3.79, N = 3SE +/- 0.13, N = 3SE +/- 0.43, N = 3SE +/- 0.04, N = 31168.94342.811158.01556.001. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3648 / Avg: 4276.15 / Max: 5255Min: 600 / Avg: 4685.27 / Max: 5524Min: 545 / Avg: 4818.54 / Max: 5346Min: 545 / Avg: 4961.4 / Max: 5501
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 21.06 / Avg: 213.87 / Max: 233.38Min: 21.07 / Avg: 208.81 / Max: 228.13Min: 17.98 / Avg: 185.38 / Max: 201.59Min: 28.69 / Avg: 180.05 / Max: 196.04
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 45.13 / Avg: 92.42 / Max: 96.13Min: 46.13 / Avg: 88.81 / Max: 92.88Min: 46.88 / Avg: 82.44 / Max: 92.5Min: 48.38 / Avg: 78.65 / Max: 83.5

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUAVX-512 OffAVX-512 On0.180.360.540.720.9SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.800.400.750.251. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3662 / Avg: 4532.44 / Max: 5709Min: 600 / Avg: 4822.76 / Max: 5679Min: 545 / Avg: 4904.19 / Max: 5523Min: 545 / Avg: 5033.06 / Max: 5550
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 21.34 / Avg: 217.98 / Max: 235.89Min: 21.27 / Avg: 214.52 / Max: 232.6Min: 19.02 / Avg: 188.25 / Max: 200.62Min: 26.84 / Avg: 186.88 / Max: 199.12
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 48.75 / Avg: 91.54 / Max: 94.13Min: 48.38 / Avg: 88.97 / Max: 91.5Min: 47.5 / Avg: 81.3 / Max: 83.5Min: 48.5 / Avg: 78.1 / Max: 80

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUAVX-512 OffAVX-512 On12K24K36K48K60KSE +/- 30.09, N = 3SE +/- 34.76, N = 3SE +/- 18.06, N = 3SE +/- 40.07, N = 317640.8436493.6019062.5855883.541. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPUAVX-512 OffAVX-512 On246810SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 37.672.597.613.871. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3624 / Avg: 4457.57 / Max: 5659Min: 600 / Avg: 4591.12 / Max: 5645Min: 545 / Avg: 4807.9 / Max: 5518Min: 545 / Avg: 4897.53 / Max: 5109
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 20.92 / Avg: 214.29 / Max: 230.54Min: 21.45 / Avg: 205.35 / Max: 223.29Min: 18.23 / Avg: 187.35 / Max: 201.53Min: 28.73 / Avg: 183.35 / Max: 196.52
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 48 / Avg: 89.9 / Max: 92.88Min: 49.63 / Avg: 86.84 / Max: 89.75Min: 48.13 / Avg: 80.05 / Max: 82.25Min: 49.38 / Avg: 79.38 / Max: 81.5

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16 - Device: CPUAVX-512 OffAVX-512 On1122334455SE +/- 0.09, N = 3SE +/- 0.13, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 348.9820.6146.1116.561. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 600 / Avg: 4522.72 / Max: 5049Min: 3658 / Avg: 4575.96 / Max: 5722Min: 545 / Avg: 4837.77 / Max: 5172Min: 545 / Avg: 4957.66 / Max: 5275
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 21.31 / Avg: 215.55 / Max: 236.59Min: 21.51 / Avg: 213.73 / Max: 232.37Min: 29.1 / Avg: 188.3 / Max: 201.46Min: 19 / Avg: 188.22 / Max: 200.96
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 50 / Avg: 92.25 / Max: 95.88Min: 47.63 / Avg: 88.83 / Max: 93.13Min: 48.13 / Avg: 79.46 / Max: 81.5Min: 49.63 / Avg: 78.64 / Max: 80.5

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16 - Device: CPUAVX-512 OffAVX-512 On2004006008001000SE +/- 0.62, N = 3SE +/- 4.65, N = 3SE +/- 0.29, N = 3SE +/- 1.39, N = 3326.30775.12346.43962.921. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPUAVX-512 OffAVX-512 On6001200180024003000SE +/- 0.29, N = 3SE +/- 2.87, N = 3SE +/- 1.51, N = 3SE +/- 1.23, N = 31034.543027.681048.492059.521. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPUAVX-512 OffAVX-512 On3691215SE +/- 0.11, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 310.084.7710.063.721. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3629 / Avg: 4679.02 / Max: 4858Min: 600 / Avg: 4855.6 / Max: 5651Min: 545 / Avg: 4870.81 / Max: 5552Min: 545 / Avg: 4927.98 / Max: 5499
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 21.06 / Avg: 216.76 / Max: 236.74Min: 21.24 / Avg: 212.59 / Max: 236.49Min: 19 / Avg: 186.44 / Max: 200.8Min: 29.11 / Avg: 185.92 / Max: 200.72
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 47.13 / Avg: 90.12 / Max: 93.25Min: 49 / Avg: 90.09 / Max: 93.75Min: 47.5 / Avg: 79.55 / Max: 82.13Min: 49.5 / Avg: 78.3 / Max: 80.13

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPUAVX-512 OffAVX-512 On5001000150020002500SE +/- 8.20, N = 3SE +/- 10.71, N = 3SE +/- 3.56, N = 3SE +/- 5.99, N = 3791.261667.92792.032133.761. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: ResNet-50AVX-512 OffAVX-512 On1224364860SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 319.7344.0838.9951.74
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: ResNet-50AVX-512 OffAVX-512 On0.07720.15440.23160.30880.3860.1250.2620.2450.343
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterTensorFlow 2.16.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 600 / Avg: 5150.31 / Max: 5668Min: 3639 / Avg: 5195.43 / Max: 5730Min: 545 / Avg: 5191.38 / Max: 5475Min: 545 / Avg: 5230.72 / Max: 5502
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.16.1CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 20.93 / Avg: 167.98 / Max: 188.32Min: 21.55 / Avg: 157.54 / Max: 194.89Min: 19.23 / Avg: 159.46 / Max: 173.07Min: 29.46 / Avg: 151.01 / Max: 161.12
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterTensorFlow 2.16.1CPU Temperature MonitorAVX-512 OnAVX-512 Off1530456075Min: 44.13 / Avg: 76.75 / Max: 78.88Min: 45.75 / Avg: 76.6 / Max: 78.75Min: 45 / Avg: 74.05 / Max: 76Min: 44.75 / Avg: 69.67 / Max: 72.38

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16 - Device: CPUAVX-512 OffAVX-512 On0.88651.7732.65953.5464.4325SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 33.942.283.921.531. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off9001800270036004500Min: 3626 / Avg: 4501.67 / Max: 5467Min: 600 / Avg: 4615.93 / Max: 4941Min: 545 / Avg: 4764.59 / Max: 5011Min: 545 / Avg: 4939.13 / Max: 5140
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 21.02 / Avg: 216.11 / Max: 232.91Min: 21.37 / Avg: 206.72 / Max: 223.05Min: 19.31 / Avg: 187.48 / Max: 201.01Min: 29.72 / Avg: 186.17 / Max: 199.95
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature MonitorAVX-512 OnAVX-512 Off20406080100Min: 47.38 / Avg: 89.94 / Max: 93.13Min: 49.38 / Avg: 86.2 / Max: 88.5Min: 49.5 / Avg: 80.26 / Max: 82.5Min: 47.38 / Avg: 79.61 / Max: 81.75

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16 - Device: CPUAVX-512 OffAVX-512 On11002200330044005500SE +/- 7.10, N = 3SE +/- 7.46, N = 3SE +/- 4.63, N = 3SE +/- 2.51, N = 32015.674938.982015.993357.781. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

NAMD

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgns/day, More Is BetterNAMD 3.0b6Input: ATPase with 327,506 AtomsAVX-512 OffAVX-512 On0.78381.56762.35143.13523.919SE +/- 0.00219, N = 3SE +/- 0.02678, N = 3SE +/- 0.01059, N = 3SE +/- 0.02808, N = 31.493543.058771.697573.48338
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgns/day Per Watt, More Is BetterNAMD 3.0b6Input: ATPase with 327,506 AtomsAVX-512 OffAVX-512 On0.00740.01480.02220.02960.0370.0100.0260.0130.033
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterNAMD 3.0b6CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 600 / Avg: 4886.4 / Max: 5693Min: 3655 / Avg: 5241.34 / Max: 5678Min: 545 / Avg: 4961.94 / Max: 5545Min: 545 / Avg: 5062.91 / Max: 5425
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterNAMD 3.0b6CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 21.4 / Avg: 151.13 / Max: 232.97Min: 20.82 / Avg: 117.86 / Max: 227.29Min: 19.32 / Avg: 128.97 / Max: 201.35Min: 29.37 / Avg: 104.06 / Max: 200.84
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterNAMD 3.0b6CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 48.38 / Avg: 85.29 / Max: 95.38Min: 47.5 / Avg: 78.51 / Max: 88.75Min: 48.5 / Avg: 77.84 / Max: 84.5Min: 45.25 / Avg: 76.08 / Max: 80.75

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgns/day, More Is BetterNAMD 3.0b6Input: STMV with 1,066,628 AtomsAVX-512 OffAVX-512 On0.22210.44420.66630.88841.1105SE +/- 0.00052, N = 3SE +/- 0.00092, N = 3SE +/- 0.00040, N = 3SE +/- 0.00150, N = 30.426140.825810.484920.98707
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgns/day Per Watt, More Is BetterNAMD 3.0b6Input: STMV with 1,066,628 AtomsAVX-512 OffAVX-512 On0.00160.00320.00480.00640.0080.0020.0050.0030.007
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterNAMD 3.0b6CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 600 / Avg: 4834.28 / Max: 5700Min: 3619 / Avg: 5139.71 / Max: 5690Min: 545 / Avg: 5072.84 / Max: 5518Min: 545 / Avg: 5148.07 / Max: 5472
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterNAMD 3.0b6CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 21.21 / Avg: 184.64 / Max: 225.35Min: 21.16 / Avg: 151.2 / Max: 213.58Min: 18.38 / Avg: 161.74 / Max: 198.27Min: 28.75 / Avg: 136.45 / Max: 191.04
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterNAMD 3.0b6CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 47.88 / Avg: 89.47 / Max: 94.63Min: 46.25 / Avg: 82.12 / Max: 89.5Min: 47.5 / Avg: 79.22 / Max: 84.13Min: 45 / Avg: 77.56 / Max: 80.63

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPUAVX-512 OffAVX-512 On20406080100SE +/- 0.55, N = 3SE +/- 0.30, N = 3SE +/- 0.49, N = 3SE +/- 0.15, N = 3104.1157.56102.8645.101. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 600 / Avg: 4657.78 / Max: 5557Min: 3615 / Avg: 4798.72 / Max: 5719Min: 545 / Avg: 4806.14 / Max: 5192Min: 545 / Avg: 5067.47 / Max: 5538
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 21.23 / Avg: 205.67 / Max: 228.1Min: 21.01 / Avg: 201.12 / Max: 226.14Min: 19.1 / Avg: 186.38 / Max: 201.17Min: 29.34 / Avg: 170.11 / Max: 184.95
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 48.88 / Avg: 89.75 / Max: 92.88Min: 47.13 / Avg: 84.61 / Max: 88.25Min: 47.63 / Avg: 80.61 / Max: 84.13Min: 49.25 / Avg: 75.84 / Max: 78.25

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPUAVX-512 OffAVX-512 On4080120160200SE +/- 0.41, N = 3SE +/- 0.72, N = 3SE +/- 0.38, N = 3SE +/- 0.57, N = 376.77138.7977.69177.111. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OSPRay

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 OffAVX-512 On3691215SE +/- 0.00671, N = 3SE +/- 0.00679, N = 3SE +/- 0.01723, N = 3SE +/- 0.01315, N = 34.208257.937306.469209.53277
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 OffAVX-512 On0.01170.02340.03510.04680.05850.0210.0420.0360.052
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOSPRay 3.2CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 600 / Avg: 4824.55 / Max: 5609Min: 3622 / Avg: 5022.93 / Max: 5718Min: 545 / Avg: 4999.96 / Max: 5543Min: 545 / Avg: 5049.67 / Max: 5450
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 3.2CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 21.18 / Avg: 196.78 / Max: 221.85Min: 21.48 / Avg: 189.77 / Max: 222.64Min: 29.89 / Avg: 182.83 / Max: 201.18Min: 18.87 / Avg: 179.15 / Max: 203.39
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 3.2CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 48.75 / Avg: 89.5 / Max: 92Min: 47.75 / Avg: 85.39 / Max: 88.38Min: 48.75 / Avg: 80 / Max: 83.25Min: 47 / Avg: 79.36 / Max: 83.25

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX-512 OffAVX-512 On3691215SE +/- 0.00077, N = 3SE +/- 0.01996, N = 3SE +/- 0.00321, N = 3SE +/- 0.00263, N = 34.442338.076466.706629.72700
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX-512 OffAVX-512 On0.01190.02380.03570.04760.05950.0230.0430.0370.053
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOSPRay 3.2CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 600 / Avg: 4956.77 / Max: 5701Min: 3617 / Avg: 5033.79 / Max: 5719Min: 545 / Avg: 5009.68 / Max: 5461Min: 545 / Avg: 5020.2 / Max: 5404
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 3.2CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 11.53 / Avg: 195.62 / Max: 221.08Min: 21.47 / Avg: 188.23 / Max: 216.92Min: 19.1 / Avg: 183.09 / Max: 201Min: 29.13 / Avg: 182.22 / Max: 204.79
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 3.2CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 48.38 / Avg: 89.3 / Max: 91.88Min: 47.38 / Avg: 85.22 / Max: 88.25Min: 49.5 / Avg: 80.42 / Max: 85Min: 47.88 / Avg: 80.13 / Max: 86.63

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: IP Shapes 3D - Engine: CPUAVX-512 OffAVX-512 On246810SE +/- 0.00179, N = 5SE +/- 0.00401, N = 5SE +/- 0.00900, N = 5SE +/- 0.00113, N = 56.602933.115086.167213.075301. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.4CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 545 / Avg: 4438.91 / Max: 5549Min: 545 / Avg: 4561.92 / Max: 5425Min: 2614 / Avg: 4961.5 / Max: 5697Min: 3620 / Avg: 5058.03 / Max: 5725
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 3.4CPU Power Consumption MonitorAVX-512 OnAVX-512 Off306090120150Min: 28.94 / Avg: 98.43 / Max: 137.57Min: 29.27 / Avg: 84.39 / Max: 136.23Min: 17.78 / Avg: 93.39 / Max: 137.81Min: 20.52 / Avg: 79.91 / Max: 150.55
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.4CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 47.63 / Avg: 63.73 / Max: 70Min: 45.63 / Avg: 61.1 / Max: 71.63Min: 48.25 / Avg: 60.81 / Max: 67.88Min: 47.63 / Avg: 60.41 / Max: 69.75

miniBUDE

MiniBUDE is a mini application for the the core computation of the Bristol University Docking Engine (BUDE). This test profile currently makes use of the OpenMP implementation of miniBUDE for CPU benchmarking. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OffAVX-512 On20406080100SE +/- 0.33, N = 3SE +/- 0.00, N = 4SE +/- 0.02, N = 3SE +/- 0.06, N = 538.4053.1238.4777.191. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgBillion Interactions/s Per Watt, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OffAVX-512 On0.11570.23140.34710.46280.57850.1990.3160.2270.514
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterminiBUDE 20210901CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 600 / Avg: 4520.91 / Max: 5559Min: 3617 / Avg: 4629.52 / Max: 5709Min: 545 / Avg: 4524.89 / Max: 5125Min: 545 / Avg: 4648.16 / Max: 5304
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterminiBUDE 20210901CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 20.85 / Avg: 192.49 / Max: 230.83Min: 21.09 / Avg: 168.06 / Max: 215.33Min: 18.77 / Avg: 169.1 / Max: 200.59Min: 28.89 / Avg: 150.07 / Max: 200.78
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterminiBUDE 20210901CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 48.25 / Avg: 88.69 / Max: 94.5Min: 48.25 / Avg: 84.63 / Max: 90.63Min: 49.63 / Avg: 80.61 / Max: 86.75Min: 46.25 / Avg: 79.27 / Max: 83.75

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OffAVX-512 On400800120016002000SE +/- 8.36, N = 3SE +/- 0.05, N = 4SE +/- 0.52, N = 3SE +/- 1.54, N = 5960.041328.05961.731929.751. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Deconvolution Batch shapes_3d - Engine: CPUAVX-512 OffAVX-512 On0.6131.2261.8392.4523.065SE +/- 0.00474, N = 9SE +/- 0.00055, N = 9SE +/- 0.01154, N = 9SE +/- 0.00309, N = 92.724632.388302.597611.363861. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.4CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 600 / Avg: 3343.02 / Max: 5158Min: 3621 / Avg: 4383.27 / Max: 5514Min: 545 / Avg: 3837.94 / Max: 5352Min: 545 / Avg: 4318.22 / Max: 5548
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 3.4CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 21.35 / Avg: 101.36 / Max: 226.09Min: 20.45 / Avg: 96.65 / Max: 217.27Min: 27.61 / Avg: 93.68 / Max: 183.48Min: 18.13 / Avg: 93.29 / Max: 197.76
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.4CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 47.38 / Avg: 77.34 / Max: 89.25Min: 46.25 / Avg: 71.46 / Max: 81.88Min: 47.25 / Avg: 71.74 / Max: 81.13Min: 48.25 / Avg: 66.47 / Max: 74

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 On120240360480600SE +/- 0.27, N = 3SE +/- 1.03, N = 3SE +/- 1.07, N = 3SE +/- 0.98, N = 3299.67419.19447.24571.471. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 On0.75071.50142.25213.00283.7535SE +/- 0.00299, N = 3SE +/- 0.00598, N = 3SE +/- 0.00529, N = 3SE +/- 0.00302, N = 33.336392.384982.235401.749421. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgMegahertz, More Is BetterONNX Runtime 1.17CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On9001800270036004500Min: 545 / Avg: 4981.61 / Max: 5173Min: 545 / Avg: 5000.84 / Max: 5247Min: 600 / Avg: 5016.9 / Max: 5363Min: 3607 / Avg: 5024.13 / Max: 5179
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 20.66 / Avg: 191.33 / Max: 207.44Min: 10.86 / Avg: 174.4 / Max: 187.51Min: 17.79 / Avg: 175.89 / Max: 188.7Min: 28.95 / Avg: 163.95 / Max: 178.76
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterONNX Runtime 1.17CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 47.88 / Avg: 86.26 / Max: 88.75Min: 46.25 / Avg: 76.39 / Max: 78.5Min: 47.75 / Avg: 79.15 / Max: 81.13Min: 49.25 / Avg: 75.08 / Max: 77.38

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16 - Device: CPUAVX-512 OffAVX-512 On48121620SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 316.5010.0215.298.771. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 600 / Avg: 4809.34 / Max: 5681Min: 3620 / Avg: 4943.47 / Max: 5429Min: 545 / Avg: 4994.54 / Max: 5520Min: 545 / Avg: 5007.83 / Max: 5500
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 21.08 / Avg: 215.91 / Max: 235.64Min: 21.29 / Avg: 205.98 / Max: 230.48Min: 18.15 / Avg: 188.06 / Max: 200.9Min: 28.14 / Avg: 169.58 / Max: 195.86
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 48.63 / Avg: 89.17 / Max: 92Min: 46.5 / Avg: 83.55 / Max: 86.75Min: 48 / Avg: 80.27 / Max: 82.5Min: 47.75 / Avg: 74.44 / Max: 78.5

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16 - Device: CPUAVX-512 OffAVX-512 On2004006008001000SE +/- 1.66, N = 3SE +/- 6.59, N = 3SE +/- 2.33, N = 3SE +/- 0.91, N = 3483.59795.70521.70908.961. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: IP Shapes 1D - Engine: CPUAVX-512 OffAVX-512 On0.27270.54540.81811.09081.3635SE +/- 0.000909, N = 4SE +/- 0.000816, N = 4SE +/- 0.002635, N = 4SE +/- 0.006767, N = 61.2119501.0066101.0585500.6648751. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.4CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 600 / Avg: 4385.57 / Max: 5439Min: 3621 / Avg: 4728.01 / Max: 5723Min: 545 / Avg: 4505.34 / Max: 5114Min: 545 / Avg: 4550.45 / Max: 5225
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 3.4CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 20.8 / Avg: 170.06 / Max: 226.44Min: 20.94 / Avg: 162.23 / Max: 230.81Min: 18.23 / Avg: 156.72 / Max: 200.79Min: 27.64 / Avg: 142.28 / Max: 200.23
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.4CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 46.88 / Avg: 83.93 / Max: 91Min: 45.88 / Avg: 77.41 / Max: 86.88Min: 45.5 / Avg: 74.6 / Max: 80.38Min: 47.13 / Avg: 70.53 / Max: 78

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPUAVX-512 OffAVX-512 On20406080100SE +/- 0.20, N = 3SE +/- 0.34, N = 3SE +/- 0.10, N = 3SE +/- 1.04, N = 360.69109.2962.80101.511. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPUAVX-512 OffAVX-512 On306090120150SE +/- 0.43, N = 3SE +/- 0.22, N = 3SE +/- 0.21, N = 3SE +/- 0.82, N = 3131.6073.12127.2678.751. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 545 / Avg: 4936.56 / Max: 5536Min: 545 / Avg: 5040.57 / Max: 5300Min: 600 / Avg: 5067.69 / Max: 5631Min: 3628 / Avg: 5070.15 / Max: 5643
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 21.19 / Avg: 200.91 / Max: 219.71Min: 21.3 / Avg: 188.25 / Max: 207.15Min: 18.66 / Avg: 186.84 / Max: 201.2Min: 22.78 / Avg: 164.38 / Max: 188.55
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 49.5 / Avg: 88.98 / Max: 91.5Min: 48.5 / Avg: 84.47 / Max: 87.38Min: 48.13 / Avg: 85.48 / Max: 88Min: 49.38 / Avg: 79.87 / Max: 84.75

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On140280420560700SE +/- 0.48, N = 3SE +/- 1.08, N = 3SE +/- 3.66, N = 3SE +/- 3.09, N = 3359.26481.04476.88638.671. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On510152025SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.13, N = 3SE +/- 0.06, N = 322.2216.5816.7412.501. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 600 / Avg: 4858.7 / Max: 5447Min: 3618 / Avg: 4859.56 / Max: 5647Min: 545 / Avg: 4937.24 / Max: 5181Min: 545 / Avg: 4964.93 / Max: 5217
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 21.5 / Avg: 199.32 / Max: 219.67Min: 21.4 / Avg: 191.94 / Max: 211.11Min: 19.18 / Avg: 187.6 / Max: 201.03Min: 28.92 / Avg: 173.93 / Max: 193.75
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 49.25 / Avg: 90.1 / Max: 93.13Min: 48.63 / Avg: 86.49 / Max: 89.13Min: 47.38 / Avg: 82.21 / Max: 84.63Min: 49.38 / Avg: 77.06 / Max: 79.38

OSPRay

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 OffAVX-512 On3691215SE +/- 0.00125, N = 3SE +/- 0.01877, N = 3SE +/- 0.00447, N = 3SE +/- 0.00324, N = 36.357559.179629.0837611.03000
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 OffAVX-512 On0.01370.02740.04110.05480.06850.0320.0470.0500.061
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOSPRay 3.2CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 600 / Avg: 4748.25 / Max: 5727Min: 3619 / Avg: 4902.23 / Max: 5635Min: 545 / Avg: 4965.4 / Max: 5450Min: 3600 / Avg: 5067.26 / Max: 5490
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 3.2CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 21.16 / Avg: 198.83 / Max: 229.38Min: 21.1 / Avg: 194.63 / Max: 224.62Min: 18.95 / Avg: 181.7 / Max: 202.79Min: 29.65 / Avg: 180.79 / Max: 200.8
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 3.2CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 49 / Avg: 90.47 / Max: 93.5Min: 47.5 / Avg: 86.77 / Max: 89.75Min: 48.25 / Avg: 79.03 / Max: 84.88Min: 45.25 / Avg: 78.75 / Max: 85

simdjson

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: PartialTweetsAVX-512 OffAVX-512 On3691215SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 9SE +/- 0.12, N = 157.209.479.9912.381. (CXX) g++ options: -O3 -lrt
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 3.10Throughput Test: PartialTweetsAVX-512 OffAVX-512 On0.05130.10260.15390.20520.25650.1240.1600.1840.228
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgMegahertz, More Is Bettersimdjson 3.10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 545 / Avg: 5267.71 / Max: 5555Min: 545 / Avg: 5280.33 / Max: 5557Min: 600 / Avg: 5458.44 / Max: 5722Min: 2477 / Avg: 5552.06 / Max: 5749
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 3.10CPU Power Consumption MonitorAVX-512 OnAVX-512 Off1224364860Min: 20.82 / Avg: 59.23 / Max: 62.08Min: 20.61 / Avg: 58.04 / Max: 61.36Min: 26.15 / Avg: 54.31 / Max: 61.05Min: 17.29 / Avg: 54.29 / Max: 58.14
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 3.10CPU Temperature MonitorAVX-512 OnAVX-512 Off1326395265Min: 40.13 / Avg: 64.23 / Max: 67.5Min: 40.25 / Avg: 63.54 / Max: 68.38Min: 39.88 / Avg: 62.95 / Max: 65.25Min: 42 / Avg: 59.46 / Max: 65.38

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: DistinctUserIDAVX-512 OffAVX-512 On3691215SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 37.5910.2810.4413.051. (CXX) g++ options: -O3 -lrt
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 3.10Throughput Test: DistinctUserIDAVX-512 OffAVX-512 On0.05650.1130.16950.2260.28250.1300.1740.1900.251
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgMegahertz, More Is Bettersimdjson 3.10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 545 / Avg: 5310.51 / Max: 5549Min: 545 / Avg: 5390.86 / Max: 5599Min: 600 / Avg: 5477.86 / Max: 5721Min: 3634 / Avg: 5479.51 / Max: 5752
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 3.10CPU Power Consumption MonitorAVX-512 OnAVX-512 Off1224364860Min: 21.08 / Avg: 59.24 / Max: 62.18Min: 20.75 / Avg: 58.27 / Max: 61.59Min: 18.51 / Avg: 55.04 / Max: 57.72Min: 26.96 / Avg: 51.89 / Max: 55.93
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 3.10CPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 40.25 / Avg: 64.88 / Max: 69Min: 40.25 / Avg: 64.57 / Max: 66.25Min: 39.5 / Avg: 63.74 / Max: 65.13Min: 42.13 / Avg: 56.31 / Max: 58.88

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Recurrent Neural Network Training - Engine: CPUAVX-512 OffAVX-512 On30060090012001500SE +/- 0.80, N = 3SE +/- 0.97, N = 3SE +/- 0.50, N = 3SE +/- 1.13, N = 31303.161245.281258.80759.931. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.4CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3620 / Avg: 4539.43 / Max: 5097Min: 600 / Avg: 4628.18 / Max: 5635Min: 545 / Avg: 4841.65 / Max: 5350Min: 545 / Avg: 4963.28 / Max: 5425
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 3.4CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 21.31 / Avg: 212.56 / Max: 233.78Min: 20.62 / Avg: 212.31 / Max: 236.6Min: 19.21 / Avg: 189.56 / Max: 200.98Min: 28.27 / Avg: 178.02 / Max: 200.61
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.4CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 46 / Avg: 89.79 / Max: 94.13Min: 44.63 / Avg: 85.98 / Max: 90.13Min: 44.75 / Avg: 78.58 / Max: 82.5Min: 46.25 / Avg: 75.44 / Max: 80.88

simdjson

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: TopTweetAVX-512 OffAVX-512 On3691215SE +/- 0.01, N = 3SE +/- 0.09, N = 3SE +/- 0.02, N = 3SE +/- 0.14, N = 37.6410.4810.3312.951. (CXX) g++ options: -O3 -lrt
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 3.10Throughput Test: TopTweetAVX-512 OffAVX-512 On0.05470.10940.16410.21880.27350.1300.1760.1870.243
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgMegahertz, More Is Bettersimdjson 3.10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 545 / Avg: 5284.79 / Max: 5425Min: 545 / Avg: 5312.84 / Max: 5556Min: 600 / Avg: 5466.56 / Max: 5707Min: 3633 / Avg: 5525.79 / Max: 5742
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 3.10CPU Power Consumption MonitorAVX-512 OnAVX-512 Off1326395265Min: 20.7 / Avg: 59.45 / Max: 63.58Min: 21.23 / Avg: 58.89 / Max: 61.76Min: 19.22 / Avg: 55.19 / Max: 58.35Min: 29.54 / Avg: 53.21 / Max: 65.86
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 3.10CPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 41.25 / Avg: 65.6 / Max: 66.63Min: 41 / Avg: 65.56 / Max: 67.38Min: 41.5 / Avg: 65.51 / Max: 66.75Min: 43.13 / Avg: 58.91 / Max: 62.75

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 On50100150200250SE +/- 0.52, N = 3SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.18, N = 3137.13144.78151.02227.651. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 On246810SE +/- 0.02791, N = 3SE +/- 0.00447, N = 3SE +/- 0.00170, N = 3SE +/- 0.00355, N = 37.292546.906906.621284.392531. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterONNX Runtime 1.17CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off9001800270036004500Min: 3610 / Avg: 5029.56 / Max: 5141Min: 600 / Avg: 5073.02 / Max: 5287Min: 545 / Avg: 5077.08 / Max: 5250Min: 545 / Avg: 5134.93 / Max: 5300
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorAVX-512 OffAVX-512 On306090120150Min: 18.59 / Avg: 152.68 / Max: 163.63Min: 27.98 / Avg: 148.17 / Max: 157.13Min: 19.82 / Avg: 145.08 / Max: 156.27Min: 20.96 / Avg: 143.14 / Max: 153.68
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterONNX Runtime 1.17CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 47.25 / Avg: 91.67 / Max: 94.38Min: 49 / Avg: 86.06 / Max: 89Min: 47.88 / Avg: 89.65 / Max: 92.13Min: 46.5 / Avg: 84.82 / Max: 87.5

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Recurrent Neural Network Inference - Engine: CPUAVX-512 OffAVX-512 On140280420560700SE +/- 0.46, N = 3SE +/- 0.67, N = 3SE +/- 0.28, N = 3SE +/- 0.61, N = 3664.15629.60635.73404.701. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.4CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3619 / Avg: 4486.43 / Max: 5076Min: 600 / Avg: 4697.52 / Max: 5620Min: 545 / Avg: 4798.17 / Max: 5325Min: 545 / Avg: 4915.41 / Max: 5250
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 3.4CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 20.59 / Avg: 212.77 / Max: 230.06Min: 21.2 / Avg: 212.15 / Max: 235.91Min: 18.46 / Avg: 189.87 / Max: 200.99Min: 28.96 / Avg: 177.84 / Max: 200.21
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.4CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 49.75 / Avg: 91.17 / Max: 94.38Min: 48.25 / Avg: 87.04 / Max: 90.38Min: 47.5 / Avg: 79.19 / Max: 82.5Min: 49.38 / Avg: 75.9 / Max: 81.13

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPUAVX-512 OffAVX-512 On3691215SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 313.579.3613.188.431. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 600 / Avg: 4611.73 / Max: 5009Min: 3619 / Avg: 4935.35 / Max: 5671Min: 545 / Avg: 4923.65 / Max: 5187Min: 545 / Avg: 4948.23 / Max: 5417
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 21.38 / Avg: 219.56 / Max: 236.17Min: 20.76 / Avg: 207.81 / Max: 224.79Min: 19.27 / Avg: 180.53 / Max: 196.82Min: 28.92 / Avg: 170.83 / Max: 184.18
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 49.38 / Avg: 92.91 / Max: 95.75Min: 48.25 / Avg: 85.15 / Max: 87.5Min: 47.38 / Avg: 76.32 / Max: 78.63Min: 49 / Avg: 71.65 / Max: 74

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPUAVX-512 OffAVX-512 On400800120016002000SE +/- 2.29, N = 3SE +/- 2.92, N = 3SE +/- 2.28, N = 3SE +/- 3.92, N = 31166.241680.421201.731867.601. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OSPRay Studio

Intel OSPRay Studio is an open-source, interactive visualization and ray-tracing software package. OSPRay Studio makes use of Intel OSPRay, a portable ray-tracing engine for high-performance, high-fidelity visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OffAVX-512 On11002200330044005500SE +/- 5.00, N = 3SE +/- 2.85, N = 3SE +/- 2.03, N = 3SE +/- 1.00, N = 35131400435943225
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 1.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 600 / Avg: 4859.88 / Max: 5720Min: 3632 / Avg: 4931.07 / Max: 5741Min: 545 / Avg: 5006.21 / Max: 5646Min: 545 / Avg: 5033.73 / Max: 5509
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 21.3 / Avg: 193.33 / Max: 233.46Min: 21.21 / Avg: 192.85 / Max: 231.42Min: 18.83 / Avg: 177.31 / Max: 201.19Min: 29.74 / Avg: 176.55 / Max: 201
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 1.0CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 49.75 / Avg: 88.22 / Max: 93.13Min: 48.13 / Avg: 85.97 / Max: 90.75Min: 49.38 / Avg: 77.7 / Max: 80.63Min: 47.5 / Avg: 77.14 / Max: 82.25

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OffAVX-512 On20K40K60K80K100KSE +/- 106.67, N = 3SE +/- 142.41, N = 3SE +/- 25.03, N = 3SE +/- 42.15, N = 385277676115995854022
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 1.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 600 / Avg: 4858.36 / Max: 5683Min: 3615 / Avg: 4941.53 / Max: 5717Min: 545 / Avg: 5000.76 / Max: 5514Min: 545 / Avg: 5007.43 / Max: 5700
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 21.38 / Avg: 197.76 / Max: 232.88Min: 21.34 / Avg: 192.87 / Max: 235.9Min: 19.03 / Avg: 173.62 / Max: 200.99Min: 29.36 / Avg: 171.05 / Max: 201.19
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 1.0CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 49 / Avg: 88.72 / Max: 93.5Min: 47.88 / Avg: 85.99 / Max: 91.13Min: 49.38 / Avg: 77.36 / Max: 83.75Min: 48 / Avg: 77.04 / Max: 83.13

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OffAVX-512 On40K80K120K160K200KSE +/- 116.94, N = 3SE +/- 209.54, N = 3SE +/- 147.11, N = 3SE +/- 68.30, N = 3166805131605117712105798
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 1.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 600 / Avg: 4850.5 / Max: 5720Min: 3622 / Avg: 4927.48 / Max: 5735Min: 545 / Avg: 5075.26 / Max: 5477Min: 545 / Avg: 5080 / Max: 5675
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 21.11 / Avg: 209.25 / Max: 233.54Min: 21.45 / Avg: 207.59 / Max: 235.75Min: 17.96 / Avg: 185.11 / Max: 201.19Min: 28.98 / Avg: 184.04 / Max: 201.19
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 1.0CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 49 / Avg: 90.93 / Max: 93.88Min: 47.88 / Avg: 88.21 / Max: 91.5Min: 48.63 / Avg: 78.33 / Max: 80.63Min: 47.63 / Avg: 77.78 / Max: 82.25

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OffAVX-512 On13002600390052006500SE +/- 9.87, N = 3SE +/- 10.17, N = 3SE +/- 4.33, N = 3SE +/- 1.53, N = 36020473542353829
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 1.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 600 / Avg: 4870.49 / Max: 5718Min: 3640 / Avg: 4952.48 / Max: 5730Min: 545 / Avg: 5051.96 / Max: 5700Min: 545 / Avg: 5066.47 / Max: 5548
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 21.33 / Avg: 194.3 / Max: 234.61Min: 21.43 / Avg: 192.96 / Max: 234.25Min: 30.13 / Avg: 177.71 / Max: 201.19Min: 18.31 / Avg: 177.49 / Max: 203.79
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 1.0CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 48.63 / Avg: 87.75 / Max: 92.75Min: 48 / Avg: 86.17 / Max: 91.38Min: 49.13 / Avg: 77.46 / Max: 80.5Min: 47.5 / Avg: 77.24 / Max: 82

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OffAVX-512 On40K80K120K160K200KSE +/- 475.57, N = 3SE +/- 26.96, N = 3SE +/- 188.82, N = 3SE +/- 55.03, N = 3195460154740138397124596
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 1.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 600 / Avg: 4875.24 / Max: 5692Min: 3646 / Avg: 4922.13 / Max: 5722Min: 545 / Avg: 5052 / Max: 5548Min: 545 / Avg: 5081.87 / Max: 5700
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 21.2 / Avg: 210.75 / Max: 233.13Min: 21.2 / Avg: 209.83 / Max: 234.95Min: 18.85 / Avg: 186.98 / Max: 201Min: 29.54 / Avg: 186.24 / Max: 201.19
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 1.0CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 48.88 / Avg: 91.05 / Max: 93.75Min: 48 / Avg: 88.3 / Max: 91.38Min: 49.25 / Avg: 78.65 / Max: 81Min: 48.38 / Avg: 78.25 / Max: 83.63

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUAVX-512 OffAVX-512 On20K40K60K80K100KSE +/- 91.66, N = 3SE +/- 199.04, N = 3SE +/- 36.23, N = 3SE +/- 49.41, N = 399475792717036463476
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 1.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 600 / Avg: 4856.09 / Max: 5680Min: 3634 / Avg: 4957.56 / Max: 5706Min: 545 / Avg: 5024.7 / Max: 5475Min: 545 / Avg: 5062.85 / Max: 5700
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 21.1 / Avg: 200.25 / Max: 232.96Min: 21.39 / Avg: 197.03 / Max: 234.02Min: 18.96 / Avg: 176.49 / Max: 200.99Min: 29.35 / Avg: 175.27 / Max: 201.2
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 1.0CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 49.13 / Avg: 89.21 / Max: 93.25Min: 48 / Avg: 86.28 / Max: 91.13Min: 49 / Avg: 77.75 / Max: 83.63Min: 48.38 / Avg: 77.28 / Max: 82.63

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Deconvolution Batch shapes_1d - Engine: CPUAVX-512 OffAVX-512 On0.63061.26121.89182.52243.153SE +/- 0.00224, N = 3SE +/- 0.00663, N = 3SE +/- 0.00490, N = 3SE +/- 0.00399, N = 32.802512.753462.411921.788461. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.4CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 600 / Avg: 4536.93 / Max: 5617Min: 3622 / Avg: 4719.61 / Max: 5619Min: 545 / Avg: 4783.54 / Max: 5499Min: 545 / Avg: 4789.28 / Max: 5474
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 3.4CPU Power Consumption MonitorAVX-512 OnAVX-512 Off4080120160200Min: 21.22 / Avg: 167.02 / Max: 233.85Min: 20.62 / Avg: 166.22 / Max: 233.55Min: 20.37 / Avg: 154.75 / Max: 200.8Min: 28.65 / Avg: 148.35 / Max: 200.8
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.4CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 44.63 / Avg: 82.29 / Max: 94.5Min: 44.25 / Avg: 78.78 / Max: 87.88Min: 45.5 / Avg: 71.85 / Max: 79Min: 46 / Avg: 71.16 / Max: 78.63

simdjson

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: KostyaAVX-512 OffAVX-512 On246810SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 34.806.016.437.471. (CXX) g++ options: -O3 -lrt
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 3.10Throughput Test: KostyaAVX-512 OffAVX-512 On0.03040.06080.09120.12160.1520.0820.1020.1170.135
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgMegahertz, More Is Bettersimdjson 3.10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 545 / Avg: 5310.37 / Max: 5561Min: 545 / Avg: 5358.7 / Max: 5625Min: 600 / Avg: 5471.7 / Max: 5724Min: 3584 / Avg: 5478.54 / Max: 5754
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 3.10CPU Power Consumption MonitorAVX-512 OnAVX-512 Off1224364860Min: 20.87 / Avg: 58.92 / Max: 61.56Min: 21.43 / Avg: 58.67 / Max: 61.26Min: 28.92 / Avg: 55.23 / Max: 60.68Min: 18.68 / Avg: 54.99 / Max: 59.23
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 3.10CPU Temperature MonitorAVX-512 OnAVX-512 Off1428425670Min: 46.63 / Avg: 68.73 / Max: 70.63Min: 48.5 / Avg: 68.43 / Max: 71.75Min: 47.13 / Avg: 66.4 / Max: 72.25Min: 49.38 / Avg: 63.04 / Max: 72.63

LeelaChessZero

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.31.1Backend: EigenAVX-512 OffAVX-512 On50100150200250SE +/- 1.67, N = 3SE +/- 2.03, N = 3SE +/- 1.53, N = 3SE +/- 1.76, N = 31421771622201. (CXX) g++ options: -flto -pthread
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgNodes Per Second Per Watt, More Is BetterLeelaChessZero 0.31.1Backend: EigenAVX-512 OffAVX-512 On0.26060.52120.78181.04241.3030.6950.8700.8811.158
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterLeelaChessZero 0.31.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 600 / Avg: 5097.43 / Max: 5689Min: 3635 / Avg: 5194.42 / Max: 5596Min: 545 / Avg: 5098.97 / Max: 5467Min: 545 / Avg: 5144.02 / Max: 5450
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterLeelaChessZero 0.31.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 21.25 / Avg: 204.24 / Max: 236.38Min: 21.05 / Avg: 203.56 / Max: 232.81Min: 28.09 / Avg: 189.91 / Max: 202.57Min: 18.56 / Avg: 183.79 / Max: 201.6
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterLeelaChessZero 0.31.1CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 48.88 / Avg: 92.38 / Max: 94.75Min: 47.5 / Avg: 87.92 / Max: 89.75Min: 49.38 / Avg: 82.17 / Max: 89.13Min: 46.5 / Avg: 81.99 / Max: 88.5

OpenVKL

OpenVKL is the Intel Open Volume Kernel Library that offers high-performance volume computation kernels and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCAVX-512 OffAVX-512 On160320480640800SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3507647656765
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgItems / Sec Per Watt, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCAVX-512 OffAVX-512 On0.94431.88862.83293.77724.72152.6433.5273.5854.197
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOpenVKL 2.0.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 600 / Avg: 5140.88 / Max: 5728Min: 3574 / Avg: 5192.18 / Max: 5731Min: 545 / Avg: 5145.86 / Max: 5725Min: 545 / Avg: 5188.14 / Max: 5725
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterOpenVKL 2.0.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 21.69 / Avg: 191.85 / Max: 232.58Min: 21 / Avg: 183.42 / Max: 236.07Min: 18.17 / Avg: 183 / Max: 203.18Min: 25.9 / Avg: 182.28 / Max: 201.39
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterOpenVKL 2.0.0CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 47.38 / Avg: 86.97 / Max: 95.38Min: 47.38 / Avg: 83.05 / Max: 93.13Min: 41.5 / Avg: 78.25 / Max: 84.25Min: 40.13 / Avg: 77.61 / Max: 82.25

Numpy Benchmark

This is a test to obtain the general Numpy performance. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgScore, More Is BetterNumpy BenchmarkAVX-512 OffAVX-512 On2004006008001000SE +/- 2.88, N = 3SE +/- 6.26, N = 3SE +/- 2.31, N = 3SE +/- 6.93, N = 3731.83794.791010.591054.92
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgScore Per Watt, More Is BetterNumpy BenchmarkAVX-512 OffAVX-512 On51015202512.6213.6818.8519.62
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgMegahertz, More Is BetterNumpy BenchmarkCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 545 / Avg: 5274.11 / Max: 5548Min: 545 / Avg: 5348.24 / Max: 5700Min: 600 / Avg: 5459.26 / Max: 5728Min: 2590 / Avg: 5507.31 / Max: 5753
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterNumpy BenchmarkCPU Power Consumption MonitorAVX-512 OnAVX-512 Off1326395265Min: 21.17 / Avg: 58.11 / Max: 65.09Min: 21.31 / Avg: 57.99 / Max: 64.98Min: 29.26 / Avg: 53.77 / Max: 61.61Min: 18.24 / Avg: 53.62 / Max: 59.46
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterNumpy BenchmarkCPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 48.5 / Avg: 70.04 / Max: 76.13Min: 49.38 / Avg: 65.66 / Max: 77.13Min: 48.25 / Avg: 69.49 / Max: 77.5Min: 49.38 / Avg: 69.14 / Max: 73.13

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 On2004006008001000SE +/- 0.54, N = 3SE +/- 3.29, N = 3SE +/- 0.45, N = 3SE +/- 7.80, N = 15605.77695.73803.44872.941. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 On0.37130.74261.11391.48521.8565SE +/- 0.00147, N = 3SE +/- 0.00680, N = 3SE +/- 0.00071, N = 3SE +/- 0.01010, N = 151.650241.436821.244001.145951. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgMegahertz, More Is BetterONNX Runtime 1.17CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 545 / Avg: 5015.46 / Max: 5551Min: 545 / Avg: 5048.44 / Max: 5268Min: 600 / Avg: 5195.91 / Max: 5469Min: 2506 / Avg: 5329.13 / Max: 5514
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorAVX-512 OffAVX-512 On306090120150Min: 19.21 / Avg: 171.96 / Max: 185.49Min: 28.12 / Avg: 170.82 / Max: 187.78Min: 21.22 / Avg: 156.32 / Max: 167.86Min: 20.97 / Avg: 141.69 / Max: 152.37
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterONNX Runtime 1.17CPU Temperature MonitorAVX-512 OffAVX-512 On1530456075Min: 48.25 / Avg: 72.67 / Max: 75.25Min: 47.5 / Avg: 72.56 / Max: 75.75Min: 49.25 / Avg: 72.2 / Max: 74Min: 48.25 / Avg: 66.48 / Max: 68

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 On1.09232.18463.27694.36925.4615SE +/- 0.00295, N = 3SE +/- 0.00354, N = 3SE +/- 0.00187, N = 3SE +/- 0.01446, N = 33.416363.547753.600324.854881. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 On60120180240300SE +/- 0.25, N = 3SE +/- 0.28, N = 3SE +/- 0.14, N = 3SE +/- 0.61, N = 3292.71281.87277.75205.981. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterONNX Runtime 1.17CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 3615 / Avg: 4701.21 / Max: 5705Min: 600 / Avg: 4723.63 / Max: 5485Min: 545 / Avg: 4728.96 / Max: 5172Min: 545 / Avg: 5056.11 / Max: 5290
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 21.56 / Avg: 209.92 / Max: 228.59Min: 20.95 / Avg: 201.58 / Max: 222.02Min: 18.46 / Avg: 188.17 / Max: 201.12Min: 28.88 / Avg: 162.69 / Max: 174.94
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterONNX Runtime 1.17CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 47.63 / Avg: 88.67 / Max: 91.38Min: 46.25 / Avg: 86.52 / Max: 89Min: 48.38 / Avg: 82.11 / Max: 84Min: 49.75 / Avg: 74.3 / Max: 76.13

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: ResNet-50AVX-512 OffAVX-512 On48121620SE +/- 0.02, N = 4SE +/- 0.03, N = 5SE +/- 0.01, N = 5SE +/- 0.04, N = 512.2216.2312.9816.82
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: ResNet-50AVX-512 OffAVX-512 On0.05330.10660.15990.21320.26650.1180.1750.1330.237
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterTensorFlow 2.16.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 600 / Avg: 4507.81 / Max: 5719Min: 3625 / Avg: 4609.22 / Max: 5717Min: 545 / Avg: 4592.95 / Max: 5547Min: 545 / Avg: 4675.91 / Max: 5425
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.16.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On306090120150Min: 18.1 / Avg: 103.76 / Max: 155.98Min: 20.57 / Avg: 92.6 / Max: 150.83Min: 19.03 / Avg: 97.93 / Max: 147.97Min: 28.31 / Avg: 70.9 / Max: 159.43
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterTensorFlow 2.16.1CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 47.13 / Avg: 64.33 / Max: 68.75Min: 45.63 / Avg: 60.43 / Max: 67.5Min: 47.38 / Avg: 62.7 / Max: 70.5Min: 46.63 / Avg: 57.17 / Max: 65

PyTorch

This is a benchmark of PyTorch making use of pytorch-benchmark [https://github.com/LukasHedegaard/pytorch-benchmark]. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 1 - Model: ResNet-50AVX-512 OffAVX-512 On20406080100SE +/- 0.33, N = 3SE +/- 0.54, N = 3SE +/- 0.81, N = 4SE +/- 0.88, N = 463.2374.4670.1485.14
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgbatches/sec Per Watt, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 1 - Model: ResNet-50AVX-512 OffAVX-512 On0.18020.36040.54060.72080.9010.5350.6840.5530.801
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgMegahertz, More Is BetterPyTorch 2.2.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 545 / Avg: 4812.05 / Max: 5500Min: 545 / Avg: 5098.84 / Max: 5525Min: 600 / Avg: 5082.69 / Max: 5674Min: 3617 / Avg: 5126.44 / Max: 5724
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterPyTorch 2.2.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On306090120150Min: 19.07 / Avg: 126.9 / Max: 167.61Min: 28.31 / Avg: 106.25 / Max: 140.63Min: 20.24 / Avg: 118.1 / Max: 152.49Min: 20.71 / Avg: 108.88 / Max: 143.73
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterPyTorch 2.2.1CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 43.38 / Avg: 64.37 / Max: 70.5Min: 48.13 / Avg: 61.59 / Max: 70.88Min: 46.5 / Avg: 62.49 / Max: 67.75Min: 45.75 / Avg: 60.87 / Max: 68.88

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 OffAVX-512 On918273645SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 331.0434.7139.5341.35
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 OffAVX-512 On0.05560.11120.16680.22240.2780.1640.1960.2390.247
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterEmbree 4.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 600 / Avg: 4830.59 / Max: 5346Min: 3635 / Avg: 5020.42 / Max: 5374Min: 545 / Avg: 4840.28 / Max: 5223Min: 545 / Avg: 4954.57 / Max: 5550
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterEmbree 4.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 21.79 / Avg: 189.63 / Max: 225.09Min: 21.18 / Avg: 177.43 / Max: 214.2Min: 27.44 / Avg: 167.16 / Max: 201.21Min: 19.19 / Avg: 165.38 / Max: 200.81
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 4.3CPU Temperature MonitorAVX-512 OffAVX-512 On1632486480Min: 45.5 / Avg: 80.07 / Max: 85.13Min: 45.13 / Avg: 74.76 / Max: 79.75Min: 46.25 / Avg: 70.75 / Max: 75.13Min: 44.5 / Avg: 69.79 / Max: 74.38

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon ObjAVX-512 OffAVX-512 On816243240SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 326.7229.5534.0835.51
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon ObjAVX-512 OffAVX-512 On0.05290.10580.15870.21160.26450.1560.1830.2240.235
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterEmbree 4.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 600 / Avg: 4884.48 / Max: 5720Min: 3613 / Avg: 5192.2 / Max: 5739Min: 545 / Avg: 4929.02 / Max: 5545Min: 545 / Avg: 5052.51 / Max: 5700
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterEmbree 4.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 11.34 / Avg: 171.18 / Max: 229.51Min: 21.37 / Avg: 161.67 / Max: 211.86Min: 19.21 / Avg: 152.33 / Max: 200.99Min: 30.21 / Avg: 151.22 / Max: 200.98
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 4.3CPU Temperature MonitorAVX-512 OffAVX-512 On1632486480Min: 46.38 / Avg: 78.4 / Max: 84.25Min: 45.75 / Avg: 74.57 / Max: 79.38Min: 45.63 / Avg: 71.42 / Max: 76.63Min: 48 / Avg: 71.18 / Max: 75.38

PyTorch

This is a benchmark of PyTorch making use of pytorch-benchmark [https://github.com/LukasHedegaard/pytorch-benchmark]. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 64 - Model: ResNet-50AVX-512 OffAVX-512 On1326395265SE +/- 0.11, N = 3SE +/- 0.30, N = 3SE +/- 0.36, N = 3SE +/- 0.41, N = 343.8750.2347.0557.89
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgbatches/sec Per Watt, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 64 - Model: ResNet-50AVX-512 OffAVX-512 On0.10440.20880.31320.41760.5220.3080.4640.3090.376
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgMegahertz, More Is BetterPyTorch 2.2.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 545 / Avg: 5102.27 / Max: 5544Min: 545 / Avg: 5139.14 / Max: 5550Min: 3635 / Avg: 5250.28 / Max: 5650Min: 600 / Avg: 5271.25 / Max: 5644
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgWatts, Fewer Is BetterPyTorch 2.2.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On306090120150Min: 18.92 / Avg: 152.56 / Max: 180.02Min: 29.64 / Avg: 124.8 / Max: 149.27Min: 20.92 / Avg: 141.87 / Max: 165.5Min: 20.49 / Avg: 133.67 / Max: 158.26
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgCelsius, Fewer Is BetterPyTorch 2.2.1CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 45.63 / Avg: 69.35 / Max: 73.25Min: 46.38 / Avg: 61.66 / Max: 72.63Min: 45.5 / Avg: 66.81 / Max: 70.5Min: 44.13 / Avg: 63.58 / Max: 67.88

OSPRay

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.2Benchmark: particle_volume/pathtracer/real_timeAVX-512 OffAVX-512 On60120180240300SE +/- 0.33, N = 3SE +/- 0.60, N = 3SE +/- 0.58, N = 3SE +/- 0.40, N = 3210.85239.30261.16277.28
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 3.2Benchmark: particle_volume/pathtracer/real_timeAVX-512 OffAVX-512 On0.31860.63720.95581.27441.5931.0221.1701.3371.416
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterOSPRay 3.2CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 600 / Avg: 4825.38 / Max: 5444Min: 3630 / Avg: 4931.4 / Max: 5535Min: 545 / Avg: 5038.7 / Max: 5197Min: 545 / Avg: 5091.95 / Max: 5555
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 3.2CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 21.3 / Avg: 206.26 / Max: 231.22Min: 21.13 / Avg: 204.51 / Max: 233.27Min: 29.24 / Avg: 195.84 / Max: 205.19Min: 19.06 / Avg: 195.32 / Max: 203.81
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 3.2CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 47.63 / Avg: 91.85 / Max: 95.38Min: 47.63 / Avg: 89.75 / Max: 93.5Min: 49.13 / Avg: 81.85 / Max: 86.5Min: 47.38 / Avg: 81.19 / Max: 87.38

simdjson

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: LargeRandomAVX-512 OffAVX-512 On0.46580.93161.39741.86322.329SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 31.581.811.902.071. (CXX) g++ options: -O3 -lrt
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 3.10Throughput Test: LargeRandomAVX-512 OffAVX-512 On0.0090.0180.0270.0360.0450.0270.0310.0350.040
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgMegahertz, More Is Bettersimdjson 3.10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 545 / Avg: 5253.66 / Max: 5551Min: 545 / Avg: 5279.35 / Max: 5558Min: 3640 / Avg: 5485.05 / Max: 5748Min: 600 / Avg: 5495.4 / Max: 5727
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 3.10CPU Power Consumption MonitorAVX-512 OffAVX-512 On1224364860Min: 20.84 / Avg: 58.47 / Max: 61.3Min: 21.12 / Avg: 57.98 / Max: 60.63Min: 18.29 / Avg: 53.68 / Max: 57.75Min: 27.07 / Avg: 52.23 / Max: 56.4
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 3.10CPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 40.75 / Avg: 67.26 / Max: 68.38Min: 40.5 / Avg: 67.14 / Max: 68.38Min: 40.38 / Avg: 61.95 / Max: 65.25Min: 42.13 / Avg: 57.43 / Max: 60.13

LeelaChessZero

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.31.1Backend: BLASAVX-512 OffAVX-512 On50100150200250SE +/- 0.33, N = 3SE +/- 1.65, N = 6SE +/- 2.40, N = 3SE +/- 1.76, N = 31681712052201. (CXX) g++ options: -flto -pthread
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgNodes Per Second Per Watt, More Is BetterLeelaChessZero 0.31.1Backend: BLASAVX-512 OffAVX-512 On0.28010.56020.84031.12041.40050.8220.8661.0971.245
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgMegahertz, More Is BetterLeelaChessZero 0.31.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 545 / Avg: 5110.71 / Max: 5400Min: 545 / Avg: 5176.37 / Max: 5552Min: 600 / Avg: 5129.22 / Max: 5699Min: 3282 / Avg: 5187.86 / Max: 5568
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterLeelaChessZero 0.31.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 20.49 / Avg: 204.47 / Max: 236.13Min: 21 / Avg: 197.55 / Max: 228.21Min: 19.07 / Avg: 186.92 / Max: 201.72Min: 29.28 / Avg: 176.71 / Max: 192.4
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterLeelaChessZero 0.31.1CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 37.25 / Avg: 89.69 / Max: 92.25Min: 37.63 / Avg: 84.36 / Max: 86.63Min: 40.13 / Avg: 83.68 / Max: 92.75Min: 40.5 / Avg: 79.55 / Max: 87.75

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownAVX-512 OffAVX-512 On816243240SE +/- 0.07, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 328.7833.7734.6336.65
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownAVX-512 OffAVX-512 On0.04880.09760.14640.19520.2440.1410.1700.2060.217
Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertz, More Is BetterEmbree 4.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 600 / Avg: 4536.91 / Max: 5597Min: 3623 / Avg: 4942 / Max: 5589Min: 545 / Avg: 4649.18 / Max: 5453Min: 545 / Avg: 4818.4 / Max: 5191
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterEmbree 4.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 21.36 / Avg: 203.84 / Max: 237.26Min: 21.08 / Avg: 198.56 / Max: 237.09Min: 29.04 / Avg: 168.67 / Max: 201.01Min: 18.59 / Avg: 167.96 / Max: 200.8
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 4.3CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 40 / Avg: 82.96 / Max: 89.5Min: 40.38 / Avg: 80.36 / Max: 87.25Min: 41.63 / Avg: 69.37 / Max: 74.88Min: 40.13 / Avg: 68.47 / Max: 74

Y-Cruncher

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.5Pi Digits To Calculate: 1BAVX-512 OffAVX-512 On510152025SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 320.2316.4918.0616.03
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgMegahertz, More Is BetterY-Cruncher 0.8.5CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 545 / Avg: 4699.94 / Max: 5502Min: 545 / Avg: 4705.9 / Max: 5500Min: 600 / Avg: 4804.56 / Max: 5726Min: 3629 / Avg: 5077.78 / Max: 5642
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterY-Cruncher 0.8.5CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 21.2 / Avg: 168.48 / Max: 232.13Min: 21.25 / Avg: 155.2 / Max: 231.62Min: 18.65 / Avg: 157.4 / Max: 201.53Min: 28.27 / Avg: 144.36 / Max: 197.74
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterY-Cruncher 0.8.5CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 49 / Avg: 81.67 / Max: 90.63Min: 47.38 / Avg: 75.75 / Max: 86Min: 47.13 / Avg: 76.17 / Max: 81.5Min: 48.63 / Avg: 72.08 / Max: 80.38

Mobile Neural Network

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.9.b11b7037dModel: resnet-v2-50AVX-512 OffAVX-512 On3691215SE +/- 0.10, N = 3SE +/- 0.11, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 312.6610.8811.3210.051. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

GROMACS

The GROMACS (GROningen MAchine for Chemical Simulations) molecular dynamics package testing with the water_GMX50 data. This test profile allows selecting between CPU and GPU-based GROMACS builds. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2024Implementation: MPI CPU - Input: water_GMX50_bareAVX-512 OffAVX-512 On0.70541.41082.11622.82163.527SE +/- 0.006, N = 3SE +/- 0.001, N = 3SE +/- 0.004, N = 3SE +/- 0.004, N = 32.5922.7402.6693.1351. (CXX) g++ options: -O3 -lm
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgNs Per Day Per Watt, More Is BetterGROMACS 2024Implementation: MPI CPU - Input: water_GMX50_bareAVX-512 OffAVX-512 On0.00410.00820.01230.01640.02050.0140.0160.0150.018
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgMegahertz, More Is BetterGROMACS 2024CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OnAVX-512 Off10002000300040005000Min: 545 / Avg: 5061.84 / Max: 5550Min: 545 / Avg: 5096.29 / Max: 5423Min: 600 / Avg: 5102.25 / Max: 5714Min: 3623 / Avg: 5305.7 / Max: 5715
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterGROMACS 2024CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 21.01 / Avg: 179.94 / Max: 212.47Min: 21.18 / Avg: 173.84 / Max: 209.67Min: 18.86 / Avg: 177.28 / Max: 200.24Min: 28.65 / Avg: 175.5 / Max: 192.97
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterGROMACS 2024CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 41.88 / Avg: 80.23 / Max: 89.38Min: 41 / Avg: 78.22 / Max: 88.5Min: 48.63 / Avg: 79.02 / Max: 81.75Min: 41.25 / Avg: 78.18 / Max: 85.13

Y-Cruncher

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.5Pi Digits To Calculate: 500MAVX-512 OffAVX-512 On3691215SE +/- 0.008, N = 5SE +/- 0.002, N = 5SE +/- 0.009, N = 5SE +/- 0.007, N = 59.0737.5708.3957.696
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgMegahertz, More Is BetterY-Cruncher 0.8.5CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On10002000300040005000Min: 545 / Avg: 4219.63 / Max: 5501Min: 545 / Avg: 4674.45 / Max: 5551Min: 600 / Avg: 4448.63 / Max: 5712Min: 3620 / Avg: 4855.47 / Max: 5666
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterY-Cruncher 0.8.5CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 20.15 / Avg: 138.5 / Max: 225.83Min: 21.1 / Avg: 125.14 / Max: 212.55Min: 18.49 / Avg: 133.31 / Max: 200.89Min: 28.12 / Avg: 118.5 / Max: 188.81
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterY-Cruncher 0.8.5CPU Temperature MonitorAVX-512 OffAVX-512 On20406080100Min: 47.63 / Avg: 76.89 / Max: 87.13Min: 46 / Avg: 70.65 / Max: 81.25Min: 46.38 / Avg: 73.04 / Max: 80.25Min: 47.75 / Avg: 67.55 / Max: 76.13

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 On1224364860SE +/- 0.28, N = 3SE +/- 0.15, N = 3SE +/- 0.22, N = 3SE +/- 0.61, N = 347.8547.8549.8155.511. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 On510152025SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.20, N = 320.9020.9020.0818.021. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgMegahertz, More Is BetterONNX Runtime 1.17CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On9001800270036004500Min: 545 / Avg: 4926.11 / Max: 5325Min: 545 / Avg: 5055.37 / Max: 5296Min: 3620 / Avg: 5028.13 / Max: 5281Min: 600 / Avg: 5065.23 / Max: 5393
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.17CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 20.26 / Avg: 195.05 / Max: 210.64Min: 21.4 / Avg: 191.64 / Max: 207.58Min: 19.42 / Avg: 186.74 / Max: 201.09Min: 28.12 / Avg: 160.78 / Max: 172.91
Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsius, Fewer Is BetterONNX Runtime 1.17CPU Temperature MonitorAVX-512 OffAVX-512 On1632486480Min: 48.75 / Avg: 84.1 / Max: 86.13Min: 47 / Avg: 79.71 / Max: 81.75Min: 47.63 / Avg: 80.2 / Max: 82.75Min: 49.5 / Avg: 71.42 / Max: 73.13

XNNPACK

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgus, Fewer Is BetterXNNPACK 2cd86bModel: QU8MobileNetV2AVX-512 OffAVX-512 On2004006008001000SE +/- 1.45, N = 3SE +/- 0.67, N = 3SE +/- 0.58, N = 3SE +/- 3.93, N = 38708078567851. (CXX) g++ options: -O3 -lrt -lm

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgus, Fewer Is BetterXNNPACK 2cd86bModel: QU8MobileNetV3LargeAVX-512 OffAVX-512 On30060090012001500SE +/- 2.03, N = 3SE +/- 1.15, N = 3SE +/- 3.84, N = 3SE +/- 3.38, N = 311771154113010941. (CXX) g++ options: -O3 -lrt -lm

CPU Temperature Monitor

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgCelsiusCPU Temperature MonitorPhoronix Test Suite System MonitoringAVX-512 OffAVX-512 On20406080100Min: 37.25 / Avg: 83.51 / Max: 95.88Min: 37.63 / Avg: 80.57 / Max: 96.13Min: 39.5 / Avg: 75.07 / Max: 94.5Min: 40.5 / Avg: 73.15 / Max: 89.13

CPU Power Consumption Monitor

Ryzen 9 7950XRyzen 9 9950XOpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringAVX-512 OffAVX-512 On4080120160200Min: 11.34 / Avg: 172.33 / Max: 237.26Min: 10.68 / Avg: 169.29 / Max: 237.09Min: 13.82 / Avg: 152.26 / Max: 203.94Min: 22.78 / Avg: 148.64 / Max: 205.19

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Ryzen 9 9950XRyzen 9 7950XOpenBenchmarking.orgMegahertzCPU Peak Freq (Highest CPU Core Frequency) MonitorPhoronix Test Suite System MonitoringAVX-512 OnAVX-512 Off10002000300040005000Min: 2477 / Avg: 5097.18 / Max: 5799Min: 600 / Avg: 4986.91 / Max: 5728Min: 545 / Avg: 5001.33 / Max: 5725Min: 545 / Avg: 4954.31 / Max: 5725

74 Results Shown

OpenVINO:
  Weld Porosity Detection FP16 - CPU:
    ms
    FPS
  Face Detection FP16 - CPU:
    FPS
    ms
  Age Gender Recognition Retail 0013 FP16 - CPU:
    ms
    FPS
  Person Re-Identification Retail FP16 - CPU:
    ms
  Handwritten English Recognition FP16 - CPU:
    ms
    FPS
  Person Re-Identification Retail FP16 - CPU:
    FPS
  Person Vehicle Bike Detection FP16 - CPU:
    ms
    FPS
TensorFlow
OpenVINO:
  Face Detection Retail FP16 - CPU:
    ms
    FPS
NAMD:
  ATPase with 327,506 Atoms
  STMV with 1,066,628 Atoms
OpenVINO:
  Machine Translation EN To DE FP16 - CPU:
    ms
    FPS
OSPRay:
  gravity_spheres_volume/dim_512/scivis/real_time
  gravity_spheres_volume/dim_512/ao/real_time
oneDNN
miniBUDE:
  OpenMP - BM1:
    Billion Interactions/s
    GFInst/s
oneDNN
ONNX Runtime
OpenVINO:
  Vehicle Detection FP16 - CPU:
    ms
    FPS
oneDNN
OpenVINO:
  Person Detection FP16 - CPU:
    FPS
    ms
  Road Segmentation ADAS FP16-INT8 - CPU:
    FPS
    ms
OSPRay
simdjson:
  PartialTweets
  DistinctUserID
oneDNN
simdjson
ONNX Runtime
oneDNN
OpenVINO:
  Noise Suppression Poconet-Like FP16 - CPU:
    ms
    FPS
OSPRay Studio:
  1 - 4K - 1 - Path Tracer - CPU
  1 - 4K - 16 - Path Tracer - CPU
  1 - 4K - 32 - Path Tracer - CPU
  3 - 4K - 1 - Path Tracer - CPU
  3 - 4K - 32 - Path Tracer - CPU
  3 - 4K - 16 - Path Tracer - CPU
oneDNN
simdjson
LeelaChessZero
OpenVKL
Numpy Benchmark
ONNX Runtime:
  CaffeNet 12-int8 - CPU - Standard
  fcn-resnet101-11 - CPU - Standard
TensorFlow
PyTorch
Embree:
  Pathtracer ISPC - Asian Dragon
  Pathtracer ISPC - Asian Dragon Obj
PyTorch
OSPRay
simdjson
LeelaChessZero
Embree
Y-Cruncher
Mobile Neural Network
GROMACS
Y-Cruncher
ONNX Runtime
XNNPACK:
  QU8MobileNetV2
  QU8MobileNetV3Large
CPU Temperature Monitor:
  Phoronix Test Suite System Monitoring:
    Celsius
    Watts
    Megahertz

Ryzen 9 9950X: AVX-512 On

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xb40401a
Python Notes: Python 3.12.3
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 11 August 2024 14:56 by user pts.

Ryzen 9 9950X: AVX-512 Off

Processor: AMD Ryzen 9 9950X 16-Core @ 5.75GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG STRIX X670E-E GAMING WIFI (2124 BIOS), Chipset: AMD Device 14d8, Memory: 2 x 16GB DDR5-6000MT/s G Skill F5-6000J3038F16G, Disk: 2000GB Corsair MP700 PRO, Graphics: AMD Radeon RX 7900 GRE 16GB, Audio: AMD Navi 31 HDMI/DP, Monitor: DELL U2723QE, Network: Intel I225-V + Intel Wi-Fi 6E

OS: Ubuntu 24.04, Kernel: 6.10.0-phx (x86_64), Desktop: GNOME Shell 46.0, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 24.2~git2406040600.8112d4~oibaf~n (git-8112d44 2024-06-04 noble-oibaf-ppa) (LLVM 17.0.6 DRM 3.57), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 3840x2160

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xb40401a
Python Notes: Python 3.12.3
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 12 August 2024 01:11 by user phoronix.

Ryzen 9 7950X: AVX-512 On

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xa601206
Python Notes: Python 3.12.3
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 12 August 2024 18:40 by user phoronix.

Ryzen 9 7950X: AVX-512 Off

Processor: AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG STRIX X670E-E GAMING WIFI (2124 BIOS), Chipset: AMD Device 14d8, Memory: 2 x 16GB DDR5-6000MT/s G Skill F5-6000J3038F16G, Disk: 2000GB Corsair MP700 PRO, Graphics: AMD Radeon RX 7900 GRE 16GB, Audio: AMD Navi 31 HDMI/DP, Monitor: DELL U2723QE, Network: Intel I225-V + Intel Wi-Fi 6E

OS: Ubuntu 24.04, Kernel: 6.10.0-phx (x86_64), Desktop: GNOME Shell 46.0, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 24.2~git2406040600.8112d4~oibaf~n (git-8112d44 2024-06-04 noble-oibaf-ppa) (LLVM 17.0.6 DRM 3.57), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 3840x2160

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xa601206
Python Notes: Python 3.12.3
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 12 August 2024 11:50 by user phoronix.