2024 Server CPUs

2 x Intel Xeon 6780E testing with a Quanta Cloud QuantaGrid D55Q-2U S7Q-MB-MPS-MDP (2A05.QCT001 BIOS) and ASPEED on Ubuntu 24.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2406049-NE-2024SERVE17
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Limit displaying results to tests within:

AV1 2 Tests
BLAS (Basic Linear Algebra Sub-Routine) Tests 4 Tests
C++ Boost Tests 5 Tests
Chess Test Suite 2 Tests
Timed Code Compilation 8 Tests
C/C++ Compiler Tests 16 Tests
Compression Tests 3 Tests
CPU Massive 25 Tests
Creator Workloads 23 Tests
Cryptography 5 Tests
Database Test Suite 5 Tests
Encoding 7 Tests
Fortran Tests 7 Tests
Game Development 5 Tests
HPC - High Performance Computing 29 Tests
Imaging 3 Tests
Common Kernel Benchmarks 3 Tests
LAPACK (Linear Algebra Pack) Tests 3 Tests
Linear Algebra 2 Tests
Machine Learning 7 Tests
Molecular Dynamics 10 Tests
MPI Benchmarks 10 Tests
Multi-Core 44 Tests
NVIDIA GPU Compute 3 Tests
Intel oneAPI 7 Tests
OpenMPI Tests 18 Tests
Programmer / Developer System Benchmarks 12 Tests
Python 2 Tests
Raytracing 2 Tests
Renderers 5 Tests
Scientific Computing 15 Tests
Software Defined Radio 2 Tests
Server 7 Tests
Server CPU Tests 17 Tests
Single-Threaded 2 Tests
Video Encoding 7 Tests
Common Workstation Benchmarks 3 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable
Show Perf Per Clock Calculation Graphs Where Applicable
Show Perf Per RAM Channel Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs
Condense Test Profiles With Multiple Version Results Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
Xeon Platinum 8490H
April 16
  22 Hours, 19 Minutes
Xeon Platinum 8490H 2P
April 17
  23 Hours
Xeon Platinum 8592+
April 11
  22 Hours, 9 Minutes
Xeon Platinum 8592+ 2P
April 08
  23 Hours, 49 Minutes
Xeon Max 9468
April 21
  1 Day, 3 Hours, 43 Minutes
Xeon Max 9468 2P
April 22
  1 Day, 34 Minutes
Xeon Max 9480
April 26
  1 Day, 1 Hour, 37 Minutes
Xeon Max 9480 2P
April 27
  1 Day, 6 Hours, 26 Minutes
Xeon Platinum 8380 2P
May 07
  1 Day, 5 Hours, 29 Minutes
Xeon Platinum 8380
May 09
  1 Day, 7 Hours, 15 Minutes
EPYC 9684X 2P
May 11
  1 Day, 4 Hours, 57 Minutes
EPYC 9684X
May 12
  1 Day, 27 Minutes
EPYC 9654
May 13
  1 Day, 1 Hour, 48 Minutes
EPYC 9654 2P
May 14
  1 Day, 6 Hours, 48 Minutes
EPYC 9754
May 15
  1 Day, 6 Hours
EPYC 9754 2P
May 17
  1 Day, 9 Hours, 52 Minutes
EPYC 8534P
May 18
  1 Day, 3 Hours, 8 Minutes
EPYC 8534PN
May 19
  1 Day, 3 Hours, 48 Minutes
Xeon 6766E 2P
May 24
  1 Day, 3 Hours, 18 Minutes
Xeon 6766E
May 25
  18 Hours, 24 Minutes
Xeon 6780E
May 26
  17 Hours, 33 Minutes
Xeon 6780E 2P
May 27
  23 Hours, 13 Minutes
Invert Hiding All Results Option
  1 Day, 2 Hours, 10 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


2024 Server CPUsProcessorMotherboardChipsetMemoryDiskGraphicsNetworkMonitorOSKernelCompilerFile-SystemScreen ResolutionXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PXeon Platinum 8380 2PXeon Platinum 8380EPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PNXeon 6766E 2PXeon 6766EXeon 6780EXeon 6780E 2P2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads)Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS)Intel Device 1bce1008GB2 x 1920GB KIOXIA KCD8XPUG1T92ASPEED2 x Intel X710 for 10GBASE-TUbuntu 24.046.9.0-060900rc3-generic (x86_64)GCC 13.2.0ext41920x1200INTEL XEON PLATINUM 8592+ @ 3.90GHz (64 Cores / 128 Threads)512GBIntel Xeon Platinum 8490H @ 3.50GHz (60 Cores / 120 Threads)2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads)1008GB2 x Intel X710 for 10GBASE-TIntel Xeon Max 9468 @ 3.50GHz (48 Cores / 96 Threads)576GB2 x Intel Xeon Max 9468 @ 3.50GHz (96 Cores / 192 Threads)1136GB2 x Intel X710 for 10GBASE-TIntel Xeon Max 9480 @ 3.50GHz (56 Cores / 112 Threads)576GB2 x Intel Xeon Max 9480 @ 3.50GHz (112 Cores / 224 Threads)1136GB2 x Intel X710 for 10GBASE-T2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads)Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS)Intel Ice Lake IEH512GBVE2282 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFP1920x1080Intel Xeon Platinum 8380 @ 3.40GHz (40 Cores / 80 Threads)256GB2 x AMD EPYC 9684X 96-Core @ 2.55GHz (192 Cores / 384 Threads)AMD Titanite_4G (RTI1007B BIOS)AMD Device 14a41520GBBroadcom NetXtreme BCM5720 PCIe1920x1200AMD EPYC 9684X 96-Core @ 2.55GHz (96 Cores / 192 Threads)12 x 64GB DDR5-4800MT/s Samsung M321R8GA0BB0-CQKEGAMD EPYC 9654 96-Core @ 2.40GHz (96 Cores / 192 Threads)2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads)1520GBAMD EPYC 9754 128-Core @ 2.25GHz (128 Cores / 256 Threads)12 x 64GB DDR5-4800MT/s Samsung M321R8GA0BB0-CQKEG2 x AMD EPYC 9754 128-Core @ 2.25GHz (256 Cores / 512 Threads)1520GBAMD EPYC 8534P 64-Core @ 2.30GHz (64 Cores / 128 Threads)AMD Cinnabar (RCB1009C BIOS)6 x 32GB DDR5-4800MT/s Samsung M321R4GA0BB0-CQKMG2 x 1920GB KIOXIA KCD8XPUG1T92 + 2000GB Corsair MP700 PRO2 x Broadcom NetXtreme BCM5720 PCIeAMD EPYC 8534PN 64-Core @ 2.00GHz (64 Cores / 128 Threads)2 x 1920GB KIOXIA KCD8XPUG1T922 x Intel Xeon 6766E @ 2.70GHz (288 Cores)Quanta Cloud QuantaGrid D55Q-2U S7Q-MB-MPS-MDP (2A05.QCT001 BIOS)Intel Ice Lake IEH512GB3201GB Micron_7450_MTFDKCB3T2TFS + 2 x 1920GB KIOXIA KCD8XPUG1T922 x Broadcom BCM57416 NetXtreme-E Dual-Media 10G RDMAIntel Xeon 6766E @ 2.70GHz (144 Cores)256GB2 x 1920GB KIOXIA KCD8XPUG1T92 + 3201GB Micron_7450_MTFDKCB3T2TFSIntel Xeon 6780E @ 3.00GHz (144 Cores)3201GB Micron_7450_MTFDKCB3T2TFS + 2 x 1920GB KIOXIA KCD8XPUG1T922 x Intel Xeon 6780E @ 3.00GHz (288 Cores)512GBOpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Details- Xeon Platinum 8592+ 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000200- Xeon Platinum 8592+: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000200- Xeon Platinum 8490H: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b000590- Xeon Platinum 8490H 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b000590- Xeon Max 9468: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290- Xeon Max 9468 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290- Xeon Max 9480: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290- Xeon Max 9480 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290- Xeon Platinum 8380 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0xd0003d1- Xeon Platinum 8380: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0xd0003d1- EPYC 9684X 2P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144- EPYC 9684X: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144- EPYC 9654: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144- EPYC 9654 2P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101144- EPYC 9754: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00116- EPYC 9754 2P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00116- EPYC 8534P: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00213- EPYC 8534PN: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00213- Xeon 6766E 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x13000131- Xeon 6766E: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x13000131- Xeon 6780E: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x13000131- Xeon 6780E 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x13000131Java Details- OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1)Python Details- Python 3.12.2Security Details- Xeon Platinum 8592+ 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Platinum 8592+: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Platinum 8490H: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Platinum 8490H 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Max 9468: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Max 9468 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Max 9480: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Max 9480 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Platinum 8380 2P: gather_data_sampling: Mitigation of Microcode + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Xeon Platinum 8380: gather_data_sampling: Mitigation of Microcode + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- EPYC 9684X 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 9684X: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 9654: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 9654 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 9754: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 9754 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 8534P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 8534PN: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- Xeon 6766E 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- Xeon 6766E: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- Xeon 6780E: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- Xeon 6780E 2P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PXeon Platinum 8380 2PXeon Platinum 8380EPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PNXeon 6766E 2PXeon 6766EXeon 6780EXeon 6780E 2PLogarithmic Result OverviewPhoronix Test SuiteNAMDStockfishASTC EncoderRocksDBCoremarkJohn The RipperminiBUDEOpenSSLSpeedbBlenderACES DGEMMHelsingPrimesievem-queensOSPRayOSPRay StudioLlamafileMemcached7-Zip CompressionOpenVKLOpenVINOEmbreePyTorchLULESHoneDNNONNX RuntimeTimed Node.js CompilationKvazaarTimed LLVM CompilationLuxCoreRenderPostgreSQLminiFEParallel BZIP2 CompressionIntel Open Image Denoiseuvg266QuantLibTimed Linux Kernel CompilationGraphicsMagickCloverLeafY-CruncherLiquid-DSPsrsRAN ProjectNumpy BenchmarkTensorFlowFFmpegx265ClickHouseBRL-CADXmriglibavif avifencTimed FFmpeg CompilationTimed Godot Game Engine CompilationGNU Octave BenchmarkApache IoTDBSVT-AV1Timed ImageMagick CompilationTimed Gem5 CompilationZstd CompressionWebP Image EncodePyBenchGoogle SynthMarkTimed Mesa CompilationSecureMark

Xeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PXeon Platinum 8380 2PXeon Platinum 8380EPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PNXeon 6766E 2PXeon 6766EXeon 6780EXeon 6780E 2PLogarithmic Per Watt Result OverviewPhoronix Test SuiteminiFEMemcachedWebP Image EncodeZstd CompressionSVT-AV1PyTorchFFmpegASTC EncodersrsRAN ProjectNumpy Benchmarkx265Google SynthMarkminiBUDESecureMarkCoremarkACES DGEMM7-Zip CompressionKvazaarClickHouseXmrigSpeedbTensorFlowuvg266LuxCoreRenderRocksDBGraphicsMagickLiquid-DSPEmbreeOpenVKLQuantLibOSPRayLULESHJohn The RipperStockfishBRL-CADOpenSSLIntel Open Image DenoiseLlamafileNAMDP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.MP.W.G.M

2024 Server CPUswrf: conus 2.5kmopenvkl: vklBenchmarkCPU ISPCrelion: Basic - CPUnwchem: C240 Buckyballhpcg: 144 144 144 - 60tensorflow: CPU - 512 - ResNet-50brl-cad: VGR Performance Metricincompact3d: X3D-benchmarking input.i3dcloverleaf: clover_bm16askap: tConvolve MT - Griddingaskap: tConvolve MT - Degriddingpytorch: CPU - 256 - ResNet-152pgbench: 100 - 1000 - Read Only - Average Latencypgbench: 100 - 1000 - Read Onlytensorflow: CPU - 256 - ResNet-50openssl: RSA4096openssl: RSA4096build-linux-kernel: allmodconfigstockfish: Chess Benchmarkapache-iotdb: 800 - 100 - 800 - 100apache-iotdb: 800 - 100 - 800 - 100pytorch: CPU - 512 - ResNet-152pytorch: CPU - 64 - ResNet-152securemark: SecureMark-TLSclickhouse: 100M Rows Hits Dataset, Third Runclickhouse: 100M Rows Hits Dataset, Second Runclickhouse: 100M Rows Hits Dataset, First Run / Cold Cacheapache-iotdb: 500 - 100 - 800 - 400apache-iotdb: 500 - 100 - 800 - 400openradioss: Chrysler Neon 1Mnamd: STMV with 1,066,628 Atomsbuild-gem5: Time To Compilelammps: 20k Atomsbuild-nodejs: Time To Compileopenssl: SHA256tensorflow: CPU - 512 - GoogLeNetffmpeg: libx265 - Platformffmpeg: libx265 - Video On Demandonnx: fcn-resnet101-11 - CPU - Standardonnx: fcn-resnet101-11 - CPU - Standardffmpeg: libx265 - Uploadpgbench: 100 - 1000 - Read Write - Average Latencypgbench: 100 - 1000 - Read Writeblender: Barbershop - CPU-Onlynumpy: luxcorerender: DLSC - CPUopenssl: AES-128-GCMopenssl: AES-256-GCMopenssl: ChaCha20openssl: SHA512openssl: ChaCha20-Poly1305pytorch: CPU - 512 - ResNet-50luxcorerender: LuxCore Benchmark - CPUpytorch: CPU - 1 - ResNet-152xmrig: GhostRider - 1Mluxcorerender: Orange Juice - CPUospray: particle_volume/scivis/real_timerocksdb: Read While Writingonnx: Faster R-CNN R-50-FPN-int8 - CPU - Standardonnx: Faster R-CNN R-50-FPN-int8 - CPU - Standardopenfoam: drivaerFastback, Medium Mesh Size - Execution Timeopenfoam: drivaerFastback, Medium Mesh Size - Mesh Timebuild-llvm: Ninjamemcached: 1:100onnx: ResNet50 v1-12-int8 - CPU - Standardonnx: ResNet50 v1-12-int8 - CPU - Standardnamd: ATPase with 327,506 Atomsspeedb: Read While Writingpytorch: CPU - 64 - ResNet-50onnx: ArcFace ResNet-100 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Standardonnx: bertsquad-12 - CPU - Standardonnx: bertsquad-12 - CPU - Standardonnx: CaffeNet 12-int8 - CPU - Standardonnx: CaffeNet 12-int8 - CPU - Standardllamafile: wizardcoder-python-34b-v1.0.Q6_K - CPUbuild-godot: Time To Compilepytorch: CPU - 256 - ResNet-50openradioss: INIVOL and Fluid Structure Interaction Drop Containerqmcpack: Li2_STO_aeonnx: fcn-resnet101-11 - CPU - Parallelonnx: fcn-resnet101-11 - CPU - Parallelonnx: CaffeNet 12-int8 - CPU - Parallelonnx: CaffeNet 12-int8 - CPU - Parallelonnx: T5 Encoder - CPU - Standardonnx: T5 Encoder - CPU - Standardopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUonnx: GPT-2 - CPU - Standardonnx: GPT-2 - CPU - Standardtensorflow: CPU - 256 - GoogLeNetospray: particle_volume/ao/real_timeonnx: yolov4 - CPU - Standardonnx: yolov4 - CPU - Standardonnx: super-resolution-10 - CPU - Standardonnx: super-resolution-10 - CPU - Standardospray-studio: 1 - 4K - 32 - Path Tracer - CPUospray-studio: 3 - 4K - 32 - Path Tracer - CPUcompress-zstd: 19 - Decompression Speedcompress-zstd: 19 - Compression Speedspeedb: Rand Readvvenc: Bosphorus 4K - Fastcompress-zstd: 19, Long Mode - Decompression Speedcompress-zstd: 19, Long Mode - Compression Speedopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUospray-studio: 1 - 4K - 1 - Path Tracer - CPUtensorflow: CPU - 1 - ResNet-50tensorflow: CPU - 64 - ResNet-50openvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUonnx: ResNet50 v1-12-int8 - CPU - Parallelonnx: ResNet50 v1-12-int8 - CPU - Parallelopenvino: Noise Suppression Poconet-Like FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUavifenc: 0onnx: T5 Encoder - CPU - Parallelonnx: T5 Encoder - CPU - Parallelaskap: tConvolve MPI - Griddingaskap: tConvolve MPI - Degriddinghelsing: 14 digitospray-studio: 1 - 4K - 16 - Path Tracer - CPUospray-studio: 3 - 4K - 16 - Path Tracer - CPUcloverleaf: clover_bm64_shortospray-studio: 3 - 4K - 1 - Path Tracer - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUonnx: ArcFace ResNet-100 - CPU - Parallelonnx: ArcFace ResNet-100 - CPU - Parallelopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUonnx: Faster R-CNN R-50-FPN-int8 - CPU - Parallelonnx: Faster R-CNN R-50-FPN-int8 - CPU - Paralleltensorflow: CPU - 512 - AlexNetquantlib: Multi-Threadedopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUospray: gravity_spheres_volume/dim_512/pathtracer/real_timeblender: Pabellon Barcelona - CPU-Onlyopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUonnx: bertsquad-12 - CPU - Parallelonnx: bertsquad-12 - CPU - Parallelopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Person Re-Identification Retail FP16 - CPUpytorch: CPU - 1 - ResNet-50openvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUonnx: GPT-2 - CPU - Parallelonnx: GPT-2 - CPU - Parallelopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUonnx: yolov4 - CPU - Parallelonnx: yolov4 - CPU - Parallelgraphics-magick: Noise-Gaussiangpaw: Carbon Nanotubegraphics-magick: Sharpenbuild-linux-kernel: defconfiggraphics-magick: Enhancedonnx: super-resolution-10 - CPU - Parallelonnx: super-resolution-10 - CPU - Parallelgraphics-magick: Swirlrocksdb: Rand Readminibude: OpenMP - BM2minibude: OpenMP - BM2coremark: CoreMark Size 666 - Iterations Per Secondsrsran: PDSCH Processor Benchmark, Throughput Totalblender: Classroom - CPU-Onlyaircrack-ng: webp: Quality 100, Lossless, Highest Compressionavifenc: 2srsran: PUSCH Processor Benchmark, Throughput Totalllamafile: llava-v1.5-7b-q4 - CPUlulesh: compress-7zip: Decompression Ratingcompress-7zip: Compression Ratingamg: liquid-dsp: 1 - 256 - 512npb: EP.Dastcenc: Very Thoroughtensorflow: CPU - 256 - AlexNetminife: Smallopenradioss: Cell Phone Drop Testvvenc: Bosphorus 4K - Fasterprimesieve: 1e13gromacs: MPI CPU - water_GMX50_bareastcenc: Exhaustiveuvg266: Bosphorus 4K - Mediumjohn-the-ripper: WPA PSKtensorflow: CPU - 1 - GoogLeNetliquid-dsp: 1 - 256 - 57quantlib: Single-Threadedliquid-dsp: 64 - 256 - 512svt-av1: Preset 13 - Bosphorus 4Kuvg266: Bosphorus 4K - Slowliquid-dsp: 1 - 256 - 32tensorflow: CPU - 64 - GoogLeNetliquid-dsp: 64 - 256 - 57liquid-dsp: 128 - 256 - 512liquid-dsp: 256 - 256 - 512john-the-ripper: bcryptliquid-dsp: 128 - 256 - 57svt-av1: Preset 4 - Bosphorus 4Kembree: Pathtracer ISPC - Asian Dragon Objjohn-the-ripper: Blowfishliquid-dsp: 256 - 256 - 57liquid-dsp: 256 - 256 - 32liquid-dsp: 128 - 256 - 32synthmark: VoiceMark_100liquid-dsp: 64 - 256 - 32uvg266: Bosphorus 4K - Very Fastblender: Junkshop - CPU-Onlyblender: Fishy Cat - CPU-Onlyappleseed: Disney Materialtensorflow: CPU - 64 - AlexNetkvazaar: Bosphorus 4K - Mediumpennant: sedovbigkvazaar: Bosphorus 4K - Slowsrsran: PUSCH Processor Benchmark, Throughput Threadkvazaar: Bosphorus 4K - Very Fastopenfoam: drivaerFastback, Small Mesh Size - Execution Timeopenfoam: drivaerFastback, Small Mesh Size - Mesh Timesvt-av1: Preset 8 - Bosphorus 4Koidn: RTLightmap.hdr.4096x4096 - CPU-Onlyblender: BMW27 - CPU-Onlyminibude: OpenMP - BM1minibude: OpenMP - BM1x265: Bosphorus 4Kbuild-ffmpeg: Time To Compilepennant: leblancbigtensorflow: CPU - 1 - AlexNetnpb: SP.Cpybench: Total For Average Test Timesnpb: LU.Castcenc: Thoroughnpb: IS.Dbuild-mesa: Time To Compileincompact3d: input.i3d 193 Cells Per Directiony-cruncher: 1Bbuild-imagemagick: Time To Compilem-queens: Time To Solveoidn: RT.ldr_alb_nrm.3840x2160 - CPU-Onlyoidn: RT.hdr_alb_nrm.3840x2160 - CPU-Onlynpb: CG.Coctave-benchmark: y-cruncher: 500Membree: Pathtracer ISPC - Asian Dragonwebp: Quality 100, Highest Compressionembree: Pathtracer ISPC - Crownastcenc: Mediumsvt-av1: Preset 12 - Bosphorus 4Kavifenc: 6, Losslessmt-dgemm: Sustained Floating-Point Rateavifenc: 10, Losslessnpb: MG.Csrsran: PDSCH Processor Benchmark, Throughput Threadlammps: Rhodopsin Proteinavifenc: 6primesieve: 1e12compress-pbzip2: FreeBSD-13.0-RELEASE-amd64-memstick.img Compressiononednn: Deconvolution Batch shapes_3d - CPUXeon Platinum 8592+ 2PXeon Platinum 8592+Xeon Platinum 8490HXeon Platinum 8490H 2PXeon Max 9468Xeon Max 9468 2PXeon Max 9480Xeon Max 9480 2PXeon Platinum 8380 2PXeon Platinum 8380EPYC 9684X 2PEPYC 9684XEPYC 9654EPYC 9654 2PEPYC 9754EPYC 9754 2PEPYC 8534PEPYC 8534PNXeon 6766E 2PXeon 6766EXeon 6780EXeon 6780E 2P5601.1013222155.7411809.769.2976169.755186677171.375778378.056038.9216.001.149881881150.332057021.661499.6189.73922261037882.739277163916.1716.25308434438.60443.58423.30286.788923185086.932.25422157.36356.400145.413131976050120577.7653.2253.29100.7389.9268426.8030.20333110125.87519.8912.74176931314601314975299393776842843827604652076070744409914427040.838.8817.5716324.719.9153.93481242551928.848134.6628137.03802139.61713106.8153780240.565.83954171.2315.852671758573740.7726.086638.424044.599622.42511.32454754.8053.05103.37641.45100.0097.911327.8753.050851.64919605.5892.80263356.76443.41736.234.29531236.648501.3954.119558.939416.96723.98013251.30524249333911165.817.85861478716.9601189.79.670.46128566.817593.8594.6628.171128.786.49693153.92213.159360.8960.5262.81739354.75472004.059139.248.091121241435831.9089857.132237.6931.790731.458922.965570.6314.678719.3731.532431.71092039.63380867.5234.24545.2148.757641.8511.6910934.1764.789115.43416.9518375.6345.692.4848122.165.10948195.4535.1824676.8670.437714.198019438.04928425.8723744.65431214.812689578392800191.8184795.4624966250.77798330547.633.6164181.2930.5933.6505493.47.4970826.73457341067423936096463331820053316004.0714.63341681.4442114.626.8813.25625.02118.5408.909130.3779709312.69704990003586.3883701250162.97927.1138950600291.3726200666671493833333202700000020677844505250007.360173.2208205499628430000060773000003520766667799.491215463333353.6618.3117.2943.695399858.8441.589.96452640.92129.565.3823.55893229.32512570.4262.4012.76199.7344993.34339.3117.3892.15945930.76228184.68692455312.0997.93837437.8116.1835.391259675.11011.4937.4025.095.0398764.936.8562.659199.60893.46153.1622550.0168165.4955.61358.2533404.579220893.78755.555.4962.8052.1871.4323620.62425010602.4082004290.4481878.335.1361140.53916904323.245697410.595062.0723.330.5891699046129.021036735.631594.4316.90210976634581.739461680723.4123.49309896458.23455.79437.20280.2692709751157.561.43787187.50737.460214.43166573957920462.7853.9253.99109.6709.1188526.9313.26475396236.73520.229.388895675065407443876836703441509169372388605477022362573801363.308.0627.218378.314.7430.6799892689329.018534.4595302.0641148.40248165.0484752673.793.18392314.0574.648141216841363.0615.037666.516239.745125.15911.10042908.1874.08122.71863.60128.74105.98302.2663.308361.20298830.7252.16966460.77539.62403.203.69649270.329423.5930.840443.535522.96893.85774259.18650798595221221.818.03151783817.3921242.69.800.4981279.7914416.4391.5126.85592.203.23780308.8019.406757.2664.4752.15980462.85537265.931177.289.070231253199339.38170955.071159.6616.553460.409421.872924.6613.734656.9229.956633.37971486.12195648.8224.64284.6427.101080.2911.175725.0350.830719.67736.729515.8677.522.3626943.424.01687248.6825.1912317.9447.895320.879517143.04816734.5912284.26352234.540529297517946108.1242703.0882369998.35694026378.163.61153584.2030.6034.7913088.716.6138433.9733381464416361814760000187743338089.147.62401277.4631830.227.9015.96648.40610.4774.630316.6442811621.67731406673600.5783770000174.83216.0640244000319.7624755000001152933333117876666710578135032000007.87697.1861105831380683333331672000003148233333799.717192776666735.1032.0831.9148.425051819.8924.8016.9691024.23129.538.0233.06539331.70490579.4371.5823.72106.3952659.88338.9321.3574.18270735.50109416.42691232012.7754.45474059.7017.25810.19670666.70112.59514.2573.323.3163760.456.4583.391112.66113.4782.9663327.7829177.8615.78429.1410784.456107321.89742.934.3012.9714.2501.8475370.90716111980.8061734373.1822070.331.0738148.45833892357.009712328.478088.1120.250.5721748146143.67974189.927431.1362.4549688747985.169087177020.4620.13277205481.66486.05465.50294.3387797206207.201.05274210.93434.892254.00361806994523461.2349.7949.84116.3158.5971924.9714.04071227261.97455.578.727688046936977002393527173161264211732221992772322503885073056.447.1019.415808.813.4621.8932784173829.408034.0021420.6467160.72685187.0174481667.953.17002315.4102.970211069536056.0118.931952.816749.637620.14531.17292852.3265.85140.23354.84140.43109.30329.0363.039221.27368784.3042.79694357.355100.39298.564.49976222.029448.4621.932450.352219.85934.39649227.42358026680061032.014.62761796176.7191069.17.940.43115106.30165710.53120.9362.46477.773.19298313.10013.954209.1069.9313.06500326.14321314.217891.693.348313803664939.48197755.991068.4321.343646.849136.201643.4317.843325.9030.916532.34331278.45179647.5356.38167.8324.644587.9216.503606.1262.127616.09569.795943.6651.463.5815943.175.21520191.5626.439004.2355.120418.141315847.77615739.4502164.86604205.52550226536617086.9672174.1922194630.60044924688.568.61147469.3280.5237.7522616.920.9523072.3022878623881901605097000168823337562.807.08851205.3035230.131.4915.06051.8208.7624.268917.8540127833.56670746673209.6744410000162.47415.7136506000380.14253920000091856666710208333339455131812666677.06179.380594513350083333332438000003200600000711.378189056666749.4235.9634.8353.490276969.6220.9716.0308020.23129.750.0342.21941931.38458570.9081.2925.8982.8482071.18937.8624.0564.95586556.5371245.26765135125.1551.29712865.7219.22612.92934137.04714.72415.2112.712.7133811.637.5323.26791.99253.0870.0540333.9902164.2506.27823.5437054.92383448.70680.228.7163.1694.5762.1448571.077436674.122716203.4071960.960.8515174.954136969196.808116214.807630.0614.081.293778141161.061916162.954601.1218.57018776176992.238365178514.5914.03275472501.63507.56485.63317.3680169620115.891.10900178.28250.521172.990119106802107576.0848.7648.7792.347310.8362324.5614.85667315141.54456.1811.12153302630072713695343284706244029729474284625447744220253297737.558.8215.7711263.218.7038.22691232130029.753633.6082196.49644162.02669122.3143245908.405.62517177.7632.219481729702737.0827.594436.249360.358916.57051.43573696.9803.82118.57237.44107.36101.629352.7382.834981.76353566.3773.46571288.47145.78654.845.55101180.032528.9338.223564.285815.55554.72530212.9243341138813963.615.25512869586.480992.18.160.29189893.318944.39115.4737.58793.646.39031156.46115.967356.6367.3754.05881246.33541773.034614.150.831141381683726.58106365.021843.6134.305429.148725.124744.0521.735483.8133.289930.03681899.64350187.5283.11423.1842.818846.3815.047862.5868.829914.52807.7215519.9235.532.5047654.956.90619144.6405.7220937.5878.398912.754618241.56326529.9813425.29287188.890617525049998140.8283520.7053902076.24361230108.735.9153914.9330.5137.3114853.610.4443724.06255705459272931244026671684333314946.7613.75181730.2546877.528.2212.53627.10715.4508.370127.6579325313.50669913333210.1799496667154.50224.7136461000331.7626555000001126466667161696666718360337236666676.698132.2806183583536126666761165666673558600000712.697202500000054.8821.1519.1348.56418996.4732.0411.2843831.24129.767.6428.55603735.60409765.2242.1813.74133.6283340.69437.0419.5062.52980737.57147311.14767261127.0986.98453960.2818.2936.391698175.00813.2627.8814.484.4158128.248.0362.364152.74723.07124.7084484.5499156.5166.17245.9659555.074163333.21675.542.2813.0442.3251.4692100.73617013273.6941243412.3712530.525.2423117.53713937407.589406351.293375.3219.200.5591792636119.73697707.222861.0428.3876801908890.028574454219.4719.01277647470.02465.06446.40314.4482455664228.741.45223220.56928.278270.38044439185187383.5747.3247.34139.0967.2418723.3314.29269969320.11461.617.466412008481705074567280872265973541531619926127716132105821351.056.3019.995446.811.8616.0869743966333.334129.9973440.83113153.12467212.4824384040.523.02897330.1045.97130879540851.5521.217947.270347.241721.17021.37831728.4691.47149.37852.97160.56121.19380.9022.625441.45280687.6714.57581219.53241.93285.955.67700176.333375.7316.050254.959918.21794.58912217.88068973807421126.414.42114570486.3241131.17.760.33135075.07198811.29104.2328.73415.963.13366319.04311.374208.4976.9152.97094337.00421766.518522123.832370554283741.43235755.74860.6424.553540.728923.122074.3016.332935.4735.066528.51641047.96143755.3236.52202.5919.9102106.9612.543802.6161.254716.32517.136717.6550.992.5019183.835.22781191.1115.279087.1261.825616.174215054.37611443.4211605.10914195.70539420534615470.2131755.3331614763.70323721286.686.67117588.9920.5541.1252170.77.6723848.5402077383147161588496667169063335366.695.1342986.0420091.133.7514.10167.3247.5453.120415.1728655236.13671303333225.7632396667144.69813.3636537667333.7321387666678001866678385300006787526700333336.49064.959767893284893333323818000002351900000711.101164026666739.5642.8542.7858.379116841.6818.1321.0211217.52129.740.2345.94743531.78187462.7501.0831.6663.6201590.50129.0526.4585.93095748.2858815.36763126171.5237.00513050.1620.17513.96923768.30016.07521.0302.272.2635116.557.6223.78175.46903.1058.4230247.2979146.0976.83619.7689304.91685910.95702.627.6293.7306.1602.6320771.264077157.9611776214.416178554.4054145.293658790189.686116263.333347.9316.301.027976035141.951395446.445531.0246.93613797720394.848077046516.6815.84277589501.07499.18491.89328.4177501248125.151.88679184.29846.705175.62588635753413467.9145.9545.29121.6708.3996222.3416.96358952169.44435.2110.17127758338275710118989933234499084949273230422299332039672044741.656.8117.9110975.816.9129.3496962441736.228327.6074201.10956134.78213134.4193373323.925.74491174.6777.300651385925442.3524.651040.567160.112016.63941.65270604.7551.77123.88241.68114.29102.12460.6732.174632.02659492.8855.02267199.07942.16568.817.04111141.954447.5029.501869.450114.48314.85818205.88538926452111040.213.84199435706.0231041.87.620.28174862.5610495.11111.7129.98795.636.00525166.48517.155565.2369.6474.05270246.68042939.236900.565.026166451970132.25123756.711691.7930.473332.814124.003998.0217.195576.8640.453424.72741604.11288129.1256.63373.5035.932455.2613.347127.2872.801813.73667.3213102.2846.492.5337710.607.34848135.9765.5517252.2776.422713.086915042.87319932.1432695.74921173.909509405533173127.8453196.1232993136.60183230236.044.7183665.7580.5438.6533787.07.7752102.66840170749172931562616671690466710970.4510.20511479.5319876.527.5111.89733.92113.3926.212622.2556287518.24670640003207.0732560000122.61719.7536497667341.5124940500001091460000144406666713386635964000005.991104.8425134562482513333346709666673254033333710.916196323333344.7524.9923.1751.245898932.5926.6913.2112526.00129.751.9128.99311932.48199354.8231.7216.55108.3972709.93027.2620.7882.88109937.76135939.25763246822.5272.32973816.7018.4747.293491176.33414.40210.8403.493.5165396.2212.6173.110125.74943.09107.6299441.6518122.0897.12139.3457325.317172614.10651.947.5123.7763.1211.9829320.94507512410.291356384.3842245.230.5872125.14767812351.644165357.573406.9619.580.6221607424123.69813667.625441.5384.0637359223089.538635451819.2919.24277260476.91474.68461.62309.0383475645212.991.50214215.49632.157252.64851840436763398.4048.3548.14155.7886.5496523.7713.84572225290.56464.728.007477107026605920141154532637406900671889398078318779617444051.866.8218.076122.312.5018.4851736650033.987729.4250410.29005150.66848197.8444315467.173.37034296.7995.92501998817651.3523.662542.274749.974020.01031.41662705.6061.54143.80851.56146.03117.81382.1092.617211.47249678.4834.64757215.12759.69301.305.91961168.859386.0018.553359.179516.91664.67269213.98562540733661127.514.52440706746.5011133.37.720.37140144.0117929.99103.5638.50467.083.32030301.13612.724386.4873.0602.88734346.21323250.220561.4107.237337903923842.22212362.53894.8723.656542.271124.942243.8419.442877.3235.111028.47981108.95162727.4257.50217.1122.362597.8013.594093.7363.535315.73947.767207.7448.592.6720910.535.29027188.9305.779686.3961.010716.389815848.48713040.5011815.26075190.06343223446993978.1051952.6061855135.32609815081.076.87134048.9640.5539.8762514.08.1325831.8382433473423631597993333168853336445.095.97021058.9918621.231.9214.36258.1598.2823.627615.6833407631.47671276673229.1689003333149.99613.8936539000335.5823089666678822000009445500007914429724000006.57271.825379152322253333327690666672739633333712.013167970000040.8239.1738.4856.401698852.3618.8419.8824618.24129.741.3441.74619231.99824865.3591.1428.4970.8431771.06531.4024.8405.11416143.6769776.41762131606.8642.98343076.6619.65012.79975827.95915.37618.1022.392.3835234.067.7483.70483.49213.1065.3318284.3336151.7186.60522.5399904.86786407.46705.530.8433.5505.3322.2877661.196436840.0571852201.3821873.162.6357138.394075342187.224004269.204382.9714.921.098920725135.281627941.448534.8231.03314940908295.398013956614.7414.96277298471.79467.96460.66325.9778057728117.911.76778181.62951.816171.174103382860113477.3346.5946.79121.7808.2601623.3016.65560046156.70439.8410.44148466962705011811489573535229124033473756452205337273521529737.847.4114.8612115.016.6433.12751122332936.003927.7772186.32539159.31171128.0663392842.386.17796161.8862.563191535440038.3029.444833.962155.901917.98731.71875581.7691.54122.70437.91110.56106.27475.2542.104802.08780478.4675.39123185.4664.91569.607.53259132.712449.9133.112569.201414.45835.00222199.89636179419711039.213.34979074906.0771046.07.460.30176900.329614.37107.3041.57889.186.51744153.40718.725933.6568.4373.95819252.67145195.140368.658.248153571811132.44114362.111801.8934.250729.195525.724351.5920.245525.5640.517824.68181677.62316359.2278.52401.4539.338951.2914.427689.3273.968413.51907.9714033.9435.462.7940032.817.30822136.6896.0218561.9179.377012.597416443.91122730.5303015.88628169.850558473755946133.9903349.7563279262.53034911866.740.3865663.8230.5438.1364386.67.2653269.46946913152551432051610001688400012793.0111.88751528.4121583.227.6311.96730.19614.1277.207524.6565788914.67662660003222.8757176667124.26322.1436521333308.9524913400001206066667151893333315595938965000006.052112.7231156658503600000053670333333337066667712.085209046666746.2523.4521.4549.136175940.4029.6212.1069028.96129.752.2327.57729128.84015755.9791.7415.29114.9022872.56227.9020.0082.52736333.21141954.15763257384.5583.33953819.8318.1386.663875106.26614.0949.2853.663.6566492.4412.5782.961129.74823.09116.6053483.1049127.5467.03844.6683025.311171436.47663.852.2443.7382.6911.7112960.86435814030.5131527368.219217030.1110127.972300947292.030314295.305279.079893.3214.880.5251930006125.911099481.536371.6356.987104597200102.677517848014.7615.11231076295.06295.43285.17349.4274653007185.031.61232219.66935.701303.42154530700576411.0543.5543.80110.9709.0336721.7313.69373042235.31394.718.988072292653007124854114474254511900632207953990029350212241337.456.4316.685230.914.3117.6222983668929.764533.6027362.5935162.32335194.3824814941.534.49317222.5226.726631179531837.7521.956445.541454.283218.42221.42849701.7243.10151.53736.97135.56131.37345.9382.892531.55821641.0013.43125292.517113.70175.725.16480194.149402.7817.826960.928216.41235.29844192.8105524764188900.514.32591364665.877912.97.830.45151627.4215539.13108.3270.95281.365.18070192.99326.332963.8288.0654.00675249.48414497.312800.482.959304423486635.29183316.841186.2425.981338.502560.901313.394.544390.8138.517925.96061470.46182366.9207.8496.0822.508176.109.822030.9766.913614.946024.393263.0342.648.279657.086.50747153.5385.9313467.2870.340914.216915348.45314439.4102155.59763178.61540325123410397.0752426.8811839444.39631118943.662.54159709.7470.4947.5053288.412.2921389.823366534391719723153533135990008880.824.29351340.3431046.531.1713.02340.4448.9642.647116.1949158329.18539303332558.6646513333138.72213.7931992000347.721999266667981090000106103333311321926890333335.43784.8010113223303710000035722333333044700000548.362173116666740.6933.2030.7558.376732904.3620.3315.2471919.71112.344.1140.28640436.86211659.0971.4823.6785.2892132.23530.8025.9394.70255737.2690420.25971185954.5430.03093345.4521.43711.24980167.74416.33412.3903.103.0838906.139.6943.72499.24302.8182.9195216.9678140.7567.38824.9741045.919110742.15490.333.5443.5283.3662.1814550.86706518998.816869705.5843576.420.412991.75430885558.384868512.365172.967425.2217.700.581172076291.65587354.818389.3612.78251099545100.297672949517.5517.73231357342.99339.67326.65326.5378823112343.161.11056275.71421.379423.62627858504490290.1644.0144.13160.5276.2474021.9616.34161233456.81400.645.633995268154273560620408832122948838301098094009314615621295048.994.2922.272593.28.829.70022553987028.018135.6875798.34986182.23572298.4094826284.802.98306335.1523.60479714712048.9919.603551.017248.470020.87231.17561849.5594.41187.87548.89204.21163.75363.3512.752421.30173767.4763.34966298.673236.8184.304.80418207.934290.279.7776449.386220.24955.05427197.8521034611217341032.413.71303591455.5831018.37.520.5661956.93305217.8290.72127.89156.133.17360315.03025.911525.57100.4613.54242282.2529623.778429.13165.785544566303560.89361631.05642.4422.585444.274862.64637.769.262120.3335.604928.0886883.0091036.5415.8947.9911.8638150.3918.081100.1859.935316.686323.251698.0561.328.584502.745.54379180.2256.565913.0456.580217.674712176.1757955.7381235.67175176.29227812558495349.2031230.0801218453.34287313537.7124.63101665.4690.5052.2271770.019.1117348.4291883452437321073627667136083334479.282.1596852.1422957.343.4513.10081.3554.8131.331912.5624806653.38540896672534.5503253333133.18810.9331995000282.5014691666675392266675426066675693915546666675.43847.643756939161046666718235666671797400000555.597156176666730.1761.2259.1579.832398690.0915.5125.7894515.09112.331.2574.95658439.11791455.2380.8646.3247.2601181.49429.7634.28911.8521342.0537567.6197398557.1615.50382266.3223.65823.970828410.71218.84424.1751.811.8122655.329.1044.87455.42082.8243.6733126.4407134.0728.20113.4945575.90657317.66484.821.1624.0936.6733.3931891.422134431.344390693.1681429.944.9502137.506193921167.128164223.5414185.116906.27.020.2893480909120.113214376.398237.0181.99539912422361.461249472887.077.08301740526.36528.21513.92246.0810677837949.556.38343161.93662.000114.912276267766403464.7855.1155.01182.2685.4971127.4318.1595527267.52540.9622.581990352059967171406176108710866181919509145597120076765271954716.8210.618.3531157.833.0855.25761985166422.788644.063593.568115135.516389.2758683410.797.09682141.83020.752593330757417.2842.887923.496090.062111.27072.24645446.8055.2496.16116.9779.4291.9661165.930.8576853.21781310.5913.80792263.52443.771095.796.17190161.947391.4055.3382137.9897.248698.39969119.558517855208931392.516.810595465331321.48.420.35178488.035613.9286.0843.171110.499.95245100.460022.208231.7263.4043.61792276.207121976.912348030.69489161051422.8366011.954013.9666.435515.051633.185766.624.0811735.4241.569624.05401897.64644091.0233.63205.0360.374823.844.919752.89114.1588.759713.7812665.6219.849.2520550.939.06607110.1685.3435809.59158.2656.3182817924.13429725.87240811.458087.25795831031209151309.2197730.4718448083.72998025977.418.670.5635.3166999.714.2954678.485111646574136644672813331308313322166.6019.40521560.5659466.622.5212.13022.52511.910745.26129400012.83554156673125.4849340000161.33943.3936040000248.0327728000001394733333239433333337626847593666678.513210.4367374589801270000079352666674407900000783.200227930000055.0511.4710.16738.3163.483.08110862.82112.274.0322.70798926.82362787.8241.647.75236.6105915.25331.9517.8392.07683519.92390520.93818551955.55116.122612296.2716.4013.753199018.99211.7204.1333.473.4588487.916.9554.510231.42723.62214.0178508.0926163.7955.95078.4961584.943244738.81664.753.7712.8901.1991.1094461.0019147885.162396176.4221450.527.5824121.963122574309.847653245.8214955.614143.114.080.2513989358123.371613828.748996.8290.34121452465952.9314476044813.9513.89300833595.19597.73566.31209.6812616102877.323.41085176.87646.891147.837138409588983425.2555.3855.56178.0325.6650827.6112.58079492123.90542.1516.219960071092678597205999635449040847734586513191338392565207734.6912.4315.8615786.624.6932.52321415841921.578446.8764178.25382118.54229124.4558634258.394.10914243.3409.335341959577734.7124.109741.474571.556413.97451.48596672.9168.48103.35234.9094.7697.004801.9611.251791.69307590.7073.57543279.641110.91433.066.16668162.092406.5832.5188102.7349.736858.13326122.94838645443491385.317.25376330347.5471324.98.450.45138605.5210378.96104.5283.11576.985.59491178.69813.526963.3161.6292.23922446.30374389.064260.256.912166031953542.17122521.632212.4133.499429.849332.002986.337.856017.1934.812628.72501392.91319827.2471.98101.5134.644744.878.485608.0781.431912.28076.936846.7941.179.429997.896.18478161.4975.4117230.35102.0359.8000816530.00120132.8893009.18524108.868546523310091187.6844692.1064152864.87538029384.935.66206619.2920.5734.0445656.925.3827287.26171606557911223761490001338733311424.0510.32241301.2653167.820.4517.01623.26515.2226.302732.7467132234.20554553333114.2850586667162.47529.1836066000330.2628620000001368733333157040000019289847553333338.595133.4769192574581190000058624666674353533333783.422228746666762.7018.6518.3640.918961868.5440.505.46066040.00112.278.1528.32559425.93164686.2981.2814.29151.9483798.69532.1219.9913.36045326.23225311.82818362511.4373.37966346.1516.6686.881212797.47112.1996.9502.662.6462071.106.8574.312155.12083.61130.7874500.7673165.7535.75745.2457944.770134994.14680.739.9982.7231.9841.3690631.1192310176.8642077238.8811575.528.3185140.013161216466.548014334.3012394.614217.113.950.2783603261138.111436324.935964.9311.82519770835053.7714210225414.0513.84298341559.55562.50536.82211.85125562060176.142.87877185.30042.507164.021126475137690470.9555.6155.59182.0175.5501827.6612.50279987139.25529.8014.298972884361237676965536675033110211233962757549735096099835734.6511.3415.5714207.721.3228.06891460854423.919842.0692325.42331136.39912135.6668220895.454.46135225.3088.182751802499335.0125.478939.258672.123213.86471.66046604.0458.35111.68834.90100.24108.02800.2311.251351.70579586.1785.34656187.012157.45306.277.88584126.816447.6128.0956101.46869.860188.15092122.68343290500191388.917.24285570547.4311328.58.380.48133779.6211809.01114.6391.16525.885.25321190.38216.325697.5161.9922.66711374.74546233.742172.462.173188962230546.50139127.461743.4934.163629.269034.922739.018.585528.1533.520929.83811363.33294183.2510.1093.9930.607348.889.475024.3281.604112.25497.236554.1240.4510.099356.716.37780156.6105.8516038.90102.1919.7851616034.86617334.5672649.08955109.998511409272949171.7714294.2833926265.27712027695.240.26186675.4320.5734.1485239.625.7526082.71164262654950022828020001339466710652.039.18441278.5850909.622.5316.73024.23712.5145.630131.4464347532.80554253333105.9811373333172.87528.0136068333354.5928598333331158166667136216666716654142563000008.422113.2783166541526646666752719333334032733333783.778228276666762.0221.0220.1543.454051942.1939.585.91645838.90112.276.8332.59178328.03102287.9931.3115.96136.9453423.63431.7220.4943.75483532.56125191.11818269047.2865.30255229.4116.9638.253835116.74313.4717.7382.732.7353182.777.5283.850132.49183.62110.5253449.1141178.5165.79939.0862624.792116725.04684.736.1512.7562.0581.4229541.154876918.0213335145.6471558.442.5158161.906162228248.867315266.1012708.511941.37.140.2933422731133.872861959.871942.0197.63037075153061.071255956077.207.04299610525.23529.80504.84240.4310882158077.645.27839164.89957.099118.902251645629887525.8452.7952.81220.3514.5381726.4118.0595550579.05529.0317.891785006879067152650546581310015026348607882225738369892582222316.2410.568.2726702.729.6147.52672010828925.317139.8035124.29946140.4826194.8108498306.787.55558133.48517.811053032459617.0742.513723.578693.834010.66152.25020444.8475.24102.58317.4185.89102.981094.2560.9170433.17064315.3555.98436167.10763.98750.119.74614102.572401.8447.6143155.9606.4122910.434495.837220750279431382.117.08576871791324.68.300.35172688.506613.6682.9448.43990.169.96245100.358623.127810.6562.8873.68001271.62086757.781025.833.675104281242730.0578014.303353.7366.628515.008236.905178.294.4610708.9139.017625.62651862.79593246.9253.63188.7452.674126.355.209203.19113.5178.809303.9812024.1819.3410.1718666.169.12452109.4645.9831974.88157.5056.3489117825.84426227.67836811.502486.9230553815145110291.2787281.9587975907.45064922931.821.120.5735.4026835.714.4748760.815103327776173443249303331339066719414.9417.00981524.7443531.023.5312.63120.23410.601842.03125333312.42549546673098.5824583333167.22340.9636033000227.2227302333331199966667212953333332052742809333338.349175.5971316492741186666775133333334063333333782.322228206666753.4412.8711.25727.7761.113.40833761.07112.272.6825.00563227.73771286.3411.678.61217.8465446.16128.8118.0892.31297719.88256584.67822472931.04105.405210139.6916.4094.260785968.19612.7494.6093.493.4884477.727.6454.329185.71103.62176.2061491.5344171.2185.84668.8685054.829194942.32673.450.1212.8101.2421.1263291.00947311895.4072508360.207170023.6266135.173484477534.059428400.5212731.89839.6411.010.2923422492125.761872096.153966.9337.68518976379958.1113178130910.9110.88250695458.96450.12433.79227.40116685326231.962.88869212.54647.986186.103161269162280450.6147.3147.33166.7936.0116423.3613.84372244114.76425.4616.7911672211418709975390078736563963293875274663411345703974887027.5312.4113.059320.523.7635.14641577618626.445837.9585449.46597167.40625146.7617736018.746.22791160.9047.997562282942627.6832.474430.857287.655211.41822.61653382.1037.47128.27927.78106.54110.80319.3483.131562.21020452.3237.63337131.004230.24283.1811.139289.7350462.7935.2461120.5568.295339.42177106.13037383429451139.913.85899510706.4651102.26.680.73132973.439546.19106.14102.84621.426.52367153.24622.675310.0773.2713.12904319.45228854.328476.648.849152861812948.36113038.211671.2340.633024.609538.853280.2510.975778.5136.446027.44711620.53374413.5551.07115.7837.738139.8311.355594.81103.5979.652968.037862.6531.6210.9211508.197.28087137.1936.2519917.54115.7908.6359415133.12020738.52630410.553794.7365535573235452232.7495818.7364525288.00301425194.631.65177989.8910.4840.3515973.820.6424218.83178087157544022753526671117450012575.3012.31871454.7150139.923.6914.78521.76213.2427.557332.4480318721.00462700002596.1709650000163.41329.0029907333314.6724449333331369800000174470000022018847145000007.283133.9297220188640136666765882000003791566667655.795189876666754.4617.7016.5845.078087924.8039.085.14765838.47112.168.5633.81422330.38137278.7391.5012.86229.9135747.82328.1623.2173.65430335.08127519.37974279397.4586.01395702.1319.9068.872259146.92816.3886.3503.163.1243799.788.8013.968156.39093.04126.1456527.7997169.2306.85344.9708265.662125567.07596.240.3863.2511.9211.3557370.9436217365.8634012201.2651712.641.8727174.935861750253.318553349.6711208.713455.05.710.3293044620131.383729470.8107830.6210.19730120223266.541153178345.755.79251075427.95420.35411.26253.1310363048393.995.83606192.97758.839147.735320258686237588.4347.1347.14203.5714.9142023.2816.8845922865.58422.7622.0023166119452831983103026700130692850757310477663304790602860899013.769.656.6417873.132.2656.44852290015227.897535.8712137.11385192.41705101.5617645325.708.51808117.61718.974543659320413.6855.915818.013393.636010.751883.16441316.1134.63126.11213.1190.85111.15397.4292.517093.69602270.6317.84065127.53785.86750.9611.577486.6864397.4456.6936148.2086.7497710.2310698.637416960200711139.013.711699473851104.26.640.41166151.425312.4767.0856.731127.0511.314888.374128.106513.3674.6893.98735250.63454066.052639.526.77684131001527.7463015.844032.6683.766011.938239.866400.94512750.5938.000026.32571876.66759922.1275.53231.8363.845921.666.2710182.16125.2447.984024.3714601.5214.9011.2022499.0310.066699.21826.638546.66179.9895.5576716427.14531030.68040312.809378.06765671135206564288.5377213.4338171241.70851229877.116.820.4841.9168396.710.9446126.080134022677696827830390831127366722017.7522.00231403.4642113.527.8611.55721.30514.103838.1215510008.10462296672590.8709393333159.74637.1329893333176.0023747666671349800000173480000041272346265666677.153200.1612415412631626666764390000003794133333655.046189496666746.0011.219.71658.9754.572.94045654.88112.159.0124.57012229.47448477.5961.717.17214.6175365.42128.1121.2242.08438418.59214017.18972588329.32121.30179771.4119.5584.510618937.91515.8103.9813.573.5963265.018.8484.100208.31313.03190.0839462.2382168.7796.98684.6885945.740245447.72576.851.6293.3411.3591.0683980.82965316146.9971266468.6882024.722.1972101.17851997567.286947495.255826.447382.4313.260.384260650098.70881480.825894.6406.4149919814465.6611687979913.2813.19250024338.84337.32323.59251.47105432862297.251.51901242.93127.532277.52574584721007313.5046.8746.88216.7034.6649123.2516.32161272240.13421.999.395397849313734623097505303070689383772437846082021118566172733.767.3815.254660.013.8117.9448933364527.928136.0772691.64224163.69864205.0146198256.724.57029219.0585.706721205390133.4932.920130.374380.723212.38842.25716443.0585.16154.01033.68176.87137.23388.7432.572781.82443547.5247.87325127.085161.48197.9111.204789.2081308.4617.9668112.7288.874469.38681106.52672051842611118.813.92740917786.1181101.46.760.5387511.11204310.7987.31100.67317.384.82506207.33617.303636.3375.8643.91006255.67116573.216704.4105.676388114537757.38242131.99998.0936.611927.312841.381542.6110.782943.0835.794327.9362875.23172566.8592.2253.8918.470585.1211.222830.12102.05039.80098.593692.6741.1111.785366.797.74521128.9826.779256.11114.1748.7581412363.79611244.27617210.302697.0508379266186537107.7152692.8732274636.13154419375.967.67153818.0310.4841.6573193.021.0016949.5913679893313571150052667112900006416.345.7420843.6324526.033.2313.96845.9536.4993.514619.2538621236.66462106672593.3633860000160.78517.0429899667276.93218683333380991666782101333310222229828000006.93964.3253102198311693333330622000003047066667655.239187133333350.0435.8234.3556.417518673.4224.3111.3696423.71112.154.6058.16923533.67316268.1880.8627.12107.3532683.83128.1327.5366.54176834.5152745.64976133284.4641.02252746.2021.03520.937913910.20517.91713.2501.801.7922229.948.9295.07775.21493.0362.1866294.6209165.0897.18221.8175775.73563930.64557.924.2463.4843.8012.2004971.4983516609.7811177496.2412224.622.134195.63771352568.254049498.225821.467421.2313.180.414241637592.82810291.821047.5438.1689065815664.9311788497713.2813.15250162335.46337.44322.69251.05105138551300.691.46163251.60625.334288.11867806730387295.2946.8646.93226.6264.4653323.2718.05355395263.76418.898.484889653908574158939632072820533270772219447097319330509364333.186.9315.114564.313.0016.4505893417626.829037.5302690.73503188.37105215.9255820618.184.74221211.1875.449711188210333.2332.229431.064486.651511.54472.23868446.6895.11159.62433.30187.03151.27443.9612.254531.80573553.4717.86015127.208156.59204.0511.286488.5688287.4216.4504114.3118.752339.71131102.96678093916431144.813.82429401106.0001096.56.740.678334.92224010.7080.86109.00293.074.92653203.05518.493405.9478.2413.92455254.72716399.715903.4120.560425134884457.54264934.76918.5338.102726.247545.711396.7811.482763.4835.883127.8703796.82153920.8654.8348.7316.920094.4112.672506.10112.7608.871449.463355.7340.9713.114830.017.70511129.6467.608279.63118.0238.4728312066.70510546.35216310.397796.167936323499263697.9782449.4542069432.52809319485.875.26141831.7760.4842.6052818.520.6516855.8913383553190941147108000112363335745.045.2406771.4724548.835.9513.61454.3896.2463.199317.8033999836.48454863332593.0577263333153.41715.7729899333256.7920263333337317566677417400009347226870666676.72763.343393473279370000027896000002767933333656.250177686666744.9238.8638.0461.362463617.0323.0212.1513222.46112.151.5159.26637736.82344164.7870.8030.0798.2072455.16327.7428.4206.85271234.3552684.93974130839.1237.95972718.9421.53021.178030710.42718.17514.4931.691.6921684.808.9485.16573.90733.0358.2776273.6703157.3627.30120.9977325.73462449.55563.621.9353.6234.5452.3211951.797492020113.422239294226.606.110.8151229649103.221479879.022587.4192.098235445499107.28716640056.336.15197298320.87320.17311.63380.33675997930.70757252.968187.654256330349777354.8126.9026.89194.1075.1516613.9028.80734716106.48258.497.7110960821997139794193887973528268216537859939523024000513515314.816.416.4710431.616.8832.79792446614347.197721.1982138.5661783869.9612.434580.41992.554002763078114.84179.1445.58241155.9006.604713.61920276.2352.56160.46214.67608.0941.6467412.302181.25726.14327178.1131293.02245.277.32610136.391301.4632.9663133.3567.4994016.806259.49836244971583721.410.61158496546701.25.601.2075761.5014971.7661.48294.69243.7636.400927.4727340.26843.92143.79710.806692.508358.957382284390628.99183241.501731.50285.9883.49785180.291593.8816.284376.0956.773417.6172979.89456271.0719.8399.7221.222735.1126.122743.39149.9946.6671818.753787.9416.4528.2410020.9117.055358.576719.2314551.12217.9294.5896011833635.54635016.582860.2880474111572074278.2351955.8816575205.53864631677.227.410.3579.2003067.02.8342946.258767313591835628076711.3573857.2039580.929.3857.129122.033676575.88334393331760.8349746667108.29320.4631705667168.101852366667707053333130673333336313337121333333.710125.1146363300680090000068215333333607900000494.379178053333327.3318.7016.52464.8029.1529.1549.836.4042.8571.5110.5676.6021915.04122.0725.71116.24111971.024725.8797.96720.5886.0452.972.9812.2453.629138.84992.23121.4320338.1468108.4959.96031.4785578.094293.14.8292.6051.8576422.49734126791.961508453314.8811.880.572174865887.17743282.711348.5274.85512279424690.318511789711.7411.95196740379.92381.05365.62312.32819004770.52357267.951246.848129975994733278.0527.1727.17188.3005.3105014.0112.62879191191.20261.199.405657207677835063013746231772490621834060513792312059178725726.917.9013.395315.715.9019.42511134038941.083324.3394184.2022299150.517.68977130.0623.768111754893426.89106.6889.37294124.0648.060132.24323445.6235.39165.40926.82562.3981.778095.66426176.6434.80725207.942283.83126.647.16440139.454260.8319.515978.730212.701516.863159.298988579101444743.510.65969554944.052739.15.651.3684584.1323184.6771.41259.66138.5317.900055.862282.121747.50140.8594.20355237.803115.462520835765738.01273138.87924.90160.1286.24521172.72832.2915.112366.8342.901623.3078677.40233836.3692.7951.8512.173765.6725.331414.86116.6448.5728617.812006.0032.4527.015278.467.59589131.53618.207721.00140.1447.1358714525341.09527014.476169.068350457474955239.348983.7072915609.74736827281.952.47114715.7890.3576.4741953.18.5626024.60242106341385162843005.8632609.6740441.010.39157.7133.650515.6518892512.40334446671765.6359576667114.54213.7731726000214.14190626666771962666784837666719005837363000003.97276.5292190209425943333343011666673671966667494.046184140000040.7329.0629.5558.306715443.7419.3418.8649.841.8646.4830.9819.8539.171979.27920.2227.85029.56111740.692425.88511.19820.90811.4791.931.9310.9965.17784.70572.2373.9558284.4616115.3459.18815.9416047.507299.44.2434.8062.5046212.29712139197.671640921313.5013.640.542184608092.42826049.512610.8251.19512519406684.599097341413.6113.00220051400.52403.96388.29296.36871903970.56717238.432228.571144163027280298.1629.9429.95174.1405.7423415.4711.53786677174.49284.3310.096384532037635689375783131969206832704508875564013403303909030.878.4714.535753.915.8321.51471186481536.783427.1844169.4472339570.286.97509143.3553.763481794574530.6996.687010.3425111.8748.938332.07288482.2095.58152.22930.86515.0791.941445.24051190.7824.59703217.445266.91134.776.74630148.107281.6221.622272.312013.829515.105766.19718100392175816.711.56731592174.440797.76.191.2591273.0220905.0276.37240.38149.6315.585664.158475.221906.99126.9664.06272246.037103.863468755250138.01247235.301018.18146.7796.81330153.76934.9714.012553.5538.419726.0268732.79262432.6618.9758.0613.401860.1123.491525.26105.2239.5035316.362179.9935.8524.255866.637.13535140.02616.418536.39129.9407.6958315528137.64029913.178975.865056664530948343.7281093.2063340274.03430929804.448.07116716.4010.3969.3432118.69.6026864.11046376843804869839336.5166668.3340626.411.18152.0744.057417.2920980313.14371956671960.7398566667124.59715.2435259000232.51209903333379634000094027000021131141367666674.35083.7321211449471470000047991333334102200000540.240205730000044.4426.4926.5252.321381482.0621.3920.8752.546.1850.8221.0717.6143.5531088.83321.3025.23531.99100745.210023.40510.38619.20310.3012.112.1110.2434.77092.87842.4981.8340314.6232126.5858.35917.8536826.849333.23.8724.3242.2799712.049102228124.602449334236.816.610.7751292122115.121644363.725098.0174.272266919825101.49757401396.656.59217536337.75339.50333.06377.58683208000.57694233.205173.087287035041140378.7928.3928.39182.3615.4834314.8726.2883804397.18283.527.99126688286665311253730411733919112254808919441685726658385788715.976.747.1011147.217.4536.24642705978643.806822.8289125.2741821144.0011.482087.08672.397702765777616.10167.9745.95283141.5747.312853.41537292.7912.67148.99316.22587.0001.7036512.126882.44214.74859210.365274.52261.6410.58571103.8947335.3836.5043122.7518.1461515.127466.17725608266487774.411.61324163340753.26.101.0976895.2913421.9968.52271.14264.6635.226628.3969293.36978.46129.91010.588394.424753.015350813928328.92163137.171933.08266.1043.76003157.281826.8214.304992.7854.254318.42951064.18519392.2630.23113.6823.116331.2824.242957.69140.077.1391716.734259.9917.9124.7711390.0416.541860.388316.9816394.06219.1734.5627812638132.65538915.278465.4320517127290756186.8842172.1037302247.13820633010.524.610.3871.9683414.22.9944136.525846335611200696996712.62201010.9337461.126.4627.906022.594072566.72371213331954.2384406667116.61821.6335190667190.802036733333777940000143710000040227540686666674.040136.2218404739759756666775463666674021033333538.908198930000028.4316.8915.16520.0131.7031.8552.638.9247.2531.689.7184.3472108.67519.5523.32318.34100579.285223.4567.46818.8515.5123.313.3111.6193.411151.24812.47133.4150363.3844117.6819.35135.1966927.603323.74.4862.3371.7180222.24526OpenBenchmarking.org

WRF

WRF, the Weather Research and Forecasting Model, is a "next-generation mesoscale numerical weather prediction system designed for both atmospheric research and operational forecasting applications. It features two dynamical cores, a data assimilation system, and a software architecture supporting parallel computation and system extensibility." Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterWRF 4.2.2Input: conus 2.5kmEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P4K8K12K16K20K16609.7816147.007365.8611895.416918.0210176.867885.164431.3418998.8214030.516840.0612410.297157.9613273.696674.1211980.8110602.415601.101. (F9X) gfortran options: -O2 -ftree-vectorize -funroll-loops -ffree-form -fconvert=big-endian -frecord-marker=4 -fallow-invalid-boz -lesmf_time -lwrfio_nf -lnetcdff -lnetcdf -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

OpenVKL

OpenVKL is the Intel Open Volume Kernel Library that offers high-performance volume computation kernels and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P9001800270036004500SE +/- 3.61, N = 3SE +/- 0.67, N = 3SE +/- 0.58, N = 3SE +/- 7.31, N = 3SE +/- 8.17, N = 3SE +/- 1.20, N = 3SE +/- 26.33, N = 3SE +/- 0.88, N = 3SE +/- 8.67, N = 3SE +/- 1.20, N = 3SE +/- 1.00, N = 3SE +/- 5.36, N = 3SE +/- 6.81, N = 3SE +/- 12.02, N = 3SE +/- 4.36, N = 3SE +/- 13.96, N = 3SE +/- 8.62, N = 3SE +/- 6.66, N = 3SE +/- 6.74, N = 3SE +/- 1.53, N = 3SE +/- 2.08, N = 3SE +/- 13.62, N = 3222813911267202011771266401225083335207723963906869152718521356177612432716173420043222

RELION

RELION - REgularised LIkelihood OptimisatioN - is a stand-alone computer program for Maximum A Posteriori refinement of (multiple) 3D reconstructions or 2D class averages in cryo-electron microscopy (cryo-EM). It is developed in the research group of Sjors Scheres at the MRC Laboratory of Molecular Biology. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterRELION 4.0.1Test: Basic - Device: CPUEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P150300450600750SE +/- 6.20, N = 3SE +/- 4.63, N = 3SE +/- 4.04, N = 12SE +/- 7.69, N = 9SE +/- 2.11, N = 12SE +/- 2.95, N = 3SE +/- 2.17, N = 3SE +/- 1.27, N = 15SE +/- 7.86, N = 9SE +/- 0.35, N = 3SE +/- 2.66, N = 12SE +/- 4.65, N = 9SE +/- 3.24, N = 12SE +/- 2.98, N = 3SE +/- 2.65, N = 3SE +/- 7.14, N = 9SE +/- 2.68, N = 7SE +/- 1.41, N = 3496.24468.69201.27360.21145.65238.88176.4293.17705.58368.22201.38384.38214.42412.37203.41373.18290.45155.741. (CXX) g++ options: -fopenmp -std=c++11 -O3 -rdynamic -ldl -ltiff -lfftw3f -lfftw3 -lpng -ljpeg -lmpi_cxx -lmpi

NWChem

NWChem is an open-source high performance computational chemistry package. Per NWChem's documentation, "NWChem aims to provide its users with computational chemistry tools that are scalable both in their ability to treat large scientific computational chemistry problems efficiently, and in their use of available parallel computing resources from high-performance parallel supercomputers to conventional workstation clusters." Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterNWChem 7.0.2Input: C240 BuckyballEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P80016002400320040002224.62024.71712.61700.01558.41575.51450.51429.93576.42170.01873.12245.21785.02530.51960.92070.31878.31809.71. (F9X) gfortran options: -lnwctask -lccsd -lmcscf -lselci -lmp2 -lmoints -lstepper -ldriver -loptim -lnwdft -lgradients -lcphf -lesp -lddscf -ldangchang -lguess -lhessian -lvib -lnwcutil -lrimp2 -lproperty -lsolvation -lnwints -lprepar -lnwmd -lnwpw -lofpw -lpaw -lpspw -lband -lnwpwlib -lcafe -lspace -lanalyze -lqhop -lpfft -ldplot -ldrdy -lvscf -lqmmm -lqmd -letrans -ltce -lbq -lmm -lcons -lperfm -ldntmc -lccca -ldimqm -lga -larmci -lpeigs -l64to32 -lopenblas -lpthread -lrt -llapack -lnwcblas -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz -lcomex -m64 -ffast-math -std=legacy -fdefault-integer-8 -finline-functions -O2

High Performance Conjugate Gradient

HPCG is the High Performance Conjugate Gradient and is a new scientific benchmark from Sandia National Lans focused for super-computer testing with modern real-world workloads compared to HPCC. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGFLOP/s, More Is BetterHigh Performance Conjugate Gradient 3.1X Y Z: 144 144 144 - RT: 60EPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1530456075SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.28, N = 5SE +/- 0.51, N = 3SE +/- 0.01, N = 3SE +/- 0.34, N = 9SE +/- 0.07, N = 3SE +/- 0.37, N = 3SE +/- 0.29, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.94, N = 322.1322.2041.8723.6342.5228.3227.5844.9520.4130.1162.6430.5954.4125.2460.8531.0735.1469.301. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 512 - Model: ResNet-50Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P4080120160200SE +/- 1.22, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.93, N = 9SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.81, N = 3SE +/- 1.62, N = 4SE +/- 1.83, N = 3SE +/- 0.34, N = 3SE +/- 1.42, N = 4SE +/- 0.31, N = 3SE +/- 0.08, N = 3SE +/- 0.21, N = 3SE +/- 1.80, N = 3SE +/- 0.61, N = 3SE +/- 0.79, N = 3SE +/- 1.17, N = 3SE +/- 1.39, N = 3SE +/- 0.01, N = 3SE +/- 0.48, N = 3SE +/- 0.61, N = 3124.6097.6791.96113.4295.63101.17174.93135.17161.90140.01121.96137.5091.75127.97138.39125.14145.29117.53174.95148.45140.53169.75

BRL-CAD

BRL-CAD is a cross-platform, open-source solid modeling system with built-in benchmark mode. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.38.2VGR Performance MetricXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1.3M2.6M3.9M5.2M6.5M2449334164092115084532239294771352851997586175034844776162228316121631225746193921430885230094740753427678123658790713937413696983389291690451866771. (CXX) g++ options: -std=c++17 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lnetpbm -lregex_brl -lz_brl -lassimp -ldl -lm -ltk8.6

Xcompact3d Incompact3d

Xcompact3d Incompact3d is a Fortran-MPI based, finite difference high-performance code for solving the incompressible Navier-Stokes equation and as many as you need scalar transport equations. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: X3D-benchmarking input.i3dEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P120240360480600SE +/- 0.22, N = 3SE +/- 0.92, N = 3SE +/- 9.13, N = 9SE +/- 5.39, N = 3SE +/- 3.26, N = 9SE +/- 4.73, N = 3SE +/- 3.06, N = 9SE +/- 2.20, N = 12SE +/- 0.13, N = 3SE +/- 1.19, N = 3SE +/- 0.01, N = 3SE +/- 0.14, N = 3SE +/- 0.04, N = 3SE +/- 1.25, N = 3SE +/- 0.05, N = 3SE +/- 3.88, N = 4SE +/- 2.51, N = 3SE +/- 0.37, N = 3568.25567.29253.32534.06248.87466.55309.85167.13558.38292.03187.22351.64189.69407.59196.81357.01323.25171.381. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

CloverLeaf

CloverLeaf is a Lagrangian-Eulerian hydrodynamics benchmark. This test profile currently makes use of CloverLeaf's OpenMP version. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeaf 1.3Input: clover_bm16Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P110220330440550SE +/- 2.04, N = 3SE +/- 0.00, N = 3SE +/- 0.11, N = 3SE +/- 1.60, N = 12SE +/- 1.08, N = 3SE +/- 0.79, N = 3SE +/- 1.02, N = 3SE +/- 4.99, N = 9SE +/- 0.12, N = 3SE +/- 3.79, N = 9SE +/- 2.24, N = 3SE +/- 0.59, N = 3SE +/- 1.58, N = 3SE +/- 3.41, N = 3SE +/- 2.11, N = 9SE +/- 2.03, N = 3SE +/- 1.56, N = 3SE +/- 1.43, N = 3SE +/- 0.74, N = 3SE +/- 0.13, N = 3SE +/- 0.54, N = 3SE +/- 2.02, N = 3236.81313.50314.88226.60498.22495.25349.67400.52266.10334.30245.82223.54512.36295.30269.20357.57263.33351.29214.80328.47410.59378.051. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp

ASKAP

ASKAP is a set of benchmarks from the Australian SKA Pathfinder. The principal ASKAP benchmarks are the Hogbom Clean Benchmark (tHogbomClean) and Convolutional Resamping Benchmark (tConvolve) as well as some previous ASKAP benchmarks being included as well for OpenCL and CUDA execution of tConvolve. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMillion Grid Points Per Second, More Is BetterASKAP 1.0Test: tConvolve MT - GriddingEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P3K6K9K12K15KSE +/- 0.88, N = 3SE +/- 0.88, N = 3SE +/- 21.01, N = 3SE +/- 2.09, N = 3SE +/- 141.43, N = 5SE +/- 59.24, N = 3SE +/- 262.30, N = 12SE +/- 204.28, N = 3SE +/- 6.18, N = 3SE +/- 19.36, N = 3SE +/- 195.28, N = 8SE +/- 32.87, N = 12SE +/- 23.56, N = 3SE +/- 87.89, N = 12SE +/- 75.19, N = 5SE +/- 4.15, N = 3SE +/- 54.27, N = 5SE +/- 60.72, N = 35821.465826.4411208.7012731.8012708.5012394.6014955.6014185.105172.965279.074382.973406.963347.933375.327630.068088.115062.076038.921. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp

OpenBenchmarking.orgMillion Grid Points Per Second, More Is BetterASKAP 1.0Test: tConvolve MT - DegriddingEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2P4K8K12K16K20KSE +/- 0.54, N = 3SE +/- 34.17, N = 3SE +/- 345.37, N = 3SE +/- 25.80, N = 3SE +/- 267.65, N = 5SE +/- 128.32, N = 3SE +/- 212.00, N = 12SE +/- 889.21, N = 3SE +/- 3.76, N = 3SE +/- 322.56, N = 37421.237382.4313455.009839.6411941.3014217.1014143.1016906.207425.229893.321. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp

PyTorch

This is a benchmark of PyTorch making use of pytorch-benchmark [https://github.com/LukasHedegaard/pytorch-benchmark]. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 256 - Model: ResNet-152Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P612182430SE +/- 0.04, N = 3SE +/- 0.19, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 9SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.12, N = 9SE +/- 0.15, N = 3SE +/- 0.13, N = 9SE +/- 0.11, N = 3SE +/- 0.20, N = 3SE +/- 0.13, N = 9SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.18, N = 4SE +/- 0.15, N = 3SE +/- 0.09, N = 3SE +/- 0.15, N = 3SE +/- 0.13, N = 7SE +/- 0.08, N = 3SE +/- 0.29, N = 3SE +/- 0.16, N = 36.6113.6411.886.1113.1813.265.7111.017.1413.9514.087.0217.7014.8814.9219.5816.3019.2014.0820.2523.3316.00

PostgreSQL

This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average LatencyXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P0.29090.58180.87271.16361.4545SE +/- 0.008, N = 12SE +/- 0.006, N = 5SE +/- 0.007, N = 3SE +/- 0.009, N = 12SE +/- 0.001, N = 3SE +/- 0.002, N = 3SE +/- 0.001, N = 3SE +/- 0.001, N = 3SE +/- 0.004, N = 12SE +/- 0.003, N = 3SE +/- 0.002, N = 3SE +/- 0.006, N = 12SE +/- 0.005, N = 3SE +/- 0.022, N = 9SE +/- 0.038, N = 9SE +/- 0.007, N = 3SE +/- 0.017, N = 9SE +/- 0.008, N = 12SE +/- 0.030, N = 12SE +/- 0.007, N = 3SE +/- 0.005, N = 12SE +/- 0.040, N = 120.7750.5420.5720.8150.4140.3840.3290.2920.2930.2780.2510.2890.5810.5251.0980.6221.0270.5591.2930.5720.5891.1491. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read OnlyXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P900K1800K2700K3600K4500KSE +/- 13233.94, N = 12SE +/- 19583.16, N = 5SE +/- 20221.52, N = 3SE +/- 13874.42, N = 12SE +/- 4774.62, N = 3SE +/- 11512.67, N = 3SE +/- 13473.87, N = 3SE +/- 15503.17, N = 3SE +/- 41074.86, N = 12SE +/- 39970.22, N = 3SE +/- 27594.68, N = 3SE +/- 71870.42, N = 12SE +/- 13469.59, N = 3SE +/- 74539.48, N = 9SE +/- 36627.33, N = 9SE +/- 17697.00, N = 3SE +/- 16726.04, N = 9SE +/- 24978.23, N = 12SE +/- 18635.21, N = 12SE +/- 20350.34, N = 3SE +/- 13863.97, N = 12SE +/- 30933.90, N = 121292122184608017486581229649241637526065003044620342249234227313603261398935834809091720762193000692072516074249760351792636778141174814616990468818811. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: ResNet-50Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P4080120160200SE +/- 0.54, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.48, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.18, N = 3SE +/- 2.00, N = 12SE +/- 0.57, N = 3SE +/- 0.66, N = 3SE +/- 1.39, N = 4SE +/- 0.50, N = 3SE +/- 0.02, N = 3SE +/- 0.46, N = 3SE +/- 1.04, N = 12SE +/- 0.63, N = 3SE +/- 1.40, N = 3SE +/- 0.14, N = 3SE +/- 1.57, N = 3SE +/- 0.03, N = 3SE +/- 0.58, N = 3SE +/- 0.21, N = 3115.1292.4287.17103.2292.8298.70131.38125.76133.87138.11123.37120.1191.65125.91135.28123.69141.95119.73161.06143.67129.02150.33

OpenSSL

OpenSSL is an open-source toolkit that implements SSL (Secure Sockets Layer) and TLS (Transport Layer Security) protocols. This test profile makes use of the built-in "openssl speed" benchmarking capabilities. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgverify/s, More Is BetterOpenSSL 3.3Algorithm: RSA4096Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P800K1600K2400K3200K4000KSE +/- 205.33, N = 3SE +/- 23.84, N = 3SE +/- 9.55, N = 3SE +/- 37.76, N = 3SE +/- 136.07, N = 3SE +/- 126.84, N = 3SE +/- 2222.55, N = 3SE +/- 444.74, N = 3SE +/- 5.26, N = 3SE +/- 149.48, N = 3SE +/- 1576.96, N = 3SE +/- 6125.37, N = 3SE +/- 198.68, N = 3SE +/- 40228.60, N = 3SE +/- 277.84, N = 3SE +/- 200.66, N = 3SE +/- 355.69, N = 3SE +/- 165.80, N = 3SE +/- 862.96, N = 3SE +/- 92.46, N = 3SE +/- 92.62, N = 3SE +/- 6745.42, N = 31644363.7826049.5743282.71479879.0810291.8881480.83729470.81872096.12861959.81436324.91613828.73214376.3587354.81099481.51627941.4813667.61395446.4697707.21916162.9974189.91036735.62057021.61. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

OpenBenchmarking.orgsign/s, More Is BetterOpenSSL 3.3Algorithm: RSA4096Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P20K40K60K80K100KSE +/- 8.20, N = 3SE +/- 1.63, N = 3SE +/- 1.37, N = 3SE +/- 8.25, N = 3SE +/- 12.56, N = 3SE +/- 22.17, N = 3SE +/- 80.37, N = 3SE +/- 27.42, N = 3SE +/- 81.38, N = 3SE +/- 29.11, N = 3SE +/- 98.71, N = 3SE +/- 247.60, N = 3SE +/- 40.37, N = 3SE +/- 108.70, N = 3SE +/- 83.09, N = 3SE +/- 20.13, N = 3SE +/- 6.92, N = 3SE +/- 19.45, N = 3SE +/- 14.34, N = 3SE +/- 9.84, N = 3SE +/- 15.15, N = 3SE +/- 56.68, N = 325098.012610.811348.522587.421047.525894.6107830.653966.971942.035964.948996.898237.018389.336371.648534.825441.545531.022861.054601.127431.131594.461499.61. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

Timed Linux Kernel Compilation

This test times how long it takes to build the Linux kernel in a default configuration (defconfig) for the architecture being tested or alternatively an allmodconfig for building all possible kernel modules for the build. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.8Build: allmodconfigXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P130260390520650SE +/- 0.90, N = 3SE +/- 0.67, N = 3SE +/- 0.76, N = 3SE +/- 0.81, N = 3SE +/- 0.78, N = 3SE +/- 0.91, N = 3SE +/- 1.31, N = 3SE +/- 1.05, N = 3SE +/- 0.49, N = 3SE +/- 0.49, N = 3SE +/- 0.37, N = 3SE +/- 0.98, N = 3SE +/- 0.35, N = 3SE +/- 0.92, N = 3SE +/- 0.73, N = 3SE +/- 0.67, N = 3SE +/- 0.56, N = 3SE +/- 0.61, N = 3SE +/- 0.86, N = 3SE +/- 0.80, N = 3SE +/- 0.72, N = 3SE +/- 0.56, N = 3174.27251.20274.86192.10438.17406.41210.20337.69197.63311.83290.34182.00612.78356.99231.03384.06246.94428.39218.57362.45316.90189.74

Stockfish

This is a test of Stockfish, an advanced open-source C++11 chess benchmark that can scale up to 1024 CPU threads. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgNodes Per Second, More Is BetterStockfish 16.1Chess BenchmarkXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P90M180M270M360M450MSE +/- 3095674.84, N = 3SE +/- 1441726.26, N = 3SE +/- 3565305.92, N = 15SE +/- 2692064.58, N = 4SE +/- 2147688.02, N = 12SE +/- 2397455.91, N = 12SE +/- 7961094.38, N = 12SE +/- 4652276.19, N = 12SE +/- 2356843.91, N = 3SE +/- 3170744.86, N = 15SE +/- 2268830.04, N = 3SE +/- 919073.22, N = 3SE +/- 1466028.98, N = 9SE +/- 1325249.25, N = 3SE +/- 2925715.37, N = 11SE +/- 629927.17, N = 3SE +/- 4344961.90, N = 10SE +/- 1751369.24, N = 12SE +/- 2148606.38, N = 4SE +/- 1304590.97, N = 3SE +/- 2966712.90, N = 9SE +/- 2482737.87, N = 32669198251251940661227942462354454999065815699198144301202232189763799370751530197708350214524659399124223510995451045972001494090827359223013797720368019088187761769968874791097663452226103781. (CXX) g++ options: -lgcov -m64 -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -funroll-loops -msse -msse3 -mpopcnt -mavx2 -mbmi -msse4.1 -mssse3 -msse2 -mbmi2 -flto -flto-partition=one -flto=jobserver

Apache IoTDB

Apache IotDB is a time series database and this benchmark is facilitated using the IoT Benchmaark [https://github.com/thulab/iot-benchmark/]. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P20406080100SE +/- 0.65, N = 3SE +/- 0.15, N = 3SE +/- 0.11, N = 3SE +/- 1.37, N = 3SE +/- 0.03, N = 3SE +/- 0.31, N = 3SE +/- 0.79, N = 12SE +/- 0.10, N = 3SE +/- 0.65, N = 12SE +/- 0.31, N = 3SE +/- 0.23, N = 3SE +/- 0.59, N = 12SE +/- 0.43, N = 3SE +/- 0.53, N = 3SE +/- 1.11, N = 4SE +/- 0.87, N = 3SE +/- 1.01, N = 3SE +/- 0.48, N = 3SE +/- 1.18, N = 3SE +/- 0.15, N = 3SE +/- 0.68, N = 3SE +/- 0.80, N = 7101.4984.5990.31107.2864.9365.6666.5458.1161.0753.7752.9361.46100.29102.6795.3989.5394.8490.0292.2385.1681.7382.73

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P30M60M90M120M150MSE +/- 207721.96, N = 3SE +/- 174748.00, N = 3SE +/- 84917.07, N = 3SE +/- 769517.20, N = 3SE +/- 41021.96, N = 3SE +/- 576868.09, N = 3SE +/- 1225528.40, N = 12SE +/- 263772.09, N = 3SE +/- 1249999.63, N = 12SE +/- 665173.47, N = 3SE +/- 538692.55, N = 3SE +/- 1058559.19, N = 12SE +/- 306106.55, N = 3SE +/- 365828.34, N = 3SE +/- 872659.60, N = 4SE +/- 782176.98, N = 3SE +/- 594234.55, N = 3SE +/- 435900.66, N = 3SE +/- 928557.10, N = 3SE +/- 276414.35, N = 3SE +/- 739343.51, N = 3SE +/- 862582.24, N = 77574013990973414851178977166400511788497711687979911531783413178130912559560714210225414476044812494728876729495751784808013956686354518807704658574454283651785908717709461680792771639

PyTorch

This is a benchmark of PyTorch making use of pytorch-benchmark [https://github.com/LukasHedegaard/pytorch-benchmark]. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 512 - Model: ResNet-152Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P612182430SE +/- 0.07, N = 3SE +/- 0.19, N = 3SE +/- 0.14, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.11, N = 3SE +/- 0.11, N = 9SE +/- 0.02, N = 3SE +/- 0.14, N = 9SE +/- 0.18, N = 3SE +/- 0.12, N = 3SE +/- 0.13, N = 9SE +/- 0.13, N = 3SE +/- 0.17, N = 3SE +/- 0.16, N = 3SE +/- 0.18, N = 7SE +/- 0.09, N = 3SE +/- 0.18, N = 7SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.16, N = 3SE +/- 0.18, N = 36.6513.6111.746.3313.2813.285.7510.917.2014.0513.957.0717.5514.7614.7419.2916.6819.4714.5920.4623.4116.17

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 64 - Model: ResNet-152Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P612182430SE +/- 0.05, N = 3SE +/- 0.13, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.16, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.13, N = 9SE +/- 0.17, N = 3SE +/- 0.10, N = 3SE +/- 0.15, N = 9SE +/- 0.05, N = 3SE +/- 0.12, N = 3SE +/- 0.05, N = 3SE +/- 0.17, N = 12SE +/- 0.21, N = 3SE +/- 0.19, N = 5SE +/- 0.17, N = 3SE +/- 0.18, N = 3SE +/- 0.34, N = 3SE +/- 0.15, N = 126.5913.0011.956.1513.1513.195.7910.887.0413.8413.897.0817.7315.1114.9619.2415.8419.0114.0320.1323.4916.25

SecureMark

SecureMark is an objective, standardized benchmarking framework for measuring the efficiency of cryptographic processing solutions developed by EEMBC. SecureMark-TLS is benchmarking Transport Layer Security performance with a focus on IoT/edge computing. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmarks, More Is BetterSecureMark 1.0.4Benchmark: SecureMark-TLSXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P70K140K210K280K350KSE +/- 1219.44, N = 3SE +/- 406.59, N = 3SE +/- 553.57, N = 3SE +/- 722.69, N = 3SE +/- 542.88, N = 3SE +/- 372.96, N = 3SE +/- 553.62, N = 3SE +/- 457.42, N = 3SE +/- 389.81, N = 3SE +/- 361.20, N = 3SE +/- 415.71, N = 3SE +/- 809.90, N = 3SE +/- 372.88, N = 3SE +/- 285.52, N = 3SE +/- 196.24, N = 3SE +/- 670.43, N = 3SE +/- 384.08, N = 3SE +/- 256.85, N = 3SE +/- 330.95, N = 3SE +/- 625.56, N = 3SE +/- 209.97, N = 3SE +/- 411.11, N = 32175362200511967401972982501622500242510752506952996102983413008333017402313572310762772982772602775892776472754722772053098963084341. (CC) gcc options: -pedantic -O3

ClickHouse

ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ / https://github.com/ClickHouse/ClickBench/tree/main/clickhouse with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all separate queries performed as an aggregate. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third RunXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P130260390520650SE +/- 3.52, N = 3SE +/- 1.22, N = 3SE +/- 2.14, N = 3SE +/- 1.59, N = 3SE +/- 5.23, N = 3SE +/- 1.77, N = 3SE +/- 6.21, N = 5SE +/- 3.32, N = 3SE +/- 10.00, N = 3SE +/- 4.03, N = 3SE +/- 4.34, N = 3SE +/- 2.03, N = 3SE +/- 4.79, N = 3SE +/- 1.27, N = 3SE +/- 3.54, N = 12SE +/- 3.60, N = 3SE +/- 3.08, N = 3SE +/- 6.03, N = 3SE +/- 2.55, N = 3SE +/- 3.45, N = 3SE +/- 3.62, N = 6SE +/- 5.39, N = 5337.75400.52379.92320.87335.46338.84427.95458.96525.23559.55595.19526.36342.99295.06471.79476.91501.07470.02501.63481.66458.23438.60

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second RunXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P130260390520650SE +/- 3.25, N = 3SE +/- 2.12, N = 3SE +/- 3.34, N = 3SE +/- 1.53, N = 3SE +/- 5.72, N = 3SE +/- 2.99, N = 3SE +/- 4.85, N = 5SE +/- 9.26, N = 3SE +/- 8.37, N = 3SE +/- 3.14, N = 3SE +/- 0.42, N = 3SE +/- 6.78, N = 3SE +/- 0.73, N = 3SE +/- 3.61, N = 3SE +/- 3.17, N = 12SE +/- 4.95, N = 3SE +/- 0.19, N = 3SE +/- 1.94, N = 3SE +/- 3.26, N = 3SE +/- 2.93, N = 3SE +/- 2.86, N = 6SE +/- 3.10, N = 5339.50403.96381.05320.17337.44337.32420.35450.12529.80562.50597.73528.21339.67295.43467.96474.68499.18465.06507.56486.05455.79443.58

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold CacheXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P120240360480600SE +/- 3.71, N = 3SE +/- 1.12, N = 3SE +/- 2.21, N = 3SE +/- 1.51, N = 3SE +/- 1.88, N = 3SE +/- 1.57, N = 3SE +/- 4.49, N = 5SE +/- 2.78, N = 3SE +/- 6.05, N = 3SE +/- 5.33, N = 3SE +/- 7.88, N = 3SE +/- 4.34, N = 3SE +/- 1.56, N = 3SE +/- 1.56, N = 3SE +/- 3.85, N = 12SE +/- 5.88, N = 3SE +/- 1.35, N = 3SE +/- 2.85, N = 3SE +/- 4.37, N = 3SE +/- 3.41, N = 3SE +/- 4.18, N = 6SE +/- 4.12, N = 5333.06388.29365.62311.63322.69323.59411.26433.79504.84536.82566.31513.92326.65285.17460.66461.62491.89446.40485.63465.50437.20423.30

Apache IoTDB

Apache IotDB is a time series database and this benchmark is facilitated using the IoT Benchmaark [https://github.com/thulab/iot-benchmark/]. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P80160240320400SE +/- 5.20, N = 3SE +/- 4.45, N = 3SE +/- 1.12, N = 3SE +/- 3.93, N = 12SE +/- 0.82, N = 3SE +/- 0.38, N = 3SE +/- 2.16, N = 15SE +/- 1.41, N = 3SE +/- 3.49, N = 3SE +/- 1.96, N = 3SE +/- 1.71, N = 3SE +/- 1.87, N = 3SE +/- 4.06, N = 3SE +/- 3.47, N = 3SE +/- 3.74, N = 12SE +/- 5.07, N = 3SE +/- 2.59, N = 12SE +/- 5.15, N = 3SE +/- 3.79, N = 8SE +/- 2.20, N = 3SE +/- 3.41, N = 3SE +/- 3.40, N = 12377.58296.36312.32380.33251.05251.47253.13227.40240.43211.85209.68246.08326.53349.42325.97309.03328.41314.44317.36294.33280.26286.78

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P30M60M90M120M150MSE +/- 796440.21, N = 3SE +/- 441557.52, N = 3SE +/- 111181.55, N = 3SE +/- 531367.14, N = 12SE +/- 412757.79, N = 3SE +/- 13050.78, N = 3SE +/- 666882.79, N = 15SE +/- 68559.13, N = 3SE +/- 1152766.29, N = 3SE +/- 255887.16, N = 3SE +/- 371659.60, N = 3SE +/- 353097.82, N = 3SE +/- 88241.50, N = 3SE +/- 661234.22, N = 3SE +/- 574699.97, N = 12SE +/- 1037167.36, N = 3SE +/- 565297.90, N = 12SE +/- 662950.65, N = 3SE +/- 692701.79, N = 8SE +/- 308756.34, N = 3SE +/- 746822.47, N = 3SE +/- 761276.42, N = 126832080087190397819004776759979310513855110543286210363048311668532610882158012556206012616102810677837978823112746530077805772883475645775012488245566480169620877972069270975189231850

OpenRadioss

OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/ and https://github.com/OpenRadioss/ModelExchange/tree/main/Examples. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Chrysler Neon 1MEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P70140210280350SE +/- 0.50, N = 3SE +/- 0.47, N = 3SE +/- 1.00, N = 10SE +/- 1.11, N = 3SE +/- 0.71, N = 12SE +/- 1.51, N = 8SE +/- 0.49, N = 3SE +/- 0.46, N = 3SE +/- 0.13, N = 3SE +/- 0.78, N = 3SE +/- 0.14, N = 3SE +/- 0.18, N = 3SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 0.11, N = 3SE +/- 0.15, N = 3SE +/- 0.20, N = 3SE +/- 0.14, N = 3300.69297.2593.99231.9677.64176.1477.3249.55343.16185.03117.91212.99125.15228.74115.89207.20157.5686.93

NAMD

NAMD is a parallel molecular dynamics code designed for high-performance simulation of large biomolecular systems. NAMD was developed by the Theoretical and Computational Biophysics Group in the Beckman Institute for Advanced Science and Technology at the University of Illinois at Urbana-Champaign. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgns/day, More Is BetterNAMD 3.0b6Input: STMV with 1,066,628 AtomsXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P246810SE +/- 0.03216, N = 9SE +/- 0.00540, N = 3SE +/- 0.00423, N = 3SE +/- 0.04439, N = 8SE +/- 0.00540, N = 3SE +/- 0.00440, N = 3SE +/- 0.00332, N = 3SE +/- 0.00847, N = 3SE +/- 0.02927, N = 3SE +/- 0.00537, N = 3SE +/- 0.00206, N = 3SE +/- 0.01739, N = 3SE +/- 0.00653, N = 3SE +/- 0.00911, N = 3SE +/- 0.05463, N = 15SE +/- 0.05862, N = 15SE +/- 0.05644, N = 12SE +/- 0.05087, N = 15SE +/- 0.04403, N = 15SE +/- 0.01396, N = 15SE +/- 0.02648, N = 15SE +/- 0.08185, N = 130.576940.567170.523570.707571.461631.519015.836062.888695.278392.878773.410856.383431.110561.612321.767781.502141.886791.452231.109001.052741.437872.25422

Timed Gem5 Compilation

This test times how long it takes to compile Gem5. Gem5 is a simulator for computer system architecture research. Gem5 is widely used for computer architecture research within the industry, academia, and more. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 23.0.1Time To CompileXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P60120180240300SE +/- 2.61, N = 3SE +/- 1.47, N = 3SE +/- 3.60, N = 3SE +/- 0.78, N = 3SE +/- 0.97, N = 3SE +/- 1.99, N = 9SE +/- 1.73, N = 3SE +/- 1.88, N = 3SE +/- 0.72, N = 3SE +/- 2.24, N = 4SE +/- 2.15, N = 3SE +/- 1.16, N = 3SE +/- 3.88, N = 3SE +/- 1.04, N = 3SE +/- 1.01, N = 3SE +/- 2.11, N = 6SE +/- 1.72, N = 3SE +/- 2.59, N = 4SE +/- 0.58, N = 3SE +/- 0.92, N = 3SE +/- 2.17, N = 3SE +/- 0.89, N = 3233.21238.43267.95252.97251.61242.93192.98212.55164.90185.30176.88161.94275.71219.67181.63215.50184.30220.57178.28210.93187.51157.36

LAMMPS Molecular Dynamics Simulator

LAMMPS is a classical molecular dynamics code, and an acronym for Large-scale Atomic/Molecular Massively Parallel Simulator. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: 20k AtomsEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1428425670SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.13, N = 3SE +/- 0.19, N = 3SE +/- 0.13, N = 3SE +/- 0.12, N = 3SE +/- 0.30, N = 3SE +/- 0.12, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 325.3327.5358.8447.9957.1042.5146.8962.0021.3835.7051.8232.1646.7128.2850.5234.8937.4656.401. (CXX) g++ options: -O3 -lm -ldl

Timed Node.js Compilation

This test profile times how long it takes to build/compile Node.js itself from source. Node.js is a JavaScript run-time built from the Chrome V8 JavaScript engine while itself is written in C/C++. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 21.7.2Time To CompileXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P90180270360450SE +/- 0.60, N = 3SE +/- 0.51, N = 3SE +/- 0.15, N = 3SE +/- 1.20, N = 3SE +/- 0.19, N = 3SE +/- 0.17, N = 3SE +/- 1.51, N = 3SE +/- 0.72, N = 3SE +/- 0.18, N = 3SE +/- 0.59, N = 3SE +/- 0.50, N = 3SE +/- 1.19, N = 3SE +/- 0.22, N = 3SE +/- 0.68, N = 3SE +/- 0.52, N = 3SE +/- 0.74, N = 3SE +/- 0.84, N = 3SE +/- 0.53, N = 3SE +/- 0.48, N = 3SE +/- 0.71, N = 3SE +/- 0.52, N = 3SE +/- 0.12, N = 3173.09228.57246.85187.65288.12277.53147.74186.10118.90164.02147.84114.91423.63303.42171.17252.65175.63270.38172.99254.00214.43145.41

OpenSSL

OpenSSL is an open-source toolkit that implements SSL (Secure Sockets Layer) and TLS (Transport Layer Security) protocols. This test profile makes use of the built-in "openssl speed" benchmarking capabilities. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: SHA256Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P70000M140000M210000M280000M350000MSE +/- 228931567.43, N = 3SE +/- 242095363.59, N = 3SE +/- 34216643.88, N = 3SE +/- 97765007.32, N = 3SE +/- 64797308.82, N = 3SE +/- 10642001.84, N = 3SE +/- 80639802.67, N = 3SE +/- 34182873.86, N = 3SE +/- 210407867.05, N = 3SE +/- 38601729.93, N = 3SE +/- 146384349.91, N = 3SE +/- 160246527.97, N = 3SE +/- 8534071.27, N = 3SE +/- 919807437.76, N = 12SE +/- 70647143.49, N = 3SE +/- 33334799.97, N = 3SE +/- 126029257.64, N = 3SE +/- 27466135.54, N = 3SE +/- 66583540.43, N = 3SE +/- 159515825.53, N = 3SE +/- 23323764.84, N = 3SE +/- 29142783.86, N = 32870350411401441630272801299759947332563303497776780673038774584721007320258686237161269162280251645629887126475137690138409588983276267766403278585044905453070057610338286011351840436763886357534134443918518711910680210761806994523665739579201319760501201. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 512 - Model: GoogLeNetXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P130260390520650SE +/- 1.26, N = 3SE +/- 0.19, N = 3SE +/- 0.26, N = 3SE +/- 1.19, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 5.63, N = 6SE +/- 12.03, N = 12SE +/- 5.11, N = 3SE +/- 4.02, N = 10SE +/- 3.05, N = 12SE +/- 1.60, N = 3SE +/- 0.12, N = 3SE +/- 0.25, N = 3SE +/- 2.46, N = 3SE +/- 0.37, N = 3SE +/- 1.14, N = 3SE +/- 0.41, N = 3SE +/- 2.62, N = 3SE +/- 0.34, N = 3SE +/- 3.68, N = 3SE +/- 1.52, N = 3378.79298.16278.05354.81295.29313.50588.43450.61525.84470.95425.25464.78290.16411.05477.33398.40467.91383.57576.08461.23462.78577.76

FFmpeg

This is a benchmark of the FFmpeg multimedia framework. The FFmpeg test profile is making use of a modified version of vbench from Columbia University's Architecture and Design Lab (ARCADE) [http://arcade.cs.columbia.edu/vbench/] that is a benchmark for video-as-a-service workloads. The test profile offers the options of a range of vbench scenarios based on freely distributable video content and offers the options of using the x264 or x265 video encoders for transcoding. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 7.0Encoder: libx265 - Scenario: PlatformXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1224364860SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.08, N = 3SE +/- 0.05, N = 3SE +/- 0.27, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.16, N = 3SE +/- 0.14, N = 3SE +/- 0.15, N = 328.3929.9427.1726.9046.8646.8747.1347.3152.7955.6155.3855.1144.0143.5546.5948.3545.9547.3248.7649.7953.9253.221. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 7.0Encoder: libx265 - Scenario: Video On DemandXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1224364860SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.13, N = 3SE +/- 0.07, N = 3SE +/- 0.43, N = 3SE +/- 0.10, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.14, N = 328.3929.9527.1726.8946.9346.8847.1447.3352.8155.5955.5655.0144.1343.8046.7948.1445.2947.3448.7749.8453.9953.291. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: StandardXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P50100150200250SE +/- 0.13, N = 3SE +/- 0.21, N = 3SE +/- 0.09, N = 3SE +/- 0.06, N = 3SE +/- 7.19, N = 15SE +/- 6.87, N = 12SE +/- 2.91, N = 3SE +/- 2.29, N = 15SE +/- 0.35, N = 3SE +/- 4.84, N = 15SE +/- 4.76, N = 12SE +/- 2.18, N = 15SE +/- 2.32, N = 15SE +/- 1.55, N = 15SE +/- 2.59, N = 15SE +/- 6.41, N = 15SE +/- 5.82, N = 12SE +/- 3.36, N = 15SE +/- 0.69, N = 15SE +/- 0.09, N = 3SE +/- 0.71, N = 3SE +/- 0.44, N = 3182.36174.14188.30194.11226.63216.70203.57166.79220.35182.02178.03182.27160.53110.97121.78155.79121.67139.1092.35116.32109.67100.741. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: StandardXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P3691215SE +/- 0.00381, N = 3SE +/- 0.00692, N = 3SE +/- 0.00241, N = 3SE +/- 0.00154, N = 3SE +/- 0.11914, N = 15SE +/- 0.14467, N = 12SE +/- 0.07023, N = 3SE +/- 0.08489, N = 15SE +/- 0.00718, N = 3SE +/- 0.15150, N = 15SE +/- 0.16422, N = 12SE +/- 0.06453, N = 15SE +/- 0.08940, N = 15SE +/- 0.11577, N = 15SE +/- 0.16487, N = 15SE +/- 0.22869, N = 15SE +/- 0.34632, N = 12SE +/- 0.15651, N = 15SE +/- 0.07619, N = 15SE +/- 0.00664, N = 3SE +/- 0.05824, N = 3SE +/- 0.04271, N = 35.483435.742345.310505.151664.465334.664914.914206.011644.538175.550185.665085.497116.247409.033678.260166.549658.399627.2418710.836238.597199.118859.926841. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

FFmpeg

This is a benchmark of the FFmpeg multimedia framework. The FFmpeg test profile is making use of a modified version of vbench from Columbia University's Architecture and Design Lab (ARCADE) [http://arcade.cs.columbia.edu/vbench/] that is a benchmark for video-as-a-service workloads. The test profile offers the options of a range of vbench scenarios based on freely distributable video content and offers the options of using the x264 or x265 video encoders for transcoding. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 7.0Encoder: libx265 - Scenario: UploadXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P714212835SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 3SE +/- 0.00, N = 3SE +/- 0.10, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 314.8715.4714.0113.9023.2723.2523.2823.3626.4127.6627.6127.4321.9621.7323.3023.7722.3423.3324.5624.9726.9326.801. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

PostgreSQL

This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average LatencyXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P714212835SE +/- 0.15, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.14, N = 3SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.25, N = 12SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.32, N = 12SE +/- 0.12, N = 12SE +/- 0.12, N = 3SE +/- 0.12, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.10, N = 326.2911.5412.6328.8118.0516.3216.8813.8418.0612.5012.5818.1616.3413.6916.6613.8516.9614.2914.8614.0413.2630.201. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read WriteXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P20K40K60K80K100KSE +/- 221.82, N = 3SE +/- 232.81, N = 3SE +/- 186.80, N = 3SE +/- 163.06, N = 3SE +/- 299.71, N = 3SE +/- 175.33, N = 3SE +/- 58.85, N = 3SE +/- 242.45, N = 3SE +/- 865.71, N = 12SE +/- 232.97, N = 3SE +/- 87.23, N = 3SE +/- 1059.49, N = 12SE +/- 434.11, N = 12SE +/- 656.63, N = 3SE +/- 440.63, N = 3SE +/- 143.25, N = 3SE +/- 195.77, N = 3SE +/- 95.84, N = 3SE +/- 137.82, N = 3SE +/- 78.02, N = 3SE +/- 198.41, N = 3SE +/- 106.16, N = 3380438667779191347165539561272592287224455505799877949255272612337304260046722255895269969673157122775396331101. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

Blender

Blender is an open-source 3D creation and modeling software project. This test is of Blender's Cycles performance with various sample files. GPU computing via NVIDIA OptiX and NVIDIA CUDA is currently supported as well as HIP for AMD Radeon GPUs and Intel oneAPI for Intel Graphics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Barbershop - Compute: CPU-OnlyXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P100200300400500SE +/- 0.17, N = 3SE +/- 0.08, N = 3SE +/- 0.33, N = 3SE +/- 0.41, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.25, N = 3SE +/- 0.12, N = 3SE +/- 0.11, N = 3SE +/- 0.03, N = 3SE +/- 0.25, N = 3SE +/- 0.06, N = 3SE +/- 1.09, N = 3SE +/- 0.23, N = 3SE +/- 0.12, N = 3SE +/- 0.42, N = 3SE +/- 0.18, N = 3SE +/- 0.69, N = 3SE +/- 0.21, N = 397.18174.49191.20106.48263.76240.1365.58114.7679.05139.25123.9067.52456.81235.31156.70290.56169.44320.11141.54261.97236.73125.87

Numpy Benchmark

This is a test to obtain the general Numpy performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgScore, More Is BetterNumpy BenchmarkXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P120240360480600SE +/- 0.47, N = 3SE +/- 2.24, N = 3SE +/- 0.37, N = 3SE +/- 0.30, N = 3SE +/- 1.34, N = 3SE +/- 0.72, N = 3SE +/- 0.25, N = 3SE +/- 0.96, N = 3SE +/- 0.38, N = 3SE +/- 2.28, N = 3SE +/- 1.85, N = 3SE +/- 0.60, N = 3SE +/- 2.23, N = 3SE +/- 1.52, N = 3SE +/- 1.30, N = 3SE +/- 0.79, N = 3SE +/- 1.13, N = 3SE +/- 0.60, N = 3SE +/- 0.26, N = 3SE +/- 0.33, N = 3SE +/- 1.84, N = 3SE +/- 1.42, N = 3283.52284.33261.19258.49418.89421.99422.76425.46529.03529.80542.15540.96400.64394.71439.84464.72435.21461.61456.18455.57520.22519.89

LuxCoreRender

LuxCoreRender is an open-source 3D physically based renderer formerly known as LuxRender. LuxCoreRender supports CPU-based rendering as well as GPU acceleration via OpenCL, NVIDIA CUDA, and NVIDIA OptiX interfaces. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: DLSC - Acceleration: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P510152025SE +/- 0.22, N = 15SE +/- 0.06, N = 3SE +/- 0.02, N = 3SE +/- 0.22, N = 12SE +/- 0.03, N = 3SE +/- 0.06, N = 15SE +/- 1.02, N = 15SE +/- 0.28, N = 15SE +/- 0.12, N = 3SE +/- 0.13, N = 3SE +/- 0.18, N = 15SE +/- 0.91, N = 15SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.20, N = 15SE +/- 0.10, N = 3SE +/- 0.12, N = 3SE +/- 0.08, N = 3SE +/- 0.23, N = 15SE +/- 0.06, N = 15SE +/- 0.02, N = 3SE +/- 0.24, N = 157.9910.099.407.718.489.3922.0016.7917.8914.2916.2122.585.638.9810.448.0010.177.4611.128.729.3812.74

OpenSSL

OpenSSL is an open-source toolkit that implements SSL (Secure Sockets Layer) and TLS (Transport Layer Security) protocols. This test profile makes use of the built-in "openssl speed" benchmarking capabilities. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: AES-128-GCMXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P500000M1000000M1500000M2000000M2500000MSE +/- 333650111.34, N = 3SE +/- 129279575.06, N = 3SE +/- 195953395.92, N = 3SE +/- 429428665.34, N = 3SE +/- 409615403.40, N = 3SE +/- 530918594.60, N = 3SE +/- 1841260363.24, N = 3SE +/- 49279694.68, N = 3SE +/- 337702856.52, N = 3SE +/- 164763342.54, N = 3SE +/- 570058274.06, N = 3SE +/- 1428966819.54, N = 3SE +/- 706172241.68, N = 3SE +/- 266669781.18, N = 3SE +/- 697208281.49, N = 3SE +/- 56355870.99, N = 3SE +/- 268465891.11, N = 3SE +/- 43545680.66, N = 3SE +/- 159598753.20, N = 3SE +/- 28627701.54, N = 3SE +/- 1253503549.61, N = 3SE +/- 1622921637.03, N = 312668828666536384532037635657207677831096082199713488965390857539784931373231661194528311672211418701785006879067897288436123996007109267199035205996739952681542780722926530014846696270507477107026601277583382757641200848170153302630072776880469369788956750654017693131460131. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: AES-256-GCMXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P400000M800000M1200000M1600000M2000000MSE +/- 301551944.80, N = 3SE +/- 317370827.95, N = 3SE +/- 34244051.67, N = 3SE +/- 252081360.30, N = 3SE +/- 3442274884.66, N = 3SE +/- 148092414.72, N = 3SE +/- 1791964708.17, N = 3SE +/- 290015345.25, N = 3SE +/- 2225250504.62, N = 3SE +/- 818689705.82, N = 3SE +/- 671752057.50, N = 3SE +/- 1859275059.09, N = 3SE +/- 81945775.93, N = 3SE +/- 116420153.53, N = 3SE +/- 112278705.55, N = 3SE +/- 63026881.96, N = 3SE +/- 108288170.03, N = 3SE +/- 119857064.56, N = 3SE +/- 1397764228.85, N = 3SE +/- 2848140790.67, N = 3SE +/- 3966858436.56, N = 3SE +/- 1320809584.03, N = 3112537304117356893757831350630137462397941938879741589396320746230975053019831030267009975390078731526505465813767696553667859720599963171406176108735606204088371248541144711811489573535920141154531011898993323507456728087136953432847070023935271774438768367014975299393771. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: ChaCha20Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P300000M600000M900000M1200000M1500000MSE +/- 63366974.35, N = 3SE +/- 39095934.62, N = 3SE +/- 11028602.79, N = 3SE +/- 11835135.62, N = 3SE +/- 71110585.03, N = 3SE +/- 9570566.28, N = 3SE +/- 63368290.15, N = 3SE +/- 170968063.89, N = 3SE +/- 80233613.02, N = 3SE +/- 151272595.84, N = 3SE +/- 94935214.36, N = 3SE +/- 874940734.18, N = 3SE +/- 151152302.42, N = 3SE +/- 352722951.98, N = 3SE +/- 863978337.15, N = 3SE +/- 312824840.64, N = 3SE +/- 329510485.23, N = 3SE +/- 415487944.57, N = 3SE +/- 271318554.29, N = 3SE +/- 232288636.76, N = 3SE +/- 3335467.26, N = 3SE +/- 303075210.03, N = 33919112254801969206832701772490621833528268216532820533270773070689383771306928507573656396329387100150263486050331102112354490408477310866181919502122948838304254511900635229124033472637406900674499084949272265973541536244029729473161264211733441509169376842843827601. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: SHA512Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P20000M40000M60000M80000M100000MSE +/- 64065176.93, N = 3SE +/- 24045021.87, N = 3SE +/- 14430784.68, N = 3SE +/- 66704467.17, N = 3SE +/- 9990938.84, N = 3SE +/- 15082903.45, N = 3SE +/- 17716195.81, N = 3SE +/- 5822493.86, N = 3SE +/- 37307640.51, N = 3SE +/- 6285194.15, N = 3SE +/- 55712209.05, N = 3SE +/- 44023374.36, N = 3SE +/- 6313493.56, N = 3SE +/- 20492408.59, N = 3SE +/- 14339684.98, N = 3SE +/- 1250834.62, N = 3SE +/- 3500318.33, N = 3SE +/- 500176.69, N = 3SE +/- 481040738.21, N = 3SE +/- 203213936.42, N = 3SE +/- 37654528.63, N = 3SE +/- 14734422.48, N = 38919441685745088755640406051379237859939523022194470973243784608201047766330475274663411378822257383396275754974586513191391455971200109809400932207953990037564522053188939807833230422299316199261277428462544772221992772323886054770465207607071. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.3Algorithm: ChaCha20-Poly1305Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P200000M400000M600000M800000M1000000MSE +/- 38565703.74, N = 3SE +/- 18243420.30, N = 3SE +/- 2360978.39, N = 3SE +/- 37182497.08, N = 3SE +/- 65233629.47, N = 3SE +/- 24234601.89, N = 3SE +/- 19082587.00, N = 3SE +/- 151303743.70, N = 3SE +/- 6119305.11, N = 3SE +/- 29295317.86, N = 3SE +/- 4478378.70, N = 3SE +/- 558033954.71, N = 3SE +/- 255765711.98, N = 3SE +/- 31274617.76, N = 3SE +/- 36941390.18, N = 3SE +/- 37795783.50, N = 3SE +/- 4148679.28, N = 3SE +/- 6370607.14, N = 3SE +/- 132227134.30, N = 3SE +/- 766713911.50, N = 3SE +/- 120899798.30, N = 3SE +/- 82161991.11, N = 32665838578871340330390901205917872572400051351531933050936432111856617279060286089904570397488706989258222233509609983573839256520777676527195471461562129502935021224133727352152971877961744403203967204471613210582134422025329772250388507302236257380134440991442701. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

PyTorch

This is a benchmark of PyTorch making use of pytorch-benchmark [https://github.com/LukasHedegaard/pytorch-benchmark]. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 512 - Model: ResNet-50Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1428425670SE +/- 0.13, N = 9SE +/- 0.02, N = 3SE +/- 0.24, N = 3SE +/- 0.03, N = 3SE +/- 0.11, N = 3SE +/- 0.08, N = 3SE +/- 0.22, N = 12SE +/- 0.04, N = 3SE +/- 0.23, N = 3SE +/- 0.10, N = 3SE +/- 0.19, N = 3SE +/- 0.29, N = 12SE +/- 0.17, N = 3SE +/- 0.38, N = 15SE +/- 0.34, N = 15SE +/- 0.43, N = 15SE +/- 0.26, N = 3SE +/- 0.72, N = 3SE +/- 0.21, N = 3SE +/- 0.12, N = 3SE +/- 0.19, N = 3SE +/- 0.30, N = 1515.9730.8726.9114.8133.1833.7613.7627.5316.2434.6534.6916.8248.9937.4537.8451.8641.6551.0537.5556.4463.3040.83

LuxCoreRender

LuxCoreRender is an open-source 3D physically based renderer formerly known as LuxRender. LuxCoreRender supports CPU-based rendering as well as GPU acceleration via OpenCL, NVIDIA CUDA, and NVIDIA OptiX interfaces. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: LuxCore Benchmark - Acceleration: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P3691215SE +/- 0.08, N = 15SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.10, N = 15SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 15SE +/- 0.16, N = 3SE +/- 0.11, N = 15SE +/- 0.10, N = 7SE +/- 0.04, N = 3SE +/- 0.12, N = 15SE +/- 0.06, N = 15SE +/- 0.07, N = 15SE +/- 0.16, N = 15SE +/- 0.05, N = 3SE +/- 0.22, N = 12SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.04, N = 3SE +/- 0.11, N = 3SE +/- 0.17, N = 126.748.477.906.416.937.389.6512.4110.5611.3412.4310.614.296.437.416.826.816.308.827.108.068.88

PyTorch

This is a benchmark of PyTorch making use of pytorch-benchmark [https://github.com/LukasHedegaard/pytorch-benchmark]. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 1 - Model: ResNet-152Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P612182430SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.12, N = 3SE +/- 0.17, N = 9SE +/- 0.06, N = 3SE +/- 0.17, N = 3SE +/- 0.15, N = 12SE +/- 0.04, N = 3SE +/- 0.27, N = 9SE +/- 0.09, N = 3SE +/- 0.01, N = 3SE +/- 0.20, N = 12SE +/- 0.12, N = 3SE +/- 0.10, N = 3SE +/- 0.13, N = 8SE +/- 0.16, N = 3SE +/- 0.18, N = 3SE +/- 0.26, N = 3SE +/- 0.16, N = 4SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.19, N = 57.1014.5313.396.4715.1115.256.6413.058.2715.5715.868.3522.2716.6814.8618.0717.9119.9915.7719.4127.2117.57

Xmrig

Xmrig is an open-source cross-platform CPU/GPU miner for RandomX, KawPow, CryptoNight and AstroBWT. This test profile is setup to measure the Xmrig CPU mining performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: GhostRider - Hash Count: 1MXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P7K14K21K28K35KSE +/- 43.14, N = 3SE +/- 43.00, N = 3SE +/- 19.74, N = 3SE +/- 53.95, N = 3SE +/- 41.94, N = 3SE +/- 30.53, N = 3SE +/- 46.94, N = 3SE +/- 61.27, N = 3SE +/- 290.50, N = 3SE +/- 117.32, N = 3SE +/- 10.36, N = 3SE +/- 95.10, N = 3SE +/- 32.20, N = 2SE +/- 49.14, N = 12SE +/- 7.44, N = 3SE +/- 14.78, N = 3SE +/- 14.02, N = 3SE +/- 12.93, N = 3SE +/- 4.03, N = 3SE +/- 23.16, N = 3SE +/- 44.68, N = 3SE +/- 64.69, N = 311147.25753.95315.710431.64564.34660.017873.19320.526702.714207.715786.631157.82593.25230.912115.06122.310975.85446.811263.25808.88378.316324.71. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

LuxCoreRender

LuxCoreRender is an open-source 3D physically based renderer formerly known as LuxRender. LuxCoreRender supports CPU-based rendering as well as GPU acceleration via OpenCL, NVIDIA CUDA, and NVIDIA OptiX interfaces. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: Orange Juice - Acceleration: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P816243240SE +/- 0.46, N = 15SE +/- 0.06, N = 3SE +/- 0.19, N = 3SE +/- 0.46, N = 12SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 1.12, N = 15SE +/- 0.07, N = 3SE +/- 0.84, N = 15SE +/- 0.18, N = 15SE +/- 0.28, N = 5SE +/- 1.06, N = 15SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.28, N = 15SE +/- 0.04, N = 3SE +/- 0.16, N = 15SE +/- 0.10, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.30, N = 1517.4515.8315.9016.8813.0013.8132.2623.7629.6121.3224.6933.088.8214.3116.6412.5016.9111.8618.7013.4614.7419.91

OSPRay

Intel OSPRay is a portable ray-tracing engine for high-performance, high-fidelity scientific visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/scivis/real_timeXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1326395265SE +/- 0.02131, N = 3SE +/- 0.01460, N = 3SE +/- 0.00610, N = 3SE +/- 0.04097, N = 3SE +/- 0.00583, N = 3SE +/- 0.01395, N = 3SE +/- 0.01106, N = 3SE +/- 0.02252, N = 3SE +/- 0.04960, N = 3SE +/- 0.01265, N = 3SE +/- 0.01858, N = 3SE +/- 0.01792, N = 3SE +/- 0.00909, N = 3SE +/- 0.03711, N = 3SE +/- 0.04134, N = 3SE +/- 0.03593, N = 3SE +/- 0.05872, N = 3SE +/- 0.00932, N = 3SE +/- 0.02499, N = 3SE +/- 0.00525, N = 3SE +/- 0.04057, N = 3SE +/- 0.04682, N = 336.2464021.5147019.4251032.7979016.4505017.9448056.4485035.1464047.5267028.0689032.5232055.257609.7002217.6222033.1275018.4851029.3496016.0869038.2269021.8932030.6799053.93480

RocksDB

This is a benchmark of Meta/Facebook's RocksDB as an embeddable persistent key-value store for fast storage based on Google's LevelDB. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Read While WritingXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P6M12M18M24M30MSE +/- 726178.20, N = 12SE +/- 136761.19, N = 4SE +/- 45015.86, N = 3SE +/- 426084.70, N = 15SE +/- 81998.56, N = 3SE +/- 28098.62, N = 3SE +/- 273109.47, N = 3SE +/- 109424.14, N = 3SE +/- 506458.47, N = 15SE +/- 36524.26, N = 3SE +/- 93669.97, N = 15SE +/- 236709.61, N = 3SE +/- 23120.76, N = 3SE +/- 113154.86, N = 4SE +/- 254193.37, N = 15SE +/- 26369.56, N = 3SE +/- 218479.19, N = 15SE +/- 83772.27, N = 13SE +/- 343737.14, N = 15SE +/- 61518.27, N = 10SE +/- 28201.44, N = 3SE +/- 215352.04, N = 15270597861186481511340389244661438934176933364522900152157761862010828914608544141584191985166455398709836689112233297366500962441774396631232130078417388926893124255191. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: StandardXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1122334455SE +/- 0.35, N = 3SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.36, N = 11SE +/- 0.61, N = 15SE +/- 0.63, N = 15SE +/- 0.23, N = 15SE +/- 0.45, N = 15SE +/- 0.61, N = 15SE +/- 0.50, N = 15SE +/- 0.61, N = 15SE +/- 0.40, N = 15SE +/- 0.01, N = 3SE +/- 0.35, N = 3SE +/- 0.33, N = 3SE +/- 0.31, N = 3SE +/- 0.40, N = 3SE +/- 0.11, N = 3SE +/- 0.12, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.09, N = 343.8136.7841.0847.2026.8327.9327.9026.4525.3223.9221.5822.7928.0229.7636.0033.9936.2333.3329.7529.4129.0228.851. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: StandardXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1122334455SE +/- 0.18, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.16, N = 11SE +/- 0.82, N = 15SE +/- 0.87, N = 15SE +/- 0.27, N = 15SE +/- 0.63, N = 15SE +/- 0.92, N = 15SE +/- 0.91, N = 15SE +/- 1.36, N = 15SE +/- 0.76, N = 15SE +/- 0.01, N = 3SE +/- 0.40, N = 3SE +/- 0.26, N = 3SE +/- 0.27, N = 3SE +/- 0.31, N = 3SE +/- 0.09, N = 3SE +/- 0.13, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.11, N = 322.8327.1824.3421.2037.5336.0835.8737.9639.8042.0746.8844.0635.6933.6027.7829.4327.6130.0033.6134.0034.4634.661. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenFOAM

OpenFOAM is the leading free, open-source software for computational fluid dynamics (CFD). This test profile currently uses the drivaerFastback test case for analyzing automotive aerodynamics or alternatively the older motorBike input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Execution TimeEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P2004006008001000690.74691.64137.11449.47124.30325.42178.2593.57798.35362.59186.33410.29201.11440.83196.50420.65302.06137.041. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Mesh TimeEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P4080120160200188.37163.70192.42167.41140.48136.40118.54135.52182.24162.32159.31150.67134.78153.12162.03160.73148.40139.621. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

Timed LLVM Compilation

This test times how long it takes to compile/build the LLVM compiler stack. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: NinjaXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P60120180240300SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.20, N = 3SE +/- 1.52, N = 3SE +/- 0.10, N = 3SE +/- 0.20, N = 3SE +/- 0.45, N = 3SE +/- 0.74, N = 3SE +/- 0.08, N = 3SE +/- 0.31, N = 3SE +/- 0.27, N = 3SE +/- 0.09, N = 3SE +/- 1.03, N = 3SE +/- 0.37, N = 3SE +/- 0.79, N = 3SE +/- 0.36, N = 3SE +/- 0.17, N = 3SE +/- 0.19, N = 3SE +/- 0.15, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 3SE +/- 0.27, N = 3125.27169.45184.20138.57215.93205.01101.56146.7694.81135.67124.4689.28298.41194.38128.07197.84134.42212.48122.31187.02165.05106.82

Memcached

Memcached is a high performance, distributed memory object caching system. This Memcached test profiles makes use of memtier_benchmark for excuting this CPU/memory-focused server benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.19Set To Get Ratio: 1:100Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P2M4M6M8M10MSE +/- 16926.98, N = 15SE +/- 19998.04, N = 15SE +/- 19070.02, N = 15SE +/- 16910.46, N = 15SE +/- 41123.40, N = 3SE +/- 36366.89, N = 3SE +/- 14591.70, N = 3SE +/- 38372.96, N = 3SE +/- 83562.82, N = 3SE +/- 29027.89, N = 3SE +/- 58081.25, N = 3SE +/- 27143.58, N = 3SE +/- 38410.91, N = 15SE +/- 101903.23, N = 15SE +/- 24083.78, N = 3SE +/- 52575.97, N = 3SE +/- 26891.33, N = 3SE +/- 21428.06, N = 3SE +/- 50660.01, N = 15SE +/- 25335.31, N = 3SE +/- 35182.67, N = 3SE +/- 35300.21, N = 31821144.002339570.282299150.511783869.965820618.186198256.727645325.707736018.748498306.788220895.458634258.398683410.794826284.804814941.533392842.384315467.173373323.924384040.523245908.404481667.954752673.793780240.561. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: StandardXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P3691215SE +/- 0.00701, N = 3SE +/- 0.03249, N = 3SE +/- 0.08614, N = 3SE +/- 0.06840, N = 3SE +/- 0.05392, N = 15SE +/- 0.04633, N = 15SE +/- 0.10131, N = 15SE +/- 0.07891, N = 15SE +/- 0.20624, N = 12SE +/- 0.08822, N = 15SE +/- 0.01598, N = 3SE +/- 0.14799, N = 15SE +/- 0.01476, N = 3SE +/- 0.01280, N = 3SE +/- 0.06816, N = 3SE +/- 0.03815, N = 5SE +/- 0.09530, N = 15SE +/- 0.02187, N = 3SE +/- 0.03225, N = 3SE +/- 0.01810, N = 3SE +/- 0.02572, N = 3SE +/- 0.01358, N = 311.482006.975097.6897712.434504.742214.570298.518086.227917.555584.461354.109147.096822.983064.493176.177963.370345.744913.028975.625173.170023.183925.839541. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: StandardXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P70140210280350SE +/- 0.05, N = 3SE +/- 0.67, N = 3SE +/- 1.47, N = 3SE +/- 0.44, N = 3SE +/- 2.40, N = 15SE +/- 2.24, N = 15SE +/- 1.44, N = 15SE +/- 2.12, N = 15SE +/- 3.84, N = 12SE +/- 4.35, N = 15SE +/- 0.95, N = 3SE +/- 3.21, N = 15SE +/- 1.65, N = 3SE +/- 0.64, N = 3SE +/- 1.78, N = 3SE +/- 3.31, N = 5SE +/- 2.72, N = 15SE +/- 2.40, N = 3SE +/- 1.01, N = 3SE +/- 1.80, N = 3SE +/- 2.52, N = 3SE +/- 0.40, N = 387.09143.36130.0680.42211.19219.06117.62160.90133.49225.31243.34141.83335.15222.52161.89296.80174.68330.10177.76315.41314.06171.231. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

NAMD

NAMD is a parallel molecular dynamics code designed for high-performance simulation of large biomolecular systems. NAMD was developed by the Theoretical and Computational Biophysics Group in the Beckman Institute for Advanced Science and Technology at the University of Illinois at Urbana-Champaign. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgns/day, More Is BetterNAMD 3.0b6Input: ATPase with 327,506 AtomsXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P510152025SE +/- 0.20408, N = 12SE +/- 0.17734, N = 15SE +/- 0.02593, N = 3SE +/- 0.19805, N = 15SE +/- 0.00431, N = 4SE +/- 0.04338, N = 5SE +/- 0.02125, N = 3SE +/- 0.04917, N = 5SE +/- 0.04751, N = 3SE +/- 0.01368, N = 5SE +/- 0.02148, N = 6SE +/- 0.08771, N = 3SE +/- 0.02582, N = 3SE +/- 0.07204, N = 4SE +/- 0.44989, N = 15SE +/- 0.14537, N = 15SE +/- 0.26203, N = 15SE +/- 0.16058, N = 15SE +/- 0.17435, N = 15SE +/- 0.21567, N = 12SE +/- 0.54361, N = 15SE +/- 0.34017, N = 122.397703.763483.768112.554005.449715.7067218.974547.9975617.811058.182759.3353420.752593.604796.726632.563195.925017.300655.971302.219482.970214.648145.85267

Speedb

Speedb is a next-generation key value storage engine that is RocksDB compatible and aiming for stability, efficiency, and performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Read While WritingXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P8M16M24M32M40MSE +/- 223786.94, N = 15SE +/- 75416.94, N = 3SE +/- 45758.35, N = 3SE +/- 138092.00, N = 3SE +/- 86788.79, N = 3SE +/- 88013.69, N = 15SE +/- 803844.71, N = 15SE +/- 172052.60, N = 3SE +/- 746932.76, N = 15SE +/- 170909.18, N = 3SE +/- 118870.12, N = 3SE +/- 651901.79, N = 15SE +/- 48302.92, N = 15SE +/- 48351.08, N = 3SE +/- 197596.27, N = 3SE +/- 93731.24, N = 7SE +/- 171807.74, N = 3SE +/- 88257.34, N = 3SE +/- 239363.92, N = 3SE +/- 62510.72, N = 3SE +/- 143570.67, N = 4SE +/- 195912.00, N = 15276577761794574517548934276307811188210312053901365932042282942630324596180249931959577733307574714712011795318153544009988176138592548795408172970271069536012168413175857371. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

PyTorch

This is a benchmark of PyTorch making use of pytorch-benchmark [https://github.com/LukasHedegaard/pytorch-benchmark]. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 64 - Model: ResNet-50Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1428425670SE +/- 0.11, N = 3SE +/- 0.33, N = 5SE +/- 0.14, N = 3SE +/- 0.06, N = 3SE +/- 0.18, N = 3SE +/- 0.06, N = 3SE +/- 0.23, N = 9SE +/- 0.10, N = 3SE +/- 0.35, N = 12SE +/- 0.26, N = 3SE +/- 0.10, N = 3SE +/- 0.37, N = 12SE +/- 0.14, N = 3SE +/- 0.40, N = 15SE +/- 0.46, N = 4SE +/- 0.62, N = 3SE +/- 0.51, N = 3SE +/- 0.71, N = 3SE +/- 0.50, N = 3SE +/- 0.24, N = 3SE +/- 0.12, N = 3SE +/- 0.12, N = 316.1030.6926.8914.8433.2333.4913.6827.6817.0735.0134.7117.2848.9937.7538.3051.3542.3551.5537.0856.0163.0640.77

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P4080120160200SE +/- 0.28, N = 3SE +/- 0.35, N = 3SE +/- 0.34, N = 3SE +/- 1.15, N = 3SE +/- 0.31, N = 15SE +/- 0.07, N = 3SE +/- 1.27, N = 15SE +/- 0.40, N = 15SE +/- 0.56, N = 15SE +/- 0.28, N = 4SE +/- 0.03, N = 3SE +/- 0.98, N = 15SE +/- 0.21, N = 3SE +/- 0.09, N = 3SE +/- 0.18, N = 3SE +/- 0.33, N = 3SE +/- 0.21, N = 3SE +/- 0.32, N = 15SE +/- 0.36, N = 3SE +/- 0.06, N = 3SE +/- 0.19, N = 3SE +/- 0.39, N = 13167.9796.69106.69179.1432.2332.9255.9232.4742.5125.4824.1142.8919.6021.9629.4423.6624.6521.2227.5918.9315.0426.091. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1530456075SE +/- 0.00992, N = 3SE +/- 0.03724, N = 3SE +/- 0.02972, N = 3SE +/- 0.03571, N = 3SE +/- 0.29092, N = 15SE +/- 0.06539, N = 3SE +/- 0.40826, N = 15SE +/- 0.38216, N = 15SE +/- 0.31646, N = 15SE +/- 0.42374, N = 4SE +/- 0.05911, N = 3SE +/- 0.56636, N = 15SE +/- 0.54692, N = 3SE +/- 0.18826, N = 3SE +/- 0.20595, N = 3SE +/- 0.58786, N = 3SE +/- 0.34209, N = 3SE +/- 0.69010, N = 15SE +/- 0.47575, N = 3SE +/- 0.16471, N = 3SE +/- 0.82440, N = 3SE +/- 0.50579, N = 135.9528310.342509.372945.5824131.0644030.3743018.0133030.8572023.5786039.2586041.4745023.4960051.0172045.5414033.9621042.2747040.5671047.2703036.2493052.8167066.5162038.424001. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: StandardXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P306090120150SE +/- 6.88, N = 15SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 6.85, N = 15SE +/- 1.26, N = 3SE +/- 0.51, N = 3SE +/- 2.33, N = 12SE +/- 0.70, N = 15SE +/- 0.90, N = 6SE +/- 0.17, N = 3SE +/- 0.18, N = 3SE +/- 2.80, N = 15SE +/- 1.84, N = 12SE +/- 0.29, N = 3SE +/- 1.12, N = 15SE +/- 0.23, N = 3SE +/- 0.68, N = 3SE +/- 0.44, N = 3SE +/- 0.62, N = 3SE +/- 0.17, N = 3SE +/- 0.04, N = 3SE +/- 0.44, N = 3141.57111.87124.06155.9086.6580.7293.6487.6693.8372.1271.5690.0648.4754.2855.9049.9760.1147.2460.3649.6439.7544.601. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: StandardXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P612182430SE +/- 0.36771, N = 15SE +/- 0.00509, N = 3SE +/- 0.00331, N = 3SE +/- 0.31004, N = 15SE +/- 0.16639, N = 3SE +/- 0.07825, N = 3SE +/- 0.26635, N = 12SE +/- 0.09294, N = 15SE +/- 0.10002, N = 6SE +/- 0.03352, N = 3SE +/- 0.03564, N = 3SE +/- 0.38561, N = 15SE +/- 0.58074, N = 12SE +/- 0.09869, N = 3SE +/- 0.35497, N = 15SE +/- 0.09194, N = 3SE +/- 0.18711, N = 3SE +/- 0.19764, N = 3SE +/- 0.16743, N = 3SE +/- 0.07031, N = 3SE +/- 0.02370, N = 3SE +/- 0.21982, N = 37.312858.938338.060136.6047111.5447012.3884010.7518811.4182010.6615013.8647013.9745011.2707020.8723018.4222017.9873020.0103016.6394021.1702016.5705020.1453025.1591022.425101. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: StandardXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P0.81431.62862.44293.25724.0715SE +/- 0.03971, N = 3SE +/- 0.00120, N = 3SE +/- 0.00335, N = 3SE +/- 0.01119, N = 3SE +/- 0.03117, N = 3SE +/- 0.02450, N = 4SE +/- 0.02347, N = 11SE +/- 0.01501, N = 3SE +/- 0.02209, N = 15SE +/- 0.02493, N = 15SE +/- 0.01470, N = 3SE +/- 0.03659, N = 15SE +/- 0.00236, N = 3SE +/- 0.02289, N = 15SE +/- 0.01853, N = 5SE +/- 0.01456, N = 3SE +/- 0.00498, N = 3SE +/- 0.02719, N = 15SE +/- 0.01405, N = 15SE +/- 0.01594, N = 3SE +/- 0.00291, N = 3SE +/- 0.01541, N = 33.415372.072882.243233.619202.238682.257163.164412.616532.250201.660461.485962.246451.175611.428491.718751.416621.652701.378311.435731.172921.100421.324541. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: StandardXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P2004006008001000SE +/- 3.37, N = 3SE +/- 0.28, N = 3SE +/- 0.67, N = 3SE +/- 0.86, N = 3SE +/- 6.13, N = 3SE +/- 4.84, N = 4SE +/- 2.36, N = 11SE +/- 2.19, N = 3SE +/- 4.37, N = 15SE +/- 9.50, N = 15SE +/- 6.60, N = 3SE +/- 7.76, N = 15SE +/- 1.66, N = 3SE +/- 10.46, N = 15SE +/- 6.21, N = 5SE +/- 7.34, N = 3SE +/- 1.83, N = 3SE +/- 12.91, N = 15SE +/- 6.50, N = 15SE +/- 11.46, N = 3SE +/- 2.43, N = 3SE +/- 8.88, N = 3292.79482.21445.62276.24446.69443.06316.11382.10444.85604.05672.92446.81849.56701.72581.77705.61604.76728.47696.98852.33908.19754.811. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

Llamafile

Mozilla's Llamafile allows distributing and running large language models (LLMs) as a single file. Llamafile aims to make open-source LLMs more accessible to developers and users. Llamafile supports a variety of models, CPUs and GPUs, and other options. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.7Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P246810SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.12, N = 6SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 32.675.585.392.565.115.164.637.475.248.358.485.244.413.101.541.541.771.473.825.854.083.05

Timed Godot Game Engine Compilation

This test times how long it takes to compile the Godot Game Engine. Godot is a popular, open-source, cross-platform 2D/3D game engine and is built using the SCons build system and targeting the X11 platform. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 4.0Time To CompileXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P4080120160200SE +/- 1.40, N = 3SE +/- 0.73, N = 3SE +/- 0.16, N = 3SE +/- 0.64, N = 3SE +/- 0.16, N = 3SE +/- 0.32, N = 3SE +/- 0.55, N = 3SE +/- 0.20, N = 3SE +/- 0.06, N = 3SE +/- 0.16, N = 3SE +/- 0.12, N = 3SE +/- 0.62, N = 3SE +/- 0.22, N = 3SE +/- 0.69, N = 3SE +/- 1.69, N = 3SE +/- 0.32, N = 3SE +/- 0.56, N = 3SE +/- 0.18, N = 3SE +/- 0.56, N = 3SE +/- 0.76, N = 3SE +/- 0.91, N = 3SE +/- 0.29, N = 3148.99152.23165.41160.46159.62154.01126.11128.28102.58111.69103.3596.16187.88151.54122.70143.81123.88149.38118.57140.23122.72103.38

PyTorch

This is a benchmark of PyTorch making use of pytorch-benchmark [https://github.com/LukasHedegaard/pytorch-benchmark]. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 256 - Model: ResNet-50Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1428425670SE +/- 0.12, N = 3SE +/- 0.13, N = 3SE +/- 0.12, N = 3SE +/- 0.11, N = 3SE +/- 0.13, N = 3SE +/- 0.18, N = 3SE +/- 0.28, N = 12SE +/- 0.08, N = 3SE +/- 0.37, N = 12SE +/- 0.21, N = 3SE +/- 0.09, N = 3SE +/- 0.32, N = 12SE +/- 0.04, N = 3SE +/- 0.23, N = 3SE +/- 0.45, N = 3SE +/- 0.62, N = 3SE +/- 0.52, N = 3SE +/- 0.76, N = 3SE +/- 0.49, N = 3SE +/- 0.52, N = 3SE +/- 0.64, N = 3SE +/- 0.29, N = 316.2230.8626.8214.6733.3033.6813.1127.7817.4134.9034.9016.9748.8936.9737.9151.5641.6852.9737.4454.8463.6041.45

OpenRadioss

OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/ and https://github.com/OpenRadioss/ModelExchange/tree/main/Examples. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: INIVOL and Fluid Structure Interaction Drop ContainerEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P4080120160200SE +/- 0.63, N = 3SE +/- 0.37, N = 3SE +/- 0.12, N = 3SE +/- 0.46, N = 3SE +/- 0.14, N = 3SE +/- 0.57, N = 3SE +/- 0.93, N = 3SE +/- 0.43, N = 3SE +/- 0.23, N = 3SE +/- 0.50, N = 3SE +/- 0.09, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.08, N = 3SE +/- 0.17, N = 3SE +/- 0.19, N = 3SE +/- 0.12, N = 3SE +/- 0.30, N = 3187.03176.8790.85106.5485.89100.2494.7679.42204.21135.56110.56146.03114.29160.56107.36140.43128.74100.00

QMCPACK

QMCPACK is a modern high-performance open-source Quantum Monte Carlo (QMC) simulation code making use of MPI for this benchmark of the H20 example code. QMCPACK is an open-source production level many-body ab initio Quantum Monte Carlo code for computing the electronic structure of atoms, molecules, and solids. QMCPACK is supported by the U.S. Department of Energy. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTotal Execution Time - Seconds, Fewer Is BetterQMCPACK 3.17.1Input: Li2_STO_aeEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P4080120160200SE +/- 0.40, N = 3SE +/- 1.13, N = 3SE +/- 0.42, N = 3SE +/- 0.63, N = 3SE +/- 0.23, N = 3SE +/- 0.54, N = 3SE +/- 1.06, N = 3SE +/- 0.06, N = 3SE +/- 1.47, N = 7SE +/- 0.50, N = 3SE +/- 1.11, N = 5SE +/- 1.04, N = 3SE +/- 0.88, N = 3SE +/- 1.20, N = 3SE +/- 1.11, N = 3SE +/- 0.89, N = 3SE +/- 1.03, N = 3SE +/- 0.93, N = 3151.27137.23111.15110.80102.98108.0297.0091.97163.75131.37106.27117.81102.12121.19101.63109.30105.9897.911. (CXX) g++ options: -fopenmp -foffload=disable -finline-limit=1000 -fstrict-aliasing -funroll-all-loops -ffast-math -march=native -O3 -lm -ldl

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: ParallelXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P30060090012001500SE +/- 3.30, N = 3SE +/- 0.63, N = 3SE +/- 0.61, N = 3SE +/- 6.08, N = 15SE +/- 3.59, N = 15SE +/- 3.54, N = 3SE +/- 5.48, N = 3SE +/- 1.91, N = 3SE +/- 19.12, N = 12SE +/- 9.04, N = 12SE +/- 13.72, N = 15SE +/- 1.59, N = 3SE +/- 2.55, N = 3SE +/- 2.36, N = 15SE +/- 6.06, N = 3SE +/- 2.21, N = 3SE +/- 5.57, N = 13SE +/- 1.73, N = 3SE +/- 0.96, N = 3SE +/- 0.94, N = 3SE +/- 0.74, N = 3SE +/- 4.07, N = 3587.00515.08562.40608.09443.96388.74397.43319.351094.26800.23801.961165.93363.35345.94475.25382.11460.67380.90352.74329.04302.27327.881. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: fcn-resnet101-11 - Device: CPU - Executor: ParallelXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P0.74441.48882.23322.97763.722SE +/- 0.009611, N = 3SE +/- 0.002384, N = 3SE +/- 0.001935, N = 3SE +/- 0.016386, N = 15SE +/- 0.018603, N = 15SE +/- 0.023203, N = 3SE +/- 0.034519, N = 3SE +/- 0.018814, N = 3SE +/- 0.016597, N = 12SE +/- 0.013875, N = 12SE +/- 0.020352, N = 15SE +/- 0.001170, N = 3SE +/- 0.019473, N = 3SE +/- 0.019617, N = 15SE +/- 0.026516, N = 3SE +/- 0.015170, N = 3SE +/- 0.027020, N = 13SE +/- 0.011894, N = 3SE +/- 0.007683, N = 3SE +/- 0.008707, N = 3SE +/- 0.008053, N = 3SE +/- 0.038257, N = 31.7036501.9414401.7780901.6467402.2545302.5727802.5170903.1315600.9170431.2513501.2517900.8576852.7524202.8925302.1048002.6172102.1746302.6254402.8349803.0392203.3083603.0508501. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: ParallelXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P3691215SE +/- 0.11179, N = 3SE +/- 0.04327, N = 3SE +/- 0.04869, N = 15SE +/- 0.07940, N = 3SE +/- 0.01684, N = 6SE +/- 0.00301, N = 3SE +/- 0.03210, N = 15SE +/- 0.01454, N = 15SE +/- 0.02296, N = 15SE +/- 0.01428, N = 15SE +/- 0.01586, N = 15SE +/- 0.04200, N = 3SE +/- 0.00184, N = 3SE +/- 0.00943, N = 3SE +/- 0.00871, N = 3SE +/- 0.01053, N = 3SE +/- 0.00720, N = 3SE +/- 0.00884, N = 3SE +/- 0.01492, N = 3SE +/- 0.00936, N = 3SE +/- 0.01491, N = 4SE +/- 0.00701, N = 312.126805.240515.6642612.302101.805731.824433.696022.210203.170641.705791.693073.217811.301731.558212.087801.472492.026591.452801.763531.273681.202981.649191. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: CaffeNet 12-int8 - Device: CPU - Executor: ParallelXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P2004006008001000SE +/- 0.77, N = 3SE +/- 1.57, N = 3SE +/- 1.50, N = 15SE +/- 0.53, N = 3SE +/- 5.34, N = 6SE +/- 0.91, N = 3SE +/- 2.41, N = 15SE +/- 3.02, N = 15SE +/- 2.35, N = 15SE +/- 4.99, N = 15SE +/- 5.53, N = 15SE +/- 4.10, N = 3SE +/- 1.09, N = 3SE +/- 3.90, N = 3SE +/- 1.98, N = 3SE +/- 4.87, N = 3SE +/- 1.77, N = 3SE +/- 4.16, N = 3SE +/- 4.81, N = 3SE +/- 5.72, N = 3SE +/- 10.06, N = 4SE +/- 2.57, N = 382.44190.78176.6481.26553.47547.52270.63452.32315.36586.18590.71310.59767.48641.00478.47678.48492.89687.67566.38784.30830.73605.591. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: StandardXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P246810SE +/- 0.02282, N = 3SE +/- 0.00392, N = 3SE +/- 0.00782, N = 3SE +/- 0.56391, N = 15SE +/- 0.03354, N = 3SE +/- 0.06404, N = 13SE +/- 0.07124, N = 3SE +/- 0.06745, N = 3SE +/- 0.06624, N = 3SE +/- 0.03084, N = 3SE +/- 0.01718, N = 3SE +/- 0.06302, N = 15SE +/- 0.03065, N = 15SE +/- 0.06148, N = 15SE +/- 0.02608, N = 3SE +/- 0.01103, N = 3SE +/- 0.03283, N = 3SE +/- 0.08827, N = 15SE +/- 0.00316, N = 3SE +/- 0.00659, N = 3SE +/- 0.00472, N = 3SE +/- 0.02371, N = 34.748594.597034.807256.143277.860157.873257.840657.633375.984365.346563.575433.807923.349663.431255.391234.647575.022674.575813.465712.796942.169662.802631. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: StandardXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P100200300400500SE +/- 1.00, N = 3SE +/- 0.17, N = 3SE +/- 0.35, N = 3SE +/- 11.98, N = 15SE +/- 0.54, N = 3SE +/- 0.98, N = 13SE +/- 1.15, N = 3SE +/- 1.16, N = 3SE +/- 1.86, N = 3SE +/- 1.08, N = 3SE +/- 1.35, N = 3SE +/- 4.17, N = 15SE +/- 2.62, N = 15SE +/- 4.93, N = 15SE +/- 0.89, N = 3SE +/- 0.51, N = 3SE +/- 1.31, N = 3SE +/- 3.95, N = 15SE +/- 0.26, N = 3SE +/- 0.84, N = 3SE +/- 1.00, N = 3SE +/- 3.01, N = 3210.37217.45207.94178.11127.21127.09127.54131.00167.11187.01279.64263.52298.67292.52185.46215.13199.08219.53288.47357.36460.78356.761. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P60120180240300SE +/- 0.34, N = 3SE +/- 0.15, N = 3SE +/- 0.25, N = 3SE +/- 0.07, N = 3SE +/- 0.41, N = 3SE +/- 0.19, N = 3SE +/- 1.90, N = 15SE +/- 6.97, N = 15SE +/- 0.44, N = 15SE +/- 2.90, N = 15SE +/- 1.22, N = 15SE +/- 0.09, N = 3SE +/- 0.92, N = 3SE +/- 0.14, N = 3SE +/- 0.06, N = 3SE +/- 0.10, N = 3SE +/- 0.10, N = 3SE +/- 0.18, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.09, N = 3SE +/- 0.09, N = 3274.52266.91283.83293.02156.59161.4885.86230.2463.98157.45110.9143.77236.81113.7064.9159.6942.1641.9345.78100.3939.6243.411. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P2004006008001000SE +/- 0.34, N = 3SE +/- 0.05, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.56, N = 3SE +/- 0.25, N = 3SE +/- 20.94, N = 15SE +/- 13.40, N = 15SE +/- 5.47, N = 15SE +/- 7.13, N = 15SE +/- 5.20, N = 15SE +/- 2.17, N = 3SE +/- 0.34, N = 3SE +/- 0.23, N = 3SE +/- 0.55, N = 3SE +/- 0.52, N = 3SE +/- 1.28, N = 3SE +/- 1.23, N = 3SE +/- 0.69, N = 3SE +/- 0.04, N = 3SE +/- 0.95, N = 3SE +/- 1.42, N = 3261.64134.77126.64245.27204.05197.91750.96283.18750.11306.27433.061095.7984.30175.72569.60301.30568.81285.95654.84298.56403.20736.231. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: StandardXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P3691215SE +/- 0.80628, N = 15SE +/- 0.02008, N = 3SE +/- 0.02403, N = 3SE +/- 0.02533, N = 3SE +/- 0.07964, N = 3SE +/- 0.03478, N = 3SE +/- 0.20120, N = 15SE +/- 0.01807, N = 3SE +/- 0.01221, N = 3SE +/- 0.08751, N = 5SE +/- 0.02661, N = 3SE +/- 0.01742, N = 3SE +/- 0.04594, N = 3SE +/- 0.08423, N = 15SE +/- 0.06105, N = 3SE +/- 0.06620, N = 3SE +/- 0.02902, N = 3SE +/- 0.06596, N = 15SE +/- 0.03218, N = 3SE +/- 0.03075, N = 3SE +/- 0.01631, N = 3SE +/- 0.15083, N = 1510.585716.746307.164407.3261011.2864011.2047011.5774011.139209.746147.885846.166686.171904.804185.164807.532595.919617.041115.677005.551014.499763.696494.295311. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: StandardXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P60120180240300SE +/- 8.91, N = 15SE +/- 0.44, N = 3SE +/- 0.47, N = 3SE +/- 0.47, N = 3SE +/- 0.63, N = 3SE +/- 0.28, N = 3SE +/- 1.43, N = 15SE +/- 0.15, N = 3SE +/- 0.13, N = 3SE +/- 1.37, N = 5SE +/- 0.70, N = 3SE +/- 0.46, N = 3SE +/- 1.97, N = 3SE +/- 3.16, N = 15SE +/- 1.08, N = 3SE +/- 1.88, N = 3SE +/- 0.58, N = 3SE +/- 2.01, N = 15SE +/- 1.05, N = 3SE +/- 1.50, N = 3SE +/- 1.19, N = 3SE +/- 8.14, N = 15103.89148.11139.45136.3988.5789.2186.6989.74102.57126.82162.09161.95207.93194.15132.71168.86141.95176.33180.03222.03270.33236.651. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: GoogLeNetXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P110220330440550SE +/- 2.49, N = 3SE +/- 0.07, N = 3SE +/- 0.31, N = 3SE +/- 3.73, N = 4SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 1.11, N = 3SE +/- 10.93, N = 12SE +/- 1.02, N = 3SE +/- 3.87, N = 15SE +/- 2.76, N = 15SE +/- 0.51, N = 3SE +/- 0.16, N = 3SE +/- 0.69, N = 3SE +/- 4.80, N = 3SE +/- 1.91, N = 3SE +/- 2.29, N = 3SE +/- 1.67, N = 3SE +/- 4.87, N = 3SE +/- 0.24, N = 3SE +/- 2.30, N = 3SE +/- 2.68, N = 3335.38281.62260.83301.46287.42308.46397.44462.79401.84447.61406.58391.40290.27402.78449.91386.00447.50375.73528.93448.46423.59501.39

OSPRay

Intel OSPRay is a portable ray-tracing engine for high-performance, high-fidelity scientific visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/ao/real_timeXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1326395265SE +/- 0.03595, N = 3SE +/- 0.01225, N = 3SE +/- 0.02488, N = 3SE +/- 0.03817, N = 3SE +/- 0.04390, N = 3SE +/- 0.02190, N = 3SE +/- 0.01800, N = 3SE +/- 0.03039, N = 3SE +/- 0.01406, N = 3SE +/- 0.01424, N = 3SE +/- 0.01754, N = 3SE +/- 0.02899, N = 3SE +/- 0.05948, N = 3SE +/- 0.03319, N = 3SE +/- 0.00297, N = 3SE +/- 0.01050, N = 3SE +/- 0.01945, N = 3SE +/- 0.03513, N = 3SE +/- 0.02269, N = 3SE +/- 0.00975, N = 3SE +/- 0.01144, N = 3SE +/- 0.07203, N = 336.5043021.6222019.5159032.9663016.4504017.9668056.6936035.2461047.6143028.0956032.5188055.338209.7776417.8269033.1125018.5533029.5018016.0502038.2235021.9324030.8404054.11950

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: StandardXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P306090120150SE +/- 0.25, N = 3SE +/- 0.51, N = 3SE +/- 0.37, N = 3SE +/- 1.08, N = 3SE +/- 1.32, N = 5SE +/- 1.36, N = 4SE +/- 2.08, N = 3SE +/- 0.77, N = 3SE +/- 1.03, N = 3SE +/- 0.88, N = 8SE +/- 1.34, N = 3SE +/- 1.60, N = 3SE +/- 0.38, N = 3SE +/- 0.25, N = 3SE +/- 0.47, N = 14SE +/- 0.55, N = 15SE +/- 1.43, N = 15SE +/- 0.55, N = 15SE +/- 0.28, N = 3SE +/- 0.12, N = 3SE +/- 0.10, N = 3SE +/- 0.35, N = 3122.7572.3178.73133.36114.31112.73148.21120.56155.96101.47102.73137.9949.3960.9369.2059.1869.4554.9664.2950.3543.5458.941. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: StandardXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P612182430SE +/- 0.01654, N = 3SE +/- 0.09768, N = 3SE +/- 0.05969, N = 3SE +/- 0.06011, N = 3SE +/- 0.09781, N = 5SE +/- 0.10588, N = 4SE +/- 0.09575, N = 3SE +/- 0.05314, N = 3SE +/- 0.04207, N = 3SE +/- 0.08554, N = 8SE +/- 0.12519, N = 3SE +/- 0.08454, N = 3SE +/- 0.15605, N = 3SE +/- 0.06818, N = 3SE +/- 0.09595, N = 14SE +/- 0.15263, N = 15SE +/- 0.29451, N = 15SE +/- 0.16821, N = 15SE +/- 0.06825, N = 3SE +/- 0.04802, N = 3SE +/- 0.05084, N = 3SE +/- 0.09991, N = 38.1461513.8295012.701507.499408.752338.874466.749778.295336.412299.860189.736857.2486920.2495016.4123014.4583016.9166014.4831018.2179015.5555019.8593022.9689016.967201. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: StandardXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P48121620SE +/- 0.14238, N = 15SE +/- 0.07241, N = 3SE +/- 0.08782, N = 3SE +/- 0.07602, N = 3SE +/- 0.02847, N = 3SE +/- 0.02616, N = 3SE +/- 0.26893, N = 15SE +/- 0.02331, N = 3SE +/- 0.06617, N = 3SE +/- 0.04482, N = 3SE +/- 0.03798, N = 3SE +/- 0.18371, N = 12SE +/- 0.04501, N = 3SE +/- 0.28946, N = 12SE +/- 0.02558, N = 3SE +/- 0.00532, N = 3SE +/- 0.05347, N = 4SE +/- 0.00187, N = 3SE +/- 0.10855, N = 15SE +/- 0.00313, N = 3SE +/- 0.00044, N = 3SE +/- 0.05342, N = 315.1274015.1057016.8631016.806209.711319.3868110.231069.4217710.434408.150928.133268.399695.054275.298445.002224.672694.858184.589124.725304.396493.857743.980131. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: StandardXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P60120180240300SE +/- 0.60, N = 15SE +/- 0.32, N = 3SE +/- 0.31, N = 3SE +/- 0.27, N = 3SE +/- 0.30, N = 3SE +/- 0.30, N = 3SE +/- 2.46, N = 15SE +/- 0.26, N = 3SE +/- 0.61, N = 3SE +/- 0.67, N = 3SE +/- 0.58, N = 3SE +/- 2.15, N = 12SE +/- 1.75, N = 3SE +/- 6.83, N = 12SE +/- 1.02, N = 3SE +/- 0.25, N = 3SE +/- 2.30, N = 4SE +/- 0.09, N = 3SE +/- 4.15, N = 15SE +/- 0.16, N = 3SE +/- 0.03, N = 3SE +/- 3.39, N = 366.1866.2059.3059.50102.97106.5398.64106.1395.84122.68122.95119.56197.85192.81199.90213.99205.89217.88212.92227.42259.19251.311. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OSPRay Studio

Intel OSPRay Studio is an open-source, interactive visualization and ray-tracing software package. OSPRay Studio makes use of Intel OSPRay, a portable ray-tracing engine for high-performance, high-fidelity visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P20K40K60K80K100KSE +/- 605.82, N = 15SE +/- 424.84, N = 3SE +/- 541.85, N = 3SE +/- 739.02, N = 15SE +/- 346.19, N = 3SE +/- 172.59, N = 3SE +/- 47.34, N = 3SE +/- 312.83, N = 12SE +/- 109.43, N = 3SE +/- 42.05, N = 3SE +/- 193.23, N = 3SE +/- 14.62, N = 3SE +/- 175.68, N = 3SE +/- 152.29, N = 3SE +/- 13.86, N = 3SE +/- 64.91, N = 3SE +/- 37.55, N = 3SE +/- 134.33, N = 3SE +/- 64.24, N = 3SE +/- 102.40, N = 3SE +/- 90.37, N = 3SE +/- 16.05, N = 3560828100388579624497809372051169603738320750432903864517855103461552473617962540389266897333411580265079824249

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P30K60K90K120K150KSE +/- 176.25, N = 3SE +/- 189.03, N = 3SE +/- 365.52, N = 3SE +/- 900.17, N = 15SE +/- 13.58, N = 3SE +/- 29.36, N = 3SE +/- 28.11, N = 3SE +/- 50.97, N = 3SE +/- 756.08, N = 15SE +/- 231.95, N = 3SE +/- 89.57, N = 3SE +/- 27.74, N = 3SE +/- 623.29, N = 3SE +/- 32.38, N = 3SE +/- 141.04, N = 3SE +/- 65.97, N = 3SE +/- 155.80, N = 3SE +/- 41.33, N = 3SE +/- 125.33, N = 3SE +/- 58.68, N = 3SE +/- 162.52, N = 3SE +/- 47.16, N = 36648792175101444715839164384261200714294527943500194434920893121734641884197173366452118074238813680065952233391

Zstd Compression

This test measures the time needed to compress/decompress a sample file (silesia.tar) using Zstd (Zstandard) compression with options for different compression levels / settings. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Decompression SpeedXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P30060090012001500SE +/- 2.25, N = 3SE +/- 5.13, N = 3SE +/- 2.22, N = 3SE +/- 5.06, N = 3SE +/- 1.58, N = 3SE +/- 21.23, N = 3SE +/- 1.83, N = 3SE +/- 0.83, N = 3SE +/- 2.20, N = 3SE +/- 0.46, N = 3SE +/- 7.31, N = 3SE +/- 1.73, N = 3SE +/- 1.75, N = 3SE +/- 1.74, N = 4SE +/- 0.65, N = 15SE +/- 1.08, N = 15SE +/- 0.66, N = 15SE +/- 2.12, N = 3SE +/- 4.96, N = 3SE +/- 4.45, N = 3SE +/- 3.01, N = 4SE +/- 1.88, N = 3774.4816.7743.5721.41144.81118.81139.01139.91382.11388.91385.31392.51032.4900.51039.21127.51040.21126.4963.61032.01221.81165.81. (CC) gcc options: -O3 -pthread -lz -llzma

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Compression SpeedXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P48121620SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.09, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.22, N = 3SE +/- 0.03, N = 3SE +/- 0.17, N = 4SE +/- 0.13, N = 15SE +/- 0.11, N = 15SE +/- 0.09, N = 15SE +/- 0.15, N = 3SE +/- 0.12, N = 3SE +/- 0.06, N = 3SE +/- 0.21, N = 4SE +/- 0.03, N = 311.611.510.610.613.813.913.713.817.017.217.216.813.714.313.314.513.814.415.214.618.017.81. (CC) gcc options: -O3 -pthread -lz -llzma

Speedb

Speedb is a next-generation key value storage engine that is RocksDB compatible and aiming for stability, efficiency, and performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random ReadXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P300M600M900M1200M1500MSE +/- 2674444.99, N = 3SE +/- 1322733.50, N = 3SE +/- 998087.60, N = 3SE +/- 1272758.30, N = 3SE +/- 70537.88, N = 3SE +/- 109015.29, N = 3SE +/- 2399164.12, N = 3SE +/- 1606748.01, N = 3SE +/- 955915.20, N = 3SE +/- 66268.38, N = 3SE +/- 205170.43, N = 3SE +/- 5954964.38, N = 3SE +/- 232538.80, N = 3SE +/- 706582.63, N = 3SE +/- 2955608.21, N = 3SE +/- 2763560.64, N = 13SE +/- 8491098.40, N = 15SE +/- 3698537.65, N = 15SE +/- 5393159.45, N = 3SE +/- 168680.90, N = 3SE +/- 242146.75, N = 3SE +/- 5399265.88, N = 1513241633406731592175969554941158496546242940110274091778116994738558995107085768717942855705453763303410595465331303591452591364664979074902440706744199435702114570485512869582761796173151783815861478711. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

VVenC

VVenC is the Fraunhofer Versatile Video Encoder as a fast/efficient H.266/VVC encoder. The vvenc encoder makes use of SIMD Everywhere (SIMDe). The vvenc software is published under the Clear BSD License. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FastXeon 6780EXeon 6766EEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P246810SE +/- 0.007, N = 3SE +/- 0.008, N = 3SE +/- 0.041, N = 3SE +/- 0.038, N = 3SE +/- 0.045, N = 3SE +/- 0.048, N = 3SE +/- 0.057, N = 3SE +/- 0.010, N = 3SE +/- 0.028, N = 3SE +/- 0.043, N = 15SE +/- 0.033, N = 3SE +/- 0.081, N = 3SE +/- 0.010, N = 3SE +/- 0.047, N = 3SE +/- 0.022, N = 3SE +/- 0.023, N = 3SE +/- 0.038, N = 34.4404.0526.0006.1186.4657.4317.5475.5835.8776.0776.5016.0236.3246.4806.7197.3926.9601. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

Video Input: Bosphorus 4K - Video Preset: Fast

EPYC 9684X 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

EPYC 9654 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

EPYC 9754 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

Xeon 6766E 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

Xeon 6780E 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

Zstd Compression

This test measures the time needed to compress/decompress a sample file (silesia.tar) using Zstd (Zstandard) compression with options for different compression levels / settings. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Decompression SpeedXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P30060090012001500SE +/- 1.54, N = 3SE +/- 1.05, N = 3SE +/- 3.99, N = 3SE +/- 4.61, N = 3SE +/- 0.92, N = 3SE +/- 2.09, N = 3SE +/- 0.19, N = 3SE +/- 1.95, N = 3SE +/- 1.87, N = 3SE +/- 1.17, N = 3SE +/- 1.99, N = 3SE +/- 2.93, N = 3SE +/- 4.15, N = 3SE +/- 0.30, N = 3SE +/- 1.78, N = 15SE +/- 1.45, N = 3SE +/- 1.00, N = 3SE +/- 0.56, N = 3SE +/- 3.69, N = 3SE +/- 0.43, N = 3SE +/- 0.84, N = 3SE +/- 1.60, N = 3753.2797.7739.1701.21096.51101.41104.21102.21324.61328.51324.91321.41018.3912.91046.01133.31041.81131.1992.11069.11242.61189.71. (CC) gcc options: -O3 -pthread -lz -llzma

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Compression SpeedXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P3691215SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 15SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 36.106.195.655.606.746.766.646.688.308.388.458.427.527.837.467.727.627.768.167.949.809.671. (CC) gcc options: -O3 -pthread -lz -llzma

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P0.3060.6120.9181.2241.53SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 9SE +/- 0.00, N = 3SE +/- 0.00, N = 15SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 7SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 15SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 31.091.251.361.200.600.530.410.730.350.480.450.350.560.450.300.370.280.330.290.430.490.461. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P40K80K120K160K200KSE +/- 1067.91, N = 3SE +/- 100.17, N = 3SE +/- 68.06, N = 3SE +/- 1048.23, N = 3SE +/- 55.52, N = 3SE +/- 86.99, N = 3SE +/- 1374.23, N = 9SE +/- 89.35, N = 3SE +/- 1922.38, N = 15SE +/- 205.87, N = 3SE +/- 162.47, N = 3SE +/- 1640.61, N = 7SE +/- 95.54, N = 3SE +/- 696.52, N = 3SE +/- 1422.88, N = 15SE +/- 1761.33, N = 3SE +/- 18.38, N = 3SE +/- 383.22, N = 3SE +/- 2494.14, N = 3SE +/- 75.30, N = 3SE +/- 988.12, N = 3SE +/- 1158.60, N = 376895.2991273.0284584.1375761.5078334.9287511.11166151.42132973.43172688.50133779.62138605.52178488.0361956.93151627.42176900.32140144.01174862.56135075.07189893.31115106.3081279.79128566.811. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OSPRay Studio

Intel OSPRay Studio is an open-source, interactive visualization and ray-tracing software package. OSPRay Studio makes use of Intel OSPRay, a portable ray-tracing engine for high-performance, high-fidelity visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P7001400210028003500SE +/- 24.01, N = 12SE +/- 11.06, N = 3SE +/- 7.84, N = 3SE +/- 21.79, N = 12SE +/- 1.20, N = 3SE +/- 0.58, N = 3SE +/- 0.88, N = 3SE +/- 1.20, N = 3SE +/- 0.58, N = 3SE +/- 0.58, N = 3SE +/- 1.15, N = 3SE +/- 1.20, N = 3SE +/- 4.62, N = 3SE +/- 0.33, N = 3SE +/- 0.58, N = 3SE +/- 0.58, N = 3SE +/- 1.76, N = 3SE +/- 0.33, N = 3SE +/- 0.58, N = 3SE +/- 0.58, N = 3SE +/- 0.88, N = 3SE +/- 0.88, N = 3134220902318149722402043531954661118010375613052155396117921049198889416571441759

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: ResNet-50Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P48121620SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 15SE +/- 0.08, N = 15SE +/- 0.08, N = 15SE +/- 0.03, N = 15SE +/- 0.05, N = 15SE +/- 0.06, N = 15SE +/- 0.01, N = 4SE +/- 0.09, N = 15SE +/- 0.01, N = 3SE +/- 0.08, N = 5SE +/- 0.13, N = 15SE +/- 0.04, N = 15SE +/- 0.10, N = 4SE +/- 0.07, N = 3SE +/- 0.09, N = 4SE +/- 0.06, N = 15SE +/- 0.05, N = 4SE +/- 0.05, N = 9SE +/- 0.03, N = 151.995.024.671.7610.7010.792.476.193.669.018.963.9217.829.134.379.995.1111.294.3910.536.433.85

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: ResNet-50Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P306090120150SE +/- 0.76, N = 3SE +/- 0.14, N = 3SE +/- 0.04, N = 3SE +/- 0.56, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 3SE +/- 0.88, N = 3SE +/- 0.60, N = 3SE +/- 0.91, N = 5SE +/- 0.64, N = 3SE +/- 0.08, N = 3SE +/- 1.04, N = 4SE +/- 0.36, N = 3SE +/- 1.42, N = 3SE +/- 1.28, N = 3SE +/- 0.93, N = 3SE +/- 0.39, N = 3SE +/- 0.13, N = 3SE +/- 1.12, N = 3SE +/- 0.04, N = 3SE +/- 0.50, N = 3SE +/- 0.70, N = 368.5276.3771.4161.4880.8687.3167.08106.1482.94114.63104.5286.0890.72108.32107.30103.56111.71104.23115.47120.9391.5194.66

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P60120180240300SE +/- 3.14, N = 3SE +/- 0.06, N = 3SE +/- 0.48, N = 3SE +/- 2.84, N = 15SE +/- 0.05, N = 3SE +/- 0.13, N = 3SE +/- 0.59, N = 3SE +/- 1.05, N = 5SE +/- 0.44, N = 3SE +/- 0.77, N = 7SE +/- 0.60, N = 11SE +/- 0.01, N = 3SE +/- 0.39, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.34, N = 3SE +/- 0.07, N = 3SE +/- 0.12, N = 3SE +/- 0.16, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3271.14240.38259.66294.69109.00100.6756.73102.8448.4391.1683.1143.17127.8970.9541.5738.5029.9828.7337.5862.4626.8528.171. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P2004006008001000SE +/- 3.00, N = 3SE +/- 0.03, N = 3SE +/- 0.25, N = 3SE +/- 2.30, N = 15SE +/- 0.13, N = 3SE +/- 0.39, N = 3SE +/- 11.78, N = 3SE +/- 6.34, N = 5SE +/- 8.96, N = 3SE +/- 4.59, N = 7SE +/- 4.29, N = 11SE +/- 0.37, N = 3SE +/- 0.45, N = 3SE +/- 0.17, N = 3SE +/- 1.13, N = 3SE +/- 4.09, N = 3SE +/- 1.99, N = 3SE +/- 1.21, N = 3SE +/- 3.48, N = 3SE +/- 0.17, N = 3SE +/- 0.54, N = 3SE +/- 0.85, N = 3264.66149.63138.53243.76293.07317.381127.05621.42990.16525.88576.981110.49156.13281.36889.18467.08795.63415.96793.64477.77592.201128.781. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: ParallelXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P816243240SE +/- 0.32730, N = 6SE +/- 0.07856, N = 3SE +/- 0.08701, N = 3SE +/- 0.34399, N = 3SE +/- 0.03633, N = 15SE +/- 0.03641, N = 15SE +/- 0.08457, N = 3SE +/- 0.02258, N = 3SE +/- 0.05293, N = 3SE +/- 0.06505, N = 4SE +/- 0.04669, N = 3SE +/- 0.05309, N = 3SE +/- 0.01736, N = 3SE +/- 0.03509, N = 3SE +/- 0.03080, N = 3SE +/- 0.03023, N = 3SE +/- 0.01680, N = 3SE +/- 0.01698, N = 3SE +/- 0.02968, N = 3SE +/- 0.00544, N = 3SE +/- 0.02630, N = 3SE +/- 0.06875, N = 335.2266015.5856017.9000036.400904.926534.8250611.314806.523679.962455.253215.594919.952453.173605.180706.517443.320306.005253.133666.390313.192983.237806.496931. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ResNet50 v1-12-int8 - Device: CPU - Executor: ParallelXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P70140210280350SE +/- 0.27, N = 6SE +/- 0.32, N = 3SE +/- 0.27, N = 3SE +/- 0.26, N = 3SE +/- 1.50, N = 15SE +/- 1.54, N = 15SE +/- 0.66, N = 3SE +/- 0.53, N = 3SE +/- 0.54, N = 3SE +/- 2.31, N = 4SE +/- 1.50, N = 3SE +/- 0.54, N = 3SE +/- 1.73, N = 3SE +/- 1.30, N = 3SE +/- 0.73, N = 3SE +/- 2.72, N = 3SE +/- 0.47, N = 3SE +/- 1.74, N = 3SE +/- 0.73, N = 3SE +/- 0.53, N = 3SE +/- 2.50, N = 3SE +/- 1.63, N = 328.4064.1655.8627.47203.06207.3488.37153.25100.36190.38178.70100.46315.03192.99153.41301.14166.49319.04156.46313.10308.80153.921. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P70140210280350SE +/- 0.86, N = 3SE +/- 0.65, N = 3SE +/- 0.66, N = 3SE +/- 4.48, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.10, N = 3SE +/- 0.45, N = 12SE +/- 0.08, N = 3SE +/- 0.16, N = 14SE +/- 0.00, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.02, N = 3SE +/- 0.12, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3293.3675.2282.12340.2618.4917.3028.1022.6723.1216.3213.5222.2025.9126.3318.7212.7217.1511.3715.9613.959.4013.151. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P2K4K6K8K10KSE +/- 2.88, N = 3SE +/- 16.46, N = 3SE +/- 13.67, N = 3SE +/- 11.12, N = 3SE +/- 3.67, N = 3SE +/- 0.64, N = 3SE +/- 27.90, N = 3SE +/- 139.41, N = 12SE +/- 77.59, N = 3SE +/- 67.22, N = 14SE +/- 1.84, N = 3SE +/- 59.51, N = 3SE +/- 1.70, N = 3SE +/- 6.96, N = 3SE +/- 28.98, N = 3SE +/- 7.60, N = 3SE +/- 37.79, N = 3SE +/- 15.13, N = 3SE +/- 13.31, N = 3SE +/- 1.87, N = 3SE +/- 10.14, N = 3SE +/- 24.76, N = 3978.461906.991747.50843.923405.943636.336513.365310.077810.655697.516963.318231.721525.572963.825933.654386.485565.234208.497356.634209.106757.269360.891. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

libavif avifenc

This is a test of the AOMedia libavif library testing the encoding of a JPEG image to AV1 Image Format (AVIF). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 0Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P306090120150SE +/- 0.18, N = 3SE +/- 0.12, N = 3SE +/- 0.03, N = 3SE +/- 0.22, N = 3SE +/- 0.18, N = 3SE +/- 0.19, N = 3SE +/- 0.06, N = 3SE +/- 0.13, N = 3SE +/- 0.11, N = 3SE +/- 0.01, N = 3SE +/- 0.12, N = 3SE +/- 0.01, N = 3SE +/- 0.52, N = 3SE +/- 0.18, N = 3SE +/- 0.32, N = 3SE +/- 0.22, N = 3SE +/- 0.29, N = 3SE +/- 0.15, N = 3SE +/- 0.05, N = 3SE +/- 0.32, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3129.91126.97140.86143.8078.2475.8674.6973.2762.8961.9961.6363.40100.4688.0768.4473.0669.6576.9267.3869.9364.4860.531. (CXX) g++ options: -O3 -fPIC -lm

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: ParallelXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P3691215SE +/- 0.14331, N = 3SE +/- 0.01135, N = 3SE +/- 0.01143, N = 3SE +/- 0.12596, N = 3SE +/- 0.02993, N = 3SE +/- 0.03399, N = 3SE +/- 0.01019, N = 3SE +/- 0.02990, N = 3SE +/- 0.03309, N = 3SE +/- 0.00389, N = 3SE +/- 0.01812, N = 3SE +/- 0.00852, N = 3SE +/- 0.02857, N = 3SE +/- 0.01782, N = 3SE +/- 0.02633, N = 15SE +/- 0.01443, N = 3SE +/- 0.04072, N = 3SE +/- 0.03338, N = 15SE +/- 0.04801, N = 3SE +/- 0.00807, N = 3SE +/- 0.01801, N = 3SE +/- 0.01381, N = 310.588304.062724.2035510.806603.924553.910063.987353.129043.680012.667112.239223.617923.542424.006753.958192.887344.052702.970944.058813.065002.159802.817391. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: T5 Encoder - Device: CPU - Executor: ParallelXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P100200300400500SE +/- 1.28, N = 3SE +/- 0.69, N = 3SE +/- 0.65, N = 3SE +/- 1.08, N = 3SE +/- 1.96, N = 3SE +/- 2.24, N = 3SE +/- 0.64, N = 3SE +/- 3.02, N = 3SE +/- 2.43, N = 3SE +/- 0.55, N = 3SE +/- 3.58, N = 3SE +/- 0.65, N = 3SE +/- 2.25, N = 3SE +/- 1.11, N = 3SE +/- 1.67, N = 15SE +/- 1.74, N = 3SE +/- 2.44, N = 3SE +/- 3.48, N = 15SE +/- 2.94, N = 3SE +/- 0.86, N = 3SE +/- 3.84, N = 3SE +/- 1.73, N = 394.42246.04237.8092.51254.73255.67250.63319.45271.62374.75446.30276.21282.25249.48252.67346.21246.68337.00246.34326.14462.86354.751. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ASKAP

ASKAP is a set of benchmarks from the Australian SKA Pathfinder. The principal ASKAP benchmarks are the Hogbom Clean Benchmark (tHogbomClean) and Convolutional Resamping Benchmark (tConvolve) as well as some previous ASKAP benchmarks being included as well for OpenCL and CUDA execution of tConvolve. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMpix/sec, More Is BetterASKAP 1.0Test: tConvolve MPI - GriddingEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P30K60K90K120K150KSE +/- 0.00, N = 3SE +/- 86.77, N = 3SE +/- 1180.69, N = 14SE +/- 685.49, N = 12SE +/- 2386.93, N = 4SE +/- 1853.72, N = 3SE +/- 581.17, N = 3SE +/- 19579.11, N = 3SE +/- 47.29, N = 3SE +/- 46.25, N = 3SE +/- 802.88, N = 3SE +/- 0.00, N = 3SE +/- 194.30, N = 3SE +/- 99.83, N = 3SE +/- 412.68, N = 4SE +/- 76.67, N = 3SE +/- 219.20, N = 3SE +/- 1080.03, N = 316399.7016573.2054066.0028854.3086757.7046233.7074389.00121976.909623.7714497.3045195.1023250.2042939.2021766.5041773.0021314.2037265.9072004.001. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp

OpenBenchmarking.orgMpix/sec, More Is BetterASKAP 1.0Test: tConvolve MPI - DegriddingEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P30K60K90K120K150KSE +/- 69.57, N = 3SE +/- 44.43, N = 3SE +/- 1077.92, N = 14SE +/- 598.81, N = 12SE +/- 882.91, N = 4SE +/- 189.10, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 64.71, N = 3SE +/- 62.13, N = 3SE +/- 0.00, N = 3SE +/- 76.47, N = 3SE +/- 143.60, N = 3SE +/- 0.00, N = 3SE +/- 378.22, N = 4SE +/- 93.91, N = 3SE +/- 153.57, N = 3SE +/- 480.95, N = 315903.4016704.4052639.5028476.6081025.8042172.4064260.20123480.008429.1312800.4040368.6020561.4036900.5018522.0034614.1017891.6031177.2059139.201. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp

Helsing

Helsing is an open-source POSIX vampire number generator. This test profile measures the time it takes to generate vampire numbers between varying numbers of digits. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterHelsing 1.0-betaDigit Range: 14 digitXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P4080120160200SE +/- 0.01, N = 3SE +/- 0.10, N = 3SE +/- 0.12, N = 3SE +/- 0.11, N = 3SE +/- 0.06, N = 3SE +/- 0.27, N = 3SE +/- 0.32, N = 3SE +/- 0.02, N = 3SE +/- 0.38, N = 5SE +/- 0.10, N = 3SE +/- 0.14, N = 3SE +/- 0.42, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.42, N = 3SE +/- 0.12, N = 3SE +/- 0.11, N = 3SE +/- 0.53, N = 3SE +/- 0.06, N = 3SE +/- 0.26, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 353.02103.86115.4658.96120.56105.6826.7848.8533.6862.1756.9130.69165.7982.9658.25107.2465.03123.8350.8393.3589.0748.091. (CC) gcc options: -O2 -pthread

OSPRay Studio

Intel OSPRay Studio is an open-source, interactive visualization and ray-tracing software package. OSPRay Studio makes use of Intel OSPRay, a portable ray-tracing engine for high-performance, high-fidelity visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P12K24K36K48K60KSE +/- 429.71, N = 4SE +/- 371.33, N = 3SE +/- 199.93, N = 3SE +/- 409.89, N = 15SE +/- 31.02, N = 3SE +/- 250.73, N = 3SE +/- 12.34, N = 3SE +/- 33.33, N = 3SE +/- 32.74, N = 3SE +/- 44.33, N = 3SE +/- 39.30, N = 3SE +/- 17.16, N = 3SE +/- 148.46, N = 3SE +/- 53.03, N = 3SE +/- 51.39, N = 3SE +/- 83.47, N = 3SE +/- 72.42, N = 3SE +/- 28.06, N = 3SE +/- 34.10, N = 3SE +/- 62.46, N = 3SE +/- 37.49, N = 3SE +/- 7.13, N = 3350814687552083382284251338811841315286104281889616603891654456304421535733790166453705514138313802312512124

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P14K28K42K56K70KSE +/- 301.00, N = 12SE +/- 26.58, N = 3SE +/- 500.31, N = 3SE +/- 51.90, N = 3SE +/- 197.99, N = 3SE +/- 111.72, N = 3SE +/- 16.90, N = 3SE +/- 21.05, N = 3SE +/- 27.79, N = 3SE +/- 5.55, N = 3SE +/- 24.66, N = 3SE +/- 32.79, N = 3SE +/- 62.75, N = 3SE +/- 28.75, N = 3SE +/- 10.97, N = 3SE +/- 74.33, N = 3SE +/- 25.12, N = 3SE +/- 36.47, N = 3SE +/- 29.96, N = 3SE +/- 61.20, N = 3SE +/- 26.00, N = 3SE +/- 8.00, N = 339283525015765743906488444537710015181291242722305195351051463035348661811139238197014283716837366493199314358

CloverLeaf

CloverLeaf is a Lagrangian-Eulerian hydrodynamics benchmark. This test profile currently makes use of CloverLeaf's OpenMP version. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeaf 1.3Input: clover_bm64_shortXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1428425670SE +/- 0.33, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.33, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.30, N = 3SE +/- 2.07, N = 12SE +/- 1.11, N = 12SE +/- 2.15, N = 15SE +/- 1.81, N = 15SE +/- 0.23, N = 3SE +/- 0.03, N = 3SE +/- 0.31, N = 3SE +/- 0.40, N = 4SE +/- 0.17, N = 3SE +/- 0.31, N = 15SE +/- 0.15, N = 3SE +/- 0.24, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.45, N = 328.9238.0138.0128.9957.5457.3827.7448.3630.0546.5042.1722.8360.8935.2932.4442.2232.2541.4326.5839.4839.3831.901. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp

OSPRay Studio

Intel OSPRay Studio is an open-source, interactive visualization and ray-tracing software package. OSPRay Studio makes use of Intel OSPRay, a portable ray-tracing engine for high-performance, high-fidelity visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P8001600240032004000SE +/- 16.65, N = 5SE +/- 3.51, N = 3SE +/- 6.23, N = 3SE +/- 4.67, N = 3SE +/- 3.06, N = 3SE +/- 1.00, N = 3SE +/- 0.67, N = 3SE +/- 0.88, N = 3SE +/- 0.58, N = 3SE +/- 1.00, N = 3SE +/- 1.53, N = 3SE +/- 1.45, N = 3SE +/- 3.79, N = 3SE +/- 2.73, N = 3SE +/- 0.33, N = 3SE +/- 1.20, N = 3SE +/- 2.65, N = 3SE +/- 1.20, N = 3SE +/- 0.88, N = 3SE +/- 0.88, N = 3SE +/- 1.45, N = 3SE +/- 0.00, N = 3163124722731183226492421630113078013911225660361618331143212312372357106319771709898

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1530456075SE +/- 0.04, N = 3SE +/- 0.10, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.26, N = 15SE +/- 0.02, N = 3SE +/- 0.11, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.21, N = 3SE +/- 0.05, N = 3SE +/- 0.15, N = 3SE +/- 0.03, N = 3SE +/- 0.14, N = 3SE +/- 0.02, N = 3SE +/- 0.28, N = 337.1735.3038.8741.5034.7631.9915.8438.2114.3027.4621.6311.9531.0516.8462.1162.5356.7155.7465.0255.9955.0757.131. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P9001800270036004500SE +/- 2.23, N = 3SE +/- 2.82, N = 3SE +/- 2.69, N = 3SE +/- 2.08, N = 3SE +/- 0.81, N = 3SE +/- 0.65, N = 3SE +/- 5.40, N = 3SE +/- 11.41, N = 15SE +/- 3.90, N = 3SE +/- 6.85, N = 3SE +/- 1.09, N = 3SE +/- 5.33, N = 3SE +/- 0.62, N = 3SE +/- 3.75, N = 3SE +/- 1.74, N = 3SE +/- 2.94, N = 3SE +/- 1.56, N = 3SE +/- 2.29, N = 3SE +/- 0.66, N = 3SE +/- 2.65, N = 3SE +/- 0.47, N = 3SE +/- 11.53, N = 31933.081018.18924.901731.50918.53998.094032.661671.233353.731743.492212.414013.96642.441186.241801.89894.871691.79860.641843.611068.431159.662237.691. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: ParallelXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P60120180240300SE +/- 1.74, N = 15SE +/- 0.89, N = 3SE +/- 0.84, N = 3SE +/- 3.87, N = 3SE +/- 0.35, N = 3SE +/- 0.17, N = 3SE +/- 0.45, N = 3SE +/- 0.13, N = 3SE +/- 0.25, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.22, N = 3SE +/- 0.06, N = 3SE +/- 0.37, N = 3SE +/- 0.13, N = 3SE +/- 0.12, N = 3SE +/- 0.11, N = 3SE +/- 0.17, N = 3SE +/- 0.11, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.28, N = 3266.10146.78160.13285.9938.1036.6183.7740.6366.6334.1633.5066.4422.5925.9834.2523.6630.4724.5534.3121.3416.5531.791. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: ArcFace ResNet-100 - Device: CPU - Executor: ParallelXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1428425670SE +/- 0.02474, N = 15SE +/- 0.04131, N = 3SE +/- 0.03255, N = 3SE +/- 0.04782, N = 3SE +/- 0.23936, N = 3SE +/- 0.12474, N = 3SE +/- 0.06474, N = 3SE +/- 0.07716, N = 3SE +/- 0.05569, N = 3SE +/- 0.03174, N = 3SE +/- 0.04145, N = 3SE +/- 0.05013, N = 3SE +/- 0.10899, N = 3SE +/- 0.55506, N = 3SE +/- 0.11212, N = 3SE +/- 0.20934, N = 3SE +/- 0.11901, N = 3SE +/- 0.27882, N = 3SE +/- 0.09239, N = 3SE +/- 0.09731, N = 3SE +/- 0.27014, N = 3SE +/- 0.27122, N = 33.760036.813306.245213.4978526.2475027.3128011.9382024.6095015.0082029.2690029.8493015.0516044.2748038.5025029.1955042.2711032.8141040.7289029.1487046.8491060.4094031.458901. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P4080120160200SE +/- 0.33, N = 3SE +/- 0.10, N = 3SE +/- 0.34, N = 3SE +/- 0.13, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.46, N = 3SE +/- 0.45, N = 15SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.00, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3157.28153.76172.72180.2945.7141.3839.8638.8536.9034.9232.0033.1862.6460.9025.7224.9424.0023.1225.1236.2021.8722.961. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P14002800420056007000SE +/- 3.81, N = 3SE +/- 0.61, N = 3SE +/- 1.73, N = 3SE +/- 1.20, N = 3SE +/- 0.47, N = 3SE +/- 3.51, N = 3SE +/- 14.68, N = 3SE +/- 7.27, N = 3SE +/- 9.83, N = 3SE +/- 4.84, N = 3SE +/- 4.06, N = 3SE +/- 13.59, N = 3SE +/- 4.60, N = 3SE +/- 9.58, N = 15SE +/- 2.81, N = 3SE +/- 4.55, N = 3SE +/- 1.09, N = 3SE +/- 3.41, N = 3SE +/- 2.46, N = 3SE +/- 1.46, N = 3SE +/- 0.73, N = 3SE +/- 3.43, N = 31826.82934.97832.291593.881396.781542.616400.943280.255178.292739.012986.335766.62637.761313.394351.592243.843998.022074.304744.051643.432924.665570.631. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P510152025SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.12, N = 15SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 314.3014.0115.1116.2811.4810.785.0010.974.468.587.854.089.264.5420.2419.4417.1916.3321.7317.8413.7314.671. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P3K6K9K12K15KSE +/- 5.08, N = 3SE +/- 2.61, N = 3SE +/- 1.12, N = 3SE +/- 8.74, N = 3SE +/- 2.89, N = 3SE +/- 2.22, N = 3SE +/- 1.24, N = 3SE +/- 66.33, N = 15SE +/- 4.21, N = 3SE +/- 8.39, N = 3SE +/- 3.54, N = 3SE +/- 4.04, N = 3SE +/- 1.06, N = 3SE +/- 2.84, N = 3SE +/- 8.70, N = 3SE +/- 5.68, N = 3SE +/- 4.11, N = 3SE +/- 8.09, N = 3SE +/- 11.51, N = 3SE +/- 0.81, N = 3SE +/- 0.73, N = 3SE +/- 6.25, N = 34992.782553.552366.834376.092763.482943.0812750.595778.5110708.915528.156017.1911735.422120.334390.815525.562877.325576.862935.475483.813325.904656.928719.371. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: ParallelXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1326395265SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.71, N = 3SE +/- 0.33, N = 3SE +/- 0.18, N = 3SE +/- 0.35, N = 7SE +/- 0.43, N = 4SE +/- 0.07, N = 3SE +/- 0.41, N = 3SE +/- 0.22, N = 3SE +/- 0.15, N = 3SE +/- 0.30, N = 3SE +/- 0.07, N = 3SE +/- 0.32, N = 3SE +/- 0.08, N = 3SE +/- 0.55, N = 3SE +/- 0.13, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 354.2538.4242.9056.7735.8835.7938.0036.4539.0233.5234.8141.5735.6038.5240.5235.1140.4535.0733.2930.9229.9631.531. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: ParallelXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P816243240SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.22, N = 3SE +/- 0.25, N = 3SE +/- 0.14, N = 3SE +/- 0.24, N = 7SE +/- 0.33, N = 4SE +/- 0.05, N = 3SE +/- 0.36, N = 3SE +/- 0.19, N = 3SE +/- 0.08, N = 3SE +/- 0.24, N = 3SE +/- 0.05, N = 3SE +/- 0.19, N = 3SE +/- 0.07, N = 3SE +/- 0.34, N = 3SE +/- 0.10, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 318.4326.0323.3117.6227.8727.9426.3327.4525.6329.8428.7324.0528.0925.9624.6828.4824.7328.5230.0432.3433.3831.711. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 512 - Model: AlexNetXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P400800120016002000SE +/- 38.99, N = 12SE +/- 0.86, N = 3SE +/- 2.03, N = 3SE +/- 20.10, N = 12SE +/- 0.57, N = 3SE +/- 0.35, N = 3SE +/- 7.97, N = 3SE +/- 4.07, N = 3SE +/- 12.71, N = 3SE +/- 0.67, N = 3SE +/- 0.49, N = 3SE +/- 23.15, N = 4SE +/- 1.47, N = 3SE +/- 5.91, N = 3SE +/- 8.55, N = 3SE +/- 5.13, N = 3SE +/- 17.88, N = 4SE +/- 3.89, N = 3SE +/- 18.52, N = 3SE +/- 0.51, N = 3SE +/- 1.84, N = 3SE +/- 19.23, N = 31064.18732.79677.40979.89796.82875.231876.661620.531862.791363.331392.911897.64883.001470.461677.621108.951604.111047.961899.641278.451486.122039.63

QuantLib

QuantLib is an open-source library/framework around quantitative finance for modeling, trading and risk management scenarios. QuantLib is written in C++ with Boost and its built-in benchmark used reports the QuantLib Benchmark Index benchmark score. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Multi-ThreadedXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P160K320K480K640K800KSE +/- 1647.70, N = 3SE +/- 846.02, N = 3SE +/- 306.14, N = 3SE +/- 1610.78, N = 3SE +/- 86.28, N = 3SE +/- 82.80, N = 3SE +/- 804.57, N = 3SE +/- 156.35, N = 3SE +/- 713.18, N = 3SE +/- 86.78, N = 3SE +/- 412.72, N = 3SE +/- 1065.76, N = 3SE +/- 395.04, N = 3SE +/- 457.00, N = 3SE +/- 160.59, N = 3SE +/- 40.48, N = 3SE +/- 286.86, N = 3SE +/- 155.19, N = 3SE +/- 362.38, N = 3SE +/- 105.60, N = 3SE +/- 63.14, N = 3SE +/- 248.00, N = 3519392.2262432.6233836.3456271.0153920.8172566.8759922.1374413.5593246.9294183.2319827.2644091.091036.5182366.9316359.2162727.4288129.1143755.3350187.5179647.5195648.8380867.51. (CXX) g++ options: -O3 -march=native -fPIE -pie

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P160320480640800SE +/- 1.63, N = 3SE +/- 1.47, N = 3SE +/- 0.99, N = 3SE +/- 1.58, N = 3SE +/- 0.12, N = 3SE +/- 0.18, N = 3SE +/- 0.03, N = 3SE +/- 0.18, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.43, N = 3SE +/- 0.43, N = 3SE +/- 3.13, N = 3SE +/- 0.22, N = 3SE +/- 0.35, N = 3SE +/- 0.47, N = 3SE +/- 0.40, N = 3SE +/- 0.15, N = 3SE +/- 0.00, N = 3SE +/- 0.28, N = 3SE +/- 0.69, N = 3SE +/- 0.33, N = 3630.23618.97692.79719.83654.83592.22275.53551.07253.63510.10471.98233.63415.89207.84278.52257.50256.63236.52283.11356.38224.64234.241. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P120240360480600SE +/- 0.18, N = 3SE +/- 0.15, N = 3SE +/- 0.07, N = 3SE +/- 0.18, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.12, N = 3SE +/- 0.41, N = 3SE +/- 0.36, N = 3SE +/- 0.10, N = 3SE +/- 0.54, N = 3SE +/- 0.41, N = 3SE +/- 0.58, N = 3SE +/- 0.14, N = 3SE +/- 0.01, N = 3SE +/- 0.12, N = 3SE +/- 0.69, N = 3SE +/- 0.77, N = 3113.6858.0651.8599.7248.7353.89231.83115.78188.7493.99101.51205.0347.9996.08401.45217.11373.50202.59423.18167.83284.64545.211. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OSPRay

Intel OSPRay is a portable ray-tracing engine for high-performance, high-fidelity scientific visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1428425670SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.23, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.14, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.16, N = 3SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 323.1213.4012.1721.2216.9218.4763.8537.7452.6730.6134.6460.3711.8622.5139.3422.3635.9319.9142.8224.6427.1048.76

Blender

Blender is an open-source 3D creation and modeling software project. This test is of Blender's Cycles performance with various sample files. GPU computing via NVIDIA OptiX and NVIDIA CUDA is currently supported as well as HIP for AMD Radeon GPUs and Intel oneAPI for Intel Graphics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Pabellon Barcelona - Compute: CPU-OnlyXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P306090120150SE +/- 0.17, N = 3SE +/- 0.25, N = 3SE +/- 0.13, N = 3SE +/- 0.29, N = 3SE +/- 0.05, N = 3SE +/- 0.16, N = 3SE +/- 0.13, N = 3SE +/- 0.13, N = 3SE +/- 0.10, N = 3SE +/- 0.04, N = 3SE +/- 0.16, N = 3SE +/- 0.11, N = 3SE +/- 0.15, N = 3SE +/- 0.26, N = 3SE +/- 0.20, N = 3SE +/- 0.44, N = 3SE +/- 0.08, N = 3SE +/- 0.31, N = 3SE +/- 0.26, N = 3SE +/- 0.15, N = 3SE +/- 0.09, N = 3SE +/- 0.06, N = 331.2860.1165.6735.1194.4185.1221.6639.8326.3548.8844.8723.84150.3976.1051.2997.8055.26106.9646.3887.9280.2941.85

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P612182430SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.11, N = 3SE +/- 0.00, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 324.2423.4925.3326.1212.6711.226.2711.355.209.478.484.9118.089.8214.4213.5913.3412.5415.0416.5011.1711.691. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P2K4K6K8K10KSE +/- 3.86, N = 3SE +/- 2.87, N = 3SE +/- 2.55, N = 3SE +/- 5.02, N = 3SE +/- 3.87, N = 3SE +/- 2.97, N = 3SE +/- 4.91, N = 3SE +/- 54.09, N = 3SE +/- 6.56, N = 3SE +/- 25.68, N = 3SE +/- 18.02, N = 3SE +/- 10.88, N = 3SE +/- 0.24, N = 3SE +/- 1.00, N = 3SE +/- 3.66, N = 3SE +/- 9.37, N = 3SE +/- 4.05, N = 3SE +/- 7.17, N = 3SE +/- 8.98, N = 3SE +/- 4.52, N = 3SE +/- 4.97, N = 3SE +/- 3.37, N = 32957.691525.261414.862743.392506.102830.1210182.165594.819203.195024.325608.079752.891100.182030.977689.324093.737127.283802.617862.583606.125725.0310934.171. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: ParallelXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P306090120150SE +/- 0.21, N = 3SE +/- 0.31, N = 3SE +/- 0.10, N = 3SE +/- 0.90, N = 3SE +/- 1.29, N = 4SE +/- 1.08, N = 3SE +/- 0.30, N = 3SE +/- 0.60, N = 3SE +/- 0.65, N = 3SE +/- 0.60, N = 3SE +/- 0.57, N = 3SE +/- 0.60, N = 3SE +/- 0.49, N = 3SE +/- 0.56, N = 3SE +/- 0.23, N = 3SE +/- 0.31, N = 3SE +/- 0.50, N = 3SE +/- 0.23, N = 3SE +/- 0.11, N = 3SE +/- 0.18, N = 3SE +/- 0.57, N = 3SE +/- 0.12, N = 3140.07105.22116.64149.99112.76102.05125.24103.60113.5281.6081.43114.1659.9466.9173.9763.5472.8061.2568.8362.1350.8364.791. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: bertsquad-12 - Device: CPU - Executor: ParallelXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P510152025SE +/- 0.01071, N = 3SE +/- 0.02804, N = 3SE +/- 0.00728, N = 3SE +/- 0.03979, N = 3SE +/- 0.10146, N = 4SE +/- 0.10485, N = 3SE +/- 0.01907, N = 3SE +/- 0.05587, N = 3SE +/- 0.05052, N = 3SE +/- 0.09004, N = 3SE +/- 0.08493, N = 3SE +/- 0.04604, N = 3SE +/- 0.13407, N = 3SE +/- 0.12404, N = 3SE +/- 0.04124, N = 3SE +/- 0.07567, N = 3SE +/- 0.09371, N = 3SE +/- 0.06023, N = 3SE +/- 0.02421, N = 3SE +/- 0.04566, N = 3SE +/- 0.21736, N = 3SE +/- 0.02832, N = 37.139179.503538.572866.667188.871449.800907.984029.652968.8093012.2549012.280708.7597116.6863014.9460013.5190015.7394013.7366016.3251014.5280016.0956019.6773015.434101. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P612182430SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.16, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 316.7316.3617.8118.759.468.594.378.033.987.236.933.7823.2524.397.977.767.327.137.729.796.726.951. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P4K8K12K16K20KSE +/- 4.90, N = 3SE +/- 11.75, N = 3SE +/- 20.57, N = 3SE +/- 6.55, N = 3SE +/- 1.89, N = 3SE +/- 3.18, N = 3SE +/- 10.13, N = 3SE +/- 4.98, N = 3SE +/- 7.03, N = 3SE +/- 4.14, N = 3SE +/- 4.58, N = 3SE +/- 7.99, N = 3SE +/- 1.47, N = 3SE +/- 2.06, N = 3SE +/- 7.22, N = 3SE +/- 0.46, N = 3SE +/- 3.67, N = 3SE +/- 3.72, N = 3SE +/- 4.14, N = 3SE +/- 3.97, N = 3SE +/- 5.57, N = 3SE +/- 7.74, N = 34259.992179.992006.003787.943355.733692.6714601.527862.6512024.186554.126846.7912665.621698.053263.0314033.947207.7413102.286717.6515519.925943.669515.8618375.631. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

PyTorch

This is a benchmark of PyTorch making use of pytorch-benchmark [https://github.com/LukasHedegaard/pytorch-benchmark]. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 1 - Model: ResNet-50Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P20406080100SE +/- 0.22, N = 4SE +/- 0.45, N = 4SE +/- 0.12, N = 3SE +/- 0.20, N = 3SE +/- 0.30, N = 3SE +/- 0.12, N = 3SE +/- 0.06, N = 3SE +/- 0.12, N = 3SE +/- 0.28, N = 15SE +/- 0.15, N = 3SE +/- 0.15, N = 3SE +/- 0.37, N = 12SE +/- 0.22, N = 3SE +/- 0.20, N = 3SE +/- 0.44, N = 3SE +/- 0.36, N = 3SE +/- 0.38, N = 8SE +/- 0.28, N = 3SE +/- 0.49, N = 3SE +/- 0.03, N = 3SE +/- 0.16, N = 3SE +/- 0.52, N = 317.9135.8532.4516.4540.9741.1114.9031.6219.3440.4541.1719.8461.3242.6435.4648.5946.4950.9935.5351.4677.5245.69

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P714212835SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 4SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 324.7724.2527.0128.2413.1111.7811.2010.9210.1710.099.429.258.588.272.792.672.532.502.503.582.362.481. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P10K20K30K40K50KSE +/- 19.55, N = 3SE +/- 6.61, N = 3SE +/- 7.59, N = 3SE +/- 12.93, N = 3SE +/- 1.69, N = 3SE +/- 0.41, N = 3SE +/- 11.27, N = 3SE +/- 5.50, N = 3SE +/- 147.69, N = 3SE +/- 4.46, N = 3SE +/- 11.71, N = 3SE +/- 110.20, N = 3SE +/- 5.62, N = 3SE +/- 6.41, N = 3SE +/- 233.95, N = 3SE +/- 21.27, N = 3SE +/- 80.58, N = 3SE +/- 234.43, N = 4SE +/- 53.98, N = 3SE +/- 2.71, N = 3SE +/- 47.41, N = 3SE +/- 39.08, N = 311390.045866.635278.4610020.914830.015366.7922499.0311508.1918666.169356.719997.8920550.934502.749657.0840032.8120910.5337710.6019183.8347654.9515943.1726943.4248122.161. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: ParallelXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P48121620SE +/- 0.01174, N = 3SE +/- 0.01181, N = 3SE +/- 0.00515, N = 3SE +/- 0.11771, N = 3SE +/- 0.02580, N = 3SE +/- 0.03809, N = 3SE +/- 0.01997, N = 3SE +/- 0.00921, N = 3SE +/- 0.02885, N = 3SE +/- 0.00351, N = 3SE +/- 0.02436, N = 3SE +/- 0.03939, N = 3SE +/- 0.01980, N = 3SE +/- 0.06784, N = 3SE +/- 0.01417, N = 3SE +/- 0.07483, N = 3SE +/- 0.08283, N = 3SE +/- 0.02823, N = 3SE +/- 0.03717, N = 3SE +/- 0.01428, N = 3SE +/- 0.00434, N = 3SE +/- 0.02114, N = 316.541807.135357.5958917.055307.705117.7452110.066607.280879.124526.377806.184789.066075.543796.507477.308225.290277.348485.227816.906195.215204.016875.109481. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: GPT-2 - Device: CPU - Executor: ParallelXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P50100150200250SE +/- 0.04, N = 3SE +/- 0.23, N = 3SE +/- 0.09, N = 3SE +/- 0.40, N = 3SE +/- 0.43, N = 3SE +/- 0.64, N = 3SE +/- 0.19, N = 3SE +/- 0.17, N = 3SE +/- 0.35, N = 3SE +/- 0.08, N = 3SE +/- 0.64, N = 3SE +/- 0.48, N = 3SE +/- 0.64, N = 3SE +/- 1.59, N = 3SE +/- 0.26, N = 3SE +/- 2.63, N = 3SE +/- 1.53, N = 3SE +/- 1.04, N = 3SE +/- 0.78, N = 3SE +/- 0.53, N = 3SE +/- 0.27, N = 3SE +/- 0.81, N = 360.39140.03131.5458.58129.65128.9899.22137.19109.46156.61161.50110.17180.23153.54136.69188.93135.98191.11144.64191.56248.68195.451. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P510152025SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 316.9816.4118.2019.237.606.776.606.255.985.855.415.346.565.936.025.775.555.275.726.435.195.181. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P8K16K24K32K40KSE +/- 41.98, N = 3SE +/- 0.67, N = 3SE +/- 2.54, N = 3SE +/- 30.29, N = 3SE +/- 7.49, N = 3SE +/- 2.45, N = 3SE +/- 10.72, N = 3SE +/- 8.57, N = 3SE +/- 46.87, N = 3SE +/- 2.59, N = 3SE +/- 7.70, N = 3SE +/- 15.46, N = 3SE +/- 15.90, N = 3SE +/- 16.45, N = 3SE +/- 3.89, N = 3SE +/- 7.39, N = 3SE +/- 12.64, N = 3SE +/- 18.13, N = 3SE +/- 12.64, N = 3SE +/- 5.45, N = 3SE +/- 4.30, N = 3SE +/- 17.69, N = 316394.068536.397721.0014551.128279.639256.1138546.6619917.5431974.8816038.9017230.3535809.595913.0413467.2818561.919686.3917252.279087.1220937.589004.2312317.9424676.861. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: ParallelXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P50100150200250SE +/- 1.41, N = 3SE +/- 0.52, N = 3SE +/- 0.91, N = 3SE +/- 2.49, N = 3SE +/- 0.53, N = 3SE +/- 0.01, N = 3SE +/- 2.38, N = 3SE +/- 0.20, N = 3SE +/- 0.61, N = 3SE +/- 0.20, N = 3SE +/- 0.05, N = 3SE +/- 0.15, N = 3SE +/- 0.36, N = 3SE +/- 0.46, N = 3SE +/- 0.13, N = 3SE +/- 0.01, N = 3SE +/- 0.74, N = 3SE +/- 0.22, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 3SE +/- 0.30, N = 3SE +/- 0.57, N = 3219.17129.94140.14217.93118.02114.17179.99115.79157.51102.19102.04158.2756.5870.3479.3861.0176.4261.8378.4055.1247.9070.441. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: yolov4 - Device: CPU - Executor: ParallelXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P510152025SE +/- 0.02942, N = 3SE +/- 0.03075, N = 3SE +/- 0.04609, N = 3SE +/- 0.05214, N = 3SE +/- 0.03807, N = 3SE +/- 0.00112, N = 3SE +/- 0.07368, N = 3SE +/- 0.01474, N = 3SE +/- 0.02467, N = 3SE +/- 0.01934, N = 3SE +/- 0.00491, N = 3SE +/- 0.00606, N = 3SE +/- 0.11211, N = 3SE +/- 0.09305, N = 3SE +/- 0.02010, N = 3SE +/- 0.00279, N = 3SE +/- 0.12795, N = 3SE +/- 0.05802, N = 3SE +/- 0.01439, N = 3SE +/- 0.01672, N = 3SE +/- 0.13074, N = 3SE +/- 0.11392, N = 34.562787.695837.135874.589608.472838.758145.557678.635946.348919.785169.800086.3182817.6747014.2169012.5974016.3898013.0869016.1742012.7546018.1413020.8795014.198001. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

GraphicsMagick

This is a test of GraphicsMagick with its OpenMP implementation that performs various imaging tests on a sample high resolution (currently 15400 x 6940) JPEG image. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.43Operation: Noise-GaussianXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P4080120160200SE +/- 1.44, N = 4SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.58, N = 3SE +/- 0.58, N = 3SE +/- 0.67, N = 3SE +/- 0.58, N = 3SE +/- 0.00, N = 3SE +/- 0.67, N = 3SE +/- 0.67, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 1.15, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.88, N = 31261551451181201231641511781601651791211531641581501501821581711941. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp

GPAW

GPAW is a density-functional theory (DFT) Python code based on the projector-augmented wave (PAW) method and the atomic simulation environment (ASE). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterGPAW 23.6Input: Carbon NanotubeEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P20406080100SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.18, N = 3SE +/- 0.14, N = 3SE +/- 0.29, N = 15SE +/- 0.21, N = 3SE +/- 0.11, N = 3SE +/- 0.30, N = 15SE +/- 0.12, N = 3SE +/- 0.60, N = 3SE +/- 0.27, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.55, N = 3SE +/- 0.24, N = 3SE +/- 0.12, N = 3SE +/- 0.10, N = 366.7163.8027.1533.1225.8434.8730.0024.1376.1848.4543.9148.4942.8754.3841.5647.7843.0538.051. (CC) gcc options: -shared -lxc -lblas -lmpi

GraphicsMagick

This is a test of GraphicsMagick with its OpenMP implementation that performs various imaging tests on a sample high resolution (currently 15400 x 6940) JPEG image. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.43Operation: SharpenXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P80160240320400SE +/- 0.67, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.88, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 3.00, N = 3SE +/- 0.33, N = 3SE +/- 1.20, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.88, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 1.20, N = 3SE +/- 0.00, N = 3SE +/- 1.67, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 1.67, N = 3381281253336105112310207262173201297791442271301991142651571672841. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp

Timed Linux Kernel Compilation

This test times how long it takes to build the Linux kernel in a default configuration (defconfig) for the architecture being tested or alternatively an allmodconfig for building all possible kernel modules for the build. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.8Build: defconfigXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1326395265SE +/- 0.28, N = 8SE +/- 0.37, N = 6SE +/- 0.39, N = 6SE +/- 0.22, N = 14SE +/- 0.54, N = 4SE +/- 0.50, N = 4SE +/- 0.28, N = 7SE +/- 0.44, N = 3SE +/- 0.33, N = 3SE +/- 0.43, N = 3SE +/- 0.46, N = 3SE +/- 0.17, N = 13SE +/- 0.33, N = 3SE +/- 0.42, N = 5SE +/- 0.31, N = 5SE +/- 0.57, N = 3SE +/- 0.40, N = 4SE +/- 0.59, N = 3SE +/- 0.43, N = 3SE +/- 0.55, N = 3SE +/- 0.39, N = 4SE +/- 0.23, N = 732.6637.6441.1035.5546.3544.2830.6838.5327.6834.5732.8925.8755.7439.4130.5340.5032.1443.4229.9839.4534.5925.87

GraphicsMagick

This is a test of GraphicsMagick with its OpenMP implementation that performs various imaging tests on a sample high resolution (currently 15400 x 6940) JPEG image. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.43Operation: EnhancedXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P90180270360450SE +/- 1.53, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 1.20, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 1.45, N = 3SE +/- 1.00, N = 3SE +/- 0.00, N = 3SE +/- 2.60, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 1.15, N = 33892992703501631724033043682643004081232153011812691603422162283741. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp

ONNX Runtime

ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: ParallelXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P48121620SE +/- 0.02665, N = 3SE +/- 0.00657, N = 3SE +/- 0.00867, N = 3SE +/- 0.06373, N = 3SE +/- 0.07856, N = 3SE +/- 0.05765, N = 3SE +/- 0.13507, N = 3SE +/- 0.02898, N = 3SE +/- 0.06993, N = 3SE +/- 0.03015, N = 3SE +/- 0.08338, N = 3SE +/- 0.05412, N = 3SE +/- 0.01290, N = 3SE +/- 0.02822, N = 3SE +/- 0.02155, N = 3SE +/- 0.01694, N = 3SE +/- 0.03854, N = 3SE +/- 0.02534, N = 3SE +/- 0.02062, N = 3SE +/- 0.05586, N = 3SE +/- 0.03569, N = 3SE +/- 0.02988, N = 315.2784013.1789014.4761016.5828010.3977010.3026012.8093010.5537011.502409.089559.1852411.458005.671755.597635.886285.260755.749215.109145.292874.866044.263524.654311. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.17Model: super-resolution-10 - Device: CPU - Executor: ParallelXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P50100150200250SE +/- 0.11, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.23, N = 3SE +/- 0.72, N = 3SE +/- 0.54, N = 3SE +/- 0.83, N = 3SE +/- 0.26, N = 3SE +/- 0.53, N = 3SE +/- 0.36, N = 3SE +/- 0.99, N = 3SE +/- 0.41, N = 3SE +/- 0.40, N = 3SE +/- 0.90, N = 3SE +/- 0.62, N = 3SE +/- 0.61, N = 3SE +/- 1.17, N = 3SE +/- 0.98, N = 3SE +/- 0.74, N = 3SE +/- 2.34, N = 3SE +/- 1.98, N = 3SE +/- 1.38, N = 365.4375.8769.0760.2996.1797.0578.0794.7486.92110.00108.8787.26176.29178.62169.85190.06173.91195.71188.89205.53234.54214.811. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

GraphicsMagick

This is a test of GraphicsMagick with its OpenMP implementation that performs various imaging tests on a sample high resolution (currently 15400 x 6940) JPEG image. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.43Operation: SwirlXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P150300450600750SE +/- 3.00, N = 3SE +/- 1.15, N = 3SE +/- 4.91, N = 3SE +/- 2.33, N = 3SE +/- 0.88, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 4.41, N = 3SE +/- 0.67, N = 3SE +/- 0.67, N = 3SE +/- 1.33, N = 3SE +/- 0.58, N = 3SE +/- 1.76, N = 3SE +/- 1.15, N = 3SE +/- 0.88, N = 3SE +/- 0.58, N = 35175665044743633795675355535115465832784035584325093946175025296891. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp

RocksDB

This is a benchmark of Meta/Facebook's RocksDB as an embeddable persistent key-value store for fast storage based on Google's LevelDB. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Random ReadXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P300M600M900M1200M1500MSE +/- 1897433.73, N = 3SE +/- 2130676.22, N = 3SE +/- 1336933.52, N = 3SE +/- 4448269.22, N = 3SE +/- 211259.57, N = 3SE +/- 206014.27, N = 3SE +/- 1154820.73, N = 3SE +/- 153963.59, N = 3SE +/- 599126.55, N = 3SE +/- 610621.13, N = 3SE +/- 326038.01, N = 3SE +/- 2927744.32, N = 3SE +/- 744772.41, N = 3SE +/- 704022.38, N = 3SE +/- 785893.13, N = 3SE +/- 86315.43, N = 3SE +/- 1120857.00, N = 3SE +/- 81327.78, N = 3SE +/- 1411218.60, N = 3SE +/- 3338569.32, N = 3SE +/- 1119855.47, N = 3SE +/- 82996.27, N = 312729075616453094835747495521115720742234992636266186537113520656457323545281514511040927294952331009110312091511255849532512341034737559462344699394055331732053461545250499982653661702975179465783928001. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

miniBUDE

MiniBUDE is a mini application for the the core computation of the Bristol University Docking Engine (BUDE). This test profile currently makes use of the OpenMP implementation of miniBUDE for CPU benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P70140210280350SE +/- 0.08, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 3.85, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 3SE +/- 0.93, N = 3SE +/- 1.71, N = 3SE +/- 2.28, N = 3SE +/- 0.11, N = 3SE +/- 0.75, N = 3SE +/- 0.93, N = 3SE +/- 0.96, N = 4SE +/- 1.48, N = 3SE +/- 0.31, N = 3SE +/- 0.99, N = 3SE +/- 0.31, N = 3SE +/- 0.03, N = 3SE +/- 1.93, N = 1586.8843.7339.3578.2497.98107.72288.54232.75291.28171.77187.68309.2249.2097.08133.9978.11127.8570.21140.8386.97108.12191.821. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P17003400510068008500SE +/- 1.96, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.82, N = 3SE +/- 0.10, N = 3SE +/- 0.13, N = 3SE +/- 96.25, N = 3SE +/- 0.20, N = 3SE +/- 2.03, N = 3SE +/- 23.15, N = 3SE +/- 42.85, N = 3SE +/- 57.10, N = 3SE +/- 2.69, N = 3SE +/- 18.66, N = 3SE +/- 23.14, N = 3SE +/- 23.93, N = 4SE +/- 36.96, N = 3SE +/- 7.81, N = 3SE +/- 24.63, N = 3SE +/- 7.77, N = 3SE +/- 0.70, N = 3SE +/- 48.20, N = 152172.101093.21983.711955.882449.452692.877213.435818.747281.964294.284692.117730.471230.082426.883349.761952.613196.121755.333520.712174.192703.094795.461. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

Coremark

This is a test of EEMBC CoreMark processor benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgIterations/Sec, More Is BetterCoremark 1.0CoreMark Size 666 - Iterations Per SecondXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P2M4M6M8M10MSE +/- 7619.10, N = 3SE +/- 40214.40, N = 15SE +/- 10294.77, N = 3SE +/- 9906.84, N = 3SE +/- 11678.22, N = 3SE +/- 1374.66, N = 3SE +/- 54771.53, N = 3SE +/- 4775.53, N = 3SE +/- 2306.54, N = 3SE +/- 10132.66, N = 3SE +/- 54326.71, N = 3SE +/- 76743.24, N = 3SE +/- 927.64, N = 3SE +/- 30163.42, N = 15SE +/- 20649.43, N = 3SE +/- 5202.86, N = 3SE +/- 7219.73, N = 3SE +/- 1747.99, N = 3SE +/- 12743.41, N = 3SE +/- 9256.47, N = 3SE +/- 4635.95, N = 3SE +/- 9700.21, N = 37302247.143340274.032915609.756575205.542069432.532274636.138171241.714525288.007975907.453926265.284152864.888448083.731218453.341839444.403279262.531855135.332993136.601614763.703902076.242194630.602369998.364966250.781. (CC) gcc options: -O2 -lrt" -lrt

srsRAN Project

srsRAN Project is a complete ORAN-native 5G RAN solution created by Software Radio Systems (SRS). The srsRAN Project radio suite was formerly known as srsLTE and can be used for building your own software-defined radio (SDR) 4G/5G mobile network. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240325Test: PDSCH Processor Benchmark, Throughput TotalXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P7K14K21K28K35KSE +/- 242.64, N = 3SE +/- 134.28, N = 4SE +/- 150.02, N = 4SE +/- 319.61, N = 3SE +/- 58.21, N = 3SE +/- 207.19, N = 5SE +/- 2115.57, N = 15SE +/- 237.63, N = 3SE +/- 526.01, N = 15SE +/- 357.13, N = 12SE +/- 348.28, N = 4SE +/- 343.97, N = 3SE +/- 44.42, N = 3SE +/- 308.01, N = 15SE +/- 490.54, N = 15SE +/- 281.72, N = 15SE +/- 175.78, N = 4SE +/- 938.95, N = 15SE +/- 312.17, N = 3SE +/- 236.27, N = 4SE +/- 298.34, N = 15SE +/- 356.81, N = 1533010.529804.427281.931677.219485.819375.929877.125194.622931.827695.229384.925977.413537.718943.611866.715081.030236.021286.630108.724688.526378.130547.61. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -fno-trapping-math -fno-math-errno -ldl

Blender

Blender is an open-source 3D creation and modeling software project. This test is of Blender's Cycles performance with various sample files. GPU computing via NVIDIA OptiX and NVIDIA CUDA is currently supported as well as HIP for AMD Radeon GPUs and Intel oneAPI for Intel Graphics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Classroom - Compute: CPU-OnlyXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P306090120150SE +/- 0.05, N = 3SE +/- 0.67, N = 3SE +/- 0.05, N = 3SE +/- 0.09, N = 3SE +/- 0.18, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.11, N = 3SE +/- 0.14, N = 3SE +/- 0.03, N = 3SE +/- 0.38, N = 3SE +/- 0.16, N = 3SE +/- 0.25, N = 3SE +/- 0.40, N = 3SE +/- 0.38, N = 3SE +/- 0.20, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.11, N = 3SE +/- 0.22, N = 324.6148.0752.4727.4175.2667.6716.8231.6521.1240.2635.6618.67124.6362.5440.3876.8744.7186.6735.9168.6163.6133.61

Aircrack-ng

Aircrack-ng is a tool for assessing WiFi/WLAN network security. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgk/s, More Is BetterAircrack-ng 1.7Xeon 6780EXeon 6766EEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P40K80K120K160K200KSE +/- 888.98, N = 3SE +/- 1379.58, N = 4SE +/- 319.60, N = 3SE +/- 338.71, N = 3SE +/- 714.86, N = 3SE +/- 207.11, N = 3SE +/- 1622.56, N = 3SE +/- 728.55, N = 3SE +/- 1234.47, N = 15SE +/- 1131.21, N = 15SE +/- 122.31, N = 3SE +/- 1027.07, N = 15SE +/- 36.42, N = 3SE +/- 1197.41, N = 15SE +/- 1953.08, N = 3SE +/- 840.59, N = 3SE +/- 773.70, N = 3116716.40114715.79141831.78153818.03177989.89186675.43206619.29101665.47159709.7565663.82134048.9683665.76117588.9953914.93147469.33153584.2064181.291. (CXX) g++ options: -std=gnu++17 -O3 -fvisibility=hidden -fcommon -rdynamic -lnl-3 -lnl-genl-3 -lpcre -lsqlite3 -lpthread -lz -lssl -lcrypto -lhwloc -ldl -lm -pthread

EPYC 9684X 2P: The test run did not produce a result.

EPYC 9654 2P: The test run did not produce a result.

EPYC 9754 2P: The test run did not produce a result.

Xeon 6766E 2P: The test run did not produce a result.

Xeon 6780E 2P: The test run did not produce a result.

WebP Image Encode

This is a test of Google's libwebp with the cwebp image encode utility and using a sample 6000x4000 pixel JPEG image as the input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Lossless, Highest CompressionXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P0.1350.270.4050.540.675SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.380.390.350.350.480.480.480.480.570.570.570.560.500.490.540.550.540.550.510.520.600.591. (CC) gcc options: -fvisibility=hidden -O2 -lm

libavif avifenc

This is a test of the AOMedia libavif library testing the encoding of a JPEG image to AV1 Image Format (AVIF). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 2Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P20406080100SE +/- 0.09, N = 3SE +/- 0.41, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 0.03, N = 3SE +/- 0.13, N = 3SE +/- 0.06, N = 3SE +/- 0.43, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.25, N = 3SE +/- 0.06, N = 3SE +/- 0.31, N = 3SE +/- 0.22, N = 3SE +/- 0.21, N = 3SE +/- 0.16, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.09, N = 371.9769.3476.4779.2042.6141.6641.9240.3535.4034.1534.0435.3252.2347.5138.1439.8838.6541.1337.3137.7534.7933.651. (CXX) g++ options: -O3 -fPIC -lm

srsRAN Project

srsRAN Project is a complete ORAN-native 5G RAN solution created by Software Radio Systems (SRS). The srsRAN Project radio suite was formerly known as srsLTE and can be used for building your own software-defined radio (SDR) 4G/5G mobile network. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240325Test: PUSCH Processor Benchmark, Throughput TotalXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P2K4K6K8K10KSE +/- 14.40, N = 3SE +/- 0.00, N = 3SE +/- 8.17, N = 3SE +/- 36.60, N = 3SE +/- 19.02, N = 13SE +/- 25.25, N = 3SE +/- 76.45, N = 3SE +/- 63.64, N = 5SE +/- 74.95, N = 4SE +/- 0.20, N = 3SE +/- 55.17, N = 3SE +/- 2.29, N = 3SE +/- 0.07, N = 3SE +/- 0.17, N = 3SE +/- 0.15, N = 3SE +/- 18.30, N = 3SE +/- 26.47, N = 3SE +/- 0.09, N = 3SE +/- 47.68, N = 6SE +/- 18.43, N = 3SE +/- 18.09, N = 3SE +/- 0.12, N = 33414.22118.61953.13067.02818.53193.08396.75973.86835.75239.65656.96999.71770.03288.44386.62514.03787.02170.74853.62616.93088.75493.41. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -fno-trapping-math -fno-math-errno -ldl

Llamafile

Mozilla's Llamafile allows distributing and running large language models (LLMs) as a single file. Llamafile aims to make open-source LLMs more accessible to developers and users. Llamafile supports a variety of models, CPUs and GPUs, and other options. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.7Test: llava-v1.5-7b-q4 - Acceleration: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P612182430SE +/- 0.04, N = 3SE +/- 0.30, N = 15SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 4SE +/- 0.11, N = 4SE +/- 0.08, N = 4SE +/- 0.05, N = 4SE +/- 0.07, N = 4SE +/- 0.02, N = 5SE +/- 0.10, N = 5SE +/- 0.02, N = 4SE +/- 0.11, N = 3SE +/- 0.10, N = 15SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.09, N = 15SE +/- 0.15, N = 4SE +/- 0.17, N = 4SE +/- 1.08, N = 122.999.608.562.8320.6521.0010.9420.6414.4725.7525.3814.2919.1112.297.268.137.777.6710.4420.9516.617.49

LULESH

LULESH is the Livermore Unstructured Lagrangian Explicit Shock Hydrodynamics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgz/s, More Is BetterLULESH 2.0.3Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P15K30K45K60K75KSE +/- 91.45, N = 3SE +/- 314.85, N = 4SE +/- 254.25, N = 6SE +/- 55.60, N = 3SE +/- 373.78, N = 12SE +/- 372.63, N = 12SE +/- 427.75, N = 3SE +/- 244.17, N = 3SE +/- 349.39, N = 15SE +/- 372.12, N = 3SE +/- 194.65, N = 15SE +/- 675.87, N = 3SE +/- 53.94, N = 5SE +/- 188.07, N = 8SE +/- 207.54, N = 5SE +/- 217.67, N = 6SE +/- 206.20, N = 5SE +/- 211.12, N = 6SE +/- 272.44, N = 4SE +/- 182.38, N = 15SE +/- 437.51, N = 4SE +/- 359.29, N = 344136.5326864.1126024.6042946.2616855.8916949.5946126.0824218.8348760.8226082.7127287.2654678.4917348.4321389.8253269.4725831.8452102.6723848.5443724.0623072.3038433.9770826.731. (CXX) g++ options: -O3 -fopenmp -lm -lmpi_cxx -lmpi

7-Zip Compression

This is a test of 7-Zip compression/decompression with its integrated benchmark feature. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression RatingXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P300K600K900K1200K1500KSE +/- 903.01, N = 3SE +/- 258.19, N = 3SE +/- 343.82, N = 3SE +/- 2333.15, N = 3SE +/- 81.21, N = 3SE +/- 120.28, N = 3SE +/- 14188.09, N = 3SE +/- 291.68, N = 3SE +/- 15794.26, N = 3SE +/- 111.53, N = 3SE +/- 1085.99, N = 3SE +/- 38431.24, N = 3SE +/- 309.57, N = 3SE +/- 559.82, N = 3SE +/- 6276.88, N = 3SE +/- 374.59, N = 3SE +/- 2598.93, N = 3SE +/- 916.22, N = 3SE +/- 185.14, N = 3SE +/- 61.74, N = 3SE +/- 119.21, N = 3SE +/- 28320.74, N = 38463354637684210637673133383553679891340226780871103327764262671606511164651883453665344691312433474017072077385570542878623381465734101. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression RatingXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P170K340K510K680K850KSE +/- 1102.28, N = 3SE +/- 933.46, N = 3SE +/- 610.46, N = 3SE +/- 7384.79, N = 3SE +/- 206.69, N = 3SE +/- 268.94, N = 3SE +/- 2500.52, N = 3SE +/- 1188.96, N = 3SE +/- 6869.20, N = 3SE +/- 719.89, N = 3SE +/- 1520.59, N = 3SE +/- 3075.95, N = 3SE +/- 248.73, N = 3SE +/- 1785.84, N = 3SE +/- 3924.87, N = 3SE +/- 2258.81, N = 3SE +/- 5127.15, N = 3SE +/- 1836.55, N = 3SE +/- 4200.62, N = 3SE +/- 1535.53, N = 3SE +/- 1982.97, N = 3SE +/- 709.87, N = 36112004380484138515918353190943313577769685754407617345495005791127413662437323917195255143423634917293147165927293881904416366742391. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

Algebraic Multi-Grid Benchmark

AMG is a parallel algebraic multigrid solver for linear systems arising from problems on unstructured grids. The driver provided with AMG builds linear systems for various 3-dimensional problems. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFigure Of Merit, More Is BetterAlgebraic Multi-Grid Benchmark 1.2EPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1000M2000M3000M4000M5000MSE +/- 291866.98, N = 3SE +/- 2902028.33, N = 3SE +/- 235140242.43, N = 12SE +/- 433397.56, N = 3SE +/- 8808919.44, N = 3SE +/- 1066998.75, N = 3SE +/- 4963892.66, N = 3SE +/- 6340323.98, N = 3SE +/- 971797.70, N = 3SE +/- 467864.03, N = 3SE +/- 9164253.67, N = 3SE +/- 1778769.08, N = 3SE +/- 7233468.75, N = 3SE +/- 3359086.30, N = 3SE +/- 2438223.49, N = 3SE +/- 468935.32, N = 3SE +/- 4000850.45, N = 3SE +/- 9014927.20, N = 3114710800011500526672783039083227535266743249303332282802000237614900044672813331073627667723153533320516100015979933333156261667158849666731244026671605097000181476000036096463331. (CC) gcc options: -lparcsr_ls -lparcsr_mv -lseq_mv -lIJ_mv -lkrylov -lHYPRE_utilities -lm -fopenmp -lmpi

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 512Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P4M8M12M16M20MSE +/- 133.33, N = 3SE +/- 88.19, N = 3SE +/- 115.47, N = 3SE +/- 33.33, N = 3SE +/- 31571.79, N = 3SE +/- 3464.10, N = 3SE +/- 11050.39, N = 3SE +/- 120841.84, N = 4SE +/- 124115.99, N = 3SE +/- 121304.48, N = 3SE +/- 134727.30, N = 3SE +/- 234395.65, N = 15SE +/- 18478.22, N = 3SE +/- 11150.49, N = 3SE +/- 7571.88, N = 3SE +/- 30179.10, N = 3SE +/- 17457.89, N = 3SE +/- 5238.74, N = 3SE +/- 38670.98, N = 3SE +/- 8685.88, N = 3SE +/- 9492.69, N = 3SE +/- 162096.41, N = 1569699676983933628430062807671123633311290000112736671117450013390667133946671338733313083133136083331359900016884000168853331690466716906333168433331688233318774333182005331. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

NAS Parallel Benchmarks

NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: EP.DEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P5K10K15K20K25KSE +/- 50.01, N = 8SE +/- 14.68, N = 3SE +/- 1274.85, N = 12SE +/- 367.88, N = 12SE +/- 530.31, N = 15SE +/- 122.47, N = 15SE +/- 309.03, N = 15SE +/- 602.37, N = 15SE +/- 13.82, N = 3SE +/- 17.53, N = 3SE +/- 10.93, N = 4SE +/- 6.53, N = 3SE +/- 4.83, N = 4SE +/- 155.10, N = 12SE +/- 100.23, N = 4SE +/- 6.77, N = 3SE +/- 22.33, N = 3SE +/- 30.19, N = 45745.046416.3422017.7512575.3019414.9410652.0311424.0522166.604479.288880.8212793.016445.0910970.455366.6914946.767562.808089.1416004.071. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6

ASTC Encoder

ASTC Encoder (astcenc) is for the Adaptive Scalable Texture Compression (ASTC) format commonly used with OpenGL, OpenGL ES, and Vulkan graphics APIs. This test profile does a coding test of both compression/decompression. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.7Preset: Very ThoroughXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P510152025SE +/- 0.0314, N = 3SE +/- 0.0005, N = 3SE +/- 0.0005, N = 3SE +/- 0.0386, N = 3SE +/- 0.0012, N = 3SE +/- 0.0007, N = 3SE +/- 0.1961, N = 15SE +/- 0.0006, N = 3SE +/- 0.1965, N = 3SE +/- 0.0006, N = 3SE +/- 0.0254, N = 3SE +/- 0.1284, N = 3SE +/- 0.0075, N = 3SE +/- 0.0026, N = 3SE +/- 0.0022, N = 3SE +/- 0.0016, N = 3SE +/- 0.0055, N = 3SE +/- 0.0016, N = 3SE +/- 0.0379, N = 3SE +/- 0.0054, N = 3SE +/- 0.0294, N = 3SE +/- 0.0007, N = 312.62206.51665.863211.35735.24065.742022.002312.318717.00989.184410.322419.40522.15964.293511.88755.970210.20515.134213.75187.08857.624014.63341. (CXX) g++ options: -O3 -flto -pthread

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: AlexNetXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P400800120016002000SE +/- 10.51, N = 4SE +/- 2.12, N = 3SE +/- 1.03, N = 3SE +/- 19.06, N = 15SE +/- 0.41, N = 3SE +/- 0.99, N = 3SE +/- 10.23, N = 15SE +/- 4.01, N = 3SE +/- 6.01, N = 3SE +/- 2.58, N = 3SE +/- 1.54, N = 3SE +/- 15.82, N = 3SE +/- 1.28, N = 3SE +/- 3.03, N = 3SE +/- 5.81, N = 3SE +/- 6.82, N = 3SE +/- 1.15, N = 3SE +/- 1.21, N = 3SE +/- 5.06, N = 3SE +/- 0.54, N = 3SE +/- 4.27, N = 3SE +/- 1.86, N = 31010.93668.33609.67857.20771.47843.631403.461454.711524.741278.581301.261560.56852.141340.341528.411058.991479.53986.041730.251205.301277.461681.44

miniFE

MiniFE Finite Element is an application for unstructured implicit finite element codes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgCG Mflops, More Is BetterminiFE 2.2Problem Size: SmallXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P13K26K39K52K65KSE +/- 712.94, N = 12SE +/- 8.42, N = 4SE +/- 19.87, N = 4SE +/- 1039.71, N = 15SE +/- 42.17, N = 4SE +/- 49.20, N = 4SE +/- 2087.13, N = 15SE +/- 53.07, N = 5SE +/- 1510.37, N = 15SE +/- 42.89, N = 5SE +/- 92.04, N = 5SE +/- 2182.93, N = 15SE +/- 54.57, N = 4SE +/- 366.08, N = 4SE +/- 283.44, N = 3SE +/- 572.00, N = 12SE +/- 1097.75, N = 15SE +/- 601.03, N = 12SE +/- 467.78, N = 4SE +/- 11.14, N = 4SE +/- 135.77, N = 4SE +/- 1633.92, N = 1537461.140626.440441.039580.924548.824526.042113.550139.943531.050909.653167.859466.622957.331046.521583.218621.219876.520091.146877.535230.131830.242114.61. (CXX) g++ options: -O3 -fopenmp -lmpi_cxx -lmpi

OpenRadioss

OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/ and https://github.com/OpenRadioss/ModelExchange/tree/main/Examples. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Cell Phone Drop TestEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1020304050SE +/- 0.35, N = 3SE +/- 0.18, N = 3SE +/- 0.05, N = 3SE +/- 0.26, N = 3SE +/- 0.05, N = 3SE +/- 0.26, N = 3SE +/- 0.19, N = 3SE +/- 0.05, N = 3SE +/- 0.21, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 3SE +/- 0.10, N = 3SE +/- 0.08, N = 3SE +/- 0.18, N = 3SE +/- 0.32, N = 335.9533.2327.8623.6923.5322.5320.4522.5243.4531.1727.6331.9227.5133.7528.2231.4927.9026.88

VVenC

VVenC is the Fraunhofer Versatile Video Encoder as a fast/efficient H.266/VVC encoder. The vvenc encoder makes use of SIMD Everywhere (SIMDe). The vvenc software is published under the Clear BSD License. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FasterXeon 6780EXeon 6766EEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P48121620SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.13, N = 6SE +/- 0.13, N = 3SE +/- 0.13, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 3SE +/- 0.16, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.12, N = 311.1810.3913.6113.9714.7916.7317.0213.1013.0211.9714.3611.9014.1012.5415.0615.9713.261. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

Video Input: Bosphorus 4K - Video Preset: Faster

EPYC 9684X 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

EPYC 9654 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

EPYC 9754 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

Xeon 6766E 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

Xeon 6780E 2P: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1

Primesieve

Primesieve generates prime numbers using a highly optimized sieve of Eratosthenes implementation. Primesieve primarily benchmarks the CPU's L1/L2 cache performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.1Length: 1e13Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P20406080100SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 4SE +/- 0.02, N = 3SE +/- 0.01, N = 4SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 4SE +/- 0.25, N = 3SE +/- 0.10, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 326.4652.0757.7129.3954.3945.9511.5621.7612.6324.2423.2712.1381.3640.4430.2058.1633.9267.3227.1151.8248.4125.021. (CXX) g++ options: -O3

GROMACS

The GROMACS (GROningen MAchine for Chemical Simulations) molecular dynamics package testing with the water_GMX50 data. This test profile allows selecting between CPU and GPU-based GROMACS builds. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2024Implementation: MPI CPU - Input: water_GMX50_bareEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P510152025SE +/- 0.004, N = 3SE +/- 0.004, N = 3SE +/- 0.067, N = 3SE +/- 0.032, N = 3SE +/- 0.189, N = 6SE +/- 0.034, N = 3SE +/- 0.052, N = 3SE +/- 0.224, N = 14SE +/- 0.018, N = 3SE +/- 0.036, N = 3SE +/- 0.032, N = 3SE +/- 0.007, N = 3SE +/- 0.025, N = 3SE +/- 0.019, N = 3SE +/- 0.019, N = 3SE +/- 0.010, N = 3SE +/- 0.009, N = 3SE +/- 0.046, N = 36.2466.49921.30513.24220.23412.51415.22222.5254.8138.96414.1278.28213.3927.54515.4508.76210.47718.5401. (CXX) g++ options: -O3 -lm

ASTC Encoder

ASTC Encoder (astcenc) is for the Adaptive Scalable Texture Compression (ASTC) format commonly used with OpenGL, OpenGL ES, and Vulkan graphics APIs. This test profile does a coding test of both compression/decompression. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.7Preset: ExhaustiveXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P48121620SE +/- 0.0118, N = 3SE +/- 0.0000, N = 3SE +/- 0.0007, N = 3SE +/- 0.0040, N = 3SE +/- 0.0006, N = 3SE +/- 0.0010, N = 3SE +/- 0.1160, N = 3SE +/- 0.0025, N = 3SE +/- 0.0218, N = 3SE +/- 0.0002, N = 3SE +/- 0.0086, N = 3SE +/- 0.0170, N = 3SE +/- 0.0016, N = 3SE +/- 0.0029, N = 3SE +/- 0.0016, N = 3SE +/- 0.0011, N = 3SE +/- 0.0033, N = 3SE +/- 0.0003, N = 3SE +/- 0.0164, N = 3SE +/- 0.0024, N = 3SE +/- 0.0072, N = 3SE +/- 0.0157, N = 37.90604.05743.65057.12913.19933.514614.10387.557310.60185.63016.302711.91071.33192.64717.20753.62766.21263.12048.37014.26894.63038.90911. (CXX) g++ options: -O3 -flto -pthread

uvg266

uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: MediumXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1020304050SE +/- 0.16, N = 15SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.23, N = 5SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.28, N = 11SE +/- 0.05, N = 3SE +/- 0.23, N = 4SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.46, N = 4SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.16, N = 3SE +/- 0.05, N = 322.5917.2915.6522.0317.8019.2538.1232.4442.0331.4432.7445.2612.5616.1924.6515.6822.2515.1727.6517.8516.6430.37

John The Ripper

This is a benchmark of John The Ripper, which is a password cracker. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 2023.03.14Test: WPA PSKXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P300K600K900K1200K1500KSE +/- 394.40, N = 3SE +/- 66.16, N = 3SE +/- 30.00, N = 3SE +/- 187.67, N = 3SE +/- 79.20, N = 3SE +/- 321.00, N = 3SE +/- 4358.90, N = 3SE +/- 478.70, N = 3SE +/- 1333.33, N = 3SE +/- 921.74, N = 3SE +/- 2683.36, N = 3SE +/- 5291.50, N = 3SE +/- 177.03, N = 3SE +/- 1491.72, N = 3SE +/- 788.50, N = 3SE +/- 1274.00, N = 3SE +/- 5122.51, N = 3SE +/- 987.33, N = 3SE +/- 2519.00, N = 3SE +/- 1599.31, N = 3SE +/- 864.17, N = 3SE +/- 15579.94, N = 154072562098031889253676573399983862121551000803187125333364347567132212940002480664915836578893340765628752865527932534012784281167970931. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: GoogLeNetXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1224364860SE +/- 0.06, N = 9SE +/- 0.09, N = 4SE +/- 0.04, N = 4SE +/- 0.05, N = 7SE +/- 0.14, N = 6SE +/- 0.30, N = 15SE +/- 0.04, N = 3SE +/- 0.27, N = 15SE +/- 0.14, N = 15SE +/- 0.41, N = 15SE +/- 0.33, N = 15SE +/- 0.17, N = 15SE +/- 0.24, N = 7SE +/- 0.34, N = 15SE +/- 0.23, N = 12SE +/- 0.27, N = 6SE +/- 0.20, N = 15SE +/- 0.27, N = 7SE +/- 0.23, N = 15SE +/- 0.19, N = 6SE +/- 0.21, N = 6SE +/- 0.12, N = 66.7213.1412.405.8836.4836.668.1021.0012.4232.8034.2012.8353.3829.1814.6731.4718.2436.1313.5033.5621.6712.69

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 57Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P16M32M48M64M80MSE +/- 11392.00, N = 3SE +/- 5206.83, N = 3SE +/- 20835.33, N = 3SE +/- 2185.81, N = 3SE +/- 393224.42, N = 3SE +/- 4807.40, N = 3SE +/- 8089.77, N = 3SE +/- 7937.25, N = 3SE +/- 486361.09, N = 3SE +/- 12719.19, N = 3SE +/- 7423.69, N = 3SE +/- 34724.31, N = 3SE +/- 15982.63, N = 3SE +/- 178712.37, N = 3SE +/- 822374.71, N = 4SE +/- 5364.49, N = 3SE +/- 4163.33, N = 3SE +/- 4910.31, N = 3SE +/- 3844.19, N = 3SE +/- 666.67, N = 3SE +/- 599433.09, N = 9SE +/- 68119.99, N = 3371213333719566733444667334393334548633346210667462296674627000054954667554253335545533355415667540896675393033366266000671276676706400067130333669913336707466773140667704990001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

QuantLib

QuantLib is an open-source library/framework around quantitative finance for modeling, trading and risk management scenarios. QuantLib is written in C++ with Boost and its built-in benchmark used reports the QuantLib Benchmark Index benchmark score. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Single-ThreadedXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P8001600240032004000SE +/- 7.35, N = 3SE +/- 6.88, N = 3SE +/- 4.87, N = 3SE +/- 4.34, N = 3SE +/- 14.40, N = 3SE +/- 18.64, N = 3SE +/- 19.30, N = 3SE +/- 14.83, N = 3SE +/- 19.83, N = 3SE +/- 24.27, N = 3SE +/- 22.39, N = 3SE +/- 1.14, N = 3SE +/- 14.88, N = 3SE +/- 2.82, N = 3SE +/- 28.57, N = 3SE +/- 25.35, N = 3SE +/- 28.11, N = 3SE +/- 22.17, N = 3SE +/- 25.40, N = 3SE +/- 28.42, N = 3SE +/- 33.58, N = 3SE +/- 30.36, N = 121954.21960.71765.61760.82593.02593.32590.82596.13098.53105.93114.23125.42534.52558.63222.83229.13207.03225.73210.13209.63600.53586.31. (CXX) g++ options: -O3 -march=native -fPIE -pie

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 512Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P200M400M600M800M1000MSE +/- 3610015.39, N = 3SE +/- 124677.36, N = 3SE +/- 271682.00, N = 3SE +/- 584646.14, N = 3SE +/- 2292977.20, N = 3SE +/- 822739.33, N = 3SE +/- 958772.36, N = 3SE +/- 673003.22, N = 3SE +/- 2261241.06, N = 3SE +/- 1678355.68, N = 3SE +/- 752558.60, N = 3SE +/- 3039034.93, N = 3SE +/- 147685.85, N = 3SE +/- 749718.47, N = 3SE +/- 6141471.96, N = 3SE +/- 1289603.73, N = 3SE +/- 4432294.36, N = 3SE +/- 1611276.24, N = 3SE +/- 3717554.45, N = 3SE +/- 940265.92, N = 3SE +/- 1515552.70, N = 3SE +/- 7562646.32, N = 83844066673985666673595766673497466675772633336338600007093933337096500008245833338113733338505866678493400005032533336465133337571766676890033337325600006323966677994966677444100007837700008837012501. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

SVT-AV1

This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 13 - Input: Bosphorus 4KXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P4080120160200SE +/- 1.79, N = 15SE +/- 1.12, N = 7SE +/- 1.01, N = 8SE +/- 0.80, N = 15SE +/- 3.84, N = 15SE +/- 4.25, N = 15SE +/- 4.46, N = 15SE +/- 4.48, N = 15SE +/- 4.23, N = 15SE +/- 4.38, N = 15SE +/- 3.81, N = 15SE +/- 1.54, N = 15SE +/- 1.11, N = 15SE +/- 3.34, N = 15SE +/- 1.67, N = 15SE +/- 1.62, N = 15SE +/- 1.63, N = 15SE +/- 1.44, N = 15SE +/- 2.18, N = 15SE +/- 2.31, N = 15SE +/- 2.83, N = 15SE +/- 2.84, N = 15116.62124.60114.54108.29153.42160.79159.75163.41167.22172.88162.48161.34133.19138.72124.26150.00122.62144.70154.50162.47174.83162.981. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

uvg266

uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: SlowXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1020304050SE +/- 0.18, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.23, N = 4SE +/- 0.04, N = 3SE +/- 0.21, N = 4SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.12, N = 4SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 321.6315.2413.7720.4615.7717.0437.1329.0040.9628.0129.1843.3910.9313.7922.1413.8919.7513.3624.7115.7116.0627.11

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 32Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P9M18M27M36M45MSE +/- 881.92, N = 3SE +/- 1527.53, N = 3SE +/- 0.00, N = 3SE +/- 881.92, N = 3SE +/- 881.92, N = 3SE +/- 2333.33, N = 3SE +/- 2185.81, N = 3SE +/- 6984.11, N = 3SE +/- 13503.09, N = 3SE +/- 7753.14, N = 3SE +/- 7023.77, N = 3SE +/- 19139.84, N = 3SE +/- 1000.00, N = 3SE +/- 577.35, N = 3SE +/- 1452.97, N = 3SE +/- 3000.00, N = 3SE +/- 1201.85, N = 3SE +/- 1666.67, N = 3SE +/- 1154.70, N = 3SE +/- 1527.53, N = 3SE +/- 417042.80, N = 5SE +/- 419600.12, N = 5351906673525900031726000317056672989933329899667298933332990733336033000360683333606600036040000319950003199200036521333365390003649766736537667364610003650600040244000389506001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: GoogLeNetXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P80160240320400SE +/- 0.21, N = 3SE +/- 0.64, N = 3SE +/- 0.29, N = 3SE +/- 2.29, N = 3SE +/- 0.44, N = 3SE +/- 0.30, N = 3SE +/- 1.18, N = 3SE +/- 3.84, N = 4SE +/- 2.41, N = 3SE +/- 4.22, N = 3SE +/- 1.66, N = 3SE +/- 2.47, N = 3SE +/- 0.49, N = 3SE +/- 1.42, N = 3SE +/- 2.38, N = 3SE +/- 0.83, N = 3SE +/- 3.52, N = 5SE +/- 1.94, N = 3SE +/- 2.37, N = 3SE +/- 1.62, N = 3SE +/- 1.12, N = 3SE +/- 0.21, N = 3190.80232.51214.14168.10256.79276.93176.00314.67227.22354.59330.26248.03282.50347.72308.95335.58341.51333.73331.76380.14319.76291.37

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 57Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P600M1200M1800M2400M3000MSE +/- 7523814.04, N = 3SE +/- 1361779.88, N = 3SE +/- 1953913.45, N = 3SE +/- 4223873.95, N = 3SE +/- 7776531.65, N = 3SE +/- 4914717.13, N = 3SE +/- 17457503.96, N = 3SE +/- 8567444.84, N = 3SE +/- 10590929.03, N = 3SE +/- 3786085.64, N = 3SE +/- 8476044.68, N = 3SE +/- 8732315.46, N = 3SE +/- 4885465.97, N = 3SE +/- 25737283.81, N = 3SE +/- 27382304.50, N = 5SE +/- 5493127.02, N = 3SE +/- 28812627.44, N = 4SE +/- 2629533.12, N = 3SE +/- 28500058.48, N = 3SE +/- 7076957.92, N = 3SE +/- 11426868.92, N = 3SE +/- 32405829.38, N = 320367333332099033333190626666718523666672026333333218683333323747666672444933333273023333328598333332862000000277280000014691666671999266667249134000023089666672494050000213876666726555000002539200000247550000026200666671. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 128 - Buffer Length: 256 - Filter Length: 512Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P300M600M900M1200M1500MSE +/- 866544.86, N = 3SE +/- 287923.60, N = 3SE +/- 305632.31, N = 3SE +/- 1072572.19, N = 3SE +/- 431058.13, N = 3SE +/- 390953.25, N = 3SE +/- 503322.30, N = 3SE +/- 814452.78, N = 3SE +/- 2338327.99, N = 3SE +/- 1047748.91, N = 3SE +/- 2412697.89, N = 3SE +/- 3901424.24, N = 3SE +/- 912164.70, N = 3SE +/- 8061118.62, N = 3SE +/- 2123152.79, N = 3SE +/- 1345523.44, N = 3SE +/- 11560043.25, N = 5SE +/- 681281.47, N = 3SE +/- 6842108.19, N = 3SE +/- 1740596.96, N = 3SE +/- 2313246.88, N = 3SE +/- 4790383.89, N = 3777940000796340000719626667707053333731756667809916667134980000013698000001199966667115816666713687333331394733333539226667981090000120606666788220000010914600008001866671126466667918566667115293333314938333331. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 256 - Buffer Length: 256 - Filter Length: 512Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P500M1000M1500M2000M2500MSE +/- 6411708.04, N = 3SE +/- 409267.64, N = 3SE +/- 320537.74, N = 3SE +/- 2198737.01, N = 3SE +/- 170391.71, N = 3SE +/- 776881.23, N = 3SE +/- 1650252.51, N = 3SE +/- 1300000.00, N = 3SE +/- 11753202.87, N = 3SE +/- 520683.31, N = 3SE +/- 2676440.42, N = 3SE +/- 14870701.99, N = 3SE +/- 4629652.01, N = 3SE +/- 11053858.05, N = 3SE +/- 6728628.72, N = 3SE +/- 740202.67, N = 3SE +/- 4238841.56, N = 3SE +/- 569766.03, N = 3SE +/- 5630373.98, N = 3SE +/- 1722723.94, N = 3SE +/- 240370.09, N = 3SE +/- 14465476.14, N = 31437100000940270000848376667130673333374174000082101333317348000001744700000212953333313621666671570400000239433333354260666710610333331518933333944550000144406666783853000016169666671020833333117876666720270000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

John The Ripper

This is a benchmark of John The Ripper, which is a password cracker. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 2023.03.14Test: bcryptXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P90K180K270K360K450KSE +/- 2096.39, N = 3SE +/- 87.49, N = 3SE +/- 32.84, N = 3SE +/- 801.76, N = 3SE +/- 0.00, N = 3SE +/- 22.28, N = 3SE +/- 4958.68, N = 4SE +/- 1.33, N = 3SE +/- 710.46, N = 3SE +/- 20.00, N = 3SE +/- 154.46, N = 3SE +/- 1315.55, N = 3SE +/- 6.33, N = 3SE +/- 12.67, N = 3SE +/- 576.80, N = 3SE +/- 8.67, N = 3SE +/- 866.68, N = 3SE +/- 8.84, N = 3SE +/- 292.24, N = 3SE +/- 10.67, N = 3SE +/- 46.28, N = 3SE +/- 288.38, N = 340227521131119005836313393472102222412723220188320527166541192898376268569391132191559597914413386667875183603945511057812067781. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 128 - Buffer Length: 256 - Filter Length: 57Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1000M2000M3000M4000M5000MSE +/- 13354940.83, N = 3SE +/- 1909915.65, N = 3SE +/- 6887912.12, N = 3SE +/- 2709448.49, N = 3SE +/- 6398003.16, N = 3SE +/- 3527510.93, N = 3SE +/- 14606429.33, N = 3SE +/- 18691531.06, N = 3SE +/- 4098915.85, N = 3SE +/- 20120967.50, N = 3SE +/- 6778479.02, N = 3SE +/- 11892621.43, N = 3SE +/- 1549551.91, N = 3SE +/- 11686221.71, N = 3SE +/- 14772609.79, N = 3SE +/- 3119294.79, N = 3SE +/- 25888414.40, N = 3SE +/- 2030052.00, N = 3SE +/- 13655808.69, N = 3SE +/- 3116800.35, N = 3SE +/- 5260228.13, N = 3SE +/- 51282832.98, N = 440686666674136766667373630000037121333332687066667298280000046265666674714500000428093333342563000004755333333475936666715546666672689033333389650000029724000003596400000267003333337236666673181266667350320000044505250001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

SVT-AV1

This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 4 - Input: Bosphorus 4KXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P246810SE +/- 0.041, N = 3SE +/- 0.003, N = 3SE +/- 0.002, N = 3SE +/- 0.023, N = 3SE +/- 0.015, N = 3SE +/- 0.007, N = 3SE +/- 0.004, N = 3SE +/- 0.024, N = 3SE +/- 0.046, N = 3SE +/- 0.019, N = 3SE +/- 0.021, N = 3SE +/- 0.040, N = 3SE +/- 0.014, N = 3SE +/- 0.014, N = 3SE +/- 0.042, N = 3SE +/- 0.047, N = 3SE +/- 0.015, N = 3SE +/- 0.027, N = 3SE +/- 0.049, N = 3SE +/- 0.030, N = 3SE +/- 0.005, N = 3SE +/- 0.044, N = 34.0404.3503.9723.7106.7276.9397.1537.2838.3498.4228.5958.5135.4385.4376.0526.5725.9916.4906.6987.0617.8767.3601. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon ObjXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P50100150200250SE +/- 0.09, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.22, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 3.26, N = 12SE +/- 0.07, N = 4SE +/- 1.58, N = 15SE +/- 0.02, N = 4SE +/- 0.11, N = 4SE +/- 1.72, N = 15SE +/- 0.03, N = 3SE +/- 0.10, N = 3SE +/- 0.89, N = 15SE +/- 0.09, N = 3SE +/- 0.76, N = 3SE +/- 0.08, N = 3SE +/- 0.22, N = 4SE +/- 0.09, N = 3SE +/- 0.35, N = 3SE +/- 0.29, N = 4136.2283.7376.53125.1163.3464.33200.16133.93175.60113.28133.48210.4447.6484.80112.7271.83104.8464.96132.2879.3897.19173.22

John The Ripper

This is a benchmark of John The Ripper, which is a password cracker. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 2023.03.14Test: BlowfishXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P90K180K270K360K450KSE +/- 482.17, N = 3SE +/- 14.67, N = 3SE +/- 174.44, N = 3SE +/- 353.58, N = 3SE +/- 20.54, N = 3SE +/- 13.72, N = 3SE +/- 2397.15, N = 3SE +/- 1.33, N = 3SE +/- 3455.48, N = 3SE +/- 38.33, N = 3SE +/- 98.33, N = 3SE +/- 454.86, N = 3SE +/- 6.33, N = 3SE +/- 14.62, N = 3SE +/- 169.28, N = 3SE +/- 8.67, N = 3SE +/- 116.69, N = 3SE +/- 17.33, N = 3SE +/- 348.45, N = 3SE +/- 11.39, N = 3SE +/- 79.75, N = 3SE +/- 649.08, N = 340473921144919020936330093473102198415412220188316492166541192574374589569391132231566587915213456267893183583945131058312054991. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 256 - Buffer Length: 256 - Filter Length: 57Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P2000M4000M6000M8000M10000MSE +/- 30821331.00, N = 3SE +/- 6906036.01, N = 3SE +/- 8015887.00, N = 3SE +/- 28436830.58, N = 3SE +/- 4481443.22, N = 3SE +/- 1959875.28, N = 3SE +/- 8069352.17, N = 3SE +/- 12739745.33, N = 3SE +/- 60380193.59, N = 3SE +/- 2618735.91, N = 3SE +/- 8144527.82, N = 3SE +/- 50144890.07, N = 3SE +/- 2935605.18, N = 3SE +/- 3572580.77, N = 3SE +/- 28453880.81, N = 3SE +/- 1976810.00, N = 3SE +/- 17558125.69, N = 3SE +/- 4088330.28, N = 3SE +/- 2331189.49, N = 3SE +/- 5292237.50, N = 3SE +/- 3555434.03, N = 3SE +/- 61971606.40, N = 375975666674714700000425943333368009000002793700000311693333363162666676401366667741186666752664666675811900000801270000016104666673037100000503600000032225333334825133333284893333353612666673500833333380683333362843000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 256 - Buffer Length: 256 - Filter Length: 32Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P2000M4000M6000M8000M10000MSE +/- 20501246.57, N = 3SE +/- 2601495.30, N = 3SE +/- 821245.67, N = 3SE +/- 32054242.22, N = 3SE +/- 1928730.15, N = 3SE +/- 1501110.70, N = 3SE +/- 2936551.27, N = 3SE +/- 3768731.00, N = 3SE +/- 46730658.51, N = 3SE +/- 1419311.26, N = 3SE +/- 11426625.83, N = 3SE +/- 34610274.65, N = 3SE +/- 1266666.67, N = 3SE +/- 7369833.41, N = 3SE +/- 895048.11, N = 3SE +/- 1338323.99, N = 3SE +/- 2447674.63, N = 3SE +/- 1320353.49, N = 3SE +/- 10496401.50, N = 3SE +/- 4021608.30, N = 3SE +/- 2516611.48, N = 3SE +/- 6711433.03, N = 375463666674799133333430116666768215333332789600000306220000064390000006588200000751333333352719333335862466667793526666718235666673572233333536703333327690666674670966667238180000061165666673243800000316720000060773000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 128 - Buffer Length: 256 - Filter Length: 32Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P900M1800M2700M3600M4500MSE +/- 517472.49, N = 3SE +/- 2023198.79, N = 3SE +/- 920748.49, N = 3SE +/- 3194265.70, N = 3SE +/- 2003607.86, N = 3SE +/- 3138116.92, N = 3SE +/- 384418.75, N = 3SE +/- 4056818.68, N = 3SE +/- 3186603.90, N = 3SE +/- 2714365.08, N = 3SE +/- 841295.30, N = 3SE +/- 4250882.26, N = 3SE +/- 3178574.10, N = 3SE +/- 3557152.42, N = 3SE +/- 2403700.85, N = 3SE +/- 1342054.81, N = 3SE +/- 4598671.31, N = 3SE +/- 400000.00, N = 3SE +/- 26633124.74, N = 3SE +/- 1858314.65, N = 3SE +/- 2236316.42, N = 3SE +/- 13813198.20, N = 340210333334102200000367196666736079000002767933333304706666737941333333791566667406333333340327333334353533333440790000017974000003044700000333706666727396333333254033333235190000035586000003200600000314823333335207666671. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Google SynthMark

SynthMark is a cross platform tool for benchmarking CPU performance under a variety of real-time audio workloads. It uses a polyphonic synthesizer model to provide standardized tests for latency, jitter and computational throughput. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgVoices, More Is BetterGoogle SynthMark 20201109Test: VoiceMark_100Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P2004006008001000SE +/- 0.06, N = 3SE +/- 0.18, N = 3SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 0.60, N = 3SE +/- 0.14, N = 3SE +/- 0.88, N = 3SE +/- 0.45, N = 3SE +/- 0.56, N = 3SE +/- 0.55, N = 3SE +/- 0.69, N = 3SE +/- 0.72, N = 3SE +/- 7.09, N = 3SE +/- 0.53, N = 3SE +/- 0.48, N = 3SE +/- 0.24, N = 3SE +/- 0.30, N = 3SE +/- 0.26, N = 3SE +/- 1.51, N = 3SE +/- 0.22, N = 3SE +/- 0.13, N = 3SE +/- 0.38, N = 3538.91540.24494.05494.38656.25655.24655.05655.80782.32783.78783.42783.20555.60548.36712.09712.01710.92711.10712.70711.38799.72799.491. (CXX) g++ options: -lm -lpthread -std=c++11 -Ofast

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 32Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P500M1000M1500M2000M2500MSE +/- 4028647.42, N = 3SE +/- 808290.38, N = 3SE +/- 1379613.47, N = 3SE +/- 1003881.36, N = 3SE +/- 3256958.36, N = 3SE +/- 3090487.20, N = 3SE +/- 1462114.15, N = 3SE +/- 1550627.11, N = 3SE +/- 1567730.14, N = 3SE +/- 2810891.52, N = 3SE +/- 3000185.18, N = 3SE +/- 2510644.01, N = 3SE +/- 3209534.41, N = 3SE +/- 9052685.30, N = 3SE +/- 3017909.50, N = 3SE +/- 692820.32, N = 3SE +/- 2206304.10, N = 3SE +/- 688799.28, N = 3SE +/- 3300505.01, N = 3SE +/- 3167192.94, N = 3SE +/- 27191440.65, N = 3SE +/- 17236814.61, N = 319893000002057300000184140000017805333331776866667187133333318949666671898766667228206666722827666672287466667227930000015617666671731166667209046666716797000001963233333164026666720250000001890566667192776666721546333331. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

uvg266

uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Very FastXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1428425670SE +/- 0.43, N = 15SE +/- 0.06, N = 4SE +/- 0.01, N = 4SE +/- 0.34, N = 15SE +/- 0.06, N = 4SE +/- 0.08, N = 4SE +/- 0.43, N = 15SE +/- 0.18, N = 5SE +/- 0.55, N = 5SE +/- 0.13, N = 5SE +/- 0.13, N = 5SE +/- 0.12, N = 5SE +/- 0.06, N = 3SE +/- 0.18, N = 4SE +/- 0.38, N = 9SE +/- 0.02, N = 4SE +/- 0.39, N = 4SE +/- 0.12, N = 4SE +/- 0.50, N = 5SE +/- 0.01, N = 4SE +/- 0.08, N = 3SE +/- 0.16, N = 528.4344.4440.7327.3344.9250.0446.0054.4653.4462.0262.7055.0530.1740.6946.2540.8244.7539.5654.8849.4235.1053.66

Blender

Blender is an open-source 3D creation and modeling software project. This test is of Blender's Cycles performance with various sample files. GPU computing via NVIDIA OptiX and NVIDIA CUDA is currently supported as well as HIP for AMD Radeon GPUs and Intel oneAPI for Intel Graphics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Junkshop - Compute: CPU-OnlyXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1428425670SE +/- 0.14, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.11, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.02, N = 4SE +/- 0.08, N = 3SE +/- 0.02, N = 4SE +/- 0.06, N = 3SE +/- 0.13, N = 3SE +/- 0.08, N = 4SE +/- 0.09, N = 3SE +/- 0.10, N = 3SE +/- 0.19, N = 3SE +/- 0.10, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.24, N = 3SE +/- 0.10, N = 3SE +/- 0.09, N = 316.8926.4929.0618.7038.8635.8211.2117.7012.8721.0218.6511.4761.2233.2023.4539.1724.9942.8521.1535.9632.0818.31

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Fishy Cat - Compute: CPU-OnlyXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1326395265SE +/- 0.01, N = 4SE +/- 0.08, N = 3SE +/- 0.37, N = 3SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.23, N = 3SE +/- 0.04, N = 5SE +/- 0.13, N = 3SE +/- 0.05, N = 4SE +/- 0.11, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 5SE +/- 0.15, N = 3SE +/- 0.27, N = 3SE +/- 0.18, N = 3SE +/- 0.04, N = 3SE +/- 0.13, N = 3SE +/- 0.17, N = 3SE +/- 0.08, N = 3SE +/- 0.11, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 315.1626.5229.5516.5238.0434.359.7116.5811.2520.1518.3610.1659.1530.7521.4538.4823.1742.7819.1334.8331.9117.29

Appleseed

Appleseed is an open-source production renderer focused on physically-based global illumination rendering engine primarily designed for animation and visual effects. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterAppleseed 2.0 BetaScene: Disney MaterialXeon 6780EXeon 6766EEPYC 8534PNEPYC 8534PEPYC 9754EPYC 9654EPYC 9684XXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P2040608010052.3258.3161.3656.4245.0843.4540.9279.8358.3849.1456.4051.2558.3848.5653.4948.4343.70

Scene: Disney Material

EPYC 9684X 2P: The test run did not produce a result.

EPYC 9654 2P: The test run did not produce a result.

EPYC 9754 2P: The test run did not produce a result.

Xeon 6766E 2P: The test run did not produce a result.

Xeon 6780E 2P: The test run did not produce a result.

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: AlexNetXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P2004006008001000SE +/- 5.91, N = 15SE +/- 0.97, N = 3SE +/- 0.70, N = 3SE +/- 5.44, N = 15SE +/- 0.16, N = 4SE +/- 0.45, N = 4SE +/- 7.43, N = 15SE +/- 2.99, N = 5SE +/- 8.87, N = 4SE +/- 1.31, N = 5SE +/- 1.37, N = 5SE +/- 7.66, N = 5SE +/- 0.27, N = 4SE +/- 3.70, N = 5SE +/- 7.35, N = 5SE +/- 2.31, N = 5SE +/- 6.39, N = 13SE +/- 1.95, N = 5SE +/- 7.98, N = 5SE +/- 0.51, N = 5SE +/- 6.22, N = 5SE +/- 2.22, N = 5520.01482.06443.74464.80617.03673.42658.97924.80727.77942.19868.54738.31690.09904.36940.40852.36932.59841.68996.47969.62819.89858.84

Kvazaar

This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: MediumXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1428425670SE +/- 0.23, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.21, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.52, N = 15SE +/- 0.04, N = 4SE +/- 0.56, N = 5SE +/- 0.07, N = 4SE +/- 0.01, N = 4SE +/- 0.40, N = 5SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.27, N = 431.7021.3919.3429.1523.0224.3154.5739.0861.1139.5840.5063.4815.5120.3329.6218.8426.6918.1332.0420.9724.8041.581. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Pennant

Pennant is an application focused on hydrodynamics on general unstructured meshes in 2D. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgHydro Cycle Time - Seconds, Fewer Is BetterPennant 1.0.1Test: sedovbigEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P612182430SE +/- 0.029749, N = 4SE +/- 0.024479, N = 4SE +/- 0.037087, N = 15SE +/- 0.074320, N = 15SE +/- 0.040626, N = 15SE +/- 0.052975, N = 7SE +/- 0.080453, N = 15SE +/- 0.041359, N = 15SE +/- 0.034794, N = 3SE +/- 0.052953, N = 3SE +/- 0.003253, N = 4SE +/- 0.013353, N = 3SE +/- 0.003237, N = 4SE +/- 0.001847, N = 3SE +/- 0.016400, N = 4SE +/- 0.002987, N = 3SE +/- 0.002400, N = 3SE +/- 0.018471, N = 412.15132011.3696402.9404565.1476583.4083375.9164585.4606603.08110825.78945015.24719012.10690019.88246013.21125021.02112011.28438016.03080016.9691009.9645261. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi

Kvazaar

This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: SlowXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1428425670SE +/- 0.18, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.47, N = 8SE +/- 0.05, N = 4SE +/- 0.50, N = 5SE +/- 0.01, N = 4SE +/- 0.07, N = 4SE +/- 0.26, N = 5SE +/- 0.00, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 431.8520.8718.8629.1522.4623.7154.8838.4761.0738.9040.0062.8215.0919.7128.9618.2426.0017.5231.2420.2324.2340.921. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

srsRAN Project

srsRAN Project is a complete ORAN-native 5G RAN solution created by Software Radio Systems (SRS). The srsRAN Project radio suite was formerly known as srsLTE and can be used for building your own software-defined radio (SDR) 4G/5G mobile network. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240325Test: PUSCH Processor Benchmark, Throughput ThreadXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P306090120150SE +/- 0.07, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 352.652.549.849.8112.1112.1112.1112.1112.2112.2112.2112.2112.3112.3129.7129.7129.7129.7129.7129.7129.5129.51. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -fno-trapping-math -fno-math-errno -ldl

Kvazaar

This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Very FastXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P20406080100SE +/- 0.50, N = 15SE +/- 0.00, N = 4SE +/- 0.04, N = 4SE +/- 0.36, N = 15SE +/- 0.07, N = 4SE +/- 0.07, N = 5SE +/- 0.63, N = 15SE +/- 0.21, N = 5SE +/- 0.71, N = 6SE +/- 0.62, N = 6SE +/- 0.32, N = 6SE +/- 0.28, N = 6SE +/- 0.06, N = 3SE +/- 0.18, N = 4SE +/- 0.29, N = 4SE +/- 0.08, N = 4SE +/- 0.33, N = 4SE +/- 0.06, N = 4SE +/- 0.45, N = 5SE +/- 0.08, N = 4SE +/- 0.04, N = 4SE +/- 0.36, N = 538.9246.1841.8636.4051.5154.6059.0168.5672.6876.8378.1574.0331.2544.1152.2341.3451.9140.2367.6450.0338.0265.381. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenFOAM

OpenFOAM is the leading free, open-source software for computational fluid dynamics (CFD). This test profile currently uses the drivaerFastback test case for analyzing automotive aerodynamics or alternatively the older motorBike input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Execution TimeEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P2040608010059.2758.1724.5733.8125.0132.5928.3322.7174.9640.2927.5841.7528.9945.9528.5642.2233.0723.561. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Mesh TimeEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P91827364536.8233.6729.4730.3827.7428.0325.9326.8239.1236.8628.8432.0032.4831.7835.6031.3831.7029.331. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

SVT-AV1

This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 8 - Input: Bosphorus 4KXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P20406080100SE +/- 0.34, N = 3SE +/- 0.02, N = 4SE +/- 0.03, N = 4SE +/- 0.35, N = 15SE +/- 0.67, N = 4SE +/- 0.11, N = 4SE +/- 0.31, N = 4SE +/- 0.38, N = 5SE +/- 0.40, N = 5SE +/- 0.56, N = 5SE +/- 0.42, N = 5SE +/- 0.63, N = 5SE +/- 0.09, N = 4SE +/- 0.52, N = 7SE +/- 0.44, N = 15SE +/- 0.29, N = 4SE +/- 0.58, N = 5SE +/- 0.26, N = 4SE +/- 0.46, N = 4SE +/- 0.20, N = 5SE +/- 0.22, N = 5SE +/- 0.79, N = 547.2550.8246.4842.8664.7968.1977.6078.7486.3487.9986.3087.8255.2459.1055.9865.3654.8262.7565.2270.9179.4470.431. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Intel Open Image Denoise

Open Image Denoise is a denoising library for ray-tracing and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RTLightmap.hdr.4096x4096 - Device: CPU-OnlyXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P0.541.081.622.162.7SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 4SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 4SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 41.681.070.981.510.800.861.711.501.671.311.281.640.861.481.741.141.721.082.181.291.582.40

Blender

Blender is an open-source 3D creation and modeling software project. This test is of Blender's Cycles performance with various sample files. GPU computing via NVIDIA OptiX and NVIDIA CUDA is currently supported as well as HIP for AMD Radeon GPUs and Intel oneAPI for Intel Graphics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: BMW27 - Compute: CPU-OnlyXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1122334455SE +/- 0.09, N = 5SE +/- 0.05, N = 3SE +/- 0.17, N = 8SE +/- 0.06, N = 5SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 6SE +/- 0.01, N = 4SE +/- 0.02, N = 5SE +/- 0.07, N = 4SE +/- 0.04, N = 4SE +/- 0.03, N = 6SE +/- 0.11, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 4SE +/- 0.24, N = 3SE +/- 0.03, N = 3SE +/- 0.11, N = 3SE +/- 0.08, N = 4SE +/- 0.15, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 49.7117.6119.8510.5630.0727.127.1712.868.6115.9614.297.7546.3223.6715.2928.4916.5531.6613.7425.8923.7212.76

miniBUDE

MiniBUDE is a mini application for the the core computation of the Bristol University Docking Engine (BUDE). This test profile currently makes use of the OpenMP implementation of miniBUDE for CPU benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P50100150200250SE +/- 0.46, N = 15SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 5SE +/- 0.03, N = 6SE +/- 0.04, N = 6SE +/- 3.98, N = 15SE +/- 0.70, N = 9SE +/- 2.97, N = 13SE +/- 1.18, N = 7SE +/- 3.27, N = 13SE +/- 6.15, N = 12SE +/- 0.38, N = 9SE +/- 1.19, N = 15SE +/- 1.85, N = 12SE +/- 0.84, N = 15SE +/- 1.28, N = 12SE +/- 0.12, N = 4SE +/- 0.81, N = 7SE +/- 0.61, N = 5SE +/- 0.20, N = 6SE +/- 1.02, N = 884.3543.5539.1776.6098.21107.35214.62229.91217.85136.95151.95236.6147.2685.29114.9070.84108.4063.62133.6382.85106.40199.731. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P13002600390052006500SE +/- 11.58, N = 15SE +/- 0.29, N = 3SE +/- 0.46, N = 3SE +/- 1.36, N = 5SE +/- 0.82, N = 6SE +/- 0.97, N = 6SE +/- 99.42, N = 15SE +/- 17.54, N = 9SE +/- 74.36, N = 13SE +/- 29.52, N = 7SE +/- 81.83, N = 13SE +/- 153.85, N = 12SE +/- 9.38, N = 9SE +/- 29.84, N = 15SE +/- 46.19, N = 12SE +/- 21.10, N = 15SE +/- 32.01, N = 12SE +/- 2.91, N = 4SE +/- 20.15, N = 7SE +/- 15.23, N = 5SE +/- 5.07, N = 6SE +/- 25.44, N = 82108.681088.83979.281915.042455.162683.835365.425747.825446.163423.633798.705915.251181.492132.242872.561771.072709.931590.503340.692071.192659.884993.341. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

x265

This is a simple test of the x265 encoder run on the CPU with 1080p and 4K options for H.265 video encode performance with x265. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betterx265 3.6Video Input: Bosphorus 4KXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P918273645SE +/- 0.17, N = 3SE +/- 0.13, N = 3SE +/- 0.11, N = 3SE +/- 0.22, N = 6SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 3SE +/- 0.13, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.39, N = 3SE +/- 0.12, N = 3SE +/- 0.08, N = 3SE +/- 0.20, N = 4SE +/- 0.11, N = 4SE +/- 0.06, N = 4SE +/- 0.09, N = 419.5521.3020.2222.0727.7428.1328.1128.1628.8131.7232.1231.9529.7630.8027.9031.4027.2629.0537.0437.8638.9339.311. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

Timed FFmpeg Compilation

This test times how long it takes to build the FFmpeg multimedia library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 7.0Time To CompileXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P816243240SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.30, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 323.3225.2427.8525.7128.4227.5421.2223.2218.0920.4919.9917.8434.2925.9420.0124.8420.7926.4619.5124.0621.3617.39

Pennant

Pennant is an application focused on hydrodynamics on general unstructured meshes in 2D. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgHydro Cycle Time - Seconds, Fewer Is BetterPennant 1.0.1Test: leblancbigEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P3691215SE +/- 0.045713, N = 13SE +/- 0.057580, N = 6SE +/- 0.022246, N = 15SE +/- 0.115702, N = 15SE +/- 0.063684, N = 15SE +/- 0.115723, N = 15SE +/- 0.115724, N = 15SE +/- 0.055800, N = 15SE +/- 0.010812, N = 4SE +/- 0.037316, N = 9SE +/- 0.008354, N = 7SE +/- 0.023904, N = 7SE +/- 0.010204, N = 7SE +/- 0.025580, N = 6SE +/- 0.019069, N = 15SE +/- 0.022393, N = 7SE +/- 0.022698, N = 7SE +/- 0.013568, N = 66.8527126.5417682.0843843.6543032.3129773.7548353.3604532.07683511.8521304.7025572.5273635.1141612.8810995.9309572.5298074.9558654.1827072.1594591. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: AlexNetXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1326395265SE +/- 0.19, N = 5SE +/- 0.08, N = 7SE +/- 0.07, N = 6SE +/- 0.12, N = 15SE +/- 0.04, N = 7SE +/- 0.05, N = 7SE +/- 0.15, N = 9SE +/- 0.48, N = 15SE +/- 0.17, N = 15SE +/- 0.18, N = 7SE +/- 0.07, N = 7SE +/- 0.10, N = 6SE +/- 0.05, N = 7SE +/- 0.33, N = 15SE +/- 0.52, N = 15SE +/- 1.22, N = 15SE +/- 0.57, N = 15SE +/- 0.76, N = 15SE +/- 0.44, N = 15SE +/- 0.08, N = 8SE +/- 0.66, N = 15SE +/- 0.45, N = 1518.3431.9929.5616.2434.3534.5118.5935.0819.8832.5626.2319.9242.0537.2633.2143.6737.7648.2837.5756.5335.5030.76

NAS Parallel Benchmarks

NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: SP.CEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P80K160K240K320K400KSE +/- 14.31, N = 3SE +/- 23.20, N = 3SE +/- 2064.71, N = 6SE +/- 126.50, N = 4SE +/- 1929.89, N = 5SE +/- 72.03, N = 4SE +/- 1178.78, N = 6SE +/- 1666.53, N = 6SE +/- 11.99, N = 3SE +/- 33.85, N = 3SE +/- 420.81, N = 4SE +/- 9.58, N = 3SE +/- 679.14, N = 4SE +/- 67.02, N = 3SE +/- 560.20, N = 4SE +/- 150.79, N = 3SE +/- 31.76, N = 4SE +/- 1528.09, N = 552684.9352745.64214017.18127519.37256584.67125191.11225311.82390520.9337567.6190420.25141954.1569776.41135939.2558815.36147311.1471245.26109416.42228184.681. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6

PyBench

This test profile reports the total time of the different average timed test results from PyBench. PyBench reports average test times for different functions such as BuiltinFunctionCalls and NestedForLoops, with this total result providing a rough estimate as to Python's average performance on a given system. This test profile runs PyBench each time for 20 rounds. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyBench 2018-02-16Total For Average Test TimesXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P2004006008001000SE +/- 0.58, N = 3SE +/- 0.88, N = 3SE +/- 1.15, N = 3SE +/- 0.33, N = 3SE +/- 2.40, N = 3SE +/- 1.45, N = 3SE +/- 1.33, N = 3SE +/- 0.58, N = 3SE +/- 1.86, N = 3SE +/- 2.19, N = 3SE +/- 2.08, N = 3SE +/- 1.20, N = 3SE +/- 2.85, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 0.58, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 1.15, N = 3SE +/- 0.33, N = 3SE +/- 0.41, N = 4SE +/- 0.48, N = 41005100711171119974976972974822818818818973971763762763763767765691692

NAS Parallel Benchmarks

NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: LU.CEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P130K260K390K520K650KSE +/- 274.93, N = 3SE +/- 314.42, N = 4SE +/- 5800.63, N = 15SE +/- 2566.89, N = 15SE +/- 4162.49, N = 6SE +/- 789.76, N = 5SE +/- 1849.65, N = 6SE +/- 1879.23, N = 6SE +/- 123.65, N = 3SE +/- 155.95, N = 4SE +/- 411.20, N = 5SE +/- 37.04, N = 4SE +/- 441.66, N = 5SE +/- 71.37, N = 3SE +/- 398.40, N = 5SE +/- 130.20, N = 4SE +/- 213.44, N = 5SE +/- 726.00, N = 5130839.12133284.46588329.32279397.45472931.04269047.28362511.43551955.5598557.16185954.54257384.55131606.86246822.52126171.52261127.09135125.15232012.77455312.091. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6

ASTC Encoder

ASTC Encoder (astcenc) is for the Adaptive Scalable Texture Compression (ASTC) format commonly used with OpenGL, OpenGL ES, and Vulkan graphics APIs. This test profile does a coding test of both compression/decompression. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.7Preset: ThoroughXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P306090120150SE +/- 0.85, N = 4SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.42, N = 4SE +/- 0.02, N = 3SE +/- 0.02, N = 4SE +/- 1.20, N = 5SE +/- 0.01, N = 5SE +/- 0.73, N = 15SE +/- 0.01, N = 4SE +/- 0.06, N = 5SE +/- 1.46, N = 12SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 5SE +/- 0.03, N = 4SE +/- 0.05, N = 4SE +/- 0.01, N = 3SE +/- 0.19, N = 5SE +/- 0.01, N = 4SE +/- 0.05, N = 4SE +/- 0.55, N = 579.2945.2140.6971.0237.9641.02121.3086.01105.4165.3073.38116.1215.5030.0383.3442.9872.3337.0186.9851.3054.4597.941. (CXX) g++ options: -O3 -flto -pthread

NAS Parallel Benchmarks

NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: IS.DEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P3K6K9K12K15KSE +/- 14.39, N = 4SE +/- 9.85, N = 4SE +/- 85.04, N = 8SE +/- 35.67, N = 5SE +/- 76.70, N = 10SE +/- 17.53, N = 5SE +/- 29.95, N = 5SE +/- 119.22, N = 6SE +/- 11.05, N = 3SE +/- 8.35, N = 4SE +/- 4.96, N = 4SE +/- 18.08, N = 4SE +/- 12.99, N = 4SE +/- 15.55, N = 4SE +/- 23.92, N = 4SE +/- 6.56, N = 3SE +/- 8.92, N = 4SE +/- 155.00, N = 152718.942746.209771.415702.1310139.695229.416346.1512296.272266.323345.453819.833076.663816.703050.163960.282865.724059.707437.811. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6

Timed Mesa Compilation

This test profile times how long it takes to compile Mesa with Meson/Ninja. For minimizing build dependencies and avoid versioning conflicts, test this is just the core Mesa build without LLVM or the extra Gallium3D/Mesa drivers enabled. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Mesa Compilation 24.0Time To CompileXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P612182430SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.12, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 4SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 4SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.17, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 423.4623.4125.8925.8821.5321.0419.5619.9116.4116.9616.6716.4023.6621.4418.1419.6518.4720.1818.2919.2317.2616.18

Xcompact3d Incompact3d

Xcompact3d Incompact3d is a Fortran-MPI based, finite difference high-performance code for solving the incompressible Navier-Stokes equation and as many as you need scalar transport equations. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: input.i3d 193 Cells Per DirectionEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P612182430SE +/- 0.10237421, N = 3SE +/- 0.01040414, N = 3SE +/- 0.01633300, N = 4SE +/- 0.03951909, N = 5SE +/- 0.04312156, N = 5SE +/- 0.06577912, N = 5SE +/- 0.05847189, N = 6SE +/- 0.00891960, N = 5SE +/- 0.01216869, N = 3SE +/- 0.02691998, N = 4SE +/- 0.05695382, N = 15SE +/- 0.01708632, N = 4SE +/- 0.01741826, N = 5SE +/- 0.04445674, N = 4SE +/- 0.04312801, N = 5SE +/- 0.01004100, N = 4SE +/- 0.02923582, N = 4SE +/- 0.03329814, N = 521.1780307020.937913904.510618938.872259144.260785968.253835116.881212793.7531990123.9708284011.249801606.6638751012.799758207.2934911713.969237606.3916981712.9293413010.196706605.391259671. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

Y-Cruncher

Y-Cruncher is a multi-threaded Pi benchmark capable of computing Pi to trillions of digits. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 1BXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P3691215SE +/- 0.002, N = 4SE +/- 0.020, N = 4SE +/- 0.018, N = 4SE +/- 0.007, N = 4SE +/- 0.001, N = 4SE +/- 0.005, N = 4SE +/- 0.049, N = 4SE +/- 0.007, N = 4SE +/- 0.012, N = 4SE +/- 0.008, N = 5SE +/- 0.008, N = 4SE +/- 0.012, N = 4SE +/- 0.011, N = 4SE +/- 0.010, N = 5SE +/- 0.142, N = 12SE +/- 0.026, N = 5SE +/- 0.122, N = 15SE +/- 0.045, N = 5SE +/- 0.007, N = 6SE +/- 0.005, N = 5SE +/- 0.030, N = 5SE +/- 0.010, N = 67.46810.38611.1987.96710.42710.2057.9156.9288.1966.7437.4718.99210.7127.7446.2667.9596.3348.3005.0087.0476.7015.110

Timed ImageMagick Compilation

This test times how long it takes to build ImageMagick. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed ImageMagick Compilation 6.9.0Time To CompileXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P510152025SE +/- 0.11, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 4SE +/- 0.08, N = 4SE +/- 0.04, N = 4SE +/- 0.09, N = 4SE +/- 0.06, N = 4SE +/- 0.04, N = 4SE +/- 0.03, N = 3SE +/- 0.13, N = 4SE +/- 0.07, N = 4SE +/- 0.06, N = 4SE +/- 0.11, N = 4SE +/- 0.15, N = 4SE +/- 0.13, N = 4SE +/- 0.10, N = 4SE +/- 0.10, N = 4SE +/- 0.03, N = 418.8519.2020.9120.5918.1817.9215.8116.3912.7513.4712.2011.7218.8416.3314.0915.3814.4016.0813.2614.7212.6011.49

m-queens

A solver for the N-queens problem with multi-threading support via the OpenMP library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is Betterm-queens 1.2Time To SolveXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P612182430SE +/- 0.034, N = 7SE +/- 0.032, N = 5SE +/- 0.039, N = 5SE +/- 0.035, N = 7SE +/- 0.029, N = 4SE +/- 0.019, N = 4SE +/- 0.031, N = 8SE +/- 0.021, N = 6SE +/- 0.093, N = 15SE +/- 0.019, N = 6SE +/- 0.025, N = 6SE +/- 0.064, N = 15SE +/- 0.023, N = 3SE +/- 0.066, N = 4SE +/- 0.028, N = 5SE +/- 0.035, N = 3SE +/- 0.021, N = 5SE +/- 0.031, N = 3SE +/- 0.021, N = 6SE +/- 0.025, N = 4SE +/- 0.030, N = 4SE +/- 0.028, N = 65.51210.30111.4796.04514.49313.2503.9816.3504.6097.7386.9504.13324.17512.3909.28518.10210.84021.0307.88115.21114.2577.4021. (CXX) g++ options: -fopenmp -O2 -march=native

Intel Open Image Denoise

Open Image Denoise is a denoising library for ray-tracing and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-OnlyXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1.14532.29063.43594.58125.7265SE +/- 0.00, N = 5SE +/- 0.00, N = 4SE +/- 0.00, N = 4SE +/- 0.01, N = 4SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 5SE +/- 0.03, N = 6SE +/- 0.01, N = 5SE +/- 0.01, N = 4SE +/- 0.02, N = 4SE +/- 0.00, N = 5SE +/- 0.00, N = 3SE +/- 0.00, N = 5SE +/- 0.02, N = 5SE +/- 0.00, N = 4SE +/- 0.02, N = 5SE +/- 0.00, N = 4SE +/- 0.01, N = 6SE +/- 0.00, N = 4SE +/- 0.00, N = 5SE +/- 0.03, N = 63.312.111.932.971.691.803.573.163.492.732.663.471.813.103.662.393.492.274.482.713.325.09

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-OnlyXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1.13182.26363.39544.52725.659SE +/- 0.03, N = 5SE +/- 0.00, N = 4SE +/- 0.00, N = 4SE +/- 0.00, N = 4SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 5SE +/- 0.02, N = 5SE +/- 0.01, N = 5SE +/- 0.01, N = 4SE +/- 0.00, N = 4SE +/- 0.00, N = 5SE +/- 0.00, N = 3SE +/- 0.01, N = 5SE +/- 0.04, N = 5SE +/- 0.00, N = 4SE +/- 0.01, N = 5SE +/- 0.00, N = 4SE +/- 0.03, N = 6SE +/- 0.00, N = 4SE +/- 0.00, N = 5SE +/- 0.03, N = 63.312.111.932.981.691.793.593.123.482.732.643.451.813.083.652.383.512.264.412.713.315.03

NAS Parallel Benchmarks

NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: CG.CEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P20K40K60K80K100KSE +/- 207.19, N = 6SE +/- 126.79, N = 6SE +/- 545.82, N = 5SE +/- 480.71, N = 15SE +/- 779.47, N = 7SE +/- 393.67, N = 15SE +/- 386.70, N = 9SE +/- 661.05, N = 7SE +/- 34.34, N = 6SE +/- 28.62, N = 7SE +/- 560.41, N = 15SE +/- 260.16, N = 15SE +/- 545.92, N = 15SE +/- 313.88, N = 7SE +/- 178.23, N = 8SE +/- 243.41, N = 12SE +/- 328.18, N = 8SE +/- 271.54, N = 621684.8022229.9463265.0143799.7884477.7253182.7762071.1088487.9122655.3238906.1366492.4435234.0665396.2235116.5558128.2433811.6363760.4598764.931. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6

GNU Octave Benchmark

This test profile measures how long it takes to complete several reference GNU Octave files via octave-benchmark. GNU Octave is used for numerical computations and is an open-source alternative to MATLAB. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterGNU Octave Benchmark 8.4.0Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P3691215SE +/- 0.108, N = 7SE +/- 0.051, N = 5SE +/- 0.035, N = 5SE +/- 0.023, N = 5SE +/- 0.007, N = 5SE +/- 0.011, N = 5SE +/- 0.025, N = 5SE +/- 0.014, N = 5SE +/- 0.004, N = 6SE +/- 0.009, N = 6SE +/- 0.018, N = 6SE +/- 0.007, N = 6SE +/- 0.017, N = 5SE +/- 0.052, N = 5SE +/- 0.082, N = 5SE +/- 0.024, N = 6SE +/- 0.096, N = 5SE +/- 0.015, N = 6SE +/- 0.019, N = 6SE +/- 0.015, N = 6SE +/- 0.020, N = 6SE +/- 0.019, N = 611.61910.24310.99612.2458.9488.9298.8488.8017.6457.5286.8576.9559.1049.69412.5787.74812.6177.6228.0367.5326.4586.856

Y-Cruncher

Y-Cruncher is a multi-threaded Pi benchmark capable of computing Pi to trillions of digits. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 500MXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1.16482.32963.49444.65925.824SE +/- 0.004, N = 6SE +/- 0.007, N = 6SE +/- 0.005, N = 6SE +/- 0.004, N = 6SE +/- 0.008, N = 6SE +/- 0.006, N = 6SE +/- 0.015, N = 5SE +/- 0.005, N = 6SE +/- 0.003, N = 5SE +/- 0.003, N = 6SE +/- 0.003, N = 6SE +/- 0.007, N = 5SE +/- 0.003, N = 6SE +/- 0.006, N = 7SE +/- 0.074, N = 15SE +/- 0.023, N = 15SE +/- 0.064, N = 15SE +/- 0.010, N = 7SE +/- 0.002, N = 8SE +/- 0.003, N = 7SE +/- 0.008, N = 7SE +/- 0.004, N = 73.4114.7705.1773.6295.1655.0774.1003.9684.3293.8504.3124.5104.8743.7242.9613.7043.1103.7812.3643.2673.3912.659

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P50100150200250SE +/- 0.16, N = 7SE +/- 0.05, N = 5SE +/- 0.04, N = 5SE +/- 0.10, N = 6SE +/- 0.05, N = 5SE +/- 0.03, N = 5SE +/- 1.88, N = 7SE +/- 0.12, N = 7SE +/- 1.54, N = 8SE +/- 0.03, N = 6SE +/- 0.07, N = 7SE +/- 2.04, N = 8SE +/- 0.04, N = 4SE +/- 0.29, N = 6SE +/- 1.20, N = 15SE +/- 0.11, N = 5SE +/- 0.63, N = 6SE +/- 0.04, N = 5SE +/- 0.13, N = 7SE +/- 0.05, N = 5SE +/- 0.13, N = 6SE +/- 0.26, N = 8151.2592.8884.71138.8573.9175.21208.31156.39185.71132.49155.12231.4355.4299.24129.7583.49125.7575.47152.7591.99112.66199.61

WebP Image Encode

This is a test of Google's libwebp with the cwebp image encode utility and using a sample 6000x4000 pixel JPEG image as the input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Highest CompressionXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P0.81451.6292.44353.2584.0725SE +/- 0.00, N = 5SE +/- 0.00, N = 5SE +/- 0.00, N = 5SE +/- 0.00, N = 5SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 5SE +/- 0.00, N = 5SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 6SE +/- 0.00, N = 62.472.492.232.233.033.033.033.043.623.623.613.622.822.813.093.103.093.103.073.083.473.461. (CC) gcc options: -fvisibility=hidden -O2 -lm

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P50100150200250SE +/- 0.14, N = 6SE +/- 0.02, N = 5SE +/- 0.05, N = 5SE +/- 0.11, N = 6SE +/- 0.07, N = 4SE +/- 0.04, N = 4SE +/- 1.04, N = 7SE +/- 0.64, N = 6SE +/- 0.43, N = 7SE +/- 0.08, N = 6SE +/- 0.20, N = 7SE +/- 1.23, N = 8SE +/- 0.07, N = 3SE +/- 0.08, N = 5SE +/- 0.48, N = 6SE +/- 0.02, N = 4SE +/- 0.14, N = 6SE +/- 0.05, N = 4SE +/- 0.12, N = 6SE +/- 0.07, N = 5SE +/- 0.05, N = 5SE +/- 0.07, N = 7133.4281.8373.96121.4358.2862.19190.08126.15176.21110.53130.79214.0243.6782.92116.6165.33107.6358.42124.7170.0582.97153.16

ASTC Encoder

ASTC Encoder (astcenc) is for the Adaptive Scalable Texture Compression (ASTC) format commonly used with OpenGL, OpenGL ES, and Vulkan graphics APIs. This test profile does a coding test of both compression/decompression. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.7Preset: MediumXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P120240360480600SE +/- 2.01, N = 5SE +/- 0.13, N = 6SE +/- 0.18, N = 5SE +/- 1.77, N = 5SE +/- 0.07, N = 6SE +/- 0.07, N = 6SE +/- 0.52, N = 6SE +/- 0.39, N = 7SE +/- 3.54, N = 6SE +/- 0.20, N = 7SE +/- 0.63, N = 7SE +/- 3.11, N = 7SE +/- 0.32, N = 4SE +/- 2.26, N = 5SE +/- 0.77, N = 6SE +/- 0.08, N = 6SE +/- 0.52, N = 6SE +/- 0.03, N = 6SE +/- 2.79, N = 6SE +/- 0.16, N = 6SE +/- 1.17, N = 6SE +/- 1.56, N = 7363.38314.62284.46338.15273.67294.62462.24527.80491.53449.11500.77508.09126.44216.97483.10284.33441.65247.30484.55333.99327.78550.021. (CXX) g++ options: -O3 -flto -pthread

SVT-AV1

This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 12 - Input: Bosphorus 4KXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P4080120160200SE +/- 1.07, N = 6SE +/- 0.15, N = 6SE +/- 0.08, N = 6SE +/- 0.88, N = 5SE +/- 0.78, N = 6SE +/- 0.71, N = 6SE +/- 1.41, N = 6SE +/- 1.32, N = 6SE +/- 1.88, N = 15SE +/- 0.80, N = 7SE +/- 0.43, N = 7SE +/- 0.88, N = 6SE +/- 0.48, N = 6SE +/- 1.28, N = 6SE +/- 0.97, N = 6SE +/- 0.40, N = 7SE +/- 0.83, N = 5SE +/- 0.61, N = 7SE +/- 0.25, N = 7SE +/- 0.41, N = 7SE +/- 0.20, N = 7SE +/- 0.42, N = 7117.68126.59115.35108.50157.36165.09168.78169.23171.22178.52165.75163.80134.07140.76127.55151.72122.09146.10156.52164.25177.86165.501. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

libavif avifenc

This is a test of the AOMedia libavif library testing the encoding of a JPEG image to AV1 Image Format (AVIF). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6, LosslessXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P3691215SE +/- 0.038, N = 5SE +/- 0.010, N = 6SE +/- 0.012, N = 5SE +/- 0.054, N = 5SE +/- 0.011, N = 6SE +/- 0.009, N = 6SE +/- 0.025, N = 6SE +/- 0.007, N = 6SE +/- 0.020, N = 7SE +/- 0.010, N = 7SE +/- 0.014, N = 7SE +/- 0.015, N = 7SE +/- 0.016, N = 6SE +/- 0.027, N = 6SE +/- 0.035, N = 6SE +/- 0.033, N = 6SE +/- 0.027, N = 6SE +/- 0.045, N = 6SE +/- 0.022, N = 7SE +/- 0.013, N = 7SE +/- 0.025, N = 7SE +/- 0.031, N = 79.3518.3599.1889.9607.3017.1826.9866.8535.8465.7995.7575.9508.2017.3887.0386.6057.1216.8366.1726.2785.7845.6131. (CXX) g++ options: -O3 -fPIC -lm

ACES DGEMM

This is a multi-threaded DGEMM benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGFLOP/s, More Is BetterACES DGEMM 1.0Sustained Floating-Point RateXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P20406080100SE +/- 0.04, N = 6SE +/- 0.01, N = 4SE +/- 0.01, N = 4SE +/- 0.03, N = 6SE +/- 0.10, N = 5SE +/- 0.16, N = 5SE +/- 0.19, N = 10SE +/- 0.17, N = 7SE +/- 0.10, N = 9SE +/- 0.22, N = 7SE +/- 0.40, N = 7SE +/- 0.39, N = 9SE +/- 0.01, N = 3SE +/- 0.09, N = 5SE +/- 0.04, N = 7SE +/- 0.09, N = 5SE +/- 0.06, N = 7SE +/- 0.04, N = 4SE +/- 0.28, N = 7SE +/- 0.09, N = 5SE +/- 0.08, N = 6SE +/- 0.11, N = 835.2017.8515.9431.4821.0021.8284.6944.9768.8739.0945.2578.5013.4924.9744.6722.5439.3519.7745.9723.5429.1458.251. (CC) gcc options: -O3 -march=native -fopenmp

libavif avifenc

This is a test of the AOMedia libavif library testing the encoding of a JPEG image to AV1 Image Format (AVIF). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 10, LosslessXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P246810SE +/- 0.016, N = 6SE +/- 0.003, N = 6SE +/- 0.009, N = 6SE +/- 0.021, N = 6SE +/- 0.010, N = 7SE +/- 0.006, N = 7SE +/- 0.006, N = 7SE +/- 0.004, N = 7SE +/- 0.006, N = 8SE +/- 0.006, N = 8SE +/- 0.002, N = 8SE +/- 0.003, N = 7SE +/- 0.008, N = 7SE +/- 0.011, N = 7SE +/- 0.028, N = 7SE +/- 0.015, N = 7SE +/- 0.019, N = 7SE +/- 0.005, N = 7SE +/- 0.014, N = 7SE +/- 0.006, N = 7SE +/- 0.008, N = 8SE +/- 0.015, N = 87.6036.8497.5078.0945.7345.7355.7405.6624.8294.7924.7704.9435.9065.9195.3114.8675.3174.9165.0744.9234.4564.5791. (CXX) g++ options: -O3 -fPIC -lm

NAS Parallel Benchmarks

NPB, NAS Parallel Benchmarks, is a benchmark developed by NASA for high-end computer systems. This test profile currently uses the MPI version of NPB. This test profile offers selecting the different NPB tests/problems and varying problem sizes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: MG.CEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P50K100K150K200K250KSE +/- 301.54, N = 8SE +/- 167.65, N = 8SE +/- 1776.37, N = 11SE +/- 884.47, N = 9SE +/- 2707.72, N = 14SE +/- 1153.71, N = 15SE +/- 1372.89, N = 15SE +/- 7207.31, N = 15SE +/- 53.56, N = 9SE +/- 233.83, N = 9SE +/- 1298.67, N = 9SE +/- 382.59, N = 10SE +/- 1415.96, N = 9SE +/- 436.97, N = 10SE +/- 1262.04, N = 9SE +/- 152.92, N = 9SE +/- 406.29, N = 9SE +/- 1422.07, N = 762449.5563930.64245447.72125567.07194942.32116725.04134994.14244738.8157317.66110742.15171436.4786407.46172614.1085910.95163333.2183448.70107321.89220893.781. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6

srsRAN Project

srsRAN Project is a complete ORAN-native 5G RAN solution created by Software Radio Systems (SRS). The srsRAN Project radio suite was formerly known as srsLTE and can be used for building your own software-defined radio (SDR) 4G/5G mobile network. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240325Test: PDSCH Processor Benchmark, Throughput ThreadXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P160320480640800SE +/- 0.66, N = 5SE +/- 0.24, N = 5SE +/- 0.32, N = 5SE +/- 0.32, N = 5SE +/- 1.24, N = 7SE +/- 3.14, N = 7SE +/- 4.48, N = 7SE +/- 0.80, N = 7SE +/- 3.72, N = 8SE +/- 1.71, N = 8SE +/- 3.13, N = 8SE +/- 5.52, N = 8SE +/- 3.57, N = 7SE +/- 2.08, N = 7SE +/- 5.02, N = 8SE +/- 1.27, N = 8SE +/- 3.86, N = 8SE +/- 1.64, N = 8SE +/- 2.57, N = 8SE +/- 1.17, N = 8SE +/- 1.34, N = 8SE +/- 1.89, N = 8323.7333.2299.4293.1563.6557.9576.8596.2673.4684.7680.7664.7484.8490.3663.8705.5651.9702.6675.5680.2742.9755.51. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -fno-trapping-math -fno-math-errno -ldl

LAMMPS Molecular Dynamics Simulator

LAMMPS is a classical molecular dynamics code, and an acronym for Large-scale Atomic/Molecular Massively Parallel Simulator. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: Rhodopsin ProteinEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1224364860SE +/- 0.30, N = 15SE +/- 0.29, N = 15SE +/- 0.24, N = 5SE +/- 0.29, N = 10SE +/- 0.39, N = 7SE +/- 0.14, N = 11SE +/- 0.35, N = 15SE +/- 0.43, N = 7SE +/- 0.28, N = 15SE +/- 0.53, N = 15SE +/- 0.09, N = 8SE +/- 0.04, N = 11SE +/- 0.11, N = 9SE +/- 0.05, N = 11SE +/- 0.33, N = 8SE +/- 0.36, N = 15SE +/- 0.29, N = 15SE +/- 0.97, N = 1521.9424.2551.6340.3950.1236.1540.0053.7721.1633.5452.2430.8447.5127.6342.2828.7234.3055.501. (CXX) g++ options: -O3 -lm -ldl

libavif avifenc

This is a test of the AOMedia libavif library testing the encoding of a JPEG image to AV1 Image Format (AVIF). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P1.08652.1733.25954.3465.4325SE +/- 0.034, N = 8SE +/- 0.004, N = 8SE +/- 0.003, N = 8SE +/- 0.023, N = 8SE +/- 0.011, N = 9SE +/- 0.016, N = 9SE +/- 0.026, N = 9SE +/- 0.002, N = 9SE +/- 0.008, N = 10SE +/- 0.011, N = 10SE +/- 0.005, N = 10SE +/- 0.005, N = 9SE +/- 0.010, N = 8SE +/- 0.023, N = 15SE +/- 0.022, N = 9SE +/- 0.011, N = 9SE +/- 0.029, N = 8SE +/- 0.017, N = 9SE +/- 0.008, N = 9SE +/- 0.022, N = 9SE +/- 0.016, N = 9SE +/- 0.009, N = 104.4863.8724.2434.8293.6233.4843.3413.2512.8102.7562.7232.8904.0933.5283.7383.5503.7763.7303.0443.1692.9712.8051. (CXX) g++ options: -O3 -fPIC -lm

Primesieve

Primesieve generates prime numbers using a highly optimized sieve of Eratosthenes implementation. Primesieve primarily benchmarks the CPU's L1/L2 cache performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.1Length: 1e12Xeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P246810SE +/- 0.008, N = 10SE +/- 0.003, N = 8SE +/- 0.003, N = 8SE +/- 0.012, N = 10SE +/- 0.003, N = 8SE +/- 0.006, N = 8SE +/- 0.010, N = 15SE +/- 0.002, N = 11SE +/- 0.005, N = 12SE +/- 0.003, N = 11SE +/- 0.004, N = 11SE +/- 0.003, N = 12SE +/- 0.006, N = 6SE +/- 0.003, N = 9SE +/- 0.005, N = 10SE +/- 0.010, N = 7SE +/- 0.004, N = 9SE +/- 0.006, N = 7SE +/- 0.006, N = 10SE +/- 0.019, N = 8SE +/- 0.007, N = 8SE +/- 0.008, N = 112.3374.3244.8062.6054.5453.8011.3591.9211.2422.0581.9841.1996.6733.3662.6915.3323.1216.1602.3254.5764.2502.1871. (CXX) g++ options: -O3

Parallel BZIP2 Compression

This test measures the time needed to compress a file (FreeBSD-13.0-RELEASE-amd64-memstick.img) using Parallel BZIP2 compression. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterParallel BZIP2 Compression 1.1.13FreeBSD-13.0-RELEASE-amd64-memstick.img CompressionXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P0.76351.5272.29053.0543.8175SE +/- 0.015943, N = 15SE +/- 0.014326, N = 10SE +/- 0.012826, N = 10SE +/- 0.015355, N = 15SE +/- 0.016947, N = 15SE +/- 0.023387, N = 15SE +/- 0.012053, N = 15SE +/- 0.010826, N = 15SE +/- 0.019468, N = 15SE +/- 0.014512, N = 15SE +/- 0.015384, N = 15SE +/- 0.015217, N = 15SE +/- 0.048155, N = 15SE +/- 0.026496, N = 15SE +/- 0.028863, N = 15SE +/- 0.020941, N = 15SE +/- 0.030907, N = 15SE +/- 0.023295, N = 15SE +/- 0.017240, N = 15SE +/- 0.007749, N = 10SE +/- 0.023842, N = 15SE +/- 0.024402, N = 151.7180222.2799712.5046211.8576422.3211952.2004971.0683981.3557371.1263291.4229541.3690631.1094463.3931892.1814551.7112962.2877661.9829322.6320771.4692102.1448571.8475371.4323621. (CXX) g++ options: -O2 -pthread -lbz2 -lpthread

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Deconvolution Batch shapes_3d - Engine: CPUXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P0.56191.12381.68572.24762.8095SE +/- 0.001365, N = 9SE +/- 0.002181, N = 9SE +/- 0.001097, N = 9SE +/- 0.001467, N = 9SE +/- 0.001685, N = 9SE +/- 0.000791, N = 9SE +/- 0.003127, N = 9SE +/- 0.001089, N = 9SE +/- 0.001921, N = 9SE +/- 0.001484, N = 9SE +/- 0.001272, N = 9SE +/- 0.002070, N = 9SE +/- 0.006599, N = 9SE +/- 0.001091, N = 9SE +/- 0.001240, N = 9SE +/- 0.000927, N = 9SE +/- 0.000806, N = 9SE +/- 0.000508, N = 9SE +/- 0.001274, N = 9SE +/- 0.000805, N = 9SE +/- 0.000392, N = 9SE +/- 0.000902, N = 92.2452602.0491002.2971202.4973401.7974901.4983500.8296530.9436211.0094731.1548701.1192301.0019141.4221300.8670650.8643581.1964300.9450751.2640700.7361701.0774300.9071610.6242501. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

CPU Power Consumption Monitor

OpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringXeon 6780E 2PXeon 6780EXeon 6766EXeon 6766E 2PEPYC 8534PNEPYC 8534PEPYC 9754 2PEPYC 9754EPYC 9654 2PEPYC 9654EPYC 9684XEPYC 9684X 2PXeon Platinum 8380Xeon Platinum 8380 2PXeon Max 9480 2PXeon Max 9480Xeon Max 9468 2PXeon Max 9468Xeon Platinum 8490H 2PXeon Platinum 8490HXeon Platinum 8592+Xeon Platinum 8592+ 2P170340510680850Min: 53.44 / Avg: 321.01 / Max: 713.33Min: 21.7 / Avg: 169.1 / Max: 357.69Min: 21.86 / Avg: 142.1 / Max: 271.22Min: 52.85 / Avg: 291.05 / Max: 542.48Min: 9.26 / Avg: 114.13 / Max: 155.71Min: 8.43 / Avg: 128.7 / Max: 184.62Min: 20.22 / Avg: 375.51 / Max: 735.74Min: 10.09 / Avg: 225.05 / Max: 397.44Min: 35.7 / Avg: 464.49 / Max: 751.79Min: 14.69 / Avg: 244.69 / Max: 373.1Min: 17.06 / Avg: 290.08 / Max: 413.51Min: 33.66 / Avg: 525.49 / Max: 837.69Min: 26.31 / Avg: 237.91 / Max: 292.14Min: 51.38 / Avg: 437.37 / Max: 583.47Min: 95.52 / Avg: 569.8 / Max: 760.61Min: 38.16 / Avg: 295.53 / Max: 384.53Min: 102.49 / Avg: 566.6 / Max: 756.48Min: 38.11 / Avg: 291.53 / Max: 379.76Min: 87.48 / Avg: 517.33 / Max: 758.17Min: 30.38 / Avg: 278.1 / Max: 383.24Min: 17.77 / Avg: 260.08 / Max: 405.42Min: 39.72 / Avg: 455.07 / Max: 946.96

264 Results Shown

WRF
OpenVKL
RELION
NWChem
High Performance Conjugate Gradient
TensorFlow
BRL-CAD
Xcompact3d Incompact3d
CloverLeaf
ASKAP:
  tConvolve MT - Gridding
  tConvolve MT - Degridding
PyTorch
PostgreSQL:
  100 - 1000 - Read Only - Average Latency
  100 - 1000 - Read Only
TensorFlow
OpenSSL:
  RSA4096:
    verify/s
    sign/s
Timed Linux Kernel Compilation
Stockfish
Apache IoTDB:
  800 - 100 - 800 - 100:
    Average Latency
    point/sec
PyTorch:
  CPU - 512 - ResNet-152
  CPU - 64 - ResNet-152
SecureMark
ClickHouse:
  100M Rows Hits Dataset, Third Run
  100M Rows Hits Dataset, Second Run
  100M Rows Hits Dataset, First Run / Cold Cache
Apache IoTDB:
  500 - 100 - 800 - 400:
    Average Latency
    point/sec
OpenRadioss
NAMD
Timed Gem5 Compilation
LAMMPS Molecular Dynamics Simulator
Timed Node.js Compilation
OpenSSL
TensorFlow
FFmpeg:
  libx265 - Platform
  libx265 - Video On Demand
ONNX Runtime:
  fcn-resnet101-11 - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
FFmpeg
PostgreSQL:
  100 - 1000 - Read Write - Average Latency
  100 - 1000 - Read Write
Blender
Numpy Benchmark
LuxCoreRender
OpenSSL:
  AES-128-GCM
  AES-256-GCM
  ChaCha20
  SHA512
  ChaCha20-Poly1305
PyTorch
LuxCoreRender
PyTorch
Xmrig
LuxCoreRender
OSPRay
RocksDB
ONNX Runtime:
  Faster R-CNN R-50-FPN-int8 - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
OpenFOAM:
  drivaerFastback, Medium Mesh Size - Execution Time
  drivaerFastback, Medium Mesh Size - Mesh Time
Timed LLVM Compilation
Memcached
ONNX Runtime:
  ResNet50 v1-12-int8 - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
NAMD
Speedb
PyTorch
ONNX Runtime:
  ArcFace ResNet-100 - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
  bertsquad-12 - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
  CaffeNet 12-int8 - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
Llamafile
Timed Godot Game Engine Compilation
PyTorch
OpenRadioss
QMCPACK
ONNX Runtime:
  fcn-resnet101-11 - CPU - Parallel:
    Inference Time Cost (ms)
    Inferences Per Second
  CaffeNet 12-int8 - CPU - Parallel:
    Inference Time Cost (ms)
    Inferences Per Second
  T5 Encoder - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
OpenVINO:
  Person Detection FP16 - CPU:
    ms
    FPS
ONNX Runtime:
  GPT-2 - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
TensorFlow
OSPRay
ONNX Runtime:
  yolov4 - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
  super-resolution-10 - CPU - Standard:
    Inference Time Cost (ms)
    Inferences Per Second
OSPRay Studio:
  1 - 4K - 32 - Path Tracer - CPU
  3 - 4K - 32 - Path Tracer - CPU
Zstd Compression:
  19 - Decompression Speed
  19 - Compression Speed
Speedb
VVenC
Zstd Compression:
  19, Long Mode - Decompression Speed
  19, Long Mode - Compression Speed
OpenVINO:
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU:
    ms
    FPS
OSPRay Studio
TensorFlow:
  CPU - 1 - ResNet-50
  CPU - 64 - ResNet-50
OpenVINO:
  Machine Translation EN To DE FP16 - CPU:
    ms
    FPS
ONNX Runtime:
  ResNet50 v1-12-int8 - CPU - Parallel:
    Inference Time Cost (ms)
    Inferences Per Second
OpenVINO:
  Noise Suppression Poconet-Like FP16 - CPU:
    ms
    FPS
libavif avifenc
ONNX Runtime:
  T5 Encoder - CPU - Parallel:
    Inference Time Cost (ms)
    Inferences Per Second
ASKAP:
  tConvolve MPI - Gridding
  tConvolve MPI - Degridding
Helsing
OSPRay Studio:
  1 - 4K - 16 - Path Tracer - CPU
  3 - 4K - 16 - Path Tracer - CPU
CloverLeaf
OSPRay Studio
OpenVINO:
  Road Segmentation ADAS FP16-INT8 - CPU:
    ms
    FPS
ONNX Runtime:
  ArcFace ResNet-100 - CPU - Parallel:
    Inference Time Cost (ms)
    Inferences Per Second
OpenVINO:
  Handwritten English Recognition FP16-INT8 - CPU:
    ms
    FPS
  Vehicle Detection FP16-INT8 - CPU:
    ms
    FPS
ONNX Runtime:
  Faster R-CNN R-50-FPN-int8 - CPU - Parallel:
    Inference Time Cost (ms)
    Inferences Per Second
TensorFlow
QuantLib
OpenVINO:
  Face Detection FP16-INT8 - CPU:
    ms
    FPS
OSPRay
Blender
OpenVINO:
  Person Vehicle Bike Detection FP16 - CPU:
    ms
    FPS
ONNX Runtime:
  bertsquad-12 - CPU - Parallel:
    Inference Time Cost (ms)
    Inferences Per Second
OpenVINO:
  Person Re-Identification Retail FP16 - CPU:
    ms
    FPS
PyTorch
OpenVINO:
  Weld Porosity Detection FP16-INT8 - CPU:
    ms
    FPS
ONNX Runtime:
  GPT-2 - CPU - Parallel:
    Inference Time Cost (ms)
    Inferences Per Second
OpenVINO:
  Face Detection Retail FP16-INT8 - CPU:
    ms
    FPS
ONNX Runtime:
  yolov4 - CPU - Parallel:
    Inference Time Cost (ms)
    Inferences Per Second
GraphicsMagick
GPAW
GraphicsMagick
Timed Linux Kernel Compilation
GraphicsMagick
ONNX Runtime:
  super-resolution-10 - CPU - Parallel:
    Inference Time Cost (ms)
    Inferences Per Second
GraphicsMagick
RocksDB
miniBUDE:
  OpenMP - BM2:
    Billion Interactions/s
    GFInst/s
Coremark
srsRAN Project
Blender
Aircrack-ng
WebP Image Encode
libavif avifenc
srsRAN Project
Llamafile
LULESH
7-Zip Compression:
  Decompression Rating
  Compression Rating
Algebraic Multi-Grid Benchmark
Liquid-DSP
NAS Parallel Benchmarks
ASTC Encoder
TensorFlow
miniFE
OpenRadioss
VVenC
Primesieve
GROMACS
ASTC Encoder
uvg266
John The Ripper
TensorFlow
Liquid-DSP
QuantLib
Liquid-DSP
SVT-AV1
uvg266
Liquid-DSP
TensorFlow
Liquid-DSP:
  64 - 256 - 57
  128 - 256 - 512
  256 - 256 - 512
John The Ripper
Liquid-DSP
SVT-AV1
Embree
John The Ripper
Liquid-DSP:
  256 - 256 - 57
  256 - 256 - 32
  128 - 256 - 32
Google SynthMark
Liquid-DSP
uvg266
Blender:
  Junkshop - CPU-Only
  Fishy Cat - CPU-Only
Appleseed
TensorFlow
Kvazaar
Pennant
Kvazaar
srsRAN Project
Kvazaar
OpenFOAM:
  drivaerFastback, Small Mesh Size - Execution Time
  drivaerFastback, Small Mesh Size - Mesh Time
SVT-AV1
Intel Open Image Denoise
Blender
miniBUDE:
  OpenMP - BM1:
    Billion Interactions/s
    GFInst/s
x265
Timed FFmpeg Compilation
Pennant
TensorFlow
NAS Parallel Benchmarks
PyBench
NAS Parallel Benchmarks
ASTC Encoder
NAS Parallel Benchmarks
Timed Mesa Compilation
Xcompact3d Incompact3d
Y-Cruncher
Timed ImageMagick Compilation
m-queens
Intel Open Image Denoise:
  RT.ldr_alb_nrm.3840x2160 - CPU-Only
  RT.hdr_alb_nrm.3840x2160 - CPU-Only
NAS Parallel Benchmarks
GNU Octave Benchmark
Y-Cruncher
Embree
WebP Image Encode
Embree
ASTC Encoder
SVT-AV1
libavif avifenc
ACES DGEMM
libavif avifenc
NAS Parallel Benchmarks
srsRAN Project
LAMMPS Molecular Dynamics Simulator
libavif avifenc
Primesieve
Parallel BZIP2 Compression
oneDNN
CPU Power Consumption Monitor