Granite Rapids MRDIMM vs. DDR5 Benchmarks Benchmarks for a future article. 2 x Intel Xeon 6980P testing with a Intel AvenueCity v0.01 (BHSDCRB1.IPC.0035.D44.2408292336 BIOS) and ASPEED on Ubuntu 24.04 via the Phoronix Test Suite. 24 x MRDIMM 88800: Processor: 2 x Intel Xeon 6980P @ 3.90GHz (256 Cores / 512 Threads), Motherboard: Intel AvenueCity v0.01 (BHSDCRB1.IPC.0035.D44.2408292336 BIOS), Chipset: Intel Ice Lake IEH, Memory: 1520GB, Disk: 2 x 1920GB KIOXIA KCD8XPUG1T92 + 960GB SAMSUNG MZ1L2960HCJR-00A07, Graphics: ASPEED, Network: Intel I210 + 2 x Intel 10-Gigabit X540-AT2 OS: Ubuntu 24.04, Kernel: 6.10.0-phx (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200 24 x DDR5-6400: Processor: 2 x Intel Xeon 6980P @ 3.90GHz (256 Cores / 512 Threads), Motherboard: Intel AvenueCity v0.01 (BHSDCRB1.IPC.0035.D44.2408292336 BIOS), Chipset: Intel Ice Lake IEH, Memory: 1520GB, Disk: 960GB SAMSUNG MZ1L2960HCJR-00A07 + 2 x 3201GB KIOXIA KCMYXVUG3T20, Graphics: ASPEED, Network: Intel I210 + 2 x Intel 10-Gigabit X540-AT2 OS: Ubuntu 24.04, Kernel: 6.8.0-22-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200 Algebraic Multi-Grid Benchmark 1.2 Figure Of Merit > Higher Is Better 24 x MRDIMM 88800 . 8606553000 |=============================================== Algebraic Multi-Grid Benchmark 1.2 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 194 AVG: 564 MAX: 954 Apache Cassandra 5.0 Test: Writes Op/s > Higher Is Better 24 x MRDIMM 88800 . 87063 |==================================================== 24 x DDR5-6400 .... 82480 |================================================= Apache Cassandra 5.0 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 218 AVG: 372 MAX: 432 GROMACS 2024 Implementation: MPI CPU - Input: water_GMX50_bare Ns Per Day > Higher Is Better 24 x MRDIMM 88800 . 33.31 |==================================================== GROMACS 2024 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 184 AVG: 310 MAX: 809 High Performance Conjugate Gradient 3.1 X Y Z: 104 104 104 - RT: 60 GFLOP/s > Higher Is Better 24 x MRDIMM 88800 . 170.95 |=================================================== 24 x DDR5-6400 .... 130.84 |======================================= High Performance Conjugate Gradient 3.1 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 223 AVG: 960 MAX: 1108 High Performance Conjugate Gradient 3.1 X Y Z: 144 144 144 - RT: 60 GFLOP/s > Higher Is Better 24 x MRDIMM 88800 . 169.49 |=================================================== 24 x DDR5-6400 .... 128.04 |======================================= High Performance Conjugate Gradient 3.1 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 354 AVG: 1040 MAX: 1107 Java JMH Throughput Ops/s > Higher Is Better 24 x MRDIMM 88800 . 790759705068.81 |========================================== Java JMH System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 206 AVG: 766 MAX: 882 libxsmm 2-1.17-3645 M N K: 64 GFLOPS/s > Higher Is Better 24 x MRDIMM 88800 . 4501.4 |=================================================== libxsmm 2-1.17-3645 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 203 AVG: 466 MAX: 879 libxsmm 2-1.17-3645 M N K: 128 GFLOPS/s > Higher Is Better 24 x MRDIMM 88800 . 7398.5 |=================================================== libxsmm 2-1.17-3645 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 189 AVG: 310 MAX: 388 LULESH 2.0.3 z/s > Higher Is Better 24 x MRDIMM 88800 . 124013.27 |================================================ LULESH 2.0.3 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 198 AVG: 496 MAX: 911 MBW 2018-09-08 Test: Memory Copy - Array Size: 8192 MiB MiB/s > Higher Is Better 24 x MRDIMM 88800 . 15316.41 |================================================= 24 x DDR5-6400 .... 14219.82 |============================================= MBW 2018-09-08 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 205 AVG: 291 MAX: 297 MBW 2018-09-08 Test: Memory Copy, Fixed Block Size - Array Size: 8192 MiB MiB/s > Higher Is Better 24 x MRDIMM 88800 . 8766.21 |================================================== 24 x DDR5-6400 .... 8683.01 |================================================== MBW 2018-09-08 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 201 AVG: 290 MAX: 295 NAS Parallel Benchmarks 3.4 Test / Class: BT.C Total Mop/s > Higher Is Better 24 x MRDIMM 88800 . 804396.26 |================================================ 24 x DDR5-6400 .... 759415.21 |============================================= NAS Parallel Benchmarks 3.4 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 203 AVG: 476 MAX: 900 NAS Parallel Benchmarks 3.4 Test / Class: EP.D Total Mop/s > Higher Is Better 24 x MRDIMM 88800 . 32324.72 |================================================ 24 x DDR5-6400 .... 32963.42 |================================================= NAS Parallel Benchmarks 3.4 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 204 AVG: 435 MAX: 782 NAS Parallel Benchmarks 3.4 Test / Class: LU.C Total Mop/s > Higher Is Better 24 x MRDIMM 88800 . 769386.67 |================================================ 24 x DDR5-6400 .... 735889.76 |============================================== NAS Parallel Benchmarks 3.4 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 205 AVG: 399 MAX: 760 NAS Parallel Benchmarks 3.4 Test / Class: SP.B Total Mop/s > Higher Is Better 24 x MRDIMM 88800 . 373559.46 |================================================ 24 x DDR5-6400 .... 349232.51 |============================================= NAS Parallel Benchmarks 3.4 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 220 AVG: 387 MAX: 564 NAS Parallel Benchmarks 3.4 Test / Class: IS.D Total Mop/s > Higher Is Better 24 x MRDIMM 88800 . 15638.56 |================================================= 24 x DDR5-6400 .... 13871.96 |=========================================== NAS Parallel Benchmarks 3.4 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 203 AVG: 367 MAX: 499 NAS Parallel Benchmarks 3.4 Test / Class: MG.C Total Mop/s > Higher Is Better 24 x MRDIMM 88800 . 449470.32 |================================================ 24 x DDR5-6400 .... 365424.17 |======================================= NAS Parallel Benchmarks 3.4 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 202 AVG: 369 MAX: 501 NAS Parallel Benchmarks 3.4 Test / Class: CG.C Total Mop/s > Higher Is Better 24 x MRDIMM 88800 . 118207.17 |================================================ 24 x DDR5-6400 .... 113647.23 |============================================== NAS Parallel Benchmarks 3.4 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 200 AVG: 358 MAX: 502 OpenFOAM 10 Input: drivaerFastback, Small Mesh Size - Mesh Time Seconds < Lower Is Better 24 x MRDIMM 88800 . 23.42 |========================================== 24 x DDR5-6400 .... 28.91 |==================================================== OpenFOAM 10 Input: drivaerFastback, Small Mesh Size - Execution Time Seconds < Lower Is Better 24 x MRDIMM 88800 . 18.39 |================================================== 24 x DDR5-6400 .... 19.00 |==================================================== OpenFOAM 10 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 282 AVG: 523 MAX: 764 OpenFOAM 10 Input: drivaerFastback, Medium Mesh Size - Mesh Time Seconds < Lower Is Better 24 x MRDIMM 88800 . 137.85 |============================================= 24 x DDR5-6400 .... 157.09 |=================================================== OpenFOAM 10 Input: drivaerFastback, Medium Mesh Size - Execution Time Seconds < Lower Is Better 24 x MRDIMM 88800 . 71.94 |=============================================== 24 x DDR5-6400 .... 80.05 |==================================================== OpenFOAM 10 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 221 AVG: 652 MAX: 934 OpenRadioss 2023.09.15 Model: Chrysler Neon 1M Seconds < Lower Is Better 24 x MRDIMM 88800 . 60.82 |=================================== 24 x DDR5-6400 .... 89.11 |==================================================== OpenRadioss 2023.09.15 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 209 AVG: 534 MAX: 864 Pennant 1.0.1 Test: leblancbig Hydro Cycle Time - Seconds < Lower Is Better 24 x MRDIMM 88800 . 1.342768 |================================================= Pennant 1.0.1 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 200 AVG: 394 MAX: 681 Pennant 1.0.1 Test: sedovbig Hydro Cycle Time - Seconds < Lower Is Better 24 x MRDIMM 88800 . 6.472671 |================================================= Pennant 1.0.1 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 207 AVG: 455 MAX: 805 PostgreSQL 17 Scaling Factor: 100 - Clients: 800 - Mode: Read Write TPS > Higher Is Better 24 x MRDIMM 88800 . 14452 |==================================================== 24 x DDR5-6400 .... 14207 |=================================================== PostgreSQL 17 Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latency ms < Lower Is Better 24 x MRDIMM 88800 . 55.37 |=================================================== 24 x DDR5-6400 .... 56.31 |==================================================== PostgreSQL 17 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 200 AVG: 339 MAX: 374 PostgreSQL 17 Scaling Factor: 100 - Clients: 800 - Mode: Read Only TPS > Higher Is Better 24 x MRDIMM 88800 . 509160 |=================================================== 24 x DDR5-6400 .... 503950 |================================================== PostgreSQL 17 Scaling Factor: 100 - Clients: 800 - Mode: Read Only - Average Latency ms < Lower Is Better 24 x MRDIMM 88800 . 1.596 |==================================================== 24 x DDR5-6400 .... 1.595 |==================================================== PostgreSQL 17 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 198 AVG: 488 MAX: 567 PostgreSQL 17 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write TPS > Higher Is Better 24 x MRDIMM 88800 . 13757 |==================================================== 24 x DDR5-6400 .... 13686 |==================================================== PostgreSQL 17 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency ms < Lower Is Better 24 x MRDIMM 88800 . 72.69 |==================================================== 24 x DDR5-6400 .... 73.08 |==================================================== PostgreSQL 17 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 205 AVG: 344 MAX: 378 PostgreSQL 17 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only TPS > Higher Is Better 24 x MRDIMM 88800 . 475621 |====================================== 24 x DDR5-6400 .... 637458 |=================================================== PostgreSQL 17 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency ms < Lower Is Better 24 x MRDIMM 88800 . 2.121 |==================================================== 24 x DDR5-6400 .... 1.582 |======================================= PostgreSQL 17 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 201 AVG: 483 MAX: 564 QuantLib 1.35-dev Size: S tasks/s > Higher Is Better SPECFEM3D 4.1.1 Model: Layered Halfspace Seconds < Lower Is Better 24 x MRDIMM 88800 . 7.113553561 |=========================================== 24 x DDR5-6400 .... 7.576594141 |============================================== SPECFEM3D 4.1.1 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 204 AVG: 422 MAX: 804 SPECFEM3D 4.1.1 Model: Water-layered Halfspace Seconds < Lower Is Better 24 x MRDIMM 88800 . 9.216693066 |============================================ 24 x DDR5-6400 .... 9.566090575 |============================================== SPECFEM3D 4.1.1 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 204 AVG: 470 MAX: 805 SPECFEM3D 4.1.1 Model: Homogeneous Halfspace Seconds < Lower Is Better 24 x MRDIMM 88800 . 5.417761321 |=========================================== 24 x DDR5-6400 .... 5.735451812 |============================================== SPECFEM3D 4.1.1 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 201 AVG: 421 MAX: 756 SPECFEM3D 4.1.1 Model: Mount St. Helens Seconds < Lower Is Better 24 x MRDIMM 88800 . 3.955489179 |============================================== SPECFEM3D 4.1.1 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 205 AVG: 429 MAX: 801 SPECFEM3D 4.1.1 Model: Tomographic Model Seconds < Lower Is Better 24 x MRDIMM 88800 . 4.379927179 |============================================== SPECFEM3D 4.1.1 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 198 AVG: 402 MAX: 790 Stream 2013-01-17 Type: Copy MB/s > Higher Is Better 24 x MRDIMM 88800 . 861560.8 |================================================= 24 x DDR5-6400 .... 870313.7 |================================================= Stream 2013-01-17 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 198 AVG: 585 MAX: 924 Stream 2013-01-17 Type: Scale MB/s > Higher Is Better 24 x MRDIMM 88800 . 952124.6 |================================================= 24 x DDR5-6400 .... 848431.9 |============================================ Stream 2013-01-17 Type: Add MB/s > Higher Is Better 24 x MRDIMM 88800 . 937751.9 |================================================= 24 x DDR5-6400 .... 887756.1 |============================================== Stream 2013-01-17 Type: Triad MB/s > Higher Is Better 24 x MRDIMM 88800 . 879963.6 |================================================ 24 x DDR5-6400 .... 893252.7 |================================================= System Power Consumption Monitor Phoronix Test Suite System Monitoring Watts 24 x MRDIMM 88800 . MIN: 184 AVG: 465 MAX: 1108 Timed Linux Kernel Compilation 6.8 Build: defconfig Seconds < Lower Is Better 24 x MRDIMM 88800 . 23.43 |==================================================== Timed Linux Kernel Compilation 6.8 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 198 AVG: 366 MAX: 848 Timed Linux Kernel Compilation 6.8 Build: allmodconfig Seconds < Lower Is Better 24 x MRDIMM 88800 . 131.84 |=================================================== Timed Linux Kernel Compilation 6.8 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 204 AVG: 555 MAX: 811 Timed LLVM Compilation 16.0 Build System: Ninja Seconds < Lower Is Better 24 x MRDIMM 88800 . 76.60 |==================================================== Timed LLVM Compilation 16.0 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 203 AVG: 470 MAX: 858 Timed LLVM Compilation 16.0 Build System: Unix Makefiles Seconds < Lower Is Better 24 x MRDIMM 88800 . 198.68 |=================================================== Timed LLVM Compilation 16.0 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 192 AVG: 359 MAX: 827 Timed Node.js Compilation 21.7.2 Time To Compile Seconds < Lower Is Better 24 x MRDIMM 88800 . 138.99 |=================================================== Timed Node.js Compilation 21.7.2 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 207 AVG: 445 MAX: 834 Tinymembench 2018-05-28 Standard Memcpy MB/s > Higher Is Better 24 x MRDIMM 88800 . 15008.9 |================================================== 24 x DDR5-6400 .... 15023.6 |================================================== Tinymembench 2018-05-28 Standard Memset MB/s > Higher Is Better 24 x MRDIMM 88800 . 30001.0 |================================================== 24 x DDR5-6400 .... 30044.8 |================================================== Tinymembench 2018-05-28 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 214 AVG: 286 MAX: 395 Xcompact3d Incompact3d 2021-03-11 Input: input.i3d 193 Cells Per Direction Seconds < Lower Is Better 24 x MRDIMM 88800 . 2.62023497 |=========================================== 24 x DDR5-6400 .... 2.89296635 |=============================================== Xcompact3d Incompact3d 2021-03-11 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 205 AVG: 424 MAX: 852 Xcompact3d Incompact3d 2021-03-11 Input: X3D-benchmarking input.i3d Seconds < Lower Is Better 24 x MRDIMM 88800 . 69.81 |========================================== 24 x DDR5-6400 .... 86.15 |==================================================== Xcompact3d Incompact3d 2021-03-11 System Power Consumption Monitor Watts < Lower Is Better 24 x MRDIMM 88800 . MIN: 202 AVG: 807 MAX: 1051