Graviton4 vs. Graviton3 vs. Graviton2 + AMD EPYC, Intel Xeon AWS Benchmarks by Michael Larabel for a future article on Phoronix. EPYC 9R14 r7a.16xlarge: Processor: AMD EPYC 9R14 (64 Cores), Motherboard: Amazon EC2 r7a.16xlarge (1.0 BIOS), Chipset: Intel 440FX 82441FX PMC, Memory: 1 x 512GB DDR5-4800MT/s, Disk: 429GB Amazon Elastic Block Store, Graphics: simpledrmdrmfb, Network: Amazon Elastic OS: Ubuntu 24.04, Kernel: 6.8.0-1009-aws (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 800x600, System Layer: amazon Graviton2 r6g.16xlarge: Processor: ARMv8 Neoverse-N1 (64 Cores), Motherboard: Amazon EC2 r6g.16xlarge (1.0 BIOS), Chipset: Amazon Device 0200, Memory: 512GB, Disk: 429GB Amazon Elastic Block Store, Network: Amazon Elastic OS: Ubuntu 24.04, Kernel: 6.8.0-1009-aws (aarch64), Compiler: GCC 13.2.0, File-System: ext4, System Layer: amazon Graviton3 r7g.16xlarge: Processor: ARMv8 Neoverse-V1 (64 Cores), Motherboard: Amazon EC2 r7g.16xlarge (1.0 BIOS), Chipset: Amazon Device 0200, Memory: 496GB, Disk: 429GB Amazon Elastic Block Store, Network: Amazon Elastic OS: Ubuntu 24.04, Kernel: 6.8.0-1009-aws (aarch64), Compiler: GCC 13.2.0, File-System: ext4, System Layer: amazon Graviton4 r8g.16xlarge: Processor: ARMv8 Neoverse-V2 (64 Cores), Motherboard: Amazon EC2 r8g.16xlarge (1.0 BIOS), Chipset: Amazon Device 0200, Memory: 496GB, Disk: 429GB Amazon Elastic Block Store, Network: Amazon Elastic OS: Ubuntu 24.04, Kernel: 6.8.0-1009-aws (aarch64), Compiler: GCC 13.2.0, File-System: ext4, System Layer: amazon Xeon 8488C r7i.16xlarge: Processor: Intel Xeon Platinum 8488C (32 Cores / 64 Threads), Motherboard: Amazon EC2 r7i.16xlarge (1.0 BIOS), Chipset: Intel 440FX 82441FX PMC, Memory: 1 x 512GB DDR5-4800MT/s, Disk: 429GB Amazon Elastic Block Store, Graphics: simpledrmdrmfb, Network: Amazon Elastic OS: Ubuntu 24.04, Kernel: 6.8.0-1009-aws (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 800x600, System Layer: amazon miniFE 2.2 Problem Size: Small CG Mflops > Higher Is Better EPYC 9R14 r7a.16xlarge .. 41274.2 |============================ Graviton2 r6g.16xlarge .. 22674.0 |=============== Graviton3 r7g.16xlarge .. 36361.7 |======================== Graviton4 r8g.16xlarge .. 65410.4 |============================================ Xeon 8488C r7i.16xlarge . 29012.7 |==================== Xcompact3d Incompact3d 2021-03-11 Input: input.i3d 193 Cells Per Direction Seconds < Lower Is Better EPYC 9R14 r7a.16xlarge .. 10.91576610 |================= Graviton2 r6g.16xlarge .. 25.52030050 |======================================== Graviton3 r7g.16xlarge .. 13.95584840 |====================== Graviton4 r8g.16xlarge .. 7.87502066 |============ Xeon 8488C r7i.16xlarge . 20.89203010 |================================= OpenFOAM 10 Input: drivaerFastback, Small Mesh Size - Mesh Time Seconds < Lower Is Better EPYC 9R14 r7a.16xlarge .. 24.79 |=============================== Graviton2 r6g.16xlarge .. 37.29 |============================================== Graviton3 r7g.16xlarge .. 24.78 |=============================== Graviton4 r8g.16xlarge .. 18.38 |======================= Xeon 8488C r7i.16xlarge . 26.60 |================================= OpenFOAM 10 Input: drivaerFastback, Small Mesh Size - Execution Time Seconds < Lower Is Better EPYC 9R14 r7a.16xlarge .. 43.17 |=================== Graviton2 r6g.16xlarge .. 102.65 |============================================= Graviton3 r7g.16xlarge .. 68.29 |============================== Graviton4 r8g.16xlarge .. 41.41 |================== Xeon 8488C r7i.16xlarge . 63.45 |============================ OpenFOAM 10 Input: drivaerFastback, Medium Mesh Size - Mesh Time Seconds < Lower Is Better EPYC 9R14 r7a.16xlarge .. 124.00 |============================= Graviton2 r6g.16xlarge .. 194.79 |============================================= Graviton3 r7g.16xlarge .. 121.28 |============================ Graviton4 r8g.16xlarge .. 91.97 |===================== Xeon 8488C r7i.16xlarge . 135.97 |=============================== OpenFOAM 10 Input: drivaerFastback, Medium Mesh Size - Execution Time Seconds < Lower Is Better EPYC 9R14 r7a.16xlarge .. 374.70 |=================== Graviton2 r6g.16xlarge .. 872.08 |============================================= Graviton3 r7g.16xlarge .. 552.57 |============================= Graviton4 r8g.16xlarge .. 344.17 |================== Xeon 8488C r7i.16xlarge . 653.58 |================================== Xmrig 6.21 Variant: GhostRider - Hash Count: 1M H/s > Higher Is Better EPYC 9R14 r7a.16xlarge .. 6899.8 |============================================= Graviton2 r6g.16xlarge .. 2067.5 |============= Graviton3 r7g.16xlarge .. 2108.5 |============== Graviton4 r8g.16xlarge .. 5958.7 |======================================= Xeon 8488C r7i.16xlarge . 3659.3 |======================== srsRAN Project 23.10.1-20240325 Test: PDSCH Processor Benchmark, Throughput Total Mbps > Higher Is Better EPYC 9R14 r7a.16xlarge .. 28256.8 |============================================ Graviton2 r6g.16xlarge .. 8104.1 |============= Graviton3 r7g.16xlarge .. 12612.6 |==================== Graviton4 r8g.16xlarge .. 14402.5 |====================== Xeon 8488C r7i.16xlarge . 16787.8 |========================== srsRAN Project 23.10.1-20240325 Test: PUSCH Processor Benchmark, Throughput Total Mbps > Higher Is Better EPYC 9R14 r7a.16xlarge .. 2400.2 |============================================= Graviton2 r6g.16xlarge .. 705.9 |============= Graviton3 r7g.16xlarge .. 1053.8 |==================== Graviton4 r8g.16xlarge .. 1332.5 |========================= Xeon 8488C r7i.16xlarge . 1610.3 |============================== John The Ripper 2023.03.14 Test: bcrypt Real C/S > Higher Is Better EPYC 9R14 r7a.16xlarge .. 91409 |============================================== Graviton2 r6g.16xlarge .. 45216 |======================= Graviton3 r7g.16xlarge .. 50709 |========================== Graviton4 r8g.16xlarge .. 57038 |============================= Xeon 8488C r7i.16xlarge . 58796 |============================== John The Ripper 2023.03.14 Test: WPA PSK Real C/S > Higher Is Better EPYC 9R14 r7a.16xlarge .. 371747 |============================================= Graviton2 r6g.16xlarge .. 49854 |====== Graviton3 r7g.16xlarge .. 52631 |====== Graviton4 r8g.16xlarge .. 57444 |======= Xeon 8488C r7i.16xlarge . 238561 |============================= John The Ripper 2023.03.14 Test: Blowfish Real C/S > Higher Is Better EPYC 9R14 r7a.16xlarge .. 91221 |============================================== Graviton2 r6g.16xlarge .. 45204 |======================= Graviton3 r7g.16xlarge .. 50679 |========================== Graviton4 r8g.16xlarge .. 57032 |============================= Xeon 8488C r7i.16xlarge . 58815 |============================== John The Ripper 2023.03.14 Test: HMAC-SHA512 Real C/S > Higher Is Better EPYC 9R14 r7a.16xlarge .. 256384000 |========================================== Graviton2 r6g.16xlarge .. 61258333 |========== Graviton3 r7g.16xlarge .. 86689000 |============== Graviton4 r8g.16xlarge .. 108066333 |================== Xeon 8488C r7i.16xlarge . 182244000 |============================== John The Ripper 2023.03.14 Test: MD5 Real C/S > Higher Is Better EPYC 9R14 r7a.16xlarge .. 8647000 |============================================ Graviton2 r6g.16xlarge .. 1332667 |======= Graviton3 r7g.16xlarge .. 1451333 |======= Graviton4 r8g.16xlarge .. 1579667 |======== Xeon 8488C r7i.16xlarge . 5780000 |============================= 7-Zip Compression 24.05 Test: Compression Rating MIPS > Higher Is Better EPYC 9R14 r7a.16xlarge .. 320933 |====================================== Graviton2 r6g.16xlarge .. 229844 |=========================== Graviton3 r7g.16xlarge .. 296731 |=================================== Graviton4 r8g.16xlarge .. 383460 |============================================= Xeon 8488C r7i.16xlarge . 245712 |============================= 7-Zip Compression 24.05 Test: Decompression Rating MIPS > Higher Is Better EPYC 9R14 r7a.16xlarge .. 288408 |======================================= Graviton2 r6g.16xlarge .. 232070 |================================ Graviton3 r7g.16xlarge .. 284576 |======================================= Graviton4 r8g.16xlarge .. 331505 |============================================= Xeon 8488C r7i.16xlarge . 177209 |======================== Stockfish 16.1 Chess Benchmark Nodes Per Second > Higher Is Better EPYC 9R14 r7a.16xlarge .. 85180777 |=========================================== Graviton2 r6g.16xlarge .. 43501453 |====================== Graviton3 r7g.16xlarge .. 55548662 |============================ Graviton4 r8g.16xlarge .. 81440801 |========================================= Xeon 8488C r7i.16xlarge . 59224620 |============================== Timed Gem5 Compilation 23.0.1 Time To Compile Seconds < Lower Is Better EPYC 9R14 r7a.16xlarge .. 213.29 |============================= Graviton2 r6g.16xlarge .. 334.81 |============================================= Graviton3 r7g.16xlarge .. 251.40 |================================== Graviton4 r8g.16xlarge .. 186.77 |========================= Xeon 8488C r7i.16xlarge . 244.88 |================================= Timed Godot Game Engine Compilation 4.0 Time To Compile Seconds < Lower Is Better EPYC 9R14 r7a.16xlarge .. 127.45 |===================== Graviton2 r6g.16xlarge .. 274.04 |============================================= Graviton3 r7g.16xlarge .. 195.50 |================================ Graviton4 r8g.16xlarge .. 147.87 |======================== Xeon 8488C r7i.16xlarge . 164.60 |=========================== Timed LLVM Compilation 16.0 Build System: Ninja Seconds < Lower Is Better EPYC 9R14 r7a.16xlarge .. 198.50 |========================== Graviton2 r6g.16xlarge .. 344.43 |============================================= Graviton3 r7g.16xlarge .. 257.85 |================================== Graviton4 r8g.16xlarge .. 182.06 |======================== Xeon 8488C r7i.16xlarge . 263.37 |================================== Timed Node.js Compilation 21.7.2 Time To Compile Seconds < Lower Is Better EPYC 9R14 r7a.16xlarge .. 250.43 |================= Graviton2 r6g.16xlarge .. 678.01 |============================================= Graviton3 r7g.16xlarge .. 571.01 |====================================== Graviton4 r8g.16xlarge .. 365.02 |======================== Xeon 8488C r7i.16xlarge . 354.09 |======================== C-Ray 2.0 Resolution: 4K - Rays Per Pixel: 16 Seconds < Lower Is Better EPYC 9R14 r7a.16xlarge .. 49.69 |============================== Graviton2 r6g.16xlarge .. 63.70 |====================================== Graviton3 r7g.16xlarge .. 38.67 |======================= Graviton4 r8g.16xlarge .. 28.32 |================= Xeon 8488C r7i.16xlarge . 76.25 |============================================== C-Ray 2.0 Resolution: 5K - Rays Per Pixel: 16 Seconds < Lower Is Better EPYC 9R14 r7a.16xlarge .. 88.89 |============================= Graviton2 r6g.16xlarge .. 113.15 |====================================== Graviton3 r7g.16xlarge .. 68.70 |======================= Graviton4 r8g.16xlarge .. 50.25 |================= Xeon 8488C r7i.16xlarge . 135.60 |============================================= Liquid-DSP 1.6 Threads: 64 - Buffer Length: 256 - Filter Length: 32 samples/s > Higher Is Better EPYC 9R14 r7a.16xlarge .. 2261533333 |============================ Graviton2 r6g.16xlarge .. 1851200000 |======================= Graviton3 r7g.16xlarge .. 2573800000 |================================ Graviton4 r8g.16xlarge .. 3258733333 |========================================= Xeon 8488C r7i.16xlarge . 1952200000 |========================= Liquid-DSP 1.6 Threads: 64 - Buffer Length: 256 - Filter Length: 57 samples/s > Higher Is Better EPYC 9R14 r7a.16xlarge .. 2529533333 |========================================= Graviton2 r6g.16xlarge .. 1173933333 |=================== Graviton3 r7g.16xlarge .. 1654733333 |=========================== Graviton4 r8g.16xlarge .. 1929666667 |=============================== Xeon 8488C r7i.16xlarge . 2093933333 |================================== Liquid-DSP 1.6 Threads: 64 - Buffer Length: 256 - Filter Length: 512 samples/s > Higher Is Better EPYC 9R14 r7a.16xlarge .. 759700000 |========================================== Graviton2 r6g.16xlarge .. 150236667 |======== Graviton3 r7g.16xlarge .. 166313333 |========= Graviton4 r8g.16xlarge .. 185000000 |========== Xeon 8488C r7i.16xlarge . 619730000 |================================== OpenSSL Algorithm: ChaCha20 byte/s > Higher Is Better EPYC 9R14 r7a.16xlarge .. 308611390393 |======================================= Graviton2 r6g.16xlarge .. 67045933947 |======== Graviton3 r7g.16xlarge .. 94147502077 |============ Graviton4 r8g.16xlarge .. 101898720323 |============= Xeon 8488C r7i.16xlarge . 183018463593 |======================= OpenSSL Algorithm: AES-128-GCM byte/s > Higher Is Better EPYC 9R14 r7a.16xlarge .. 256101795407 |==================== Graviton2 r6g.16xlarge .. 156957263187 |============ Graviton3 r7g.16xlarge .. 287591524763 |====================== Graviton4 r8g.16xlarge .. 299797102137 |======================= Xeon 8488C r7i.16xlarge . 503174525747 |======================================= OpenSSL Algorithm: AES-256-GCM byte/s > Higher Is Better EPYC 9R14 r7a.16xlarge .. 236482948213 |====================== Graviton2 r6g.16xlarge .. 126510935517 |============ Graviton3 r7g.16xlarge .. 249095500597 |======================= Graviton4 r8g.16xlarge .. 266125150527 |========================= Xeon 8488C r7i.16xlarge . 419371371453 |======================================= OpenSSL Algorithm: ChaCha20-Poly1305 byte/s > Higher Is Better EPYC 9R14 r7a.16xlarge .. 217491096737 |======================================= Graviton2 r6g.16xlarge .. 46479276533 |======== Graviton3 r7g.16xlarge .. 69430704540 |============ Graviton4 r8g.16xlarge .. 75190548707 |============= Xeon 8488C r7i.16xlarge . 134022346887 |======================== ClickHouse 22.12.3.5 100M Rows Hits Dataset, First Run / Cold Cache Queries Per Minute, Geo Mean > Higher Is Better EPYC 9R14 r7a.16xlarge .. 488.88 |============================================= Graviton2 r6g.16xlarge .. 252.63 |======================= Graviton3 r7g.16xlarge .. 348.41 |================================ Graviton4 r8g.16xlarge .. 449.44 |========================================= Xeon 8488C r7i.16xlarge . 377.02 |=================================== ClickHouse 22.12.3.5 100M Rows Hits Dataset, Second Run Queries Per Minute, Geo Mean > Higher Is Better EPYC 9R14 r7a.16xlarge .. 508.87 |============================================= Graviton2 r6g.16xlarge .. 269.15 |======================== Graviton3 r7g.16xlarge .. 375.29 |================================= Graviton4 r8g.16xlarge .. 479.94 |========================================== Xeon 8488C r7i.16xlarge . 404.64 |==================================== ClickHouse 22.12.3.5 100M Rows Hits Dataset, Third Run Queries Per Minute, Geo Mean > Higher Is Better EPYC 9R14 r7a.16xlarge .. 514.29 |============================================= Graviton2 r6g.16xlarge .. 274.07 |======================== Graviton3 r7g.16xlarge .. 382.14 |================================= Graviton4 r8g.16xlarge .. 495.03 |=========================================== Xeon 8488C r7i.16xlarge . 404.38 |=================================== GROMACS 2024 Implementation: MPI CPU - Input: water_GMX50_bare Ns Per Day > Higher Is Better EPYC 9R14 r7a.16xlarge .. 8.519 |============================================== Graviton2 r6g.16xlarge .. 2.709 |=============== Graviton3 r7g.16xlarge .. 4.163 |====================== Graviton4 r8g.16xlarge .. 4.831 |========================== Xeon 8488C r7i.16xlarge . 5.733 |=============================== PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only TPS > Higher Is Better EPYC 9R14 r7a.16xlarge .. 2092710 |============================================ Graviton2 r6g.16xlarge .. 916786 |=================== Graviton3 r7g.16xlarge .. 1087488 |======================= Graviton4 r8g.16xlarge .. 1947525 |========================================= Xeon 8488C r7i.16xlarge . 1995618 |========================================== PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency ms < Lower Is Better EPYC 9R14 r7a.16xlarge .. 0.478 |==================== Graviton2 r6g.16xlarge .. 1.091 |============================================== Graviton3 r7g.16xlarge .. 0.920 |======================================= Graviton4 r8g.16xlarge .. 0.514 |====================== Xeon 8488C r7i.16xlarge . 0.501 |===================== PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write TPS > Higher Is Better EPYC 9R14 r7a.16xlarge .. 4458 |============================================== Graviton2 r6g.16xlarge .. 4483 |============================================== Graviton3 r7g.16xlarge .. 4541 |=============================================== Graviton4 r8g.16xlarge .. 4420 |============================================== Xeon 8488C r7i.16xlarge . 4437 |============================================== PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency ms < Lower Is Better EPYC 9R14 r7a.16xlarge .. 224.32 |============================================= Graviton2 r6g.16xlarge .. 223.17 |============================================ Graviton3 r7g.16xlarge .. 220.27 |============================================ Graviton4 r8g.16xlarge .. 226.24 |============================================= Xeon 8488C r7i.16xlarge . 225.37 |============================================= RocksDB 9.0 Test: Random Read Op/s > Higher Is Better EPYC 9R14 r7a.16xlarge .. 324703669 |======================================= Graviton2 r6g.16xlarge .. 165816939 |==================== Graviton3 r7g.16xlarge .. 243166771 |============================= Graviton4 r8g.16xlarge .. 346532586 |========================================== Xeon 8488C r7i.16xlarge . 170624807 |===================== RocksDB 9.0 Test: Update Random Op/s > Higher Is Better EPYC 9R14 r7a.16xlarge .. 742898 |========================== Graviton2 r6g.16xlarge .. 305604 |=========== Graviton3 r7g.16xlarge .. 817470 |============================ Graviton4 r8g.16xlarge .. 1274616 |============================================ Xeon 8488C r7i.16xlarge . 779301 |=========================== RocksDB 9.0 Test: Read While Writing Op/s > Higher Is Better EPYC 9R14 r7a.16xlarge .. 6304192 |================================= Graviton2 r6g.16xlarge .. 5955845 |=============================== Graviton3 r7g.16xlarge .. 6872389 |=================================== Graviton4 r8g.16xlarge .. 8522597 |============================================ Xeon 8488C r7i.16xlarge . 5685167 |============================= RocksDB 9.0 Test: Read Random Write Random Op/s > Higher Is Better EPYC 9R14 r7a.16xlarge .. 3756585 |============================== Graviton2 r6g.16xlarge .. 2912791 |======================= Graviton3 r7g.16xlarge .. 4254497 |================================== Graviton4 r8g.16xlarge .. 5584014 |============================================ Xeon 8488C r7i.16xlarge . 3243486 |========================== Blender 4.0.2 Blend File: BMW27 - Compute: CPU-Only Seconds < Lower Is Better EPYC 9R14 r7a.16xlarge .. 30.19 |================= Graviton2 r6g.16xlarge .. 83.01 |============================================== Graviton3 r7g.16xlarge .. 62.77 |=================================== Graviton4 r8g.16xlarge .. 50.64 |============================ Xeon 8488C r7i.16xlarge . 39.74 |====================== Blender 4.0.2 Blend File: Classroom - Compute: CPU-Only Seconds < Lower Is Better EPYC 9R14 r7a.16xlarge .. 57.11 |=============== Graviton2 r6g.16xlarge .. 169.86 |============================================= Graviton3 r7g.16xlarge .. 129.48 |================================== Graviton4 r8g.16xlarge .. 105.39 |============================ Xeon 8488C r7i.16xlarge . 78.96 |===================== Blender 4.0.2 Blend File: Fishy Cat - Compute: CPU-Only Seconds < Lower Is Better EPYC 9R14 r7a.16xlarge .. 39.16 |============ Graviton2 r6g.16xlarge .. 147.77 |============================================= Graviton3 r7g.16xlarge .. 115.47 |=================================== Graviton4 r8g.16xlarge .. 95.01 |============================= Xeon 8488C r7i.16xlarge . 53.74 |================ Blender 4.0.2 Blend File: Barbershop - Compute: CPU-Only Seconds < Lower Is Better EPYC 9R14 r7a.16xlarge .. 284.63 |=============== Graviton2 r6g.16xlarge .. 832.27 |============================================= Graviton3 r7g.16xlarge .. 644.98 |=================================== Graviton4 r8g.16xlarge .. 499.63 |=========================== Xeon 8488C r7i.16xlarge . 414.24 |====================== Blender 4.0.2 Blend File: Pabellon Barcelona - Compute: CPU-Only Seconds < Lower Is Better EPYC 9R14 r7a.16xlarge .. 84.52 |============ Graviton2 r6g.16xlarge .. 321.20 |============================================= Graviton3 r7g.16xlarge .. 247.60 |=================================== Graviton4 r8g.16xlarge .. 202.26 |============================ Xeon 8488C r7i.16xlarge . 115.14 |================