18 2 x AMD EPYC 7532 32-Core testing with a GIGABYTE MZ52-G41-00 v01000100 (R01 BIOS) and Gigabyte NVIDIA GeForce RTX 3090 24GB on Rocky Linux 8.4 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2407265-NE-18639010227&grs .
18 Processor Motherboard Chipset Memory Disk Graphics Audio Network OS Kernel Display Server Display Driver Compiler File-System Screen Resolution 2 x AMD EPYC 7532 32-Core - Gigabyte NVIDIA GeForce 2 x AMD EPYC 7532 32-Core @ 2.40GHz (64 Cores) GIGABYTE MZ52-G41-00 v01000100 (R01 BIOS) AMD Starship/Matisse 512GB 4001GB INTEL SSDPE2KX040T8 Gigabyte NVIDIA GeForce RTX 3090 24GB NVIDIA GA102 HD Audio 2 x Mellanox MT28800 + 2 x Intel I350 Rocky Linux 8.4 4.18.0-477.10.1.el8_8.x86_64 (x86_64) X Server NVIDIA GCC 8.5.0 20210514 UNKNOWN (0x18031977) 1024x768 OpenBenchmarking.org - Transparent Huge Pages: always - Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0x8301038 - Python 3.8.17 - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT disabled + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
18 pytorch: NVIDIA CUDA GPU - 1 - ResNet-50 pytorch: CPU - 1 - ResNet-50 2 x AMD EPYC 7532 32-Core - Gigabyte NVIDIA GeForce 147.83 12.46 OpenBenchmarking.org
PyTorch Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-50 2 x AMD EPYC 7532 32-Core - Gigabyte NVIDIA GeForce 30 60 90 120 150 SE +/- 0.37, N = 3 147.83 MIN: 93.83 / MAX: 151.88
PyTorch Device: CPU - Batch Size: 1 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 1 - Model: ResNet-50 2 x AMD EPYC 7532 32-Core - Gigabyte NVIDIA GeForce 3 6 9 12 15 SE +/- 0.10, N = 3 12.46 MIN: 8.32 / MAX: 14.24
Phoronix Test Suite v10.8.5