onnx smoke AMD Ryzen Threadripper 7980X 64-Cores testing with a System76 Thelio Major (FA Z5 BIOS) and AMD Radeon Pro W7900 on Ubuntu 24.10 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2408219-PTS-ONNXSMOK17 .
onnx smoke Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server OpenGL Compiler File-System Screen Resolution AMD Ryzen Threadripper 7980X 64-Cores - AMD Radeon AMD Ryzen Threadripper 7980X 64-Cores @ 7.79GHz (64 Cores / 128 Threads) System76 Thelio Major (FA Z5 BIOS) AMD Device 14a4 4 x 32GB DDR5-4800MT/s Micron MTC20F1045S1RC48BA2 1000GB CT1000T700SSD5 AMD Radeon Pro W7900 AMD Device 14cc DELL P2415Q Aquantia AQC113C NBase-T/IEEE + Realtek RTL8125 2.5GbE + Intel Wi-Fi 6E Ubuntu 24.10 6.8.0-31-generic (x86_64) GNOME Shell X Server + Wayland 4.6 Mesa 24.0.9-0ubuntu2 (LLVM 17.0.6 DRM 3.57) GCC 14.2.0 ext4 1920x1200 OpenBenchmarking.org - Transparent Huge Pages: madvise - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2,rust --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-14-F5tscv/gcc-14-14.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-14-F5tscv/gcc-14-14.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xa108105 - Python 3.12.5 - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected
onnx smoke onnx: ZFNet-512 - CPU - Standard onnx: ZFNet-512 - CPU - Standard onnx: ZFNet-512 - CPU - Parallel onnx: ZFNet-512 - CPU - Parallel onnx: ResNet101_DUC_HDC-12 - CPU - Standard onnx: ResNet101_DUC_HDC-12 - CPU - Standard onnx: ResNet101_DUC_HDC-12 - CPU - Parallel onnx: ResNet101_DUC_HDC-12 - CPU - Parallel AMD Ryzen Threadripper 7980X 64-Cores - AMD Radeon 82.2233 12.1594 53.656 18.6352 2.68869 371.925 1.61769 618.159 OpenBenchmarking.org
ONNX Runtime Model: ZFNet-512 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.19 Model: ZFNet-512 - Device: CPU - Executor: Standard AMD Ryzen Threadripper 7980X 64-Cores - AMD Radeon 20 40 60 80 100 82.22 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: ZFNet-512 - Device: CPU - Executor: Standard OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.19 Model: ZFNet-512 - Device: CPU - Executor: Standard AMD Ryzen Threadripper 7980X 64-Cores - AMD Radeon 3 6 9 12 15 12.16 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime CPU Power Consumption Monitor Min Avg Max AMD Ryzen Threadripper 7980X 64-Cores - AMD Radeon 80.1 329.1 351.4 OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.19 CPU Power Consumption Monitor 100 200 300 400 500
ONNX Runtime CPU Temperature Monitor Min Avg Max AMD Ryzen Threadripper 7980X 64-Cores - AMD Radeon 41.1 61.3 65.8 OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.19 CPU Temperature Monitor 20 40 60 80 100
ONNX Runtime Model: ZFNet-512 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.19 Model: ZFNet-512 - Device: CPU - Executor: Parallel AMD Ryzen Threadripper 7980X 64-Cores - AMD Radeon 12 24 36 48 60 53.66 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: ZFNet-512 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.19 Model: ZFNet-512 - Device: CPU - Executor: Parallel AMD Ryzen Threadripper 7980X 64-Cores - AMD Radeon 5 10 15 20 25 18.64 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime CPU Power Consumption Monitor Min Avg Max AMD Ryzen Threadripper 7980X 64-Cores - AMD Radeon 82.4 325.8 351.0 OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.19 CPU Power Consumption Monitor 100 200 300 400 500
ONNX Runtime CPU Temperature Monitor Min Avg Max AMD Ryzen Threadripper 7980X 64-Cores - AMD Radeon 46.5 64.0 67.6 OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.19 CPU Temperature Monitor 20 40 60 80 100
ONNX Runtime Model: ResNet101_DUC_HDC-12 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.19 Model: ResNet101_DUC_HDC-12 - Device: CPU - Executor: Standard AMD Ryzen Threadripper 7980X 64-Cores - AMD Radeon 0.605 1.21 1.815 2.42 3.025 2.68869 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: ResNet101_DUC_HDC-12 - Device: CPU - Executor: Standard OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.19 Model: ResNet101_DUC_HDC-12 - Device: CPU - Executor: Standard AMD Ryzen Threadripper 7980X 64-Cores - AMD Radeon 80 160 240 320 400 371.93 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime CPU Power Consumption Monitor Min Avg Max AMD Ryzen Threadripper 7980X 64-Cores - AMD Radeon 84.0 322.3 350.4 OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.19 CPU Power Consumption Monitor 100 200 300 400 500
ONNX Runtime CPU Temperature Monitor Min Avg Max AMD Ryzen Threadripper 7980X 64-Cores - AMD Radeon 46.0 63.3 66.8 OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.19 CPU Temperature Monitor 20 40 60 80 100
ONNX Runtime Model: ResNet101_DUC_HDC-12 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.19 Model: ResNet101_DUC_HDC-12 - Device: CPU - Executor: Parallel AMD Ryzen Threadripper 7980X 64-Cores - AMD Radeon 0.364 0.728 1.092 1.456 1.82 1.61769 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: ResNet101_DUC_HDC-12 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.19 Model: ResNet101_DUC_HDC-12 - Device: CPU - Executor: Parallel AMD Ryzen Threadripper 7980X 64-Cores - AMD Radeon 130 260 390 520 650 618.16 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime CPU Power Consumption Monitor Min Avg Max AMD Ryzen Threadripper 7980X 64-Cores - AMD Radeon 84.2 331.1 350.7 OpenBenchmarking.org Watts, Fewer Is Better ONNX Runtime 1.19 CPU Power Consumption Monitor 100 200 300 400 500
ONNX Runtime CPU Temperature Monitor Min Avg Max AMD Ryzen Threadripper 7980X 64-Cores - AMD Radeon 45.1 64.3 69.0 OpenBenchmarking.org Celsius, Fewer Is Better ONNX Runtime 1.19 CPU Temperature Monitor 20 40 60 80 100
CPU Power Consumption Monitor Phoronix Test Suite System Monitoring Min Avg Max AMD Ryzen Threadripper 7980X 64-Cores - AMD Radeon 77.6 291.9 351.4 OpenBenchmarking.org Watts CPU Power Consumption Monitor Phoronix Test Suite System Monitoring 100 200 300 400 500
CPU Temperature Monitor Phoronix Test Suite System Monitoring Min Avg Max AMD Ryzen Threadripper 7980X 64-Cores - AMD Radeon 41.1 61.1 69.0 OpenBenchmarking.org Celsius CPU Temperature Monitor Phoronix Test Suite System Monitoring 20 40 60 80 100
Phoronix Test Suite v10.8.5