ampere altra mnn

ARMv8 Neoverse-N1 testing with a System76 Thelio Astra (3.02 BIOS) and NVIDIA RTX A400/PCIe 4GB on Ubuntu 24.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2411185-PTS-AMPEREAL95&sor&grr.

ampere altra mnnProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionabcARMv8 Neoverse-N1 @ 3.00GHz (128 Cores)System76 Thelio Astra (3.02 BIOS)Ampere Computing LLC Altra PCI Root Complex A8 x 32GB DDR4-3200MT/s Micron 18ASF4G72PDZ-3G2F11024GB KINGSTON SKC3000S1024GNVIDIA RTX A400/PCIe 4GBNVIDIA Device 2291DELL P2415Q2 x Intel X550 + Intel I210Ubuntu 24.046.8.0-48-generic-64k (aarch64)GNOME Shell 46.0X ServerNVIDIA 550.1204.6.0GCC 13.2.0ext43840x2160OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-dIwDw0/gcc-13-13.2.0/debian/tmp-nvptx/usr --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto --without-cuda-driver -v Processor Details- Scaling Governor: cppc_cpufreq schedutil (Boost: Disabled)Security Details- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 BHB + srbds: Not affected + tsx_async_abort: Not affected

ampere altra mnnmnn: inception-v3mnn: mobilenet-v1-1.0mnn: MobileNetV2_224mnn: SqueezeNetV1.0mnn: resnet-v2-50mnn: squeezenetv1.1mnn: mobilenetV3mnn: nasnetabc12.0041.5051.9173.1698.441.7041.4038.19211.9001.5041.9363.2078.2891.7351.4138.26111.8221.4651.9033.1528.3081.7201.3668.063OpenBenchmarking.org

Mobile Neural Network

Model: inception-v3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 3.0Model: inception-v3cba3691215SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 311.8211.9012.00MIN: 11.43 / MAX: 12.86MIN: 11.51 / MAX: 13.58MIN: 11.59 / MAX: 12.911. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

Mobile Neural Network

Model: mobilenet-v1-1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 3.0Model: mobilenet-v1-1.0cba0.33860.67721.01581.35441.693SE +/- 0.009, N = 3SE +/- 0.010, N = 3SE +/- 0.014, N = 31.4651.5041.505MIN: 1.27 / MAX: 3.7MIN: 1.32 / MAX: 4.6MIN: 1.29 / MAX: 4.181. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

Mobile Neural Network

Model: MobileNetV2_224

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 3.0Model: MobileNetV2_224cab0.43560.87121.30681.74242.178SE +/- 0.005, N = 3SE +/- 0.003, N = 3SE +/- 0.002, N = 31.9031.9171.936MIN: 1.71 / MAX: 3.19MIN: 1.73 / MAX: 3.63MIN: 1.78 / MAX: 3.151. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

Mobile Neural Network

Model: SqueezeNetV1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 3.0Model: SqueezeNetV1.0cab0.72161.44322.16482.88643.608SE +/- 0.009, N = 3SE +/- 0.011, N = 3SE +/- 0.008, N = 33.1523.1693.207MIN: 3 / MAX: 4.79MIN: 3.03 / MAX: 4.88MIN: 3.07 / MAX: 4.91. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

Mobile Neural Network

Model: resnet-v2-50

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 3.0Model: resnet-v2-50bca246810SE +/- 0.108, N = 3SE +/- 0.082, N = 3SE +/- 0.104, N = 38.2898.3088.440MIN: 7.83 / MAX: 10.42MIN: 7.81 / MAX: 9.93MIN: 7.93 / MAX: 11.231. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

Mobile Neural Network

Model: squeezenetv1.1

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 3.0Model: squeezenetv1.1acb0.39040.78081.17121.56161.952SE +/- 0.010, N = 3SE +/- 0.011, N = 3SE +/- 0.008, N = 31.7041.7201.735MIN: 1.53 / MAX: 3.3MIN: 1.53 / MAX: 4.06MIN: 1.55 / MAX: 3.41. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

Mobile Neural Network

Model: mobilenetV3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 3.0Model: mobilenetV3cab0.31790.63580.95371.27161.5895SE +/- 0.015, N = 3SE +/- 0.024, N = 3SE +/- 0.019, N = 31.3661.4031.413MIN: 1.2 / MAX: 2.63MIN: 1.23 / MAX: 2.72MIN: 1.23 / MAX: 3.511. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

Mobile Neural Network

Model: nasnet

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 3.0Model: nasnetcab246810SE +/- 0.022, N = 3SE +/- 0.064, N = 3SE +/- 0.090, N = 38.0638.1928.261MIN: 7.74 / MAX: 9.3MIN: 7.78 / MAX: 11.01MIN: 7.86 / MAX: 9.191. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

Phoronix Test Suite v10.8.5