testoutputncnn

ARMv8 Cortex-A76 testing on Debian 12 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2406097-NE-2404282NE52
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
1
April 29
  4 Hours, 38 Minutes
ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0
June 10
  4 Hours, 41 Minutes
Invert Hiding All Results Option
  4 Hours, 39 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

1

Processor: ARMv8 Cortex-A76 @ 2.40GHz (4 Cores), Motherboard: Raspberry Pi 5 Model B Rev 1.0, Memory: 8GB, Disk: 31GB SD32G, Network: Device 1de4:0001

OS: Debian 12, Kernel: 6.6.28+rpt-rpi-2712 (aarch64), OpenGL: 4.5 Mesa 23.2.1-1~bpo12+rpt3 (LLVM 15.0.6 128 bits), Compiler: GCC 12.2.0, File-System: ext4

Kernel Notes: cfg80211.ieee80211_regdom=US
Compiler Notes: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v
Processor Notes: Scaling Governor: cpufreq-dt ondemand
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Not affected + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 but not BHB + srbds: Not affected + tsx_async_abort: Not affected

ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0

Processor: ARMv8 Cortex-A76 @ 2.40GHz (4 Cores), Motherboard: Raspberry Pi 5 Model B Rev 1.0, Memory: 4096MB, Disk: 31GB SD32G, Network: Device 1de4:0001

OS: Debian 12, Kernel: 6.6.31+rpt-rpi-2712 (aarch64), OpenGL: 4.5 Mesa 23.2.1-1~bpo12+rpt3 (LLVM 15.0.6 128 bits), Compiler: GCC 12.2.0, File-System: ext4

Kernel Notes: cfg80211.ieee80211_regdom=US
Compiler Notes: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v
Processor Notes: Scaling Governor: cpufreq-dt ondemand
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 BHB + srbds: Not affected + tsx_async_abort: Not affected

testoutputncnnProcessorMotherboardMemoryDiskNetworkOSKernelOpenGLCompilerFile-System1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0ARMv8 Cortex-A76 @ 2.40GHz (4 Cores)Raspberry Pi 5 Model B Rev 1.08GB31GB SD32GDevice 1de4:0001Debian 126.6.28+rpt-rpi-2712 (aarch64)4.5 Mesa 23.2.1-1~bpo12+rpt3 (LLVM 15.0.6 128 bits)GCC 12.2.0ext44096MB6.6.31+rpt-rpi-2712 (aarch64)OpenBenchmarking.orgKernel Details- cfg80211.ieee80211_regdom=USCompiler Details- --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v Processor Details- Scaling Governor: cpufreq-dt ondemandSecurity Details- 1: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Not affected + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 but not BHB + srbds: Not affected + tsx_async_abort: Not affected - ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 BHB + srbds: Not affected + tsx_async_abort: Not affected

1 vs. ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0 ComparisonPhoronix Test SuiteBaseline+3.5%+3.5%+7%+7%+10.5%+10.5%14%10.1%9.6%8.5%7.8%7.8%7.7%7.4%7.3%7.2%7%6.7%6.3%2.6%2.1%Vulkan GPU - vgg16Vulkan GPU-v2-v2 - mobilenet-v2Vulkan GPU - squeezenet_ssdVulkan GPU - yolov4-tinyVulkan GPU - resnet50Vulkan GPU - googlenetVulkan GPU-v3-v3 - mobilenet-v3Vulkan GPU - efficientnet-b0Vulkan GPU - mnasnetVulkan GPU - FastestDetVulkan GPU - mobilenetVulkan GPU - resnet18Vulkan GPU - alexnetVulkan GPU - blazefaceVulkan GPU - regnety_400mNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNN1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0

testoutputncnnncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - googlenetncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - yolov4-tinyncnn: Vulkan GPU - squeezenet_ssdncnn: Vulkan GPU - regnety_400mncnn: Vulkan GPU - vision_transformerncnn: Vulkan GPU - FastestDetncnn: Vulkan GPUv2-yolov3v2-yolov3 - mobilenetv2-yolov31ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.043.8912.398.763.348.1314.241.631.06155.1722.3824.7952.5552.7238.3710.56600.405.5441.0311.258.133.307.5813.261.5628.82136.0820.9823.3248.7348.5835.0110.34598.135.1741.03OpenBenchmarking.org

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: mobilenetARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.011020304050SE +/- 0.16, N = 3SE +/- 0.14, N = 341.0343.89MIN: 40.31 / MAX: 77.21MIN: 42.94 / MAX: 80.121. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.013691215SE +/- 0.10, N = 3SE +/- 0.06, N = 311.2512.39MIN: 10.81 / MAX: 18.3MIN: 11.98 / MAX: 24.921. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.01246810SE +/- 0.02, N = 3SE +/- 0.01, N = 38.138.76MIN: 7.86 / MAX: 40.21MIN: 8.49 / MAX: 18.081. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: shufflenet-v2ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.010.75151.5032.25453.0063.7575SE +/- 0.01, N = 3SE +/- 0.00, N = 33.303.34MIN: 3.25 / MAX: 3.9MIN: 3.29 / MAX: 4.411. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: mnasnetARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.01246810SE +/- 0.06, N = 3SE +/- 0.03, N = 37.588.13MIN: 7.27 / MAX: 33.09MIN: 7.74 / MAX: 16.691. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: efficientnet-b0ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0148121620SE +/- 0.13, N = 3SE +/- 0.06, N = 313.2614.24MIN: 12.8 / MAX: 34.05MIN: 13.8 / MAX: 53.631. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: blazefaceARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.010.360.721.081.441.8SE +/- 0.01, N = 3SE +/- 0.00, N = 31.561.60MIN: 1.52 / MAX: 1.98MIN: 1.52 / MAX: 10.21. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: googlenetARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.01714212835SE +/- 0.18, N = 3SE +/- 0.21, N = 328.8231.06MIN: 27.94 / MAX: 61.36MIN: 30.13 / MAX: 62.251. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: vgg16ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.01306090120150SE +/- 0.57, N = 3SE +/- 0.11, N = 3136.08155.17MIN: 132.28 / MAX: 172.42MIN: 151.67 / MAX: 190.111. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: resnet18ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.01510152025SE +/- 0.03, N = 3SE +/- 0.13, N = 320.9822.38MIN: 20.39 / MAX: 35.46MIN: 21.66 / MAX: 31.231. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: alexnetARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.01612182430SE +/- 0.09, N = 3SE +/- 0.04, N = 323.3224.79MIN: 22.67 / MAX: 53.59MIN: 24.28 / MAX: 37.291. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: resnet50ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.011224364860SE +/- 0.32, N = 3SE +/- 0.13, N = 348.7352.55MIN: 47.39 / MAX: 87.54MIN: 51.41 / MAX: 93.481. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: yolov4-tinyARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.011224364860SE +/- 0.31, N = 3SE +/- 0.07, N = 348.5852.72MIN: 47.56 / MAX: 85.36MIN: 51.92 / MAX: 86.561. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: squeezenet_ssdARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.01918273645SE +/- 0.16, N = 3SE +/- 0.10, N = 335.0138.37MIN: 34.15 / MAX: 72.64MIN: 37.76 / MAX: 45.631. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: regnety_400mARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.013691215SE +/- 0.07, N = 3SE +/- 0.04, N = 310.3410.56MIN: 10.05 / MAX: 37.4MIN: 10.31 / MAX: 22.071. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: vision_transformerARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.01130260390520650SE +/- 3.62, N = 3SE +/- 1.09, N = 3598.13600.40MIN: 563.05 / MAX: 652.35MIN: 573.15 / MAX: 645.751. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: FastestDetARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.011.24652.4933.73954.9866.2325SE +/- 0.05, N = 3SE +/- 0.07, N = 35.175.54MIN: 4.89 / MAX: 6.04MIN: 5.28 / MAX: 14.641. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPUv2-yolov3v2-yolov3 - Model: mobilenetv2-yolov3ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0918273645SE +/- 0.16, N = 341.03MIN: 40.31 / MAX: 77.211. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

1

Processor: ARMv8 Cortex-A76 @ 2.40GHz (4 Cores), Motherboard: Raspberry Pi 5 Model B Rev 1.0, Memory: 8GB, Disk: 31GB SD32G, Network: Device 1de4:0001

OS: Debian 12, Kernel: 6.6.28+rpt-rpi-2712 (aarch64), OpenGL: 4.5 Mesa 23.2.1-1~bpo12+rpt3 (LLVM 15.0.6 128 bits), Compiler: GCC 12.2.0, File-System: ext4

Kernel Notes: cfg80211.ieee80211_regdom=US
Compiler Notes: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v
Processor Notes: Scaling Governor: cpufreq-dt ondemand
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Not affected + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 but not BHB + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 29 April 2024 00:43 by user avoss.

ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0

Processor: ARMv8 Cortex-A76 @ 2.40GHz (4 Cores), Motherboard: Raspberry Pi 5 Model B Rev 1.0, Memory: 4096MB, Disk: 31GB SD32G, Network: Device 1de4:0001

OS: Debian 12, Kernel: 6.6.31+rpt-rpi-2712 (aarch64), OpenGL: 4.5 Mesa 23.2.1-1~bpo12+rpt3 (LLVM 15.0.6 128 bits), Compiler: GCC 12.2.0, File-System: ext4

Kernel Notes: cfg80211.ieee80211_regdom=US
Compiler Notes: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v
Processor Notes: Scaling Governor: cpufreq-dt ondemand
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 BHB + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 10 June 2024 02:41 by user avoss.