testoutputncnn

ARMv8 Cortex-A76 testing on Debian 12 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2406097-NE-2404282NE52
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
1
April 29
  4 Hours, 38 Minutes
ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0
June 10
  4 Hours, 41 Minutes
Invert Hiding All Results Option
  4 Hours, 39 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

1

Processor: ARMv8 Cortex-A76 @ 2.40GHz (4 Cores), Motherboard: Raspberry Pi 5 Model B Rev 1.0, Memory: 8GB, Disk: 31GB SD32G, Network: Device 1de4:0001

OS: Debian 12, Kernel: 6.6.28+rpt-rpi-2712 (aarch64), OpenGL: 4.5 Mesa 23.2.1-1~bpo12+rpt3 (LLVM 15.0.6 128 bits), Compiler: GCC 12.2.0, File-System: ext4

Kernel Notes: cfg80211.ieee80211_regdom=US
Compiler Notes: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v
Processor Notes: Scaling Governor: cpufreq-dt ondemand
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Not affected + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 but not BHB + srbds: Not affected + tsx_async_abort: Not affected

ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0

Processor: ARMv8 Cortex-A76 @ 2.40GHz (4 Cores), Motherboard: Raspberry Pi 5 Model B Rev 1.0, Memory: 4096MB, Disk: 31GB SD32G, Network: Device 1de4:0001

OS: Debian 12, Kernel: 6.6.31+rpt-rpi-2712 (aarch64), OpenGL: 4.5 Mesa 23.2.1-1~bpo12+rpt3 (LLVM 15.0.6 128 bits), Compiler: GCC 12.2.0, File-System: ext4

Kernel Notes: cfg80211.ieee80211_regdom=US
Compiler Notes: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v
Processor Notes: Scaling Governor: cpufreq-dt ondemand
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 BHB + srbds: Not affected + tsx_async_abort: Not affected

testoutputncnnProcessorMotherboardMemoryDiskNetworkOSKernelOpenGLCompilerFile-System1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0ARMv8 Cortex-A76 @ 2.40GHz (4 Cores)Raspberry Pi 5 Model B Rev 1.08GB31GB SD32GDevice 1de4:0001Debian 126.6.28+rpt-rpi-2712 (aarch64)4.5 Mesa 23.2.1-1~bpo12+rpt3 (LLVM 15.0.6 128 bits)GCC 12.2.0ext44096MB6.6.31+rpt-rpi-2712 (aarch64)OpenBenchmarking.orgKernel Details- cfg80211.ieee80211_regdom=USCompiler Details- --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v Processor Details- Scaling Governor: cpufreq-dt ondemandSecurity Details- 1: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Not affected + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 but not BHB + srbds: Not affected + tsx_async_abort: Not affected - ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 BHB + srbds: Not affected + tsx_async_abort: Not affected

1 vs. ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0 ComparisonPhoronix Test SuiteBaseline+3.5%+3.5%+7%+7%+10.5%+10.5%14%10.1%9.6%8.5%7.8%7.8%7.7%7.4%7.3%7.2%7%6.7%6.3%2.6%2.1%Vulkan GPU - vgg16Vulkan GPU-v2-v2 - mobilenet-v2Vulkan GPU - squeezenet_ssdVulkan GPU - yolov4-tinyVulkan GPU - resnet50Vulkan GPU - googlenetVulkan GPU-v3-v3 - mobilenet-v3Vulkan GPU - efficientnet-b0Vulkan GPU - mnasnetVulkan GPU - FastestDetVulkan GPU - mobilenetVulkan GPU - resnet18Vulkan GPU - alexnetVulkan GPU - blazefaceVulkan GPU - regnety_400mNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNN1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0

testoutputncnnncnn: Vulkan GPU - FastestDetncnn: Vulkan GPU - vision_transformerncnn: Vulkan GPU - regnety_400mncnn: Vulkan GPU - squeezenet_ssdncnn: Vulkan GPU - yolov4-tinyncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - googlenetncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU - mobilenetncnn: Vulkan GPUv2-yolov3v2-yolov3 - mobilenetv2-yolov31ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.05.54600.4010.5638.3752.7252.5524.7922.38155.1731.061.614.248.133.348.7612.3943.895.17598.1310.3435.0148.5848.7323.3220.98136.0828.821.5613.267.583.308.1311.2541.0341.03OpenBenchmarking.org

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: FastestDet1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.01.24652.4933.73954.9866.2325SE +/- 0.07, N = 3SE +/- 0.05, N = 35.545.17MIN: 5.28 / MAX: 14.64MIN: 4.89 / MAX: 6.041. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: vision_transformer1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0130260390520650SE +/- 1.09, N = 3SE +/- 3.62, N = 3600.40598.13MIN: 573.15 / MAX: 645.75MIN: 563.05 / MAX: 652.351. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: regnety_400m1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.03691215SE +/- 0.04, N = 3SE +/- 0.07, N = 310.5610.34MIN: 10.31 / MAX: 22.07MIN: 10.05 / MAX: 37.41. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: squeezenet_ssd1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0918273645SE +/- 0.10, N = 3SE +/- 0.16, N = 338.3735.01MIN: 37.76 / MAX: 45.63MIN: 34.15 / MAX: 72.641. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: yolov4-tiny1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.01224364860SE +/- 0.07, N = 3SE +/- 0.31, N = 352.7248.58MIN: 51.92 / MAX: 86.56MIN: 47.56 / MAX: 85.361. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: resnet501ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.01224364860SE +/- 0.13, N = 3SE +/- 0.32, N = 352.5548.73MIN: 51.41 / MAX: 93.48MIN: 47.39 / MAX: 87.541. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: alexnet1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0612182430SE +/- 0.04, N = 3SE +/- 0.09, N = 324.7923.32MIN: 24.28 / MAX: 37.29MIN: 22.67 / MAX: 53.591. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: resnet181ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0510152025SE +/- 0.13, N = 3SE +/- 0.03, N = 322.3820.98MIN: 21.66 / MAX: 31.23MIN: 20.39 / MAX: 35.461. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: vgg161ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0306090120150SE +/- 0.11, N = 3SE +/- 0.57, N = 3155.17136.08MIN: 151.67 / MAX: 190.11MIN: 132.28 / MAX: 172.421. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: googlenet1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0714212835SE +/- 0.21, N = 3SE +/- 0.18, N = 331.0628.82MIN: 30.13 / MAX: 62.25MIN: 27.94 / MAX: 61.361. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: blazeface1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.00.360.721.081.441.8SE +/- 0.00, N = 3SE +/- 0.01, N = 31.601.56MIN: 1.52 / MAX: 10.2MIN: 1.52 / MAX: 1.981. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: efficientnet-b01ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.048121620SE +/- 0.06, N = 3SE +/- 0.13, N = 314.2413.26MIN: 13.8 / MAX: 53.63MIN: 12.8 / MAX: 34.051. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: mnasnet1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0246810SE +/- 0.03, N = 3SE +/- 0.06, N = 38.137.58MIN: 7.74 / MAX: 16.69MIN: 7.27 / MAX: 33.091. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: shufflenet-v21ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.00.75151.5032.25453.0063.7575SE +/- 0.00, N = 3SE +/- 0.01, N = 33.343.30MIN: 3.29 / MAX: 4.41MIN: 3.25 / MAX: 3.91. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU-v3-v3 - Model: mobilenet-v31ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0246810SE +/- 0.01, N = 3SE +/- 0.02, N = 38.768.13MIN: 8.49 / MAX: 18.08MIN: 7.86 / MAX: 40.211. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU-v2-v2 - Model: mobilenet-v21ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.03691215SE +/- 0.06, N = 3SE +/- 0.10, N = 312.3911.25MIN: 11.98 / MAX: 24.92MIN: 10.81 / MAX: 18.31. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: mobilenet1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.01020304050SE +/- 0.14, N = 3SE +/- 0.16, N = 343.8941.03MIN: 42.94 / MAX: 80.12MIN: 40.31 / MAX: 77.211. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPUv2-yolov3v2-yolov3 - Model: mobilenetv2-yolov3ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0918273645SE +/- 0.16, N = 341.03MIN: 40.31 / MAX: 77.211. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

1

Processor: ARMv8 Cortex-A76 @ 2.40GHz (4 Cores), Motherboard: Raspberry Pi 5 Model B Rev 1.0, Memory: 8GB, Disk: 31GB SD32G, Network: Device 1de4:0001

OS: Debian 12, Kernel: 6.6.28+rpt-rpi-2712 (aarch64), OpenGL: 4.5 Mesa 23.2.1-1~bpo12+rpt3 (LLVM 15.0.6 128 bits), Compiler: GCC 12.2.0, File-System: ext4

Kernel Notes: cfg80211.ieee80211_regdom=US
Compiler Notes: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v
Processor Notes: Scaling Governor: cpufreq-dt ondemand
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Not affected + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 but not BHB + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 29 April 2024 00:43 by user avoss.

ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0

Processor: ARMv8 Cortex-A76 @ 2.40GHz (4 Cores), Motherboard: Raspberry Pi 5 Model B Rev 1.0, Memory: 4096MB, Disk: 31GB SD32G, Network: Device 1de4:0001

OS: Debian 12, Kernel: 6.6.31+rpt-rpi-2712 (aarch64), OpenGL: 4.5 Mesa 23.2.1-1~bpo12+rpt3 (LLVM 15.0.6 128 bits), Compiler: GCC 12.2.0, File-System: ext4

Kernel Notes: cfg80211.ieee80211_regdom=US
Compiler Notes: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v
Processor Notes: Scaling Governor: cpufreq-dt ondemand
Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 BHB + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 10 June 2024 02:41 by user avoss.