testoutputncnn

ARMv8 Cortex-A76 testing on Debian 12 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2406097-NE-2404282NE52.

testoutputncnnProcessorMotherboardMemoryDiskNetworkOSKernelOpenGLCompilerFile-System1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0ARMv8 Cortex-A76 @ 2.40GHz (4 Cores)Raspberry Pi 5 Model B Rev 1.08GB31GB SD32GDevice 1de4:0001Debian 126.6.28+rpt-rpi-2712 (aarch64)4.5 Mesa 23.2.1-1~bpo12+rpt3 (LLVM 15.0.6 128 bits)GCC 12.2.0ext44096MB6.6.31+rpt-rpi-2712 (aarch64)OpenBenchmarking.orgKernel Details- cfg80211.ieee80211_regdom=USCompiler Details- --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v Processor Details- Scaling Governor: cpufreq-dt ondemandSecurity Details- 1: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Not affected + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 but not BHB + srbds: Not affected + tsx_async_abort: Not affected - ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 BHB + srbds: Not affected + tsx_async_abort: Not affected

testoutputncnnncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - googlenetncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - yolov4-tinyncnn: Vulkan GPU - squeezenet_ssdncnn: Vulkan GPU - regnety_400mncnn: Vulkan GPU - vision_transformerncnn: Vulkan GPU - FastestDetncnn: Vulkan GPUv2-yolov3v2-yolov3 - mobilenetv2-yolov31ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.043.8912.398.763.348.1314.241.631.06155.1722.3824.7952.5552.7238.3710.56600.405.5441.0311.258.133.307.5813.261.5628.82136.0820.9823.3248.7348.5835.0110.34598.135.1741.03OpenBenchmarking.org

NCNN

Target: Vulkan GPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: mobilenet1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.01020304050SE +/- 0.14, N = 3SE +/- 0.16, N = 343.8941.03MIN: 42.94 / MAX: 80.12MIN: 40.31 / MAX: 77.211. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU-v2-v2 - Model: mobilenet-v21ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.03691215SE +/- 0.06, N = 3SE +/- 0.10, N = 312.3911.25MIN: 11.98 / MAX: 24.92MIN: 10.81 / MAX: 18.31. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU-v3-v3 - Model: mobilenet-v31ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0246810SE +/- 0.01, N = 3SE +/- 0.02, N = 38.768.13MIN: 8.49 / MAX: 18.08MIN: 7.86 / MAX: 40.211. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: shufflenet-v21ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.00.75151.5032.25453.0063.7575SE +/- 0.00, N = 3SE +/- 0.01, N = 33.343.30MIN: 3.29 / MAX: 4.41MIN: 3.25 / MAX: 3.91. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: mnasnet1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0246810SE +/- 0.03, N = 3SE +/- 0.06, N = 38.137.58MIN: 7.74 / MAX: 16.69MIN: 7.27 / MAX: 33.091. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: efficientnet-b01ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.048121620SE +/- 0.06, N = 3SE +/- 0.13, N = 314.2413.26MIN: 13.8 / MAX: 53.63MIN: 12.8 / MAX: 34.051. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: blazeface1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.00.360.721.081.441.8SE +/- 0.00, N = 3SE +/- 0.01, N = 31.601.56MIN: 1.52 / MAX: 10.2MIN: 1.52 / MAX: 1.981. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: googlenet1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0714212835SE +/- 0.21, N = 3SE +/- 0.18, N = 331.0628.82MIN: 30.13 / MAX: 62.25MIN: 27.94 / MAX: 61.361. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: vgg161ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0306090120150SE +/- 0.11, N = 3SE +/- 0.57, N = 3155.17136.08MIN: 151.67 / MAX: 190.11MIN: 132.28 / MAX: 172.421. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: resnet181ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0510152025SE +/- 0.13, N = 3SE +/- 0.03, N = 322.3820.98MIN: 21.66 / MAX: 31.23MIN: 20.39 / MAX: 35.461. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: alexnet1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0612182430SE +/- 0.04, N = 3SE +/- 0.09, N = 324.7923.32MIN: 24.28 / MAX: 37.29MIN: 22.67 / MAX: 53.591. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: resnet501ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.01224364860SE +/- 0.13, N = 3SE +/- 0.32, N = 352.5548.73MIN: 51.41 / MAX: 93.48MIN: 47.39 / MAX: 87.541. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: yolov4-tiny1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.01224364860SE +/- 0.07, N = 3SE +/- 0.31, N = 352.7248.58MIN: 51.92 / MAX: 86.56MIN: 47.56 / MAX: 85.361. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: squeezenet_ssd1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0918273645SE +/- 0.10, N = 3SE +/- 0.16, N = 338.3735.01MIN: 37.76 / MAX: 45.63MIN: 34.15 / MAX: 72.641. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: regnety_400m1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.03691215SE +/- 0.04, N = 3SE +/- 0.07, N = 310.5610.34MIN: 10.31 / MAX: 22.07MIN: 10.05 / MAX: 37.41. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: vision_transformer

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: vision_transformer1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0130260390520650SE +/- 1.09, N = 3SE +/- 3.62, N = 3600.40598.13MIN: 573.15 / MAX: 645.75MIN: 563.05 / MAX: 652.351. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: FastestDet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: FastestDet1ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.01.24652.4933.73954.9866.2325SE +/- 0.07, N = 3SE +/- 0.05, N = 35.545.17MIN: 5.28 / MAX: 14.64MIN: 4.89 / MAX: 6.041. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPUv2-yolov3v2-yolov3 - Model: mobilenetv2-yolov3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPUv2-yolov3v2-yolov3 - Model: mobilenetv2-yolov3ARMv8 Cortex-A76 - - Raspberry Pi 5 Model B Rev 1.0918273645SE +/- 0.16, N = 341.03MIN: 40.31 / MAX: 77.211. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Phoronix Test Suite v10.8.5