rasp-ncnn

ARMv7 Cortex-A72 testing with a BCM2711 Raspberry Pi 4 Model B Rev 1.4 and vc4drmfb on Raspbian 11 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2404227-NE-RASPNCNN619.

rasp-ncnnProcessorMotherboardChipsetMemoryDiskGraphicsOSKernelDisplay ServerCompilerFile-SystemScreen ResolutionARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 4ARMv7 Cortex-A72 @ 1.80GHz (4 Cores)BCM2711 Raspberry Pi 4 Model B Rev 1.4Broadcom BCM27118GB32GB SD32Gvc4drmfbRaspbian 115.15.84-v7l+ (armv7l)X Server 1.20.11GCC 10.2.1 20210110ext41920x1080OpenBenchmarking.org- snd_bcm2835.enable_compat_alsa=0 snd_bcm2835.enable_hdmi=1- --build=arm-linux-gnueabihf --disable-libitm --disable-libquadmath --disable-libquadmath-support --disable-sjlj-exceptions --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=arm-linux-gnueabihf --program-prefix=arm-linux-gnueabihf- --target=arm-linux-gnueabihf --with-arch=armv6 --with-default-libstdcxx-abi=new --with-float=hard --with-fpu=vfp --with-gcc-major-version-only --with-target-system-zlib=auto -v - Scaling Governor: cpufreq-dt ondemand- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Not affected + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Vulnerable + srbds: Not affected + tsx_async_abort: Not affected

rasp-ncnnncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: CPU - squeezenet_ssdncnn: CPU - regnety_400mncnn: CPU - vision_transformerncnn: CPU - FastestDetncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - googlenetncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - yolov4-tinyncnn: Vulkan GPU - squeezenet_ssdncnn: Vulkan GPU - regnety_400mncnn: Vulkan GPU - vision_transformerncnn: Vulkan GPU - FastestDetARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 4739.49191.35164.3399.61189.49320.6431.62586.942424.98469.61320.311461.65870.83377.06279.456105.88112.11713.25207.03175.74105.47200.79331.9932.60598.852423.40474.60322.831467.91852.24369.39286.335779.54111.76OpenBenchmarking.org

NCNN

Target: CPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: mobilenetARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 4160320480640800SE +/- 25.04, N = 3739.49MIN: 577.98 / MAX: 924.061. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU-v2-v2 - Model: mobilenet-v2ARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 44080120160200SE +/- 16.90, N = 3191.35MIN: 120.41 / MAX: 276.081. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU-v3-v3 - Model: mobilenet-v3ARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 44080120160200SE +/- 12.91, N = 3164.33MIN: 106.31 / MAX: 246.871. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: shufflenet-v2ARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 420406080100SE +/- 6.90, N = 399.61MIN: 59.07 / MAX: 373.021. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: mnasnetARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 44080120160200SE +/- 13.43, N = 3189.49MIN: 112.3 / MAX: 290.451. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: efficientnet-b0ARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 470140210280350SE +/- 18.86, N = 3320.64MIN: 195.73 / MAX: 449.631. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: blazefaceARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 4714212835SE +/- 1.12, N = 331.62MIN: 20.04 / MAX: 70.31. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: googlenetARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 4130260390520650SE +/- 22.33, N = 3586.94MIN: 428.64 / MAX: 751.671. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: vgg16ARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 45001000150020002500SE +/- 44.02, N = 32424.98MIN: 2105.38 / MAX: 2786.921. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: resnet18ARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 4100200300400500SE +/- 16.16, N = 3469.61MIN: 321.56 / MAX: 1089.591. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: alexnetARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 470140210280350SE +/- 9.89, N = 3320.31MIN: 220.47 / MAX: 460.051. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: resnet50ARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 430060090012001500SE +/- 22.30, N = 31461.65MIN: 1193.51 / MAX: 1892.21. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: yolov4-tinyARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 42004006008001000SE +/- 21.82, N = 3870.83MIN: 621.63 / MAX: 1084.371. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: squeezenet_ssdARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 480160240320400SE +/- 7.34, N = 3377.06MIN: 273.26 / MAX: 739.841. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: regnety_400mARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 460120180240300SE +/- 13.64, N = 3279.45MIN: 163.73 / MAX: 398.291. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: vision_transformer

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: vision_transformerARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 413002600390052006500SE +/- 150.67, N = 36105.88MIN: 5530.32 / MAX: 6883.261. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: FastestDet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: FastestDetARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 4306090120150SE +/- 1.54, N = 3112.11MIN: 69.16 / MAX: 173.681. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: mobilenetARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 4150300450600750SE +/- 7.49, N = 3713.25MIN: 564.4 / MAX: 886.461. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2ARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 450100150200250SE +/- 3.26, N = 3207.03MIN: 138.13 / MAX: 286.551. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3ARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 44080120160200SE +/- 2.64, N = 3175.74MIN: 109.38 / MAX: 237.61. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: shufflenet-v2ARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 420406080100SE +/- 2.28, N = 3105.47MIN: 59.37 / MAX: 162.281. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: mnasnetARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 44080120160200SE +/- 3.88, N = 3200.79MIN: 115.29 / MAX: 282.951. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: efficientnet-b0ARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 470140210280350SE +/- 5.66, N = 3331.99MIN: 199.01 / MAX: 443.161. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: blazefaceARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 4816243240SE +/- 0.46, N = 332.60MIN: 20.09 / MAX: 70.511. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: googlenetARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 4130260390520650SE +/- 8.75, N = 3598.85MIN: 430.63 / MAX: 793.851. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: vgg16ARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 45001000150020002500SE +/- 40.56, N = 32423.40MIN: 2109.8 / MAX: 2808.171. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: resnet18ARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 4100200300400500SE +/- 8.10, N = 3474.60MIN: 323.99 / MAX: 585.891. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: alexnetARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 470140210280350SE +/- 4.75, N = 3322.83MIN: 184.93 / MAX: 433.231. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: resnet50ARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 430060090012001500SE +/- 26.28, N = 31467.91MIN: 1190.19 / MAX: 1737.161. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: yolov4-tinyARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 42004006008001000SE +/- 4.61, N = 3852.24MIN: 666.33 / MAX: 1184.151. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: squeezenet_ssdARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 480160240320400SE +/- 13.00, N = 3369.39MIN: 266.12 / MAX: 473.781. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: regnety_400mARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 460120180240300SE +/- 4.79, N = 3286.33MIN: 164.8 / MAX: 417.841. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: vision_transformer

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: vision_transformerARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 412002400360048006000SE +/- 46.74, N = 35779.54MIN: 4960 / MAX: 6576.861. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: Vulkan GPU - Model: FastestDet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: FastestDetARMv7 Cortex-A72 - vc4drmfb - BCM2711 Raspberry Pi 4306090120150SE +/- 2.76, N = 3111.76MIN: 69.55 / MAX: 181.331. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

Phoronix Test Suite v10.8.5