vulkan benchmarks AMD Ryzen 9 7950X 16-Core testing with a ASUS ROG STRIX X670E-E GAMING WIFI (1416 BIOS) and AMD Radeon RX 6700 XT on Ubuntu 23.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2308012-PTS-VULKANBE49&gru&sor .
vulkan benchmarks Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server OpenGL Compiler File-System Screen Resolution a b c AMD Ryzen 9 7950X 16-Core @ 4.50GHz (16 Cores / 32 Threads) ASUS ROG STRIX X670E-E GAMING WIFI (1416 BIOS) AMD Device 14d8 32GB Western Digital WD_BLACK SN850X 1000GB + 4001GB AMD Radeon RX 6700 XT (2855/1000MHz) AMD Navi 21/23 ASUS MG28U Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411 Ubuntu 23.04 6.4.6-060406-generic (x86_64) GNOME Shell 44.2 X Server 1.21.1.7 + Wayland 4.6 Mesa 23.3~git2307260600.87109c~oibaf~l (git-87109c3 2023-07-26 lunar-oibaf-ppa) (LLVM 15.0.7 DRM 3.52) GCC 12.2.0 ext4 3840x2160 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-Pa930Z/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-Pa930Z/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0xa601203 Graphics Details - BAR1 / Visible vRAM Size: 12272 MB - vBIOS Version: 113-D5121100-101 Security Details - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
vulkan benchmarks vkfft: FFT + iFFT R2C / C2R vkfft: FFT + iFFT C2C 1D batched in half precision vkfft: FFT + iFFT C2C Bluestein in single precision vkfft: FFT + iFFT C2C 1D batched in double precision vkfft: FFT + iFFT C2C 1D batched in single precision vkfft: FFT + iFFT C2C multidimensional in single precision vkfft: FFT + iFFT C2C Bluestein benchmark in double precision vkfft: FFT + iFFT C2C 1D batched in single precision, no reshuffling vkpeak: fp32-scalar vkpeak: fp32-vec4 vkpeak: fp16-scalar vkpeak: fp16-vec4 vkpeak: fp64-scalar vkpeak: fp64-vec4 vkpeak: int32-scalar vkpeak: int32-vec4 vkpeak: int16-scalar vkpeak: int16-vec4 vkresample: 2x - Single ncnn: CPU - mobilenet ncnn: CPU-v2-v2 - mobilenet-v2 ncnn: CPU - shufflenet-v2 ncnn: CPU - mnasnet ncnn: CPU - efficientnet-b0 ncnn: CPU - blazeface ncnn: CPU - googlenet ncnn: CPU - vgg16 ncnn: CPU - resnet18 ncnn: CPU - alexnet ncnn: CPU - resnet50 ncnn: CPU - yolov4-tiny ncnn: CPU - squeezenet_ssd ncnn: CPU - regnety_400m ncnn: CPU - vision_transformer ncnn: CPU - FastestDet ncnn: CPU-v3-v3 - mobilenet-v3 ncnn: Vulkan GPU - mobilenet ncnn: Vulkan GPU-v2-v2 - mobilenet-v2 ncnn: Vulkan GPU-v3-v3 - mobilenet-v3 ncnn: Vulkan GPU - shufflenet-v2 ncnn: Vulkan GPU - mnasnet ncnn: Vulkan GPU - efficientnet-b0 ncnn: Vulkan GPU - blazeface ncnn: Vulkan GPU - googlenet ncnn: Vulkan GPU - vgg16 ncnn: Vulkan GPU - resnet18 ncnn: Vulkan GPU - alexnet ncnn: Vulkan GPU - resnet50 ncnn: Vulkan GPU - yolov4-tiny ncnn: Vulkan GPU - squeezenet_ssd ncnn: Vulkan GPU - regnety_400m ncnn: Vulkan GPU - vision_transformer ncnn: Vulkan GPU - FastestDet ncnn: CPU-v3-v3-v3 - mobilenet ncnn: CPU-v3-v3-v3-v2-v2 - mobilenet-v2 ncnn: CPU-v3-v3-v3-v3-v3 - mobilenet-v3 ncnn: CPU-v3-v3-v3 - shufflenet-v2 ncnn: CPU-v3-v3-v3 - mnasnet ncnn: CPU-v3-v3-v3 - efficientnet-b0 ncnn: CPU-v3-v3-v3 - blazeface ncnn: CPU-v3-v3-v3 - googlenet ncnn: CPU-v3-v3-v3 - vgg16 ncnn: CPU-v3-v3-v3 - resnet18 ncnn: CPU-v3-v3-v3 - alexnet ncnn: CPU-v3-v3-v3 - resnet50 ncnn: CPU-v3-v3-v3 - yolov4-tiny ncnn: CPU-v3-v3-v3 - squeezenet_ssd ncnn: CPU-v3-v3-v3 - regnety_400m ncnn: CPU-v3-v3-v3 - vision_transformer ncnn: CPU-v3-v3-v3 - FastestDet ncnn: Vulkan GPU-v3-v3-v3 - mobilenet ncnn: Vulkan GPU-v3-v3-v3-v2-v2 - mobilenet-v2 ncnn: Vulkan GPU-v3-v3-v3-v3-v3 - mobilenet-v3 ncnn: Vulkan GPU-v3-v3-v3 - shufflenet-v2 ncnn: Vulkan GPU-v3-v3-v3 - mnasnet ncnn: Vulkan GPU-v3-v3-v3 - efficientnet-b0 ncnn: Vulkan GPU-v3-v3-v3 - blazeface ncnn: Vulkan GPU-v3-v3-v3 - googlenet ncnn: Vulkan GPU-v3-v3-v3 - vgg16 ncnn: Vulkan GPU-v3-v3-v3 - resnet18 ncnn: Vulkan GPU-v3-v3-v3 - alexnet ncnn: Vulkan GPU-v3-v3-v3 - resnet50 ncnn: Vulkan GPU-v3-v3-v3 - yolov4-tiny ncnn: Vulkan GPU-v3-v3-v3 - squeezenet_ssd ncnn: Vulkan GPU-v3-v3-v3 - regnety_400m ncnn: Vulkan GPU-v3-v3-v3 - vision_transformer ncnn: Vulkan GPU-v3-v3-v3 - FastestDet a b c 42105 91597 11340 20816 47887 33001 4717 50504 13190.09 12730.08 13154.15 23232.42 841.40 841.80 2272.62 2658.73 13102.75 23123.77 11.686 8.05 3.16 3.34 2.97 3.90 1.38 7.94 23.75 5.29 4.41 10.20 12.90 7.07 8.18 32.49 3.62 3.18 8.05 3.17 3.17 3.35 2.98 3.86 1.38 7.90 23.51 5.28 4.31 10.01 12.84 7.09 8.16 31.88 4.1 42163 91812 11273 20822 47948 32751 4695 50643 12807.06 12808.59 13145.19 23390.44 839.2 836.55 2269.25 2640.08 13070.81 23396.59 11.69 7.97 3.16 3.34 2.97 3.85 1.38 7.82 23.49 5.2 4.32 10.01 12.74 7.06 8.18 31.95 4.05 8.04 3.14 3.33 2.95 3.82 1.37 7.85 23.56 5.23 4.33 10 12.87 7.07 8.21 31.85 4.07 8.01 3.15 3.16 3.33 2.97 3.82 1.37 7.84 23.5 5.21 4.29 10.01 12.98 7.03 8.05 31.65 4.07 8 3.15 3.16 3.33 2.96 3.85 1.37 7.97 23.42 5.42 4.42 9.87 12.77 7.14 8.27 31.71 4.06 43021 91744 11311 20847 47971 32812 4670 50596 12860.56 12822.01 13136.79 23387.26 839.01 836.16 2269.06 2638.69 13063.86 23385.44 11.688 8.02 3.18 3.35 2.99 3.88 1.39 7.93 23.45 5.24 4.31 10.11 12.81 7.1 8.27 31.77 4.11 3.17 8.03 3.13 3.2 3.32 2.96 3.83 1.37 7.8 23.54 5.21 4.33 10 12.81 7.06 8 31.79 4.09 8 3.14 3.16 3.34 2.97 3.89 1.38 7.88 23.99 5.26 4.28 10.33 12.89 7.04 8.14 31.78 4.08 7.95 3.15 3.17 3.33 2.96 3.82 1.36 7.83 23.54 5.23 4.3 10.03 12.86 7.07 7.98 31.66 3.69 OpenBenchmarking.org
VkFFT Test: FFT + iFFT R2C / C2R OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT R2C / C2R c b a 9K 18K 27K 36K 45K SE +/- 200.55, N = 3 43021 42163 42105 1. (CXX) g++ options: -O3
VkFFT Test: FFT + iFFT C2C 1D batched in half precision OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C 1D batched in half precision b c a 20K 40K 60K 80K 100K SE +/- 83.55, N = 3 91812 91744 91597 1. (CXX) g++ options: -O3
VkFFT Test: FFT + iFFT C2C Bluestein in single precision OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C Bluestein in single precision a c b 2K 4K 6K 8K 10K SE +/- 62.67, N = 3 11340 11311 11273 1. (CXX) g++ options: -O3
VkFFT Test: FFT + iFFT C2C 1D batched in double precision OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C 1D batched in double precision c b a 4K 8K 12K 16K 20K SE +/- 11.67, N = 3 20847 20822 20816 1. (CXX) g++ options: -O3
VkFFT Test: FFT + iFFT C2C 1D batched in single precision OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C 1D batched in single precision c b a 10K 20K 30K 40K 50K SE +/- 9.54, N = 3 47971 47948 47887 1. (CXX) g++ options: -O3
VkFFT Test: FFT + iFFT C2C multidimensional in single precision OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C multidimensional in single precision a c b 7K 14K 21K 28K 35K SE +/- 57.83, N = 3 33001 32812 32751 1. (CXX) g++ options: -O3
VkFFT Test: FFT + iFFT C2C Bluestein benchmark in double precision OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C Bluestein benchmark in double precision a b c 1000 2000 3000 4000 5000 SE +/- 0.33, N = 3 4717 4695 4670 1. (CXX) g++ options: -O3
VkFFT Test: FFT + iFFT C2C 1D batched in single precision, no reshuffling OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C 1D batched in single precision, no reshuffling b c a 11K 22K 33K 44K 55K SE +/- 8.89, N = 3 50643 50596 50504 1. (CXX) g++ options: -O3
vkpeak fp32-scalar OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20230730 fp32-scalar a c b 3K 6K 9K 12K 15K SE +/- 4.18, N = 3 13190.09 12860.56 12807.06
vkpeak fp32-vec4 OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20230730 fp32-vec4 c b a 3K 6K 9K 12K 15K SE +/- 1.81, N = 3 12822.01 12808.59 12730.08
vkpeak fp16-scalar OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20230730 fp16-scalar a b c 3K 6K 9K 12K 15K SE +/- 4.01, N = 3 13154.15 13145.19 13136.79
vkpeak fp16-vec4 OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20230730 fp16-vec4 b c a 5K 10K 15K 20K 25K SE +/- 5.96, N = 3 23390.44 23387.26 23232.42
vkpeak fp64-scalar OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20230730 fp64-scalar a b c 200 400 600 800 1000 SE +/- 0.22, N = 3 841.40 839.20 839.01
vkpeak fp64-vec4 OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20230730 fp64-vec4 a b c 200 400 600 800 1000 SE +/- 0.32, N = 3 841.80 836.55 836.16
vkpeak int32-scalar OpenBenchmarking.org GIOPS, More Is Better vkpeak 20230730 int32-scalar a b c 500 1000 1500 2000 2500 SE +/- 0.34, N = 3 2272.62 2269.25 2269.06
vkpeak int32-vec4 OpenBenchmarking.org GIOPS, More Is Better vkpeak 20230730 int32-vec4 a b c 600 1200 1800 2400 3000 SE +/- 0.26, N = 3 2658.73 2640.08 2638.69
vkpeak int16-scalar OpenBenchmarking.org GIOPS, More Is Better vkpeak 20230730 int16-scalar a b c 3K 6K 9K 12K 15K SE +/- 1.30, N = 3 13102.75 13070.81 13063.86
vkpeak int16-vec4 OpenBenchmarking.org GIOPS, More Is Better vkpeak 20230730 int16-vec4 b c a 5K 10K 15K 20K 25K SE +/- 21.55, N = 3 23396.59 23385.44 23123.77
VkResample Upscale: 2x - Precision: Single OpenBenchmarking.org ms, Fewer Is Better VkResample 1.0 Upscale: 2x - Precision: Single a c b 3 6 9 12 15 SE +/- 0.00, N = 3 11.69 11.69 11.69 1. (CXX) g++ options: -O3
NCNN Target: CPU - Model: mobilenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: mobilenet b c a 2 4 6 8 10 SE +/- 0.03, N = 3 7.97 8.02 8.05 MIN: 7.94 / MAX: 8.26 MIN: 7.98 / MAX: 8.33 MIN: 7.97 / MAX: 9.07 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU-v2-v2 - Model: mobilenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU-v2-v2 - Model: mobilenet-v2 a b c 0.7155 1.431 2.1465 2.862 3.5775 SE +/- 0.00, N = 3 3.16 3.16 3.18 MIN: 3.1 / MAX: 3.8 MIN: 3.11 / MAX: 3.61 MIN: 3.13 / MAX: 3.84 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: shufflenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: shufflenet-v2 a b c 0.7538 1.5076 2.2614 3.0152 3.769 SE +/- 0.01, N = 3 3.34 3.34 3.35 MIN: 3.3 / MAX: 3.85 MIN: 3.31 / MAX: 3.77 MIN: 3.31 / MAX: 3.8 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: mnasnet a b c 0.6728 1.3456 2.0184 2.6912 3.364 SE +/- 0.01, N = 3 2.97 2.97 2.99 MIN: 2.92 / MAX: 3.48 MIN: 2.93 / MAX: 3.45 MIN: 2.96 / MAX: 3.44 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: efficientnet-b0 b c a 0.8775 1.755 2.6325 3.51 4.3875 SE +/- 0.05, N = 3 3.85 3.88 3.90 MIN: 3.81 / MAX: 4.42 MIN: 3.84 / MAX: 4.41 MIN: 3.82 / MAX: 4.51 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: blazeface a b c 0.3128 0.6256 0.9384 1.2512 1.564 SE +/- 0.00, N = 3 1.38 1.38 1.39 MIN: 1.35 / MAX: 2.06 MIN: 1.35 / MAX: 1.67 MIN: 1.36 / MAX: 1.53 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: googlenet b c a 2 4 6 8 10 SE +/- 0.11, N = 3 7.82 7.93 7.94 MIN: 7.73 / MAX: 8.65 MIN: 7.82 / MAX: 8.91 MIN: 7.71 / MAX: 8.73 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: vgg16 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: vgg16 c b a 6 12 18 24 30 SE +/- 0.30, N = 3 23.45 23.49 23.75 MIN: 23.26 / MAX: 24.51 MIN: 23.36 / MAX: 24.62 MIN: 23.31 / MAX: 25.12 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: resnet18 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: resnet18 b c a 1.1903 2.3806 3.5709 4.7612 5.9515 SE +/- 0.07, N = 3 5.20 5.24 5.29 MIN: 5.1 / MAX: 5.9 MIN: 5.15 / MAX: 6.09 MIN: 5.09 / MAX: 6.29 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: alexnet c b a 0.9923 1.9846 2.9769 3.9692 4.9615 SE +/- 0.11, N = 3 4.31 4.32 4.41 MIN: 4.26 / MAX: 4.98 MIN: 4.26 / MAX: 5.15 MIN: 4.24 / MAX: 5.16 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: resnet50 b c a 3 6 9 12 15 SE +/- 0.23, N = 3 10.01 10.11 10.20 MIN: 9.85 / MAX: 11.06 MIN: 9.95 / MAX: 16.18 MIN: 9.84 / MAX: 12.48 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: yolov4-tiny OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: yolov4-tiny b c a 3 6 9 12 15 SE +/- 0.11, N = 3 12.74 12.81 12.90 MIN: 12.66 / MAX: 13.28 MIN: 12.74 / MAX: 13.2 MIN: 12.69 / MAX: 15.88 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: squeezenet_ssd OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: squeezenet_ssd b a c 2 4 6 8 10 SE +/- 0.01, N = 3 7.06 7.07 7.10 MIN: 7.01 / MAX: 7.55 MIN: 7.01 / MAX: 8.07 MIN: 7.05 / MAX: 7.65 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: regnety_400m OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: regnety_400m a b c 2 4 6 8 10 SE +/- 0.04, N = 3 8.18 8.18 8.27 MIN: 8.07 / MAX: 9.68 MIN: 8.12 / MAX: 8.86 MIN: 8.22 / MAX: 9.18 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: vision_transformer OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: vision_transformer c b a 8 16 24 32 40 SE +/- 0.29, N = 3 31.77 31.95 32.49 MIN: 31.61 / MAX: 35.68 MIN: 31.79 / MAX: 32.33 MIN: 31.67 / MAX: 40.11 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: FastestDet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: FastestDet a b c 0.9248 1.8496 2.7744 3.6992 4.624 SE +/- 0.45, N = 3 3.62 4.05 4.11 MIN: 2.7 / MAX: 4.54 MIN: 4.02 / MAX: 4.35 MIN: 4.08 / MAX: 4.4 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU-v3-v3 - Model: mobilenet-v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU-v3-v3 - Model: mobilenet-v3 c a 0.7155 1.431 2.1465 2.862 3.5775 SE +/- 0.00, N = 2 3.17 3.18 MIN: 3.15 / MAX: 3.74 MIN: 3.14 / MAX: 3.82 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: mobilenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: mobilenet c b a 2 4 6 8 10 SE +/- 0.02, N = 3 8.03 8.04 8.05 MIN: 7.98 / MAX: 8.84 MIN: 7.95 / MAX: 14.33 MIN: 7.95 / MAX: 8.89 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 c b a 0.7133 1.4266 2.1399 2.8532 3.5665 SE +/- 0.01, N = 3 3.13 3.14 3.17 MIN: 3.08 / MAX: 3.85 MIN: 3.1 / MAX: 3.73 MIN: 3.09 / MAX: 3.78 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 a c 0.72 1.44 2.16 2.88 3.6 SE +/- 0.02, N = 3 3.17 3.20 MIN: 3.11 / MAX: 3.73 MIN: 3.16 / MAX: 3.68 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: shufflenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: shufflenet-v2 c b a 0.7538 1.5076 2.2614 3.0152 3.769 SE +/- 0.01, N = 3 3.32 3.33 3.35 MIN: 3.29 / MAX: 4.19 MIN: 3.3 / MAX: 3.59 MIN: 3.29 / MAX: 3.85 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: mnasnet b c a 0.6705 1.341 2.0115 2.682 3.3525 SE +/- 0.01, N = 3 2.95 2.96 2.98 MIN: 2.92 / MAX: 3.42 MIN: 2.93 / MAX: 3.41 MIN: 2.92 / MAX: 4.03 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: efficientnet-b0 b c a 0.8685 1.737 2.6055 3.474 4.3425 SE +/- 0.01, N = 3 3.82 3.83 3.86 MIN: 3.78 / MAX: 4.39 MIN: 3.79 / MAX: 4.61 MIN: 3.8 / MAX: 4.6 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: blazeface b c a 0.3105 0.621 0.9315 1.242 1.5525 SE +/- 0.01, N = 3 1.37 1.37 1.38 MIN: 1.35 / MAX: 1.75 MIN: 1.35 / MAX: 1.82 MIN: 1.34 / MAX: 1.85 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: googlenet c b a 2 4 6 8 10 SE +/- 0.02, N = 3 7.80 7.85 7.90 MIN: 7.72 / MAX: 8.74 MIN: 7.76 / MAX: 8.76 MIN: 7.74 / MAX: 9.54 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: vgg16 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: vgg16 a c b 6 12 18 24 30 SE +/- 0.04, N = 3 23.51 23.54 23.56 MIN: 23.29 / MAX: 24.68 MIN: 23.33 / MAX: 24.61 MIN: 23.34 / MAX: 24.72 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: resnet18 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: resnet18 c b a 1.188 2.376 3.564 4.752 5.94 SE +/- 0.01, N = 3 5.21 5.23 5.28 MIN: 5.11 / MAX: 6.04 MIN: 5.13 / MAX: 6.18 MIN: 5.17 / MAX: 6.16 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: alexnet a b c 0.9743 1.9486 2.9229 3.8972 4.8715 SE +/- 0.01, N = 3 4.31 4.33 4.33 MIN: 4.24 / MAX: 5.2 MIN: 4.28 / MAX: 5.16 MIN: 4.26 / MAX: 10.59 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: resnet50 b c a 3 6 9 12 15 SE +/- 0.02, N = 3 10.00 10.00 10.01 MIN: 9.92 / MAX: 12.35 MIN: 9.91 / MAX: 11.15 MIN: 9.88 / MAX: 11.4 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: yolov4-tiny OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: yolov4-tiny c a b 3 6 9 12 15 SE +/- 0.02, N = 3 12.81 12.84 12.87 MIN: 12.73 / MAX: 13.08 MIN: 12.69 / MAX: 15.33 MIN: 12.76 / MAX: 13.73 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: squeezenet_ssd OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: squeezenet_ssd c b a 2 4 6 8 10 SE +/- 0.02, N = 3 7.06 7.07 7.09 MIN: 7 / MAX: 8.03 MIN: 7 / MAX: 8.07 MIN: 6.98 / MAX: 7.95 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: regnety_400m OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: regnety_400m c a b 2 4 6 8 10 SE +/- 0.11, N = 3 8.00 8.16 8.21 MIN: 7.94 / MAX: 8.88 MIN: 7.9 / MAX: 8.99 MIN: 8.14 / MAX: 8.84 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: vision_transformer OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: vision_transformer c b a 7 14 21 28 35 SE +/- 0.09, N = 3 31.79 31.85 31.88 MIN: 31.63 / MAX: 35.57 MIN: 31.69 / MAX: 33.06 MIN: 31.55 / MAX: 37.47 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU - Model: FastestDet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: FastestDet b c a 0.9225 1.845 2.7675 3.69 4.6125 SE +/- 0.00, N = 3 4.07 4.09 4.10 MIN: 4.04 / MAX: 4.53 MIN: 4.05 / MAX: 5.5 MIN: 4.06 / MAX: 4.81 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU-v3-v3-v3 - Model: mobilenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU-v3-v3-v3 - Model: mobilenet c b 2 4 6 8 10 8.00 8.01 MIN: 7.96 / MAX: 8.63 MIN: 7.95 / MAX: 8.95 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU-v3-v3-v3-v2-v2 - Model: mobilenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU-v3-v3-v3-v2-v2 - Model: mobilenet-v2 c b 0.7088 1.4176 2.1264 2.8352 3.544 3.14 3.15 MIN: 3.1 / MAX: 3.67 MIN: 3.1 / MAX: 3.68 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU-v3-v3-v3-v3-v3 - Model: mobilenet-v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU-v3-v3-v3-v3-v3 - Model: mobilenet-v3 b c 0.711 1.422 2.133 2.844 3.555 3.16 3.16 MIN: 3.12 / MAX: 3.69 MIN: 3.12 / MAX: 3.7 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU-v3-v3-v3 - Model: shufflenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU-v3-v3-v3 - Model: shufflenet-v2 b c 0.7515 1.503 2.2545 3.006 3.7575 3.33 3.34 MIN: 3.3 / MAX: 3.79 MIN: 3.32 / MAX: 3.79 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU-v3-v3-v3 - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU-v3-v3-v3 - Model: mnasnet b c 0.6683 1.3366 2.0049 2.6732 3.3415 2.97 2.97 MIN: 2.94 / MAX: 3.43 MIN: 2.94 / MAX: 3.43 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU-v3-v3-v3 - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU-v3-v3-v3 - Model: efficientnet-b0 b c 0.8753 1.7506 2.6259 3.5012 4.3765 3.82 3.89 MIN: 3.79 / MAX: 4.34 MIN: 3.83 / MAX: 9.72 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU-v3-v3-v3 - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU-v3-v3-v3 - Model: blazeface b c 0.3105 0.621 0.9315 1.242 1.5525 1.37 1.38 MIN: 1.35 / MAX: 1.52 MIN: 1.36 / MAX: 1.58 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU-v3-v3-v3 - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU-v3-v3-v3 - Model: googlenet b c 2 4 6 8 10 7.84 7.88 MIN: 7.74 / MAX: 8.7 MIN: 7.79 / MAX: 8.78 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU-v3-v3-v3 - Model: vgg16 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU-v3-v3-v3 - Model: vgg16 b c 6 12 18 24 30 23.50 23.99 MIN: 23.3 / MAX: 24.41 MIN: 23.72 / MAX: 24.98 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU-v3-v3-v3 - Model: resnet18 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU-v3-v3-v3 - Model: resnet18 b c 1.1835 2.367 3.5505 4.734 5.9175 5.21 5.26 MIN: 5.12 / MAX: 6.22 MIN: 5.18 / MAX: 6.27 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU-v3-v3-v3 - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU-v3-v3-v3 - Model: alexnet c b 0.9653 1.9306 2.8959 3.8612 4.8265 4.28 4.29 MIN: 4.24 / MAX: 5.12 MIN: 4.24 / MAX: 5.64 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU-v3-v3-v3 - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU-v3-v3-v3 - Model: resnet50 b c 3 6 9 12 15 10.01 10.33 MIN: 9.89 / MAX: 10.86 MIN: 10.16 / MAX: 13.97 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU-v3-v3-v3 - Model: yolov4-tiny OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU-v3-v3-v3 - Model: yolov4-tiny c b 3 6 9 12 15 12.89 12.98 MIN: 12.84 / MAX: 13.19 MIN: 12.73 / MAX: 35.55 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU-v3-v3-v3 - Model: squeezenet_ssd OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU-v3-v3-v3 - Model: squeezenet_ssd b c 2 4 6 8 10 7.03 7.04 MIN: 6.97 / MAX: 7.88 MIN: 6.96 / MAX: 7.83 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU-v3-v3-v3 - Model: regnety_400m OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU-v3-v3-v3 - Model: regnety_400m b c 2 4 6 8 10 8.05 8.14 MIN: 8 / MAX: 8.58 MIN: 8.08 / MAX: 8.69 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU-v3-v3-v3 - Model: vision_transformer OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU-v3-v3-v3 - Model: vision_transformer b c 7 14 21 28 35 31.65 31.78 MIN: 31.53 / MAX: 32.23 MIN: 31.64 / MAX: 34.51 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU-v3-v3-v3 - Model: FastestDet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU-v3-v3-v3 - Model: FastestDet b c 0.918 1.836 2.754 3.672 4.59 4.07 4.08 MIN: 4.03 / MAX: 5.83 MIN: 4.05 / MAX: 4.36 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU-v3-v3-v3 - Model: mobilenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU-v3-v3-v3 - Model: mobilenet c b 2 4 6 8 10 7.95 8.00 MIN: 7.89 / MAX: 8.79 MIN: 7.95 / MAX: 8.99 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU-v3-v3-v3-v2-v2 - Model: mobilenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU-v3-v3-v3-v2-v2 - Model: mobilenet-v2 b c 0.7088 1.4176 2.1264 2.8352 3.544 3.15 3.15 MIN: 3.11 / MAX: 3.88 MIN: 3.11 / MAX: 3.85 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU-v3-v3-v3-v3-v3 - Model: mobilenet-v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU-v3-v3-v3-v3-v3 - Model: mobilenet-v3 b c 0.7133 1.4266 2.1399 2.8532 3.5665 3.16 3.17 MIN: 3.11 / MAX: 3.75 MIN: 3.11 / MAX: 8.89 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU-v3-v3-v3 - Model: shufflenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU-v3-v3-v3 - Model: shufflenet-v2 b c 0.7493 1.4986 2.2479 2.9972 3.7465 3.33 3.33 MIN: 3.3 / MAX: 3.77 MIN: 3.31 / MAX: 3.81 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU-v3-v3-v3 - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU-v3-v3-v3 - Model: mnasnet b c 0.666 1.332 1.998 2.664 3.33 2.96 2.96 MIN: 2.93 / MAX: 3.4 MIN: 2.93 / MAX: 3.41 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU-v3-v3-v3 - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU-v3-v3-v3 - Model: efficientnet-b0 c b 0.8663 1.7326 2.5989 3.4652 4.3315 3.82 3.85 MIN: 3.78 / MAX: 4.53 MIN: 3.82 / MAX: 4.48 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU-v3-v3-v3 - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU-v3-v3-v3 - Model: blazeface c b 0.3083 0.6166 0.9249 1.2332 1.5415 1.36 1.37 MIN: 1.34 / MAX: 1.44 MIN: 1.35 / MAX: 1.39 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU-v3-v3-v3 - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU-v3-v3-v3 - Model: googlenet c b 2 4 6 8 10 7.83 7.97 MIN: 7.74 / MAX: 8.61 MIN: 7.89 / MAX: 8.7 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU-v3-v3-v3 - Model: vgg16 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU-v3-v3-v3 - Model: vgg16 b c 6 12 18 24 30 23.42 23.54 MIN: 23.27 / MAX: 24.32 MIN: 23.32 / MAX: 24.54 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU-v3-v3-v3 - Model: resnet18 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU-v3-v3-v3 - Model: resnet18 c b 1.2195 2.439 3.6585 4.878 6.0975 5.23 5.42 MIN: 5.11 / MAX: 6.03 MIN: 5.36 / MAX: 6.27 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU-v3-v3-v3 - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU-v3-v3-v3 - Model: alexnet c b 0.9945 1.989 2.9835 3.978 4.9725 4.30 4.42 MIN: 4.26 / MAX: 5.16 MIN: 4.32 / MAX: 5.1 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU-v3-v3-v3 - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU-v3-v3-v3 - Model: resnet50 b c 3 6 9 12 15 9.87 10.03 MIN: 9.79 / MAX: 10.73 MIN: 9.93 / MAX: 10.96 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU-v3-v3-v3 - Model: yolov4-tiny OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU-v3-v3-v3 - Model: yolov4-tiny b c 3 6 9 12 15 12.77 12.86 MIN: 12.69 / MAX: 13.71 MIN: 12.76 / MAX: 13.98 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU-v3-v3-v3 - Model: squeezenet_ssd OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU-v3-v3-v3 - Model: squeezenet_ssd c b 2 4 6 8 10 7.07 7.14 MIN: 7.01 / MAX: 7.75 MIN: 7.06 / MAX: 7.95 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU-v3-v3-v3 - Model: regnety_400m OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU-v3-v3-v3 - Model: regnety_400m c b 2 4 6 8 10 7.98 8.27 MIN: 7.93 / MAX: 8.65 MIN: 8.22 / MAX: 9.01 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU-v3-v3-v3 - Model: vision_transformer OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU-v3-v3-v3 - Model: vision_transformer c b 7 14 21 28 35 31.66 31.71 MIN: 31.52 / MAX: 32.14 MIN: 31.56 / MAX: 33.03 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: Vulkan GPU-v3-v3-v3 - Model: FastestDet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU-v3-v3-v3 - Model: FastestDet c b 0.9135 1.827 2.7405 3.654 4.5675 3.69 4.06 MIN: 3.66 / MAX: 3.92 MIN: 4.03 / MAX: 4.3 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
Phoronix Test Suite v10.8.5