nvidia linux AMD Ryzen 9 5900X 12-Core testing with a ASUS ROG CROSSHAIR VIII HERO (3801 BIOS) and NVIDIA GeForce RTX 3080 10GB on Ubuntu 20.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2110109-TJ-NVIDIALIN48 .
nvidia linux Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver OpenGL OpenCL Vulkan Compiler File-System Screen Resolution GTX 1660Ti GTX 1060 GTX 1660 SUPER RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 AMD Ryzen 9 5900X 12-Core @ 3.70GHz (12 Cores / 24 Threads) ASUS ROG CROSSHAIR VIII HERO (3801 BIOS) AMD Starship/Matisse 16GB 1000GB Western Digital WDS100T1X0E-00AFY0 + 2000GB eVGA NVIDIA GeForce GTX 1660 Ti 6GB NVIDIA TU116 HD Audio ASUS VP28U Realtek RTL8125 2.5GbE + Intel I211 Ubuntu 20.04 5.11.0-37-generic (x86_64) GNOME Shell 3.36.9 X Server 1.20.11 NVIDIA 470.74 4.6.0 OpenCL 3.0 CUDA 11.4.136 1.2.175 GCC 9.3.0 ext4 3840x2160 NVIDIA GeForce GTX 1060 6GB NVIDIA GP106 HD Audio eVGA NVIDIA GeForce GTX 1660 SUPER 6GB NVIDIA TU116 HD Audio eVGA NVIDIA GeForce RTX 3060 12GB NVIDIA Device 228e NVIDIA GeForce RTX 2070 SUPER 8GB NVIDIA TU104 HD Audio ASUS NVIDIA GeForce RTX 2070 8GB NVIDIA TU106 HD Audio NVIDIA GeForce RTX 2060 SUPER 8GB NVIDIA GeForce RTX 2060 6GB NVIDIA GeForce RTX 3060 Ti 8GB NVIDIA Device 228b NVIDIA GeForce RTX 3080 Ti 12GB NVIDIA Device 1aef NVIDIA GeForce RTX 3070 8GB NVIDIA Device 228b NVIDIA GeForce RTX 3090 24GB NVIDIA Device 1aef NVIDIA GeForce RTX 3070 Ti 8GB NVIDIA Device 228b NVIDIA GeForce RTX 3080 10GB NVIDIA Device 1aef OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Processor Details - Scaling Governor: acpi-cpufreq ondemand (Boost: Enabled) - CPU Microcode: 0xa201016 Graphics Details - GTX 1660Ti: BAR1 / Visible vRAM Size: 256 MiB - GTX 1060: BAR1 / Visible vRAM Size: 256 MiB - GTX 1660 SUPER: BAR1 / Visible vRAM Size: 256 MiB - RTX 3060: BAR1 / Visible vRAM Size: 16384 MiB - NVIDIA RTX 3060: BAR1 / Visible vRAM Size: 16384 MiB - RTX 2070 SUPER: BAR1 / Visible vRAM Size: 256 MiB - RTX 2070: BAR1 / Visible vRAM Size: 256 MiB - RTX 2060 SUPER: BAR1 / Visible vRAM Size: 256 MiB - RTX 2060: BAR1 / Visible vRAM Size: 256 MiB - RTX 3060Ti: BAR1 / Visible vRAM Size: 8192 MiB - RTX 3080Ti: BAR1 / Visible vRAM Size: 16384 MiB - RTX 3070: BAR1 / Visible vRAM Size: 8192 MiB - RTX 3090: BAR1 / Visible vRAM Size: 32768 MiB - NVIDIA RTX 3090: BAR1 / Visible vRAM Size: 32768 MiB - 3090: BAR1 / Visible vRAM Size: 32768 MiB - RTX 3070 Ti: BAR1 / Visible vRAM Size: 8192 MiB - RTX 3080: BAR1 / Visible vRAM Size: 256 MiB OpenCL Details - GTX 1660Ti: GPU Compute Cores: 1536 - GTX 1060: GPU Compute Cores: 1280 - GTX 1660 SUPER: GPU Compute Cores: 1408 - RTX 3060: GPU Compute Cores: 3584 - NVIDIA RTX 3060: GPU Compute Cores: 3584 - RTX 2070 SUPER: GPU Compute Cores: 2560 - RTX 2070: GPU Compute Cores: 2304 - RTX 2060 SUPER: GPU Compute Cores: 2176 - RTX 2060: GPU Compute Cores: 1920 - RTX 3060Ti: GPU Compute Cores: 4864 - RTX 3080Ti: GPU Compute Cores: 10240 - RTX 3070: GPU Compute Cores: 5888 - RTX 3090: GPU Compute Cores: 10496 - NVIDIA RTX 3090: GPU Compute Cores: 10496 - 3090: GPU Compute Cores: 10496 - RTX 3070 Ti: GPU Compute Cores: 6144 - RTX 3080: GPU Compute Cores: 8704 Security Details - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected Compiler Details - RTX 3060, NVIDIA RTX 3060, RTX 2070 SUPER, RTX 2070, RTX 2060 SUPER, RTX 2060, RTX 3060Ti, RTX 3080Ti, RTX 3070, RTX 3090, NVIDIA RTX 3090, 3090, RTX 3070 Ti, RTX 3080: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
nvidia linux hashcat: MD5 hashcat: SHA1 hashcat: 7-Zip hashcat: SHA-512 hashcat: TrueCrypt RIPEMD160 + XTS etlegacy: 3840 x 2160 octanebench: Total Score v-ray: NVIDIA CUDA GPU ncnn: Vulkan GPU - mobilenet ncnn: Vulkan GPU-v2-v2 - mobilenet-v2 ncnn: Vulkan GPU-v3-v3 - mobilenet-v3 ncnn: Vulkan GPU - shufflenet-v2 ncnn: Vulkan GPU - mnasnet ncnn: Vulkan GPU - efficientnet-b0 ncnn: Vulkan GPU - blazeface ncnn: Vulkan GPU - googlenet ncnn: Vulkan GPU - vgg16 ncnn: Vulkan GPU - resnet18 ncnn: Vulkan GPU - alexnet ncnn: Vulkan GPU - resnet50 ncnn: Vulkan GPU - yolov4-tiny ncnn: Vulkan GPU - squeezenet_ssd ncnn: Vulkan GPU - regnety_400m blender: BMW27 - NVIDIA OptiX blender: Classroom - NVIDIA OptiX blender: Fishy Cat - NVIDIA OptiX vkfft: gravitymark: 1920 x 1080 - OpenGL gravitymark: 1920 x 1080 - Vulkan gravitymark: 2560 x 1440 - OpenGL gravitymark: 2560 x 1440 - Vulkan gravitymark: 3840 x 2160 - OpenGL gravitymark: 3840 x 2160 - Vulkan realsr-ncnn: 4x - No realsr-ncnn: 4x - Yes waifu2x-ncnn: 2x - 3 - Yes namd-cuda: ATPase Simulation - 327,506 Atoms lczero: OpenCL v-ray: NVIDIA RTX GPU GTX 1660Ti GTX 1060 GTX 1660 SUPER RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 19620766667 6702033333 355133 854600000 253767 495.2 133.125997 442 13119800000 4455966667 189133 483533333 137633 445.2 81.44449 249 18355966667 6235366667 330833 792333333 235133 482.9 133.086823 456 4.38 1.92 2.14 1.70 2.02 3.21 0.95 4.30 7.24 1.90 2.07 4.17 6.71 4.77 2.42 26.10 73.10 56.45 10.456 68.156 4.978 0.15237 22236 1207 24825266667 7790600000 410267 992833333 291333 590.6 294.020104 851 4.39 1.91 2.15 1.71 2.01 3.24 0.95 4.28 7.25 1.93 2.07 4.18 6.73 4.83 2.41 27278 110.4 149.3 93.3 120.0 72.8 84.0 35928633333 11276666667 580233 1438900000 416900 630.7 261.828555 834 4.13 1.72 1.94 1.59 1.78 2.92 0.91 3.86 7.90 1.90 2.31 3.94 6.85 4.74 2.17 28.10 89.01 52.85 29335 114.4 149.6 96.7 121.4 74.6 83.6 10.093 63.881 4.848 0.14020 21079 1055 30641800000 9694933333 491500 1224300000 353967 591.6 244.190524 513 4.30 1.79 2.02 1.64 1.85 3.05 0.93 4.13 8.78 2 2.45 4.19 7.01 4.90 2.24 30.10 146.40 59.97 30028 101.5 139.1 86.4 112.5 66.5 78.4 11.524 75.692 5.353 0.15287 17674 798 29907933333 9468200000 482933 1198700000 348033 559.7 243.812534 528 4.26 1.76 1.97 1.6 1.81 2.96 0.91 4.19 8.87 1.99 2.42 4.16 7.01 4.90 2.19 29.89 142.69 60.30 29970 103.9 138.8 87.8 112.0 67.5 77.8 11.671 76.681 5.317 0.15476 17484 826 26593433333 8390766667 435700 1062933333 305833 557.6 195.639962 505 4.40 1.80 2.00 1.63 1.86 3.02 0.93 4.21 9.96 2.19 2.63 4.49 7.25 5.16 2.25 36.03 146.87 69.56 22746 94.9 116.4 79.5 93.0 59.5 64.3 12.901 86.359 5.844 0.16856 14473 733 35414300000 11069666667 569333 1412966667 417467 645.3 384.119086 1260 4.17 1.88 2.11 1.67 1.98 3.13 0.93 4.14 5.76 1.70 1.90 3.80 6.30 4.27 2.37 17.42 52.05 39.00 33746 132.1 188.0 113.5 153.3 89.8 108.5 8.384 51.297 4.287 0.12830 30371 1716 68466466667 21732166667 1066767 2762600000 805133 646.5 668.016818 2052 4.01 1.83 2.09 1.67 1.94 3.12 0.88 4.11 4.13 1.53 1.76 3.47 5.85 4.15 2.39 9.70 29.61 19.80 43263 164.7 262.5 147.6 226.1 125.8 173.5 5.729 29.814 3.355 0.11958 38444 2850 41900433333 13140600000 663433 1682733333 488467 645.5 414.231909 1418 4.10 1.87 2.11 1.67 1.97 3.13 0.93 4.24 5.43 1.64 1.87 3.73 6.15 4.32 2.39 15.69 45.71 33.30 31446 134.9 201.3 117.3 164.0 93.6 116.1 7.898 47.047 4.123 0.12726 32980 1880 72520866667 22954666667 1113033 2890933333 832767 654.5 684.778798 2111 4.00 1.81 2.06 1.65 1.93 3.08 0.88 4.02 4.01 1.52 1.74 3.41 5.82 3.92 2.37 9.42 28.61 18.99 44486 169.7 269.2 153.3 232.7 130.3 178.6 5.614 28.744 3.314 0.12001 39001 2928 70873300000 22570933333 1104300 2857066667 818267 581.5 680.453461 2112 4 1.82 2.06 1.66 1.92 3.08 0.87 4.08 4.03 1.51 1.74 3.41 5.85 4.10 2.36 9.44 28.51 19.00 43830 170.1 269.3 70253400000 22452233333 1101967 2861100000 822167 667.2 680.626427 2111 4 1.82 2.07 1.66 1.92 3.09 0.88 3.92 4.04 1.51 1.74 3.42 5.88 4.13 2.37 9.44 28.56 19.01 43849 169.4 269.9 153.3 233.4 130.7 178.5 5.606 28.729 3.310 0.11951 38687 2917 42901566667 13536633333 709967 1717533333 505733 648.3 454.752121 1501 4.02 1.81 2.06 1.65 1.92 3.09 0.93 3.93 5.07 1.62 1.79 3.59 6.12 4.34 2.34 14.38 42.76 31.44 37970 136.4 212.2 118.7 176.5 96.2 128.9 7.155 41.302 3.820 0.12415 35401 2034 61586233333 19440866667 972500 2466033333 724700 639.3 570.414463 1774 3.96 1.79 2.04 1.64 1.90 3.05 0.88 3.90 4.36 1.52 1.75 3.40 5.86 4.10 2.32 11.24 33.85 22.67 40852 160.6 248.2 143.1 210.4 120.2 158.1 6.113 32.845 3.444 0.12250 38103 2446 OpenBenchmarking.org
Hashcat Benchmark: MD5 OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: MD5 GTX 1660Ti GTX 1060 GTX 1660 SUPER NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 16000M 32000M 48000M 64000M 80000M SE +/- 33080726.18, N = 3 SE +/- 4813522.62, N = 3 SE +/- 61580741.94, N = 3 SE +/- 12235785.40, N = 3 SE +/- 34379515.86, N = 3 SE +/- 11557248.81, N = 3 SE +/- 53112532.52, N = 3 SE +/- 58270127.66, N = 3 SE +/- 62466737.82, N = 3 SE +/- 278660763.49, N = 3 SE +/- 52398642.90, N = 3 SE +/- 151860520.80, N = 3 SE +/- 89401584.62, N = 3 SE +/- 43362195.52, N = 3 SE +/- 53053631.15, N = 3 SE +/- 122029850.63, N = 3 19620766667 13119800000 18355966667 24825266667 35928633333 30641800000 29907933333 26593433333 35414300000 68466466667 41900433333 72520866667 70873300000 70253400000 42901566667 61586233333
Hashcat Benchmark: SHA1 OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: SHA1 GTX 1660Ti GTX 1060 GTX 1660 SUPER NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 5000M 10000M 15000M 20000M 25000M SE +/- 16083670.12, N = 3 SE +/- 2008592.65, N = 3 SE +/- 10383694.48, N = 3 SE +/- 4454585.65, N = 3 SE +/- 14748144.89, N = 3 SE +/- 36354107.21, N = 3 SE +/- 5602677.93, N = 3 SE +/- 19016338.00, N = 3 SE +/- 11142461.33, N = 3 SE +/- 54926142.33, N = 3 SE +/- 17350024.02, N = 3 SE +/- 52625416.34, N = 3 SE +/- 40688750.83, N = 3 SE +/- 42808501.23, N = 3 SE +/- 7460414.05, N = 3 SE +/- 36421620.56, N = 3 6702033333 4455966667 6235366667 7790600000 11276666667 9694933333 9468200000 8390766667 11069666667 21732166667 13140600000 22954666667 22570933333 22452233333 13536633333 19440866667
Hashcat Benchmark: 7-Zip OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: 7-Zip GTX 1660Ti GTX 1060 GTX 1660 SUPER NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 200K 400K 600K 800K 1000K SE +/- 712.59, N = 3 SE +/- 578.31, N = 3 SE +/- 504.42, N = 3 SE +/- 533.33, N = 3 SE +/- 783.87, N = 3 SE +/- 493.29, N = 3 SE +/- 669.16, N = 3 SE +/- 680.69, N = 3 SE +/- 696.02, N = 3 SE +/- 1767.61, N = 3 SE +/- 1897.66, N = 3 SE +/- 5304.82, N = 3 SE +/- 1587.45, N = 3 SE +/- 920.75, N = 3 SE +/- 1785.43, N = 3 SE +/- 2685.76, N = 3 355133 189133 330833 410267 580233 491500 482933 435700 569333 1066767 663433 1113033 1104300 1101967 709967 972500
Hashcat Benchmark: SHA-512 OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: SHA-512 GTX 1660Ti GTX 1060 GTX 1660 SUPER NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 600M 1200M 1800M 2400M 3000M SE +/- 115470.05, N = 3 SE +/- 66666.67, N = 3 SE +/- 864741.45, N = 3 SE +/- 1083717.88, N = 3 SE +/- 152752.52, N = 3 SE +/- 568624.07, N = 3 SE +/- 1500000.00, N = 3 SE +/- 1560270.63, N = 3 SE +/- 4611700.10, N = 3 SE +/- 4194043.40, N = 3 SE +/- 3238483.87, N = 3 SE +/- 5366666.67, N = 3 SE +/- 1039764.93, N = 3 SE +/- 1715614.56, N = 3 SE +/- 829323.69, N = 3 SE +/- 4117577.50, N = 3 854600000 483533333 792333333 992833333 1438900000 1224300000 1198700000 1062933333 1412966667 2762600000 1682733333 2890933333 2857066667 2861100000 1717533333 2466033333
Hashcat Benchmark: TrueCrypt RIPEMD160 + XTS OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: TrueCrypt RIPEMD160 + XTS GTX 1660Ti GTX 1060 GTX 1660 SUPER NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 200K 400K 600K 800K 1000K SE +/- 533.33, N = 3 SE +/- 33.33, N = 3 SE +/- 554.78, N = 3 SE +/- 600.93, N = 3 SE +/- 2318.05, N = 3 SE +/- 2602.78, N = 3 SE +/- 317.98, N = 3 SE +/- 1975.12, N = 3 SE +/- 3507.29, N = 3 SE +/- 7319.46, N = 3 SE +/- 4139.78, N = 3 SE +/- 5546.87, N = 3 SE +/- 688.80, N = 3 SE +/- 296.27, N = 3 SE +/- 2906.51, N = 3 SE +/- 2706.17, N = 3 253767 137633 235133 291333 416900 353967 348033 305833 417467 805133 488467 832767 818267 822167 505733 724700
ET: Legacy Resolution: 3840 x 2160 OpenBenchmarking.org Frames Per Second, More Is Better ET: Legacy 2.78 Resolution: 3840 x 2160 GTX 1660Ti GTX 1060 GTX 1660 SUPER NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 140 280 420 560 700 SE +/- 4.09, N = 3 SE +/- 1.20, N = 3 SE +/- 3.91, N = 3 SE +/- 2.08, N = 3 SE +/- 1.83, N = 3 SE +/- 2.35, N = 3 SE +/- 26.17, N = 12 SE +/- 0.44, N = 3 SE +/- 3.68, N = 3 SE +/- 1.67, N = 3 SE +/- 6.77, N = 3 SE +/- 6.42, N = 5 SE +/- 72.37, N = 9 SE +/- 1.66, N = 3 SE +/- 4.84, N = 3 SE +/- 1.47, N = 3 495.2 445.2 482.9 590.6 630.7 591.6 559.7 557.6 645.3 646.5 645.5 654.5 581.5 667.2 648.3 639.3
OctaneBench Total Score OpenBenchmarking.org Score, More Is Better OctaneBench 2020.1 Total Score GTX 1660Ti GTX 1060 GTX 1660 SUPER NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 150 300 450 600 750 133.13 81.44 133.09 294.02 261.83 244.19 243.81 195.64 384.12 668.02 414.23 684.78 680.45 680.63 454.75 570.41
Chaos Group V-RAY Mode: NVIDIA CUDA GPU OpenBenchmarking.org vpaths, More Is Better Chaos Group V-RAY 5 Mode: NVIDIA CUDA GPU GTX 1660Ti GTX 1060 GTX 1660 SUPER NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 500 1000 1500 2000 2500 SE +/- 0.58, N = 3 SE +/- 0.88, N = 3 SE +/- 1.15, N = 3 SE +/- 0.67, N = 3 SE +/- 0.88, N = 3 SE +/- 0.88, N = 3 SE +/- 0.58, N = 3 SE +/- 1.86, N = 3 SE +/- 0.33, N = 3 SE +/- 2.60, N = 3 SE +/- 2.33, N = 3 SE +/- 2.19, N = 3 SE +/- 1.86, N = 3 442 249 456 851 834 513 528 505 1260 2052 1418 2111 2112 2111 1501 1774
NCNN Target: Vulkan GPU - Model: mobilenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: mobilenet RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.99 1.98 2.97 3.96 4.95 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 4.38 4.39 4.13 4.30 4.26 4.40 4.17 4.01 4.10 4.00 4.00 4.00 4.02 3.96 MIN: 4.31 / MAX: 4.57 MIN: 4.33 / MAX: 4.54 MIN: 4.09 / MAX: 6.52 MIN: 4.21 / MAX: 12.49 MIN: 4.2 / MAX: 4.47 MIN: 4.35 / MAX: 4.57 MIN: 4.12 / MAX: 4.36 MIN: 3.96 / MAX: 4.13 MIN: 4.05 / MAX: 4.23 MIN: 3.92 / MAX: 7.83 MIN: 3.94 / MAX: 4.48 MIN: 3.95 / MAX: 4.44 MIN: 3.97 / MAX: 4.21 MIN: 3.89 / MAX: 4.55 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.432 0.864 1.296 1.728 2.16 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 1.92 1.91 1.72 1.79 1.76 1.80 1.88 1.83 1.87 1.81 1.82 1.82 1.81 1.79 MIN: 1.88 / MAX: 8.45 MIN: 1.89 / MAX: 2.84 MIN: 1.7 / MAX: 3.09 MIN: 1.76 / MAX: 2.81 MIN: 1.73 / MAX: 2.62 MIN: 1.78 / MAX: 2.99 MIN: 1.84 / MAX: 5.51 MIN: 1.81 / MAX: 4.77 MIN: 1.84 / MAX: 4.81 MIN: 1.79 / MAX: 3.1 MIN: 1.79 / MAX: 8.7 MIN: 1.79 / MAX: 4.97 MIN: 1.79 / MAX: 4.69 MIN: 1.77 / MAX: 3.16 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.4838 0.9676 1.4514 1.9352 2.419 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 2.14 2.15 1.94 2.02 1.97 2.00 2.11 2.09 2.11 2.06 2.06 2.07 2.06 2.04 MIN: 2.11 / MAX: 4.76 MIN: 2.12 / MAX: 4.81 MIN: 1.92 / MAX: 3 MIN: 2 / MAX: 4.82 MIN: 1.95 / MAX: 3.04 MIN: 1.98 / MAX: 2.91 MIN: 2.07 / MAX: 4.83 MIN: 2.06 / MAX: 4.83 MIN: 2.08 / MAX: 3.71 MIN: 2.05 / MAX: 2.49 MIN: 2.04 / MAX: 2.62 MIN: 2.05 / MAX: 2.62 MIN: 2.04 / MAX: 4.66 MIN: 2.02 / MAX: 2.27 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: shufflenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: shufflenet-v2 RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.3848 0.7696 1.1544 1.5392 1.924 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 1.70 1.71 1.59 1.64 1.60 1.63 1.67 1.67 1.67 1.65 1.66 1.66 1.65 1.64 MIN: 1.68 / MAX: 2.76 MIN: 1.69 / MAX: 2.81 MIN: 1.57 / MAX: 2.93 MIN: 1.62 / MAX: 2.66 MIN: 1.59 / MAX: 2.59 MIN: 1.61 / MAX: 2.77 MIN: 1.64 / MAX: 2.7 MIN: 1.65 / MAX: 2.01 MIN: 1.64 / MAX: 3.01 MIN: 1.64 / MAX: 2.43 MIN: 1.63 / MAX: 2.59 MIN: 1.63 / MAX: 2.99 MIN: 1.62 / MAX: 6.14 MIN: 1.61 / MAX: 2.43 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: mnasnet RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.4545 0.909 1.3635 1.818 2.2725 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 2.02 2.01 1.78 1.85 1.81 1.86 1.98 1.94 1.97 1.93 1.92 1.92 1.92 1.90 MIN: 1.97 / MAX: 12.09 MIN: 1.98 / MAX: 5.81 MIN: 1.76 / MAX: 2.56 MIN: 1.83 / MAX: 2.02 MIN: 1.8 / MAX: 2.09 MIN: 1.83 / MAX: 4.81 MIN: 1.95 / MAX: 8.5 MIN: 1.92 / MAX: 3.04 MIN: 1.94 / MAX: 4.81 MIN: 1.91 / MAX: 8.55 MIN: 1.9 / MAX: 2.79 MIN: 1.89 / MAX: 4.81 MIN: 1.89 / MAX: 4.79 MIN: 1.87 / MAX: 8.44 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: efficientnet-b0 RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.729 1.458 2.187 2.916 3.645 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 3.21 3.24 2.92 3.05 2.96 3.02 3.13 3.12 3.13 3.08 3.08 3.09 3.09 3.05 MIN: 3.18 / MAX: 4.81 MIN: 3.19 / MAX: 4.87 MIN: 2.88 / MAX: 5.47 MIN: 3.02 / MAX: 4.81 MIN: 2.92 / MAX: 9.52 MIN: 2.99 / MAX: 5.02 MIN: 3.1 / MAX: 4.87 MIN: 3.09 / MAX: 4.84 MIN: 3.1 / MAX: 4.82 MIN: 3.06 / MAX: 4.67 MIN: 3.04 / MAX: 4.85 MIN: 3.06 / MAX: 6.04 MIN: 3.05 / MAX: 4.84 MIN: 3.02 / MAX: 3.36 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: blazeface RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.2138 0.4276 0.6414 0.8552 1.069 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.95 0.95 0.91 0.93 0.91 0.93 0.93 0.88 0.93 0.88 0.87 0.88 0.93 0.88 MIN: 0.93 / MAX: 1.89 MIN: 0.93 / MAX: 1.92 MIN: 0.88 / MAX: 1.8 MIN: 0.9 / MAX: 2.01 MIN: 0.89 / MAX: 1.94 MIN: 0.91 / MAX: 2 MIN: 0.91 / MAX: 1.68 MIN: 0.86 / MAX: 1.84 MIN: 0.91 / MAX: 1.8 MIN: 0.85 / MAX: 1.76 MIN: 0.85 / MAX: 1.89 MIN: 0.85 / MAX: 1.71 MIN: 0.91 / MAX: 1.99 MIN: 0.86 / MAX: 1.91 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: googlenet RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.9675 1.935 2.9025 3.87 4.8375 SE +/- 0.07, N = 3 SE +/- 0.11, N = 3 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 SE +/- 0.00, N = 2 SE +/- 0.04, N = 3 SE +/- 0.07, N = 2 SE +/- 0.11, N = 3 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 SE +/- 0.00, N = 2 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 4.30 4.28 3.86 4.13 4.19 4.21 4.14 4.11 4.24 4.02 4.08 3.92 3.93 3.90 MIN: 3.91 / MAX: 15 MIN: 3.91 / MAX: 22.46 MIN: 3.44 / MAX: 11.03 MIN: 3.63 / MAX: 11.49 MIN: 3.57 / MAX: 12.23 MIN: 3.71 / MAX: 19.56 MIN: 3.75 / MAX: 13.91 MIN: 3.62 / MAX: 17.74 MIN: 3.72 / MAX: 13.94 MIN: 3.57 / MAX: 16.52 MIN: 3.57 / MAX: 15.4 MIN: 3.57 / MAX: 18.33 MIN: 3.59 / MAX: 13.6 MIN: 3.51 / MAX: 17.33 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: vgg16 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: vgg16 RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 7.24 7.25 7.90 8.78 8.87 9.96 5.76 4.13 5.43 4.01 4.03 4.04 5.07 4.36 MIN: 7.11 / MAX: 16.52 MIN: 7.15 / MAX: 16.65 MIN: 7.39 / MAX: 17.42 MIN: 8.15 / MAX: 25.5 MIN: 8.62 / MAX: 23.64 MIN: 9.52 / MAX: 24.93 MIN: 5.68 / MAX: 13.67 MIN: 4.1 / MAX: 7.68 MIN: 5.33 / MAX: 19.97 MIN: 3.97 / MAX: 6.67 MIN: 3.98 / MAX: 10.03 MIN: 3.98 / MAX: 13.19 MIN: 5.02 / MAX: 9.32 MIN: 4.31 / MAX: 6.26 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: resnet18 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: resnet18 RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.4928 0.9856 1.4784 1.9712 2.464 SE +/- 0.01, N = 2 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 1.90 1.93 1.90 2.00 1.99 2.19 1.70 1.53 1.64 1.52 1.51 1.51 1.62 1.52 MIN: 1.88 / MAX: 2.08 MIN: 1.88 / MAX: 12.22 MIN: 1.88 / MAX: 2.05 MIN: 1.98 / MAX: 2.13 MIN: 1.97 / MAX: 2.15 MIN: 2.17 / MAX: 2.33 MIN: 1.68 / MAX: 4.79 MIN: 1.51 / MAX: 1.76 MIN: 1.62 / MAX: 1.88 MIN: 1.49 / MAX: 4.09 MIN: 1.49 / MAX: 1.76 MIN: 1.49 / MAX: 1.7 MIN: 1.61 / MAX: 3.82 MIN: 1.49 / MAX: 2.49 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: alexnet RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.5918 1.1836 1.7754 2.3672 2.959 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 2.07 2.07 2.31 2.45 2.42 2.63 1.90 1.76 1.87 1.74 1.74 1.74 1.79 1.75 MIN: 2.03 / MAX: 5.86 MIN: 2.05 / MAX: 2.22 MIN: 2.06 / MAX: 3.47 MIN: 2.39 / MAX: 4.82 MIN: 2.34 / MAX: 2.93 MIN: 2.51 / MAX: 4.77 MIN: 1.85 / MAX: 8.61 MIN: 1.74 / MAX: 1.92 MIN: 1.83 / MAX: 4.81 MIN: 1.72 / MAX: 1.89 MIN: 1.72 / MAX: 1.94 MIN: 1.72 / MAX: 1.92 MIN: 1.78 / MAX: 1.94 MIN: 1.72 / MAX: 4.78 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: resnet50 RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 1.0103 2.0206 3.0309 4.0412 5.0515 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 2 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 4.17 4.18 3.94 4.19 4.16 4.49 3.80 3.47 3.73 3.41 3.41 3.42 3.59 3.40 MIN: 4.15 / MAX: 4.26 MIN: 4.15 / MAX: 4.48 MIN: 3.91 / MAX: 4.89 MIN: 4.16 / MAX: 4.31 MIN: 4.14 / MAX: 4.83 MIN: 4.47 / MAX: 4.83 MIN: 3.76 / MAX: 13.08 MIN: 3.45 / MAX: 4.72 MIN: 3.67 / MAX: 4.82 MIN: 3.39 / MAX: 3.54 MIN: 3.39 / MAX: 4.83 MIN: 3.4 / MAX: 8.52 MIN: 3.56 / MAX: 4.82 MIN: 3.37 / MAX: 3.58 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: yolov4-tiny OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: yolov4-tiny RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 2 4 6 8 10 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.06, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 6.71 6.73 6.85 7.01 7.01 7.25 6.30 5.85 6.15 5.82 5.85 5.88 6.12 5.86 MIN: 6.58 / MAX: 7.1 MIN: 6.6 / MAX: 6.89 MIN: 6.66 / MAX: 7.27 MIN: 6.91 / MAX: 10.62 MIN: 6.92 / MAX: 16.05 MIN: 7.17 / MAX: 7.38 MIN: 6.11 / MAX: 6.59 MIN: 5.59 / MAX: 10.87 MIN: 5.94 / MAX: 6.41 MIN: 5.57 / MAX: 6.24 MIN: 5.6 / MAX: 6.5 MIN: 5.58 / MAX: 12.45 MIN: 5.9 / MAX: 6.51 MIN: 5.61 / MAX: 6.37 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: squeezenet_ssd OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: squeezenet_ssd RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 1.161 2.322 3.483 4.644 5.805 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.07, N = 3 SE +/- 0.12, N = 3 SE +/- 0.12, N = 3 SE +/- 0.13, N = 3 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 SE +/- 0.09, N = 3 SE +/- 0.01, N = 3 SE +/- 0.10, N = 3 SE +/- 0.17, N = 2 SE +/- 0.11, N = 3 SE +/- 0.13, N = 2 4.77 4.83 4.74 4.90 4.90 5.16 4.27 4.15 4.32 3.92 4.10 4.13 4.34 4.10 MIN: 4.67 / MAX: 5.06 MIN: 4.63 / MAX: 14.6 MIN: 4.52 / MAX: 9.57 MIN: 4.65 / MAX: 7.98 MIN: 4.66 / MAX: 8.68 MIN: 4.86 / MAX: 21.65 MIN: 4.16 / MAX: 4.55 MIN: 3.9 / MAX: 7.31 MIN: 4.04 / MAX: 9.9 MIN: 3.85 / MAX: 4.41 MIN: 3.84 / MAX: 8.44 MIN: 3.89 / MAX: 6.1 MIN: 4.04 / MAX: 7.74 MIN: 3.89 / MAX: 8.62 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
NCNN Target: Vulkan GPU - Model: regnety_400m OpenBenchmarking.org ms, Fewer Is Better NCNN 20210720 Target: Vulkan GPU - Model: regnety_400m RTX 3060 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 0.5445 1.089 1.6335 2.178 2.7225 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 2.42 2.41 2.17 2.24 2.19 2.25 2.37 2.39 2.39 2.37 2.36 2.37 2.34 2.32 MIN: 2.37 / MAX: 10.64 MIN: 2.39 / MAX: 3.22 MIN: 2.15 / MAX: 2.49 MIN: 2.23 / MAX: 2.46 MIN: 2.17 / MAX: 2.95 MIN: 2.2 / MAX: 2.77 MIN: 2.35 / MAX: 2.95 MIN: 2.36 / MAX: 2.88 MIN: 2.36 / MAX: 2.74 MIN: 2.35 / MAX: 2.86 MIN: 2.35 / MAX: 2.94 MIN: 2.35 / MAX: 3.22 MIN: 2.31 / MAX: 3.52 MIN: 2.3 / MAX: 3.35 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
Blender Blend File: BMW27 - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: BMW27 - Compute: NVIDIA OptiX RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 8 16 24 32 40 SE +/- 2.63, N = 15 SE +/- 2.61, N = 15 SE +/- 0.06, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 26.10 28.10 30.10 29.89 36.03 17.42 9.70 15.69 9.42 9.44 9.44 14.38 11.24
Blender Blend File: Classroom - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: Classroom - Compute: NVIDIA OptiX RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 30 60 90 120 150 SE +/- 0.10, N = 3 SE +/- 0.30, N = 3 SE +/- 1.24, N = 3 SE +/- 1.28, N = 3 SE +/- 1.05, N = 3 SE +/- 0.06, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.12, N = 3 73.10 89.01 146.40 142.69 146.87 52.05 29.61 45.71 28.61 28.51 28.56 42.76 33.85
Blender Blend File: Fishy Cat - Compute: NVIDIA OptiX OpenBenchmarking.org Seconds, Fewer Is Better Blender 2.92 Blend File: Fishy Cat - Compute: NVIDIA OptiX RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 15 30 45 60 75 SE +/- 2.71, N = 15 SE +/- 2.69, N = 15 SE +/- 0.09, N = 3 SE +/- 0.15, N = 3 SE +/- 0.10, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 56.45 52.85 59.97 60.30 69.56 39.00 19.80 33.30 18.99 19.00 19.01 31.44 22.67
VkFFT OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.1.1 NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 10K 20K 30K 40K 50K SE +/- 187.36, N = 3 SE +/- 219.94, N = 3 SE +/- 85.43, N = 3 SE +/- 231.75, N = 3 SE +/- 157.50, N = 3 SE +/- 189.63, N = 3 SE +/- 392.62, N = 9 SE +/- 83.35, N = 3 SE +/- 315.62, N = 3 SE +/- 516.79, N = 4 SE +/- 524.00, N = 3 SE +/- 436.94, N = 4 SE +/- 495.84, N = 3 27278 29335 30028 29970 22746 33746 43263 31446 44486 43830 43849 37970 40852 1. (CXX) g++ options: -O3 -pthread
GravityMark Resolution: 1920 x 1080 - Renderer: OpenGL OpenBenchmarking.org Frames Per Second, More Is Better GravityMark 1.2 Resolution: 1920 x 1080 - Renderer: OpenGL NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 40 80 120 160 200 SE +/- 0.03, N = 3 SE +/- 0.50, N = 3 SE +/- 0.23, N = 3 SE +/- 0.23, N = 3 SE +/- 0.43, N = 3 SE +/- 0.15, N = 3 SE +/- 0.12, N = 3 SE +/- 0.20, N = 3 SE +/- 0.22, N = 3 SE +/- 0.44, N = 3 SE +/- 0.72, N = 3 SE +/- 0.07, N = 3 SE +/- 0.50, N = 3 110.4 114.4 101.5 103.9 94.9 132.1 164.7 134.9 169.7 170.1 169.4 136.4 160.6
GravityMark Resolution: 1920 x 1080 - Renderer: Vulkan OpenBenchmarking.org Frames Per Second, More Is Better GravityMark 1.2 Resolution: 1920 x 1080 - Renderer: Vulkan NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 NVIDIA RTX 3090 3090 RTX 3070 Ti RTX 3080 60 120 180 240 300 SE +/- 0.15, N = 3 SE +/- 0.15, N = 3 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 SE +/- 0.07, N = 3 SE +/- 0.27, N = 3 SE +/- 0.20, N = 3 SE +/- 0.29, N = 3 SE +/- 0.50, N = 3 SE +/- 0.03, N = 3 SE +/- 0.58, N = 3 SE +/- 0.32, N = 3 SE +/- 0.20, N = 3 149.3 149.6 139.1 138.8 116.4 188.0 262.5 201.3 269.2 269.3 269.9 212.2 248.2
GravityMark Resolution: 2560 x 1440 - Renderer: OpenGL OpenBenchmarking.org Frames Per Second, More Is Better GravityMark 1.2 Resolution: 2560 x 1440 - Renderer: OpenGL NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 3090 RTX 3070 Ti RTX 3080 30 60 90 120 150 SE +/- 0.12, N = 3 SE +/- 0.22, N = 3 SE +/- 0.09, N = 3 SE +/- 0.20, N = 3 SE +/- 0.03, N = 3 SE +/- 0.40, N = 3 SE +/- 0.64, N = 3 SE +/- 0.15, N = 3 SE +/- 0.35, N = 3 SE +/- 0.69, N = 3 SE +/- 0.20, N = 3 SE +/- 0.42, N = 3 93.3 96.7 86.4 87.8 79.5 113.5 147.6 117.3 153.3 153.3 118.7 143.1
GravityMark Resolution: 2560 x 1440 - Renderer: Vulkan OpenBenchmarking.org Frames Per Second, More Is Better GravityMark 1.2 Resolution: 2560 x 1440 - Renderer: Vulkan NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 3090 RTX 3070 Ti RTX 3080 50 100 150 200 250 SE +/- 0.20, N = 3 SE +/- 0.10, N = 3 SE +/- 0.12, N = 3 SE +/- 0.18, N = 3 SE +/- 0.17, N = 3 SE +/- 0.15, N = 3 SE +/- 0.15, N = 3 SE +/- 0.28, N = 3 SE +/- 0.26, N = 3 SE +/- 0.21, N = 3 SE +/- 0.32, N = 3 SE +/- 0.34, N = 3 120.0 121.4 112.5 112.0 93.0 153.3 226.1 164.0 232.7 233.4 176.5 210.4
GravityMark Resolution: 3840 x 2160 - Renderer: OpenGL OpenBenchmarking.org Frames Per Second, More Is Better GravityMark 1.2 Resolution: 3840 x 2160 - Renderer: OpenGL NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 3090 RTX 3070 Ti RTX 3080 30 60 90 120 150 SE +/- 0.17, N = 3 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.00, N = 3 SE +/- 0.15, N = 3 SE +/- 0.09, N = 3 SE +/- 0.19, N = 3 SE +/- 0.23, N = 3 SE +/- 0.12, N = 3 SE +/- 0.15, N = 3 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 72.8 74.6 66.5 67.5 59.5 89.8 125.8 93.6 130.3 130.7 96.2 120.2
GravityMark Resolution: 3840 x 2160 - Renderer: Vulkan OpenBenchmarking.org Frames Per Second, More Is Better GravityMark 1.2 Resolution: 3840 x 2160 - Renderer: Vulkan NVIDIA RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 3090 RTX 3070 Ti RTX 3080 40 80 120 160 200 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.10, N = 3 SE +/- 0.15, N = 3 SE +/- 0.15, N = 3 SE +/- 0.21, N = 3 SE +/- 0.18, N = 3 SE +/- 0.13, N = 3 84.0 83.6 78.4 77.8 64.3 108.5 173.5 116.1 178.6 178.5 128.9 158.1
RealSR-NCNN Scale: 4x - TAA: No OpenBenchmarking.org Seconds, Fewer Is Better RealSR-NCNN 20200818 Scale: 4x - TAA: No RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 3090 RTX 3070 Ti RTX 3080 3 6 9 12 15 SE +/- 0.006, N = 3 SE +/- 0.028, N = 3 SE +/- 0.018, N = 3 SE +/- 0.010, N = 3 SE +/- 0.003, N = 3 SE +/- 0.016, N = 3 SE +/- 0.028, N = 3 SE +/- 0.010, N = 3 SE +/- 0.003, N = 3 SE +/- 0.010, N = 3 SE +/- 0.008, N = 3 SE +/- 0.008, N = 3 10.456 10.093 11.524 11.671 12.901 8.384 5.729 7.898 5.614 5.606 7.155 6.113
RealSR-NCNN Scale: 4x - TAA: Yes OpenBenchmarking.org Seconds, Fewer Is Better RealSR-NCNN 20200818 Scale: 4x - TAA: Yes RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 3090 RTX 3070 Ti RTX 3080 20 40 60 80 100 SE +/- 0.07, N = 3 SE +/- 0.05, N = 3 SE +/- 0.11, N = 3 SE +/- 0.08, N = 3 SE +/- 0.10, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.06, N = 3 SE +/- 0.07, N = 3 SE +/- 0.07, N = 3 68.16 63.88 75.69 76.68 86.36 51.30 29.81 47.05 28.74 28.73 41.30 32.85
Waifu2x-NCNN Vulkan Scale: 2x - Denoise: 3 - TAA: Yes OpenBenchmarking.org Seconds, Fewer Is Better Waifu2x-NCNN Vulkan 20200818 Scale: 2x - Denoise: 3 - TAA: Yes RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 3090 RTX 3070 Ti RTX 3080 1.3149 2.6298 3.9447 5.2596 6.5745 SE +/- 0.008, N = 3 SE +/- 0.001, N = 3 SE +/- 0.016, N = 3 SE +/- 0.007, N = 3 SE +/- 0.024, N = 3 SE +/- 0.006, N = 3 SE +/- 0.001, N = 3 SE +/- 0.007, N = 3 SE +/- 0.006, N = 3 SE +/- 0.004, N = 3 SE +/- 0.005, N = 3 SE +/- 0.006, N = 3 4.978 4.848 5.353 5.317 5.844 4.287 3.355 4.123 3.314 3.310 3.820 3.444
NAMD CUDA ATPase Simulation - 327,506 Atoms OpenBenchmarking.org days/ns, Fewer Is Better NAMD CUDA 2.14 ATPase Simulation - 327,506 Atoms RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 3090 RTX 3070 Ti RTX 3080 0.0379 0.0758 0.1137 0.1516 0.1895 SE +/- 0.00015, N = 3 SE +/- 0.00012, N = 3 SE +/- 0.00047, N = 3 SE +/- 0.00063, N = 3 SE +/- 0.00014, N = 3 SE +/- 0.00006, N = 3 SE +/- 0.00009, N = 3 SE +/- 0.00094, N = 3 SE +/- 0.00103, N = 3 SE +/- 0.00003, N = 3 SE +/- 0.00009, N = 3 SE +/- 0.00140, N = 3 0.15237 0.14020 0.15287 0.15476 0.16856 0.12830 0.11958 0.12726 0.12001 0.11951 0.12415 0.12250
LeelaChessZero Backend: OpenCL OpenBenchmarking.org Nodes Per Second, More Is Better LeelaChessZero 0.28 Backend: OpenCL RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 3090 RTX 3070 Ti RTX 3080 8K 16K 24K 32K 40K SE +/- 125.30, N = 3 SE +/- 129.25, N = 3 SE +/- 144.05, N = 3 SE +/- 87.16, N = 3 SE +/- 59.29, N = 3 SE +/- 168.30, N = 3 SE +/- 111.06, N = 3 SE +/- 232.47, N = 3 SE +/- 412.81, N = 3 SE +/- 278.45, N = 3 SE +/- 231.99, N = 3 SE +/- 230.16, N = 3 22236 21079 17674 17484 14473 30371 38444 32980 39001 38687 35401 38103 1. (CXX) g++ options: -flto -pthread
Chaos Group V-RAY Mode: NVIDIA RTX GPU OpenBenchmarking.org vrays, More Is Better Chaos Group V-RAY 5 Mode: NVIDIA RTX GPU RTX 3060 RTX 2070 SUPER RTX 2070 RTX 2060 SUPER RTX 2060 RTX 3060Ti RTX 3080Ti RTX 3070 RTX 3090 3090 RTX 3070 Ti RTX 3080 600 1200 1800 2400 3000 SE +/- 1.67, N = 3 SE +/- 1.45, N = 3 SE +/- 0.88, N = 3 SE +/- 2.40, N = 3 SE +/- 6.06, N = 3 SE +/- 1.00, N = 3 SE +/- 3.00, N = 3 SE +/- 8.88, N = 3 SE +/- 1.76, N = 3 SE +/- 4.73, N = 3 1207 1055 798 826 733 1716 2850 1880 2928 2917 2034 2446
Phoronix Test Suite v10.8.5