Intel Core i9-13900K testing with a ASUS TUF GAMING Z790-PRO WIFI (1401 BIOS) and NVIDIA GeForce RTX 3090 24GB on EndeavourOS rolling via the Phoronix Test Suite.
NVIDIA RTX 4070 SUPER Processor: Intel Core i9-13900K @ 5.50GHz (24 Cores / 32 Threads), Motherboard: ASUS TUF GAMING Z790-PRO WIFI (1401 BIOS), Chipset: Intel Device 7a27, Memory: 32GB, Disk: 4001GB Seagate ZP4000GP304001, Graphics: ASUS NVIDIA GeForce RTX 4070 SUPER 12GB, Audio: Realtek ALC1220, Monitor: ARZOPA, Network: Intel I226-V + Intel Device 7a70
OS: EndeavourOS rolling, Kernel: 6.7.1-arch1-1 (x86_64), Desktop: KDE Plasma 5.27.10, Display Server: X Server 1.21.1.11, Display Driver: NVIDIA 550.40.07, OpenGL: 4.6.0, OpenCL: OpenCL 3.0 CUDA 12.4.74, Compiler: GCC 13.2.1 20230801, File-System: ext4, Screen Resolution: 1920x1080
Kernel Notes: Transparent Huge Pages: alwaysCompiler Notes: --disable-libssp --disable-libstdcxx-pch --disable-werror --enable-__cxa_atexit --enable-bootstrap --enable-cet=auto --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-default-ssp --enable-gnu-indirect-function --enable-gnu-unique-object --enable-languages=ada,c,c++,d,fortran,go,lto,objc,obj-c++ --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-build-config=bootstrap-lto --with-linker-hash-style=gnuProcessor Notes: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x11dGraphics Notes: BAR1 / Visible vRAM Size: 16384 MiB - vBIOS Version: 95.04.69.00.c1Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
NVIDIA RTX 4070 Processor: Intel Core i9-13900K @ 5.50GHz (24 Cores / 32 Threads), Motherboard: ASUS TUF GAMING Z790-PRO WIFI (1401 BIOS), Chipset: Intel Device 7a27, Memory: 32GB, Disk: 4001GB Seagate ZP4000GP304001, Graphics: MSI NVIDIA GeForce RTX 4070 12GBAudio: Realtek ALC1220, Monitor: ARZOPA, Network: Intel I226-V + Intel Device 7a70
OS: EndeavourOS rolling, Kernel: 6.7.1-arch1-1 (x86_64), Desktop: KDE Plasma 5.27.10, Display Server: X Server 1.21.1.11, Display Driver: NVIDIA 550.40.07, OpenGL: 4.6.0, OpenCL: OpenCL 3.0 CUDA 12.4.74, Compiler: GCC 13.2.1 20230801 + CUDA 12.3, File-System: ext4, Screen Resolution: 1920x1080
Kernel Notes: Transparent Huge Pages: alwaysEnvironment Notes: NVCC_PREPEND_FLAGS="-ccbin /opt/cuda/bin"Compiler Notes: --disable-libssp --disable-libstdcxx-pch --disable-werror --enable-__cxa_atexit --enable-bootstrap --enable-cet=auto --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-default-ssp --enable-gnu-indirect-function --enable-gnu-unique-object --enable-languages=ada,c,c++,d,fortran,go,lto,objc,obj-c++ --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-build-config=bootstrap-lto --with-linker-hash-style=gnuProcessor Notes: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x11dGraphics Notes: BAR1 / Visible vRAM Size: 16384 MiB - vBIOS Version: 95.04.3e.40.2aPython Notes: Python 3.11.6Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
NVIDIA RTX 4070 TI Changed Graphics to NVIDIA GeForce RTX 4070 Ti 12GB .
Graphics Change: BAR1 / Visible vRAM Size: 16384 MiB - vBIOS Version: 95.04.31.00.36
NVIDIA RTX 3090 Processor: Intel Core i9-13900K @ 5.50GHz (24 Cores / 32 Threads), Motherboard: ASUS TUF GAMING Z790-PRO WIFI (1401 BIOS), Chipset: Intel Device 7a27, Memory: 32GB, Disk: 4001GB Seagate ZP4000GP304001, Graphics: NVIDIA GeForce RTX 3090 24GBAudio: Realtek ALC1220, Monitor: PI-KVM VideoNetwork: Intel I226-V + Intel Device 7a70
OS: EndeavourOS rolling, Kernel: 6.7.4-arch1-1 (x86_64), Desktop: KDE Plasma 5.27.10, Display Server: X Server 1.21.1.11, Display Driver: NVIDIA 550.40.07, OpenGL: 4.6.0, OpenCL: OpenCL 3.0 CUDA 12.4.74, Compiler: GCC 13.2.1 20230801 + CUDA 12.3, File-System: ext4, Screen Resolution: 1920x1080
Kernel Notes: Transparent Huge Pages: alwaysEnvironment Notes: NVCC_PREPEND_FLAGS="-ccbin /opt/cuda/bin"Compiler Notes: --disable-libssp --disable-libstdcxx-pch --disable-werror --enable-__cxa_atexit --enable-bootstrap --enable-cet=auto --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-default-ssp --enable-gnu-indirect-function --enable-gnu-unique-object --enable-languages=ada,c,c++,d,fortran,go,lto,m2,objc,obj-c++ --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-build-config=bootstrap-lto --with-linker-hash-style=gnuProcessor Notes: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x11dGraphics Notes: BAR1 / Visible vRAM Size: 256 MiB - vBIOS Version: 94.02.26.08.baPython Notes: Python 3.11.6Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
ProjectPhysX OpenCL-Benchmark ProjectPhysX OpenCL-Benchmark provides various OpenCL compute and memory bandwidth micro-benchmarks Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org TFLOPs/s, More Is Better ProjectPhysX OpenCL-Benchmark 1.2 Operation: FP64 Compute NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 3090 NVIDIA RTX 4070 TI 0.1485 0.297 0.4455 0.594 0.7425 SE +/- 0.001, N = 3 SE +/- 0.000, N = 3 SE +/- 0.001, N = 3 SE +/- 0.001, N = 3 0.510 0.621 0.637 0.660 1. (CXX) g++ options: -std=c++17 -pthread -lOpenCL
OpenBenchmarking.org TFLOPs/s, More Is Better ProjectPhysX OpenCL-Benchmark 1.2 Operation: FP32 Compute NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 3090 NVIDIA RTX 4070 TI 9 18 27 36 45 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.10, N = 3 SE +/- 0.00, N = 3 31.77 38.59 39.40 40.91 1. (CXX) g++ options: -std=c++17 -pthread -lOpenCL
OpenBenchmarking.org TIOPs/s, More Is Better ProjectPhysX OpenCL-Benchmark 1.2 Operation: INT64 Compute NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 0.9945 1.989 2.9835 3.978 4.9725 SE +/- 0.003, N = 3 SE +/- 0.004, N = 3 SE +/- 0.015, N = 3 SE +/- 0.016, N = 3 3.135 3.443 4.214 4.420 1. (CXX) g++ options: -std=c++17 -pthread -lOpenCL
OpenBenchmarking.org TIOPs/s, More Is Better ProjectPhysX OpenCL-Benchmark 1.2 Operation: INT32 Compute NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 3090 NVIDIA RTX 4070 TI 5 10 15 20 25 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.06, N = 3 SE +/- 0.04, N = 3 16.38 19.89 20.03 21.05 1. (CXX) g++ options: -std=c++17 -pthread -lOpenCL
OpenBenchmarking.org TIOPs/s, More Is Better ProjectPhysX OpenCL-Benchmark 1.2 Operation: INT16 Compute NVIDIA RTX 4070 NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 4 8 12 16 20 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 14.28 17.00 17.17 18.28 1. (CXX) g++ options: -std=c++17 -pthread -lOpenCL
OpenBenchmarking.org TIOPs/s, More Is Better ProjectPhysX OpenCL-Benchmark 1.2 Operation: INT8 Compute NVIDIA RTX 4070 NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 4 8 12 16 20 SE +/- 0.02, N = 3 SE +/- 0.07, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 12.12 13.73 14.31 15.73 1. (CXX) g++ options: -std=c++17 -pthread -lOpenCL
OpenBenchmarking.org GB/s, More Is Better ProjectPhysX OpenCL-Benchmark 1.2 Operation: Memory Bandwidth Coalesced Read NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI NVIDIA RTX 4070 NVIDIA RTX 3090 200 400 600 800 1000 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 464.86 465.07 465.18 864.11 1. (CXX) g++ options: -std=c++17 -pthread -lOpenCL
OpenBenchmarking.org GB/s, More Is Better ProjectPhysX OpenCL-Benchmark 1.2 Operation: Memory Bandwidth Coalesced Write NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI NVIDIA RTX 4070 NVIDIA RTX 3090 200 400 600 800 1000 SE +/- 0.14, N = 3 SE +/- 0.11, N = 3 SE +/- 0.16, N = 3 SE +/- 0.06, N = 3 455.01 457.17 459.43 887.31 1. (CXX) g++ options: -std=c++17 -pthread -lOpenCL
PyTorch This is a benchmark of PyTorch making use of pytorch-benchmark [https://github.com/LukasHedegaard/pytorch-benchmark]. Currently this test profile is catered to CPU-based testing. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-50 NVIDIA RTX 3090 NVIDIA RTX 4070 TI NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 120 240 360 480 600 SE +/- 11.16, N = 12 SE +/- 3.09, N = 3 525.12 535.39 546.76 557.73 MIN: 458.54 / MAX: 542.46 MIN: 428.43 / MAX: 572.99 MIN: 195.25 / MAX: 556.94 MIN: 513.63 / MAX: 563.37
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-152 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 TI NVIDIA RTX 4070 SUPER 40 80 120 160 200 SE +/- 0.09, N = 2 SE +/- 0.36, N = 3 SE +/- 0.73, N = 3 197.12 198.18 201.19 201.94 MIN: 137.37 / MAX: 198.9 MIN: 181.27 / MAX: 200.06 MIN: 180.79 / MAX: 203.92 MIN: 183.53 / MAX: 206.5
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: ResNet-50 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 TI NVIDIA RTX 4070 SUPER 110 220 330 440 550 SE +/- 0.89, N = 2 SE +/- 0.26, N = 3 SE +/- 2.23, N = 3 419.76 458.39 502.92 509.45 MIN: 376.2 / MAX: 422.17 MIN: 404.5 / MAX: 461.01 MIN: 415.65 / MAX: 520.39 MIN: 430.1 / MAX: 516.48
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: ResNet-50 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 110 220 330 440 550 SE +/- 0.13, N = 2 SE +/- 2.17, N = 2 SE +/- 1.69, N = 3 420.29 459.94 501.50 505.55 MIN: 376.81 / MAX: 421.58 MIN: 403.65 / MAX: 462.59 MIN: 415.94 / MAX: 510.69 MIN: 419.93 / MAX: 512.69
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: ResNet-50 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 TI NVIDIA RTX 4070 SUPER 110 220 330 440 550 SE +/- 0.24, N = 3 SE +/- 0.27, N = 3 SE +/- 1.92, N = 3 SE +/- 0.92, N = 3 419.03 458.36 505.62 507.45 MIN: 376 / MAX: 422 MIN: 404.89 / MAX: 461.01 MIN: 426.6 / MAX: 513.25 MIN: 423.41 / MAX: 512.88
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: ResNet-152 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 TI NVIDIA RTX 4070 SUPER 40 80 120 160 200 SE +/- 0.29, N = 3 164.14 187.26 194.29 195.40 MIN: 145.67 / MAX: 165.38 MIN: 179.81 / MAX: 188.21 MIN: 182.25 / MAX: 197.39 MIN: 186.09 / MAX: 197.7
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: ResNet-50 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 110 220 330 440 550 SE +/- 0.14, N = 3 SE +/- 0.34, N = 3 SE +/- 1.39, N = 3 416.89 459.93 504.67 MIN: 329.77 / MAX: 420.82 MIN: 403.65 / MAX: 462.74 MIN: 412.34 / MAX: 514.07 Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: ResNet-50
NVIDIA RTX 4070 TI: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: TypeError: 'NoneType' object is not callable
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: ResNet-152 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 40 80 120 160 200 SE +/- 0.29, N = 3 163.74 187.69 195.39 198.82 MIN: 144.93 / MAX: 165.03 MIN: 182.03 / MAX: 188.31 MIN: 183.94 / MAX: 198.7 MIN: 188.33 / MAX: 201.47
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-50 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 110 220 330 440 550 SE +/- 0.40, N = 3 SE +/- 0.43, N = 2 SE +/- 4.43, N = 2 SE +/- 0.83, N = 2 416.20 459.27 504.27 504.66 MIN: 355.45 / MAX: 419.05 MIN: 405.48 / MAX: 461.88 MIN: 418.22 / MAX: 512.44 MIN: 424.27 / MAX: 509.08
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: ResNet-152 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 40 80 120 160 200 SE +/- 0.34, N = 3 SE +/- 0.51, N = 3 SE +/- 0.78, N = 2 164.14 186.63 196.07 197.02 MIN: 149 / MAX: 165 MIN: 180.51 / MAX: 187.79 MIN: 171.95 / MAX: 199.96 MIN: 183.92 / MAX: 200.54
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: ResNet-152 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 40 80 120 160 200 SE +/- 0.17, N = 3 SE +/- 1.14, N = 2 SE +/- 0.19, N = 2 161.01 187.27 194.58 195.86 MIN: 138.12 / MAX: 165.16 MIN: 179.9 / MAX: 188.08 MIN: 183.74 / MAX: 198.52 MIN: 181.64 / MAX: 199.2
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-152 NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 TI NVIDIA RTX 4070 SUPER 40 80 120 160 200 SE +/- 0.33, N = 2 SE +/- 0.05, N = 3 SE +/- 1.38, N = 2 164.35 187.51 194.87 195.30 MIN: 149.91 / MAX: 166.09 MIN: 181.57 / MAX: 188.05 MIN: 180.8 / MAX: 198 MIN: 182 / MAX: 199.43
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: Efficientnet_v2_l NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 NVIDIA RTX 4070 TI 20 40 60 80 100 SE +/- 0.33, N = 3 SE +/- 0.55, N = 3 105.55 106.37 107.59 108.59 MIN: 91.76 / MAX: 107.42 MIN: 97.91 / MAX: 108.16 MIN: 98.77 / MAX: 109.43 MIN: 99.04 / MAX: 110.68
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: Efficientnet_v2_l NVIDIA RTX 3090 NVIDIA RTX 4070 TI NVIDIA RTX 4070 20 40 60 80 100 SE +/- 0.53, N = 2 SE +/- 0.52, N = 2 98.11 103.45 103.68 MIN: 89.88 / MAX: 100.25 MIN: 95.22 / MAX: 105.88 MIN: 96.86 / MAX: 105.56 Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: Efficientnet_v2_l
NVIDIA RTX 4070 SUPER: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: AttributeError: 'tuple' object has no attribute '_compiled_call_impl'
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: Efficientnet_v2_l NVIDIA RTX 4070 TI NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 20 40 60 80 100 SE +/- 6.65, N = 5 SE +/- 0.13, N = 3 96.50 99.05 102.60 102.90 MIN: 64.35 / MAX: 104.79 MIN: 91.8 / MAX: 100.69 MIN: 94.84 / MAX: 104.25 MIN: 95.98 / MAX: 104.54
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: Efficientnet_v2_l NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 20 40 60 80 100 SE +/- 0.14, N = 3 SE +/- 0.45, N = 3 SE +/- 1.49, N = 2 SE +/- 0.39, N = 2 99.84 101.55 102.60 103.20 MIN: 92.73 / MAX: 101.46 MIN: 93.44 / MAX: 103.08 MIN: 79.69 / MAX: 105.28 MIN: 95.31 / MAX: 105.27
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: Efficientnet_v2_l NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 20 40 60 80 100 SE +/- 0.57, N = 3 SE +/- 0.05, N = 2 99.43 101.24 103.17 103.24 MIN: 90.49 / MAX: 101.97 MIN: 93.33 / MAX: 102.92 MIN: 95.79 / MAX: 105.15 MIN: 95.41 / MAX: 104.9
OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.1 Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: Efficientnet_v2_l NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 TI NVIDIA RTX 4070 SUPER 20 40 60 80 100 SE +/- 0.19, N = 3 SE +/- 0.39, N = 3 SE +/- 0.36, N = 2 99.25 101.43 103.50 103.57 MIN: 91.16 / MAX: 101.18 MIN: 93.27 / MAX: 103.58 MIN: 94.95 / MAX: 105.61 MIN: 95.95 / MAX: 105.54
GpuOwl GpuOwl is a Mersenne primality tester leveraging OpenCL for cross-vendor GPU acceleration. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Iterations / Second, More Is Better GpuOwl 7.2.1 Exponent: 57885161 NVIDIA RTX 4070 NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 200 400 600 800 1000 SE +/- 0.00, N = 3 SE +/- 2.01, N = 3 SE +/- 1.26, N = 3 SE +/- 2.53, N = 3 714.80 866.31 869.07 919.13
OpenBenchmarking.org Iterations / Second, More Is Better GpuOwl 7.2.1 Exponent: 77936867 NVIDIA RTX 4070 NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 150 300 450 600 750 SE +/- 0.09, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 530.32 645.99 646.41 676.59
OpenBenchmarking.org Iterations / Second, More Is Better GpuOwl 7.2.1 Exponent: 332220523 NVIDIA RTX 4070 NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 30 60 90 120 150 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 112.61 137.32 137.44 145.84
vkpeak Vkpeak is a Vulkan compute benchmark inspired by OpenCL's clpeak. Vkpeak provides Vulkan compute performance measurements for FP16 / FP32 / FP64 / INT16 / INT32 scalar and vec4 performance. Learn more via the OpenBenchmarking.org test page.
NVIDIA RTX 4070 SUPER: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status.
NVIDIA RTX 4070: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status.
NVIDIA RTX 4070 TI: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status.
RealSR-NCNN RealSR-NCNN is an NCNN neural network implementation of the RealSR project and accelerated using the Vulkan API. RealSR is the Real-World Super Resolution via Kernel Estimation and Noise Injection. NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. This test profile times how long it takes to increase the resolution of a sample image by a scale of 4x with Vulkan. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better RealSR-NCNN 20200818 Scale: 4x - TAA: No NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI NVIDIA RTX 3090 2 4 6 8 10 SE +/- 0.006, N = 3 SE +/- 0.150, N = 15 SE +/- 0.039, N = 3 SE +/- 0.016, N = 3 7.092 6.323 5.962 5.556
OpenBenchmarking.org Seconds, Fewer Is Better RealSR-NCNN 20200818 Scale: 4x - TAA: Yes NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI NVIDIA RTX 3090 10 20 30 40 50 SE +/- 0.23, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 42.85 34.89 33.63 30.31
Waifu2x-NCNN Vulkan Waifu2x-NCNN is an NCNN neural network implementation of the Waifu2x converter project and accelerated using the Vulkan API. NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. This test profile times how long it takes to increase the resolution of a sample image with Vulkan. Learn more via the OpenBenchmarking.org test page.
Scale: 2x - Denoise: 3 - TAA: No
NVIDIA RTX 4070 SUPER: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
NVIDIA RTX 4070: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
NVIDIA RTX 4070 TI: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
NVIDIA RTX 3090: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
OpenBenchmarking.org Seconds, Fewer Is Better Waifu2x-NCNN Vulkan 20200818 Scale: 2x - Denoise: 3 - TAA: Yes NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 0.7205 1.441 2.1615 2.882 3.6025 SE +/- 0.011, N = 3 SE +/- 0.028, N = 3 SE +/- 0.014, N = 3 SE +/- 0.009, N = 3 3.202 3.168 2.855 2.854
VkFFT OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT R2C / C2R NVIDIA RTX 4070 NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 12K 24K 36K 48K 60K SE +/- 745.02, N = 13 SE +/- 320.62, N = 3 SE +/- 702.53, N = 15 SE +/- 520.37, N = 3 47097 48418 54794 55446 1. (CXX) g++ options: -O3 -lrt
OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C 1D batched in half precision NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI NVIDIA RTX 4070 NVIDIA RTX 3090 60K 120K 180K 240K 300K SE +/- 159.17, N = 3 SE +/- 1708.38, N = 3 SE +/- 1301.92, N = 3 SE +/- 160.60, N = 3 131705 136210 137762 273221 1. (CXX) g++ options: -O3 -lrt
OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C Bluestein in single precision NVIDIA RTX 4070 NVIDIA RTX 3090 NVIDIA RTX 4070 TI NVIDIA RTX 4070 SUPER 3K 6K 9K 12K 15K SE +/- 52.09, N = 3 SE +/- 115.62, N = 3 SE +/- 118.41, N = 3 SE +/- 102.52, N = 3 13714 14205 15125 15166 1. (CXX) g++ options: -O3 -lrt
OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C 1D batched in double precision NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI NVIDIA RTX 3090 7K 14K 21K 28K 35K SE +/- 125.94, N = 3 SE +/- 146.69, N = 3 SE +/- 302.46, N = 3 SE +/- 50.66, N = 3 22390 24317 25431 30912 1. (CXX) g++ options: -O3 -lrt
OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C 1D batched in single precision NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI NVIDIA RTX 4070 NVIDIA RTX 3090 30K 60K 90K 120K 150K SE +/- 7.94, N = 3 SE +/- 0.88, N = 3 SE +/- 13.72, N = 3 SE +/- 9.64, N = 3 73929 73942 77774 141876 1. (CXX) g++ options: -O3 -lrt
OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C multidimensional in single precision NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 3090 NVIDIA RTX 4070 TI 11K 22K 33K 44K 55K SE +/- 476.57, N = 5 SE +/- 407.19, N = 15 SE +/- 407.28, N = 15 SE +/- 417.77, N = 15 47212 50299 50856 51528 1. (CXX) g++ options: -O3 -lrt
OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C Bluestein benchmark in double precision NVIDIA RTX 4070 NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 1000 2000 3000 4000 5000 SE +/- 4.51, N = 3 SE +/- 9.84, N = 3 SE +/- 12.55, N = 3 SE +/- 11.35, N = 3 3886 4195 4451 4647 1. (CXX) g++ options: -O3 -lrt
OpenBenchmarking.org Benchmark Score, More Is Better VkFFT 1.2.31 Test: FFT + iFFT C2C 1D batched in single precision, no reshuffling NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI NVIDIA RTX 4070 NVIDIA RTX 3090 30K 60K 90K 120K 150K SE +/- 37.77, N = 3 SE +/- 28.54, N = 3 SE +/- 5.84, N = 3 SE +/- 37.44, N = 3 75078 75141 79057 144311 1. (CXX) g++ options: -O3 -lrt
Hashcat Hashcat is an open-source, advanced password recovery tool supporting GPU acceleration with OpenCL, NVIDIA CUDA, and Radeon ROCm. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: MD5 NVIDIA RTX 4070 NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 16000M 32000M 48000M 64000M 80000M SE +/- 33772046.30, N = 3 SE +/- 53667246.37, N = 3 SE +/- 22430807.19, N = 3 SE +/- 11283665.68, N = 3 56147866667 67177300000 67583033333 73312233333
OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: SHA1 NVIDIA RTX 4070 NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 5000M 10000M 15000M 20000M 25000M SE +/- 6318315.53, N = 3 SE +/- 26244639.66, N = 3 SE +/- 5140363.15, N = 3 SE +/- 15926811.78, N = 3 18202466667 21323733333 22132600000 23532400000
OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: 7-Zip NVIDIA RTX 4070 NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 300K 600K 900K 1200K 1500K SE +/- 2062.63, N = 3 SE +/- 1587.45, N = 3 SE +/- 1991.93, N = 3 SE +/- 2339.04, N = 3 976967 1056000 1176467 1262633
OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: SHA-512 NVIDIA RTX 4070 NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 700M 1400M 2100M 2800M 3500M SE +/- 1059874.21, N = 3 SE +/- 3288532.26, N = 3 SE +/- 1530068.99, N = 3 SE +/- 721110.26, N = 3 2673300000 3081866667 3232733333 3462500000
OpenBenchmarking.org H/s, More Is Better Hashcat 6.2.4 Benchmark: TrueCrypt RIPEMD160 + XTS NVIDIA RTX 4070 NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 200K 400K 600K 800K 1000K SE +/- 176.38, N = 3 SE +/- 1757.21, N = 3 SE +/- 633.33, N = 3 SE +/- 888.82, N = 3 660967 797833 802967 858600
Libplacebo Libplacebo is a multimedia rendering library based on the core rendering code of the MPV player. The libplacebo benchmark relies on the Vulkan API and tests various primitives. Learn more via the OpenBenchmarking.org test page.
NVIDIA RTX 4070 SUPER: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: libplacebo: line 3: ./src/bench: No such file or directory
OpenBenchmarking.org GB/s, More Is Better cl-mem 2017-01-13 Benchmark: Read NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 NVIDIA RTX 4070 TI NVIDIA RTX 3090 200 400 600 800 1000 SE +/- 0.12, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.32, N = 3 446.2 446.3 446.3 825.8 1. (CC) gcc options: -O2 -flto -lOpenCL
OpenBenchmarking.org GB/s, More Is Better cl-mem 2017-01-13 Benchmark: Write NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI NVIDIA RTX 3090 160 320 480 640 800 SE +/- 0.55, N = 3 SE +/- 1.11, N = 3 SE +/- 0.12, N = 3 SE +/- 0.83, N = 3 406.7 407.5 412.2 753.8 1. (CC) gcc options: -O2 -flto -lOpenCL
NAMD CUDA NAMD is a parallel molecular dynamics code designed for high-performance simulation of large biomolecular systems. NAMD was developed by the Theoretical and Computational Biophysics Group in the Beckman Institute for Advanced Science and Technology at the University of Illinois at Urbana-Champaign. This version of the NAMD test profile uses CUDA GPU acceleration. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org days/ns, Fewer Is Better NAMD CUDA 2.14 ATPase Simulation - 327,506 Atoms NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 0.0243 0.0486 0.0729 0.0972 0.1215 SE +/- 0.00042, N = 3 SE +/- 0.00021, N = 3 SE +/- 0.00031, N = 3 SE +/- 0.00061, N = 3 0.10822 0.07498 0.06791 0.06788
VkResample VkResample is a Vulkan-based image upscaling library based on VkFFT. The sample input file is upscaling a 4K image to 8K using Vulkan-based GPU acceleration. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org ms, Fewer Is Better VkResample 1.0 Upscale: 2x - Precision: Double NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 3090 NVIDIA RTX 4070 TI 90 180 270 360 450 SE +/- 0.77, N = 3 SE +/- 0.30, N = 3 SE +/- 0.30, N = 3 SE +/- 0.35, N = 3 415.16 339.59 333.64 322.06 1. (CXX) g++ options: -O3
OpenBenchmarking.org ms, Fewer Is Better VkResample 1.0 Upscale: 2x - Precision: Single NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI NVIDIA RTX 4070 NVIDIA RTX 3090 5 10 15 20 25 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 18.49 18.46 18.02 10.32 1. (CXX) g++ options: -O3
clpeak Clpeak is designed to test the peak capabilities of OpenCL devices. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org GIOPS, More Is Better clpeak 1.1.2 OpenCL Test: Integer Compute INT NVIDIA RTX 4070 NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 4K 8K 12K 16K 20K SE +/- 15.26, N = 3 SE +/- 16.49, N = 3 SE +/- 3.14, N = 3 SE +/- 2.50, N = 3 14555.19 17923.33 18170.54 19821.10 1. (CXX) g++ options: -O3
OpenBenchmarking.org GFLOPS, More Is Better clpeak 1.1.2 OpenCL Test: Single-Precision Float NVIDIA RTX 4070 NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 8K 16K 24K 32K 40K SE +/- 5.46, N = 3 SE +/- 113.39, N = 3 SE +/- 0.99, N = 3 SE +/- 11.67, N = 3 28479.39 34906.79 35492.69 38691.73 1. (CXX) g++ options: -O3
OpenBenchmarking.org GFLOPS, More Is Better clpeak 1.1.2 OpenCL Test: Double-Precision Double NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 3090 NVIDIA RTX 4070 TI 140 280 420 560 700 SE +/- 0.21, N = 3 SE +/- 0.98, N = 3 SE +/- 1.63, N = 3 SE +/- 1.33, N = 3 515.17 630.11 642.23 667.05 1. (CXX) g++ options: -O3
OpenBenchmarking.org GBPS, More Is Better clpeak 1.1.2 OpenCL Test: Global Memory Bandwidth NVIDIA RTX 4070 NVIDIA RTX 4070 TI NVIDIA RTX 4070 SUPER NVIDIA RTX 3090 200 400 600 800 1000 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 437.21 437.63 437.65 816.55 1. (CXX) g++ options: -O3
LeelaChessZero LeelaChessZero (lc0 / lczero) is a chess engine automated vian neural networks. This test profile can be used for OpenCL, CUDA + cuDNN, and BLAS (CPU-based) benchmarking. Learn more via the OpenBenchmarking.org test page.
Backend: OpenCL
NVIDIA RTX 4070 SUPER: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
NVIDIA RTX 4070: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
NVIDIA RTX 4070 TI: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
NVIDIA RTX 3090: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
Rodinia Rodinia is a suite focused upon accelerating compute-intensive applications with accelerators. CUDA, OpenMP, and OpenCL parallel models are supported by the included applications. This profile utilizes select OpenCL, NVIDIA CUDA and OpenMP test binaries at the moment. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better Rodinia 3.1 Test: OpenCL Particle Filter NVIDIA RTX 4070 NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 0.9221 1.8442 2.7663 3.6884 4.6105 SE +/- 0.008, N = 3 SE +/- 0.030, N = 15 SE +/- 0.039, N = 4 SE +/- 0.002, N = 3 4.098 3.844 3.480 3.291 1. (CXX) g++ options: -O2 -lOpenCL
LuxCoreRender LuxCoreRender is an open-source 3D physically based renderer formerly known as LuxRender. LuxCoreRender supports CPU-based rendering as well as GPU acceleration via OpenCL, NVIDIA CUDA, and NVIDIA OptiX interfaces. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: DLSC - Acceleration: GPU NVIDIA RTX 4070 NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 4 8 12 16 20 SE +/- 0.01, N = 3 SE +/- 1.13, N = 12 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 11.74 12.99 13.59 13.95 MIN: 11.35 / MAX: 11.83 MIN: 0.52 / MAX: 14.69 MIN: 12.52 / MAX: 13.84 MIN: 13.67 / MAX: 14.14
OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Danish Mood - Acceleration: GPU NVIDIA RTX 4070 NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 3 6 9 12 15 SE +/- 0.06, N = 3 SE +/- 0.04, N = 3 SE +/- 0.08, N = 3 SE +/- 0.11, N = 3 8.89 10.20 10.56 10.99 MIN: 3.32 / MAX: 10.26 MIN: 4.07 / MAX: 11.93 MIN: 3.7 / MAX: 12.17 MIN: 4.17 / MAX: 12.71
OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Orange Juice - Acceleration: GPU NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI NVIDIA RTX 3090 3 6 9 12 15 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 10.40 11.72 11.89 12.14 MIN: 8.31 / MAX: 13.9 MIN: 9.6 / MAX: 15.44 MIN: 9.85 / MAX: 15.88 MIN: 10.24 / MAX: 16.71
OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: LuxCore Benchmark - Acceleration: GPU NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 3090 NVIDIA RTX 4070 TI 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 2 SE +/- 0.01, N = 3 10.92 12.82 13.12 13.23 MIN: 4.45 / MAX: 12.42 MIN: 4.84 / MAX: 14.62 MIN: 4.85 / MAX: 15.21 MIN: 5.41 / MAX: 15.13
OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Rainbow Colors and Prism - Acceleration: GPU NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI NVIDIA RTX 3090 8 16 24 32 40 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.36, N = 5 23.26 27.67 27.71 33.29 MIN: 20.92 / MAX: 24.3 MIN: 24.87 / MAX: 29.03 MIN: 25.01 / MAX: 29.15 MIN: 30.4 / MAX: 36.21
ArrayFire ArrayFire is an GPU and CPU numeric processing library, this test uses the built-in CPU and OpenCL ArrayFire benchmarks. Learn more via the OpenBenchmarking.org test page.
Test: Conjugate Gradient OpenCL
NVIDIA RTX 4070 SUPER: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result. E: arrayfire: line 3: ./cg_opencl: No such file or directory
NVIDIA RTX 4070: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result. E: arrayfire: line 3: ./cg_opencl: No such file or directory
NVIDIA RTX 4070 TI: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result. E: arrayfire: line 3: ./cg_opencl: No such file or directory
NVIDIA RTX 3090: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result. E: arrayfire: line 3: ./cg_opencl: No such file or directory
FinanceBench FinanceBench is a collection of financial program benchmarks with support for benchmarking on the GPU via OpenCL and CPU benchmarking with OpenMP. The FinanceBench test cases are focused on Black-Sholes-Merton Process with Analytic European Option engine, QMC (Sobol) Monte-Carlo method (Equity Option Example), Bonds Fixed-rate bond with flat forward curve, and Repo Securities repurchase agreement. FinanceBench was originally written by the Cavazos Lab at University of Delaware. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org ms, Fewer Is Better FinanceBench 2016-07-25 Benchmark: Black-Scholes OpenCL NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 3090 NVIDIA RTX 4070 TI 2 4 6 8 10 SE +/- 0.003, N = 3 SE +/- 0.114, N = 15 SE +/- 0.006, N = 3 SE +/- 0.003, N = 3 6.906 5.912 5.741 5.226 1. (CXX) g++ options: -O3 -march=native -fopenmp
ViennaCL ViennaCL is an open-source linear algebra library written in C++ and with support for OpenCL and OpenMP. This test profile makes use of ViennaCL's built-in benchmarks. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - sCOPY NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI NVIDIA RTX 3090 30 60 90 120 150 SE +/- 1.20, N = 3 SE +/- 1.20, N = 3 SE +/- 0.88, N = 3 SE +/- 1.20, N = 3 131 132 132 132 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - sAXPY NVIDIA RTX 4070 NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 30 60 90 120 150 SE +/- 4.81, N = 3 SE +/- 0.33, N = 3 SE +/- 2.19, N = 3 SE +/- 2.00, N = 3 153 154 156 156 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - sDOT NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 NVIDIA RTX 4070 TI 40 80 120 160 200 SE +/- 35.40, N = 3 SE +/- 2.73, N = 3 SE +/- 3.76, N = 3 SE +/- 2.40, N = 3 132.1 165.0 166.0 168.0 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dCOPY NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 NVIDIA RTX 4070 TI 16 32 48 64 80 SE +/- 0.72, N = 3 SE +/- 0.32, N = 3 SE +/- 0.25, N = 3 SE +/- 0.74, N = 3 70.2 70.8 71.0 71.3 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dAXPY NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 20 40 60 80 100 SE +/- 0.94, N = 3 SE +/- 0.44, N = 3 SE +/- 0.12, N = 3 SE +/- 0.57, N = 3 86.2 86.8 87.2 87.3 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dDOT NVIDIA RTX 3090 NVIDIA RTX 4070 TI NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER 20 40 60 80 100 SE +/- 0.84, N = 3 SE +/- 0.58, N = 3 SE +/- 0.22, N = 3 SE +/- 0.09, N = 3 95.2 96.4 96.7 96.8 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMV-N NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 NVIDIA RTX 4070 TI NVIDIA RTX 3090 20 40 60 80 100 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.88, N = 3 102 103 103 103 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMV-T NVIDIA RTX 4070 TI NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 NVIDIA RTX 3090 20 40 60 80 100 SE +/- 6.30, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 102.7 109.0 109.0 110.0 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-NN NVIDIA RTX 3090 NVIDIA RTX 4070 TI NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 30 60 90 120 150 SE +/- 1.86, N = 3 SE +/- 1.15, N = 3 SE +/- 4.04, N = 3 SE +/- 1.86, N = 3 113 117 119 122 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-NT NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI NVIDIA RTX 3090 NVIDIA RTX 4070 30 60 90 120 150 SE +/- 2.08, N = 3 SE +/- 1.20, N = 3 SE +/- 3.28, N = 3 SE +/- 1.76, N = 3 117 118 119 122 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-TN NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 NVIDIA RTX 3090 NVIDIA RTX 4070 TI 30 60 90 120 150 SE +/- 1.00, N = 2 SE +/- 2.31, N = 3 SE +/- 2.08, N = 3 SE +/- 2.08, N = 3 115 121 121 125 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: CPU BLAS - dGEMM-TT NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 30 60 90 120 150 SE +/- 0.88, N = 3 SE +/- 1.20, N = 3 SE +/- 2.08, N = 3 SE +/- 2.08, N = 3 113 118 122 124 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - sCOPY NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI NVIDIA RTX 3090 80 160 240 320 400 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 SE +/- 1.00, N = 3 330 334 336 363 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - sAXPY NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI NVIDIA RTX 3090 110 220 330 440 550 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.58, N = 3 389 392 393 498 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - sDOT NVIDIA RTX 4070 NVIDIA RTX 4070 TI NVIDIA RTX 4070 SUPER NVIDIA RTX 3090 80 160 240 320 400 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.58, N = 3 362 365 370 376 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dCOPY NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 NVIDIA RTX 4070 TI NVIDIA RTX 3090 130 260 390 520 650 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.58, N = 3 423 423 424 605 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dAXPY NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI NVIDIA RTX 4070 NVIDIA RTX 3090 160 320 480 640 800 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 SE +/- 0.58, N = 3 437 437 455 724 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dDOT NVIDIA RTX 4070 NVIDIA RTX 4070 TI NVIDIA RTX 4070 SUPER NVIDIA RTX 3090 140 280 420 560 700 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.88, N = 3 456 457 458 659 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMV-N NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 50 100 150 200 250 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 187 209 210 211 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GB/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMV-T NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 80 160 240 320 400 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 374 387 389 391 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-NN NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 3090 NVIDIA RTX 4070 TI 130 260 390 520 650 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 SE +/- 2.31, N = 3 SE +/- 0.33, N = 3 473 577 592 604 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-NT NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 3090 NVIDIA RTX 4070 TI 130 260 390 520 650 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 SE +/- 2.33, N = 3 SE +/- 0.33, N = 3 477 584 595 612 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-TN NVIDIA RTX 4070 NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 140 280 420 560 700 SE +/- 0.33, N = 3 SE +/- 2.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.67, N = 3 494 594 599 634 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
OpenBenchmarking.org GFLOPs/s, More Is Better ViennaCL 1.7.1 Test: OpenCL BLAS - dGEMM-TT NVIDIA RTX 4070 NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 140 280 420 560 700 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 502 593 613 648 1. (CXX) g++ options: -fopenmp -O3 -rdynamic -lOpenCL
Caffe This is a benchmark of the Caffe deep learning framework and currently supports the AlexNet and Googlenet model and execution on both CPUs and NVIDIA GPUs. Learn more via the OpenBenchmarking.org test page.
Model: AlexNet - Acceleration: NVIDIA CUDA - Iterations: 100
NVIDIA RTX 4070 SUPER: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x7dd7c6de3450 google::LogMessageFatal::~LogMessageFatal()
NVIDIA RTX 4070: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x7b80311e3450 google::LogMessageFatal::~LogMessageFatal()
NVIDIA RTX 4070 TI: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x736df4b59450 google::LogMessageFatal::~LogMessageFatal()
NVIDIA RTX 3090: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x77ed97de3450 google::LogMessageFatal::~LogMessageFatal()
Model: AlexNet - Acceleration: NVIDIA CUDA - Iterations: 200
NVIDIA RTX 4070 SUPER: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x7b5ea59be450 google::LogMessageFatal::~LogMessageFatal()
NVIDIA RTX 4070: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x7c31ed79d450 google::LogMessageFatal::~LogMessageFatal()
NVIDIA RTX 4070 TI: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x7ba579075450 google::LogMessageFatal::~LogMessageFatal()
NVIDIA RTX 3090: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x7ace5f7b4450 google::LogMessageFatal::~LogMessageFatal()
Model: AlexNet - Acceleration: NVIDIA CUDA - Iterations: 1000
NVIDIA RTX 4070 SUPER: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x7670bcda4450 google::LogMessageFatal::~LogMessageFatal()
NVIDIA RTX 4070: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x7bb89c5be450 google::LogMessageFatal::~LogMessageFatal()
NVIDIA RTX 4070 TI: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x72248ee5c450 google::LogMessageFatal::~LogMessageFatal()
NVIDIA RTX 3090: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x7d66735f5450 google::LogMessageFatal::~LogMessageFatal()
Model: GoogleNet - Acceleration: NVIDIA CUDA - Iterations: 100
NVIDIA RTX 4070 SUPER: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x73552c3e3450 google::LogMessageFatal::~LogMessageFatal()
NVIDIA RTX 4070: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x71f0ea05a450 google::LogMessageFatal::~LogMessageFatal()
NVIDIA RTX 4070 TI: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x7898abd73450 google::LogMessageFatal::~LogMessageFatal()
NVIDIA RTX 3090: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x7522f0d76450 google::LogMessageFatal::~LogMessageFatal()
Model: GoogleNet - Acceleration: NVIDIA CUDA - Iterations: 200
NVIDIA RTX 4070 SUPER: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x7d7151816450 google::LogMessageFatal::~LogMessageFatal()
NVIDIA RTX 4070: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x7e64df79d450 google::LogMessageFatal::~LogMessageFatal()
NVIDIA RTX 4070 TI: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x761e63d48450 google::LogMessageFatal::~LogMessageFatal()
NVIDIA RTX 3090: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x7bfcc77e3450 google::LogMessageFatal::~LogMessageFatal()
Model: GoogleNet - Acceleration: NVIDIA CUDA - Iterations: 1000
NVIDIA RTX 4070 SUPER: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x74746a490450 google::LogMessageFatal::~LogMessageFatal()
NVIDIA RTX 4070: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x7493bdbbc450 google::LogMessageFatal::~LogMessageFatal()
NVIDIA RTX 4070 TI: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x7338f7773450 google::LogMessageFatal::~LogMessageFatal()
NVIDIA RTX 3090: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: @ 0x7792f141e450 google::LogMessageFatal::~LogMessageFatal()
NCNN NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.
Target: Vulkan GPU
NVIDIA RTX 4070 SUPER: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: ncnn: line 3: ./benchncnn: No such file or directory
PlaidML This test profile uses PlaidML deep learning framework developed by Intel for offering up various benchmarks. Learn more via the OpenBenchmarking.org test page.
FP16: No - Mode: Training - Network: Mobilenet - Device: OpenCL
NVIDIA RTX 4070 SUPER: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
NVIDIA RTX 4070: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test run did not produce a result.
NVIDIA RTX 4070 TI: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
NVIDIA RTX 3090: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
FP16: No - Mode: Inference - Network: IMDB LSTM - Device: OpenCL
NVIDIA RTX 4070 SUPER: The test run did not produce a result. The test run did not produce a result. The test quit with a non-zero exit status.
NVIDIA RTX 4070: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
NVIDIA RTX 4070 TI: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
NVIDIA RTX 3090: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
FP16: No - Mode: Inference - Network: Mobilenet - Device: OpenCL
NVIDIA RTX 4070 SUPER: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
NVIDIA RTX 4070: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
NVIDIA RTX 4070 TI: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
NVIDIA RTX 3090: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
FP16: Yes - Mode: Inference - Network: Mobilenet - Device: OpenCL
NVIDIA RTX 4070 SUPER: The test run did not produce a result. The test run did not produce a result. The test quit with a non-zero exit status. E: AttributeError: 'method_descriptor' object has no attribute 'default'
NVIDIA RTX 4070: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
NVIDIA RTX 4070 TI: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
NVIDIA RTX 3090: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
FP16: No - Mode: Inference - Network: DenseNet 201 - Device: OpenCL
NVIDIA RTX 4070 SUPER: The test run did not produce a result. The test quit with a non-zero exit status. The test run did not produce a result.
NVIDIA RTX 4070: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
NVIDIA RTX 4070 TI: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
NVIDIA RTX 3090: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.
Blender Blender is an open-source 3D creation and modeling software project. This test is of Blender's Cycles performance with various sample files. GPU computing via NVIDIA OptiX and NVIDIA CUDA is currently supported as well as HIP for AMD Radeon GPUs and Intel oneAPI for Intel Graphics. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.0 Blend File: BMW27 - Compute: NVIDIA OptiX NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 2 4 6 8 10 SE +/- 0.06, N = 14 SE +/- 0.01, N = 3 SE +/- 0.06, N = 13 SE +/- 0.02, N = 3 6.31 6.21 5.57 5.43
OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.0 Blend File: Classroom - Compute: NVIDIA OptiX NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 4 8 12 16 20 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 15.26 14.86 12.60 12.30
OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.0 Blend File: Fishy Cat - Compute: NVIDIA OptiX NVIDIA RTX 4070 NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 3 6 9 12 15 SE +/- 0.03, N = 3 SE +/- 0.08, N = 9 SE +/- 0.06, N = 13 SE +/- 0.01, N = 3 11.03 10.64 9.45 9.02
OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.0 Blend File: Barbershop - Compute: NVIDIA OptiX NVIDIA RTX 4070 NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 13 26 39 52 65 SE +/- 0.04, N = 3 SE +/- 0.02, N = 2 SE +/- 0.10, N = 3 SE +/- 0.05, N = 3 58.44 54.30 51.30 50.73
OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.0 Blend File: Pabellon Barcelona - Compute: NVIDIA OptiX NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 4 8 12 16 20 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 17.30 16.55 14.29 13.97
OpenBenchmarking.org M samples/s, More Is Better IndigoBench 4.4 Acceleration: OpenCL GPU - Scene: Supercar NVIDIA RTX 4070 NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 12 24 36 48 60 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 48.52 52.01 52.81 53.59
MandelGPU MandelGPU is an OpenCL benchmark and this test runs with the OpenCL rendering float4 kernel with a maximum of 4096 iterations. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Samples/sec, More Is Better MandelGPU 1.3pts1 OpenCL Device: GPU NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 130M 260M 390M 520M 650M SE +/- 794770.01, N = 3 SE +/- 1783157.89, N = 3 SE +/- 467034.80, N = 3 SE +/- 1202791.77, N = 3 484098913.8 516770131.2 587219538.2 619106132.5 1. (CC) gcc options: -O3 -lm -ftree-vectorize -funroll-loops -lglut -lOpenCL -lGL
NeatBench NeatBench is a benchmark of the cross-platform Neat Video software on the CPU and optional GPU (OpenCL / CUDA) support. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org FPS, More Is Better NeatBench 5 Acceleration: GPU NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 NVIDIA RTX 4070 TI 900 1800 2700 3600 4500 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 3090 4070 4070 4070
TensorFlow This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 1 - Model: VGG-16 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 NVIDIA RTX 4070 TI NVIDIA RTX 3090 0.3105 0.621 0.9315 1.242 1.5525 SE +/- 0.01, N = 2 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 1.35 1.36 1.38 1.38
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 1 - Model: AlexNet NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 NVIDIA RTX 3090 NVIDIA RTX 4070 TI 4 8 12 16 20 SE +/- 0.22, N = 2 SE +/- 0.16, N = 3 SE +/- 0.20, N = 15 SE +/- 0.06, N = 2 13.92 14.04 14.45 14.79
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 16 - Model: VGG-16 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI NVIDIA RTX 3090 NVIDIA RTX 4070 0.3375 0.675 1.0125 1.35 1.6875 SE +/- 0.00, N = 2 SE +/- 0.00, N = 3 SE +/- 0.01, N = 2 1.48 1.49 1.49 1.50
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 32 - Model: VGG-16 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 NVIDIA RTX 4070 TI NVIDIA RTX 3090 0.3375 0.675 1.0125 1.35 1.6875 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 2 SE +/- 0.00, N = 3 1.50 1.50 1.50 1.50
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 64 - Model: VGG-16 NVIDIA RTX 4070 NVIDIA RTX 4070 TI NVIDIA RTX 3090 0.3398 0.6796 1.0194 1.3592 1.699 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 1.50 1.50 1.51 Device: GPU - Batch Size: 64 - Model: VGG-16
NVIDIA RTX 4070 SUPER: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: UnboundLocalError: cannot access local variable 'decorators' where it is not associated with a value
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 16 - Model: AlexNet NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI NVIDIA RTX 3090 7 14 21 28 35 SE +/- 0.17, N = 3 SE +/- 0.08, N = 3 SE +/- 0.07, N = 3 31.45 31.59 31.70 31.98
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 256 - Model: VGG-16 NVIDIA RTX 4070 TI NVIDIA RTX 3090 0.3398 0.6796 1.0194 1.3592 1.699 SE +/- 0.00, N = 3 1.50 1.51 Device: GPU - Batch Size: 256 - Model: VGG-16
NVIDIA RTX 4070 SUPER: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status.
NVIDIA RTX 4070: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: AttributeError: 'collections.OrderedDict' object has no attribute 'empty'
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 32 - Model: AlexNet NVIDIA RTX 4070 TI NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 3090 8 16 24 32 40 SE +/- 0.04, N = 3 SE +/- 0.18, N = 3 SE +/- 0.15, N = 2 SE +/- 0.05, N = 3 33.29 33.32 33.40 33.53
Device: GPU - Batch Size: 512 - Model: VGG-16
NVIDIA RTX 4070 SUPER: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: Fatal Python error: Segmentation fault
NVIDIA RTX 4070: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: AttributeError: 'function' object has no attribute 'empty'
NVIDIA RTX 4070 TI: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: Fatal Python error: Segmentation fault
NVIDIA RTX 3090: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: Fatal Python error: Segmentation fault
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 64 - Model: AlexNet NVIDIA RTX 4070 NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 8 16 24 32 40 SE +/- 0.14, N = 3 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 33.93 33.93 33.97 34.06
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 1 - Model: GoogLeNet NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 NVIDIA RTX 4070 TI NVIDIA RTX 3090 3 6 9 12 15 SE +/- 0.17, N = 2 SE +/- 0.10, N = 3 SE +/- 0.30, N = 2 SE +/- 0.07, N = 3 12.62 12.78 12.79 12.82
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 1 - Model: ResNet-50 NVIDIA RTX 4070 TI NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 3090 0.9788 1.9576 2.9364 3.9152 4.894 SE +/- 0.02, N = 2 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 4.32 4.34 4.35 4.35
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 256 - Model: AlexNet NVIDIA RTX 4070 SUPER NVIDIA RTX 3090 NVIDIA RTX 4070 TI 8 16 24 32 40 SE +/- 0.01, N = 3 SE +/- 0.07, N = 3 SE +/- 0.07, N = 2 34.16 34.46 34.61 Device: GPU - Batch Size: 256 - Model: AlexNet
NVIDIA RTX 4070: The test quit with a non-zero exit status. The test quit with a non-zero exit status. The test quit with a non-zero exit status. E: UnboundLocalError: cannot access local variable 'kind' where it is not associated with a value
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 512 - Model: AlexNet NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 NVIDIA RTX 4070 TI NVIDIA RTX 3090 8 16 24 32 40 SE +/- 0.02, N = 2 SE +/- 0.03, N = 3 SE +/- 0.09, N = 2 SE +/- 0.01, N = 3 35.10 35.21 35.44 35.58
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 16 - Model: GoogLeNet NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 3090 NVIDIA RTX 4070 TI 4 8 12 16 20 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 15.66 15.67 15.68 15.69
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 16 - Model: ResNet-50 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI NVIDIA RTX 4070 NVIDIA RTX 3090 1.2353 2.4706 3.7059 4.9412 6.1765 SE +/- 0.00, N = 2 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 5.46 5.46 5.49 5.49
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 32 - Model: GoogLeNet NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 NVIDIA RTX 3090 NVIDIA RTX 4070 TI 4 8 12 16 20 SE +/- 0.01, N = 2 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 15.61 15.63 15.67 15.81
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 32 - Model: ResNet-50 NVIDIA RTX 4070 TI NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 NVIDIA RTX 3090 1.2533 2.5066 3.7599 5.0132 6.2665 SE +/- 0.02, N = 3 SE +/- 0.01, N = 2 SE +/- 0.01, N = 2 SE +/- 0.01, N = 3 5.50 5.51 5.55 5.57
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 64 - Model: GoogLeNet NVIDIA RTX 4070 TI NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 NVIDIA RTX 3090 4 8 12 16 20 SE +/- 0.06, N = 2 SE +/- 0.07, N = 3 SE +/- 0.08, N = 3 15.50 15.52 15.54 15.63
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: GPU - Batch Size: 64 - Model: ResNet-50 NVIDIA RTX 4070 TI NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 NVIDIA RTX 3090 1.2533 2.5066 3.7599 5.0132 6.2665 SE +/- 0.01, N = 2 SE +/- 0.01, N = 2 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 5.53 5.55 5.55 5.57
Libplacebo Libplacebo is a multimedia rendering library based on the core rendering code of the MPV player. The libplacebo benchmark relies on the Vulkan API and tests various primitives. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org FPS, More Is Better Libplacebo 5.229.1 Test: deband_heavy NVIDIA RTX 4070 NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 500 1000 1500 2000 2500 SE +/- 0.12, N = 3 SE +/- 2.90, N = 3 SE +/- 2.26, N = 3 SE +/- 0.40, N = 3 1843.26 2015.93 2186.70 2306.56 1. (CXX) g++ options: -lm -pthread -ldl -fvisibility=hidden -std=c++20 -O2 -fno-math-errno -fPIC -MD -MQ -MF
OpenBenchmarking.org FPS, More Is Better Libplacebo 5.229.1 Test: polar_nocompute NVIDIA RTX 4070 NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 500 1000 1500 2000 2500 SE +/- 0.01, N = 3 SE +/- 3.16, N = 3 SE +/- 0.24, N = 3 SE +/- 1.70, N = 3 1968.37 2116.50 2327.55 2459.03 1. (CXX) g++ options: -lm -pthread -ldl -fvisibility=hidden -std=c++20 -O2 -fno-math-errno -fPIC -MD -MQ -MF
OpenBenchmarking.org FPS, More Is Better Libplacebo 5.229.1 Test: hdr_peakdetect NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 NVIDIA RTX 4070 TI NVIDIA RTX 3090 1100 2200 3300 4400 5500 SE +/- 3.65, N = 3 SE +/- 11.75, N = 3 SE +/- 165.74, N = 3 SE +/- 75.68, N = 3 3292.37 3310.02 3475.06 4969.74 1. (CXX) g++ options: -lm -pthread -ldl -fvisibility=hidden -std=c++20 -O2 -fno-math-errno -fPIC -MD -MQ -MF
OpenBenchmarking.org FPS, More Is Better Libplacebo 5.229.1 Test: hdr_lut NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 NVIDIA RTX 4070 TI 900 1800 2700 3600 4500 SE +/- 13.62, N = 3 SE +/- 12.09, N = 3 SE +/- 10.06, N = 3 SE +/- 5.47, N = 3 3313.26 3905.98 3927.11 3971.61 1. (CXX) g++ options: -lm -pthread -ldl -fvisibility=hidden -std=c++20 -O2 -fno-math-errno -fPIC -MD -MQ -MF
OpenBenchmarking.org FPS, More Is Better Libplacebo 5.229.1 Test: av1_grain_lap NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 TI NVIDIA RTX 4070 SUPER 900 1800 2700 3600 4500 SE +/- 42.82, N = 3 SE +/- 66.69, N = 3 SE +/- 21.66, N = 3 SE +/- 5.52, N = 3 4096.48 4103.40 4140.87 4171.00 1. (CXX) g++ options: -lm -pthread -ldl -fvisibility=hidden -std=c++20 -O2 -fno-math-errno -fPIC -MD -MQ -MF
NCNN NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: mobilenet NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 3 6 9 12 15 SE +/- 4.97, N = 6 SE +/- 2.50, N = 9 SE +/- 0.47, N = 9 SE +/- 0.98, N = 9 12.07 10.14 8.62 8.43 MIN: 6.42 / MAX: 1193.34 MIN: 6.53 / MAX: 1509.26 MIN: 6.42 / MAX: 1101.3 MIN: 6.51 / MAX: 1023.8 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 3090 NVIDIA RTX 4070 TI 1.0553 2.1106 3.1659 4.2212 5.2765 SE +/- 2.36, N = 9 SE +/- 0.44, N = 9 SE +/- 0.05, N = 9 SE +/- 0.06, N = 12 4.69 3.03 2.67 2.54 MIN: 1.91 / MAX: 1305.64 MIN: 2.38 / MAX: 970.87 MIN: 2.44 / MAX: 22.79 MIN: 2.07 / MAX: 15.69 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 NVIDIA RTX 4070 NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 2 4 6 8 10 SE +/- 6.77, N = 8 SE +/- 1.14, N = 6 SE +/- 0.16, N = 9 SE +/- 0.09, N = 9 8.71 3.19 2.25 2.09 MIN: 1.73 / MAX: 1561.29 MIN: 1.82 / MAX: 1210.31 MIN: 1.75 / MAX: 343.7 MIN: 1.78 / MAX: 2.85 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: shufflenet-v2 NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 NVIDIA RTX 4070 TI 0.9383 1.8766 2.8149 3.7532 4.6915 SE +/- 2.18, N = 6 SE +/- 0.34, N = 8 SE +/- 0.12, N = 7 SE +/- 0.10, N = 8 4.17 2.31 2.11 2.03 MIN: 1.83 / MAX: 1393.33 MIN: 1.76 / MAX: 421.42 MIN: 1.77 / MAX: 2.53 MIN: 1.84 / MAX: 2.58 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: mnasnet NVIDIA RTX 4070 TI NVIDIA RTX 4070 SUPER NVIDIA RTX 3090 NVIDIA RTX 4070 0.9315 1.863 2.7945 3.726 4.6575 SE +/- 1.94, N = 12 SE +/- 1.31, N = 9 SE +/- 0.06, N = 9 SE +/- 0.05, N = 10 4.14 3.85 2.30 2.24 MIN: 1.95 / MAX: 1020 MIN: 1.89 / MAX: 1093.29 MIN: 2.01 / MAX: 2.64 MIN: 2 / MAX: 2.6 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: efficientnet-b0 NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 NVIDIA RTX 4070 TI 4 8 12 16 20 SE +/- 9.20, N = 6 SE +/- 0.97, N = 9 SE +/- 0.20, N = 12 SE +/- 0.06, N = 9 13.87 5.07 3.59 3.49 MIN: 2.86 / MAX: 2218.7 MIN: 3.22 / MAX: 1124.2 MIN: 3.02 / MAX: 509.97 MIN: 3.18 / MAX: 4.03 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: blazeface NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 TI 0.1958 0.3916 0.5874 0.7832 0.979 SE +/- 0.06, N = 3 SE +/- 0.03, N = 9 SE +/- 0.04, N = 9 SE +/- 0.03, N = 12 0.87 0.84 0.84 0.82 MIN: 0.74 / MAX: 1.01 MIN: 0.64 / MAX: 0.96 MIN: 0.65 / MAX: 4.63 MIN: 0.63 / MAX: 2.58 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: googlenet NVIDIA RTX 4070 SUPER NVIDIA RTX 3090 NVIDIA RTX 4070 TI NVIDIA RTX 4070 3 6 9 12 15 SE +/- 1.21, N = 9 SE +/- 1.05, N = 6 SE +/- 1.04, N = 12 SE +/- 0.14, N = 9 11.04 7.49 7.37 6.06 MIN: 5.28 / MAX: 1769.19 MIN: 5.46 / MAX: 1242.73 MIN: 5.33 / MAX: 1653.33 MIN: 5.33 / MAX: 8.36 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: vgg16 NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 NVIDIA RTX 4070 TI 30 60 90 120 150 SE +/- 22.21, N = 6 SE +/- 29.60, N = 9 SE +/- 19.29, N = 9 SE +/- 8.53, N = 12 145.72 117.81 54.54 34.49 MIN: 17.46 / MAX: 648.88 MIN: 17.16 / MAX: 647.67 MIN: 17.54 / MAX: 646.66 MIN: 17.35 / MAX: 644.35 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: resnet18 NVIDIA RTX 3090 NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 NVIDIA RTX 4070 TI 4 8 12 16 20 SE +/- 6.10, N = 6 SE +/- 3.49, N = 9 SE +/- 3.20, N = 9 SE +/- 1.74, N = 12 17.41 8.97 8.58 7.74 MIN: 4.05 / MAX: 900.27 MIN: 3.94 / MAX: 922.04 MIN: 3.98 / MAX: 912.04 MIN: 3.96 / MAX: 898.97 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: alexnet NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 NVIDIA RTX 3090 NVIDIA RTX 4070 TI 4 8 12 16 20 SE +/- 5.86, N = 9 SE +/- 3.71, N = 9 SE +/- 1.74, N = 9 SE +/- 2.33, N = 12 16.17 9.33 6.20 6.07 MIN: 3.52 / MAX: 436.52 MIN: 3.5 / MAX: 430.03 MIN: 3.56 / MAX: 340 MIN: 3.63 / MAX: 432.24 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: resnet50 NVIDIA RTX 4070 SUPER NVIDIA RTX 3090 NVIDIA RTX 4070 TI NVIDIA RTX 4070 10 20 30 40 50 SE +/- 14.70, N = 9 SE +/- 11.48, N = 6 SE +/- 4.23, N = 9 SE +/- 0.49, N = 12 46.26 27.77 14.32 8.72 MIN: 7.71 / MAX: 1829.99 MIN: 7.77 / MAX: 1603.33 MIN: 7.9 / MAX: 1787.49 MIN: 7.94 / MAX: 935.44 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: yolov4-tiny NVIDIA RTX 4070 SUPER NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 TI 14 28 42 56 70 SE +/- 10.56, N = 9 SE +/- 5.27, N = 6 SE +/- 7.50, N = 9 SE +/- 2.58, N = 9 63.82 26.85 25.11 16.47 MIN: 10.28 / MAX: 858.44 MIN: 10.35 / MAX: 853.14 MIN: 10.66 / MAX: 857.35 MIN: 10.61 / MAX: 826.68 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: squeezenet_ssd NVIDIA RTX 4070 SUPER NVIDIA RTX 3090 NVIDIA RTX 4070 TI NVIDIA RTX 4070 2 4 6 8 10 SE +/- 1.76, N = 9 SE +/- 1.57, N = 6 SE +/- 0.93, N = 12 SE +/- 0.17, N = 9 6.86 6.63 6.13 5.27 MIN: 4.34 / MAX: 1630.01 MIN: 4.43 / MAX: 1636.66 MIN: 4.75 / MAX: 1633.33 MIN: 4.53 / MAX: 7.53 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: regnety_400m NVIDIA RTX 4070 SUPER NVIDIA RTX 3090 NVIDIA RTX 4070 NVIDIA RTX 4070 TI 3 6 9 12 15 SE +/- 3.28, N = 9 SE +/- 1.17, N = 6 SE +/- 0.31, N = 8 SE +/- 0.24, N = 9 11.11 8.06 6.50 5.97 MIN: 5.49 / MAX: 4942.19 MIN: 5.43 / MAX: 1922.26 MIN: 5.52 / MAX: 460.02 MIN: 5.49 / MAX: 7.35 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: vision_transformer NVIDIA RTX 4070 SUPER NVIDIA RTX 3090 NVIDIA RTX 4070 TI NVIDIA RTX 4070 200 400 600 800 1000 SE +/- 87.53, N = 9 SE +/- 76.74, N = 6 SE +/- 58.07, N = 12 SE +/- 58.37, N = 12 844.61 663.24 497.66 382.82 MIN: 46.34 / MAX: 1866.93 MIN: 46.42 / MAX: 1833.21 MIN: 46.41 / MAX: 1886.67 MIN: 46.51 / MAX: 1840 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: Vulkan GPU - Model: FastestDet NVIDIA RTX 3090 NVIDIA RTX 4070 TI NVIDIA RTX 4070 SUPER NVIDIA RTX 4070 2 4 6 8 10 SE +/- 2.14, N = 6 SE +/- 0.32, N = 10 SE +/- 0.29, N = 9 SE +/- 0.13, N = 12 6.38 3.04 2.86 2.67 MIN: 2.14 / MAX: 1476.09 MIN: 2.14 / MAX: 847.58 MIN: 2.17 / MAX: 577.17 MIN: 2.04 / MAX: 3.47 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NVIDIA RTX 4070 SUPER Processor: Intel Core i9-13900K @ 5.50GHz (24 Cores / 32 Threads), Motherboard: ASUS TUF GAMING Z790-PRO WIFI (1401 BIOS), Chipset: Intel Device 7a27, Memory: 32GB, Disk: 4001GB Seagate ZP4000GP304001, Graphics: ASUS NVIDIA GeForce RTX 4070 SUPER 12GB, Audio: Realtek ALC1220, Monitor: ARZOPA, Network: Intel I226-V + Intel Device 7a70
OS: EndeavourOS rolling, Kernel: 6.7.1-arch1-1 (x86_64), Desktop: KDE Plasma 5.27.10, Display Server: X Server 1.21.1.11, Display Driver: NVIDIA 550.40.07, OpenGL: 4.6.0, OpenCL: OpenCL 3.0 CUDA 12.4.74, Compiler: GCC 13.2.1 20230801, File-System: ext4, Screen Resolution: 1920x1080
Kernel Notes: Transparent Huge Pages: alwaysCompiler Notes: --disable-libssp --disable-libstdcxx-pch --disable-werror --enable-__cxa_atexit --enable-bootstrap --enable-cet=auto --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-default-ssp --enable-gnu-indirect-function --enable-gnu-unique-object --enable-languages=ada,c,c++,d,fortran,go,lto,objc,obj-c++ --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-build-config=bootstrap-lto --with-linker-hash-style=gnuProcessor Notes: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x11dGraphics Notes: BAR1 / Visible vRAM Size: 16384 MiB - vBIOS Version: 95.04.69.00.c1Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 25 January 2024 21:36 by user test.
NVIDIA RTX 4070 Processor: Intel Core i9-13900K @ 5.50GHz (24 Cores / 32 Threads), Motherboard: ASUS TUF GAMING Z790-PRO WIFI (1401 BIOS), Chipset: Intel Device 7a27, Memory: 32GB, Disk: 4001GB Seagate ZP4000GP304001, Graphics: MSI NVIDIA GeForce RTX 4070 12GB, Audio: Realtek ALC1220, Monitor: ARZOPA, Network: Intel I226-V + Intel Device 7a70
OS: EndeavourOS rolling, Kernel: 6.7.1-arch1-1 (x86_64), Desktop: KDE Plasma 5.27.10, Display Server: X Server 1.21.1.11, Display Driver: NVIDIA 550.40.07, OpenGL: 4.6.0, OpenCL: OpenCL 3.0 CUDA 12.4.74, Compiler: GCC 13.2.1 20230801 + CUDA 12.3, File-System: ext4, Screen Resolution: 1920x1080
Kernel Notes: Transparent Huge Pages: alwaysEnvironment Notes: NVCC_PREPEND_FLAGS="-ccbin /opt/cuda/bin"Compiler Notes: --disable-libssp --disable-libstdcxx-pch --disable-werror --enable-__cxa_atexit --enable-bootstrap --enable-cet=auto --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-default-ssp --enable-gnu-indirect-function --enable-gnu-unique-object --enable-languages=ada,c,c++,d,fortran,go,lto,objc,obj-c++ --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-build-config=bootstrap-lto --with-linker-hash-style=gnuProcessor Notes: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x11dGraphics Notes: BAR1 / Visible vRAM Size: 16384 MiB - vBIOS Version: 95.04.3e.40.2aPython Notes: Python 3.11.6Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 28 January 2024 13:02 by user test.
NVIDIA RTX 4070 TI Processor: Intel Core i9-13900K @ 5.50GHz (24 Cores / 32 Threads), Motherboard: ASUS TUF GAMING Z790-PRO WIFI (1401 BIOS), Chipset: Intel Device 7a27, Memory: 32GB, Disk: 4001GB Seagate ZP4000GP304001, Graphics: NVIDIA GeForce RTX 4070 Ti 12GB, Audio: Realtek ALC1220, Monitor: ARZOPA, Network: Intel I226-V + Intel Device 7a70
OS: EndeavourOS rolling, Kernel: 6.7.1-arch1-1 (x86_64), Desktop: KDE Plasma 5.27.10, Display Server: X Server 1.21.1.11, Display Driver: NVIDIA 550.40.07, OpenGL: 4.6.0, OpenCL: OpenCL 3.0 CUDA 12.4.74, Compiler: GCC 13.2.1 20230801 + CUDA 12.3, File-System: ext4, Screen Resolution: 1920x1080
Kernel Notes: Transparent Huge Pages: alwaysEnvironment Notes: NVCC_PREPEND_FLAGS="-ccbin /opt/cuda/bin"Compiler Notes: --disable-libssp --disable-libstdcxx-pch --disable-werror --enable-__cxa_atexit --enable-bootstrap --enable-cet=auto --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-default-ssp --enable-gnu-indirect-function --enable-gnu-unique-object --enable-languages=ada,c,c++,d,fortran,go,lto,objc,obj-c++ --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-build-config=bootstrap-lto --with-linker-hash-style=gnuProcessor Notes: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x11dGraphics Notes: BAR1 / Visible vRAM Size: 16384 MiB - vBIOS Version: 95.04.31.00.36Python Notes: Python 3.11.6Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 29 January 2024 17:08 by user test.
NVIDIA RTX 3090 Processor: Intel Core i9-13900K @ 5.50GHz (24 Cores / 32 Threads), Motherboard: ASUS TUF GAMING Z790-PRO WIFI (1401 BIOS), Chipset: Intel Device 7a27, Memory: 32GB, Disk: 4001GB Seagate ZP4000GP304001, Graphics: NVIDIA GeForce RTX 3090 24GB, Audio: Realtek ALC1220, Monitor: PI-KVM Video, Network: Intel I226-V + Intel Device 7a70
OS: EndeavourOS rolling, Kernel: 6.7.4-arch1-1 (x86_64), Desktop: KDE Plasma 5.27.10, Display Server: X Server 1.21.1.11, Display Driver: NVIDIA 550.40.07, OpenGL: 4.6.0, OpenCL: OpenCL 3.0 CUDA 12.4.74, Compiler: GCC 13.2.1 20230801 + CUDA 12.3, File-System: ext4, Screen Resolution: 1920x1080
Kernel Notes: Transparent Huge Pages: alwaysEnvironment Notes: NVCC_PREPEND_FLAGS="-ccbin /opt/cuda/bin"Compiler Notes: --disable-libssp --disable-libstdcxx-pch --disable-werror --enable-__cxa_atexit --enable-bootstrap --enable-cet=auto --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-default-ssp --enable-gnu-indirect-function --enable-gnu-unique-object --enable-languages=ada,c,c++,d,fortran,go,lto,m2,objc,obj-c++ --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-build-config=bootstrap-lto --with-linker-hash-style=gnuProcessor Notes: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x11dGraphics Notes: BAR1 / Visible vRAM Size: 256 MiB - vBIOS Version: 94.02.26.08.baPython Notes: Python 3.11.6Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 7 February 2024 20:29 by user saddytech.