nov Intel Core i7-1280P testing with a MSI Prestige 14Evo A12M MS-14C6 (E14C6IMS.115 BIOS) and MSI Intel ADL GT2 8GB on Ubuntu 24.10 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2411271-NE-NOV20712723&grs&sor .
nov Processor Motherboard Chipset Memory Disk Graphics Audio Network OS Kernel Desktop Display Server OpenGL Compiler File-System Screen Resolution a b bb c Intel Core i7-1280P @ 4.70GHz (14 Cores / 20 Threads) MSI Prestige 14Evo A12M MS-14C6 (E14C6IMS.115 BIOS) Intel Alder Lake PCH 8 x 2GB LPDDR4-4267MT/s SK Hynix H9HCNNNCPMMLXR- 1024GB Micron_3400_MTFDKBA1T0TFH MSI Intel ADL GT2 8GB Realtek ALC274 Intel Alder Lake-P PCH CNVi WiFi Ubuntu 24.10 6.11.0-rc6-phx (x86_64) GNOME Shell 47.0 X Server + Wayland 4.6 Mesa 24.2.3-1ubuntu1 GCC 14.2.0 ext4 1920x1080 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2,rust --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-14-zdkDXv/gcc-14-14.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-14-zdkDXv/gcc-14-14.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x434 - Thermald 2.5.8 Java Details - OpenJDK Runtime Environment (build 21.0.5-ea+8-Ubuntu-1) Python Details - Python 3.12.7 Security Details - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Mitigation of Clear Register File + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; RSB filling; PBRSB-eIBRS: SW sequence; BHI: BHI_DIS_S + srbds: Not affected + tsx_async_abort: Not affected
nov supertuxkart: 1920 x 1080 - Low - OpenGL - Steady FPS llama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 512 llama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 1024 supertuxkart: 1920 x 1080 - Low - Vulkan - Steady FPS palabos: 100 llama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Text Generation 128 llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 512 palabos: 400 llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 1024 llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 2048 llama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 2048 openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU blender: Pabellon Barcelona - CPU-Only openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Face Detection Retail FP16-INT8 - CPU openvino: Person Re-Identification Retail FP16 - CPU openvino: Person Re-Identification Retail FP16 - CPU llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Text Generation 128 openvino: Face Detection Retail FP16-INT8 - CPU blender: Fishy Cat - CPU-Only openvino: Noise Suppression Poconet-Like FP16 - CPU openvino: Noise Suppression Poconet-Like FP16 - CPU renaissance: In-Memory Database Shootout blender: Classroom - CPU-Only openvino-genai: Gemma-7b-int4-ov - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Face Detection FP16-INT8 - CPU renaissance: Apache Spark Bayes openvino: Machine Translation EN To DE FP16 - CPU openvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Face Detection Retail FP16 - CPU openvino: Face Detection FP16 - CPU openvino: Face Detection Retail FP16 - CPU openvino: Face Detection FP16 - CPU llama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 1024 openvino: Road Segmentation ADAS FP16-INT8 - CPU openvino: Road Segmentation ADAS FP16-INT8 - CPU vkpeak: int16-vec4 llama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 512 llama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Text Generation 128 llama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 2048 supertuxkart: 1920 x 1080 - Ultimate - Vulkan - Steady FPS blender: BMW27 - CPU-Only openvino: Handwritten English Recognition FP16-INT8 - CPU openvino: Handwritten English Recognition FP16-INT8 - CPU blender: Junkshop - CPU-Only openvino: Handwritten English Recognition FP16 - CPU openvino: Handwritten English Recognition FP16 - CPU renaissance: Finagle HTTP Requests openvino: Person Detection FP16 - CPU openvino-genai: Falcon-7b-instruct-int4-ov - CPU openvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPU openvino: Person Detection FP16 - CPU supertuxkart: 1920 x 1080 - Ultimate - OpenGL - Steady FPS supertuxkart: 1920 x 1080 - Medium - Vulkan - Mostly Stable FPS supertuxkart: 1920 x 1080 - Ultimate - Vulkan - Mostly Stable FPS renaissance: Rand Forest renaissance: Apache Spark PageRank supertuxkart: 1920 x 1080 - Medium - OpenGL - Steady FPS renaissance: Scala Dotty supertuxkart: 1920 x 1080 - High - Vulkan - Steady FPS rustls: handshake-resume - TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384 rustls: handshake - TLS13_CHACHA20_POLY1305_SHA256 vkpeak: int16-scalar supertuxkart: 1920 x 1080 - Medium - OpenGL - Mostly Stable FPS rustls: handshake-ticket - TLS13_CHACHA20_POLY1305_SHA256 supertuxkart: 1920 x 1080 - High - OpenGL - Steady FPS renaissance: Akka Unbalanced Cobwebbed Tree supertuxkart: 1920 x 1080 - Ultimate - OpenGL - Mostly Stable FPS rustls: handshake-resume - TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 rustls: handshake-ticket - TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 supertuxkart: 1920 x 1080 - Medium - Vulkan - Steady FPS rustls: handshake - TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 rustls: handshake-ticket - TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384 supertuxkart: 1920 x 1080 - High - OpenGL - Mostly Stable FPS rustls: handshake - TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384 openvino: Vehicle Detection FP16 - CPU rustls: handshake-resume - TLS13_CHACHA20_POLY1305_SHA256 supertuxkart: 1920 x 1080 - High - Vulkan - Mostly Stable FPS openvino: Vehicle Detection FP16 - CPU renaissance: ALS Movie Lens supertuxkart: 1920 x 1080 - Low - Vulkan - Mostly Stable FPS openvino: Road Segmentation ADAS FP16 - CPU openvino: Road Segmentation ADAS FP16 - CPU supertuxkart: 1920 x 1080 - Low - OpenGL - Mostly Stable FPS renaissance: Savina Reactors.IO renaissance: Gaussian Mixture Model renaissance: Genetic Algorithm Using Jenetics + Futures vkpeak: int32-vec4 mt-dgemm: Sustained Floating-Point Rate build-eigen: Time To Compile vkpeak: fp32-scalar vkpeak: fp32-vec4 vkpeak: fp16-scalar vkpeak: fp16-vec4 vkpeak: int32-scalar openvino-genai: Gemma-7b-int4-ov - CPU - Time Per Output Token openvino-genai: Gemma-7b-int4-ov - CPU - Time To First Token openvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPU - Time Per Output Token openvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPU - Time To First Token openvino-genai: Falcon-7b-instruct-int4-ov - CPU - Time Per Output Token openvino-genai: Falcon-7b-instruct-int4-ov - CPU - Time To First Token openvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPU - Time Per Output Token openvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPU - Time To First Token renaissance: Apache Spark ALS a b bb c 113 13.09 12.77 250 43.3104 6.18 14.07 74.9255 13.7 13.34 12.48 1.66 8888.15 4.01 916.89 3750.57 678.84 183.94 32.52 6.6 8.78 403.53 205.02 29.11 5302.8 755.48 174.78 34.21 15.25 4.27 638.2 392.48 10.1 1402.5 335 1.17 17.79 5004.25 57.88 91.1 65.68 1919.65 61.51 28.13 52.18 245 271.37 66.62 238.66 368.84 61.05 259.96 4385.9 13.38 10.57 22.66 439.61 55 314 294 570.1 3063.2 76 550.0 245 415559.3 9355.19 1013.63 86 106054.04 59 9185.6 60 1082805.9 809762.81 247 9526.43 356237.68 65 92044.9 96.28 105546.18 297 62.01 14459.4 321 50.76 117.5 135 5338.7 4643.4 1244.5 550.78 179.46402 147.803 1868.44 1652.72 2503.32 3551.69 473.56 98.98 345.8 94.57 191.33 44.12 80.64 46 14.11 13.76 151 40.8387 6.42 14.82 71.1347 13.79 13.4 1.53 9570.87 3.63 801.74 4146.33 731.87 203.39 29.42 8.15 349.6 223.62 26.71 6086.2 687.92 195.02 30.68 17.05 4.61 745.2 350.74 1285.29 372.29 1.31 16.04 4489.06 100.47 59.62 1919.43 236 235.55 73.28 217.86 322.47 64.71 246.56 3884.6 14.53 411.33 51 302 286 600.6 2809.0 73 561.4 248 445443.44 10102.42 1013.52 86 112736.73 57 9157.1 56 1154350.71 864815.55 247 10169.47 379460.51 61 97635.3 100.76 111914.76 296 59.37 15204.0 318 52.36 114.32 135 5229.6 4581.1 1222.8 550.7 181.143057 148.025 1868.13 1652.47 2502.95 3551.19 473.51 59 14.13 13.76 248 26.529 6.42 14.1 50.7295 13.77 13.39 13.38 1.53 9615.64 3.62 801.96 4149.86 737.31 204.4 29.28 6.6 8.09 399.23 224.66 26.59 5054.4 753.66 4.49 196.37 30.48 16.96 4.62 716.9 352.81 9.99 1281.77 373.56 1.31 15.99 4504.41 57.7 100.83 59.42 1609.56 61.42 28.18 52.31 211 270.09 75.74 210.75 366.21 66.33 240.71 4297.2 14.57 10.55 22.58 410.91 50 286 268 624.2 2922.2 70 596.6 229 416122.79 9387.98 939.02 81 104991.4 55 8669.3 56 1079421.74 808705.16 236 9571.62 355887.32 62 91665.53 99.98 105168.67 280 59.87 14475.6 303 52.24 114.65 131 5360.8 4616.0 1230.5 542.62 181.334112 147.955 1868.01 1652.35 2502.82 3551 473.49 222.88 943.04 100.11 335.04 94.78 191.74 44.28 73.03 47 7.21 7.17 251 41.1877 4.15 9.72 71.4035 9.59 9.36 9.38 2.08 7143.56 4.79 1054.24 3171.54 565.21 157.14 38 5.09 10.48 450.68 175.67 33.81 4797.6 864.22 3.59 157.38 37.93 13.75 3.73 789.7 432.55 8.2 1568.68 306.99 1.08 19.39 5415.46 48.15 83.92 71.13 1919.4 51.6 23.68 44.05 236 237.14 65.86 241.56 355.04 58.06 273.66 3929.9 13.01 9.53 20.49 454.25 52 307 286 601.9 2815.1 75 573.8 244 448873.55 9367.73 1013.51 87 105650.04 57 8570.6 58 1083026.43 811877.86 252 9594 379788.6 63 92487.82 94.65 105132.05 298 63.15 14302.4 320 50.07 119.53 135 5250.6 4534.2 1251.9 550.72 180.516151 148.039 1868.28 1652.46 2502.98 3551.16 473.5 278.26 1158.18 121.95 473.05 104.88 238.24 48.81 88.24 OpenBenchmarking.org
SuperTuxKart Resolution: 1920 x 1080 - Graphics Effects: Low - Renderer: OpenGL - Steady FPS OpenBenchmarking.org Frames Per Second, More Is Better SuperTuxKart 1.5 Beta 1 Resolution: 1920 x 1080 - Graphics Effects: Low - Renderer: OpenGL - Steady FPS a bb c b 30 60 90 120 150 113 59 47 46
Llama.cpp Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 512 OpenBenchmarking.org Tokens Per Second, More Is Better Llama.cpp b4154 Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 512 bb b a c 4 8 12 16 20 14.13 14.11 13.09 7.21 1. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas
Llama.cpp Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 1024 OpenBenchmarking.org Tokens Per Second, More Is Better Llama.cpp b4154 Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 1024 bb b a c 4 8 12 16 20 13.76 13.76 12.77 7.17 1. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas
SuperTuxKart Resolution: 1920 x 1080 - Graphics Effects: Low - Renderer: Vulkan - Steady FPS OpenBenchmarking.org Frames Per Second, More Is Better SuperTuxKart 1.5 Beta 1 Resolution: 1920 x 1080 - Graphics Effects: Low - Renderer: Vulkan - Steady FPS c a bb b 50 100 150 200 250 251 250 248 151
Palabos Grid Size: 100 OpenBenchmarking.org Mega Site Updates Per Second, More Is Better Palabos 2.3 Grid Size: 100 a c b bb 10 20 30 40 50 43.31 41.19 40.84 26.53 1. (CXX) g++ options: -std=c++17 -pedantic -O3 -rdynamic -lcrypto -lcurl -lsz -lz -ldl -lm
Llama.cpp Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Text Generation 128 OpenBenchmarking.org Tokens Per Second, More Is Better Llama.cpp b4154 Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Text Generation 128 bb b a c 2 4 6 8 10 6.42 6.42 6.18 4.15 1. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas
Llama.cpp Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 512 OpenBenchmarking.org Tokens Per Second, More Is Better Llama.cpp b4154 Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 512 b bb a c 4 8 12 16 20 14.82 14.10 14.07 9.72 1. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas
Palabos Grid Size: 400 OpenBenchmarking.org Mega Site Updates Per Second, More Is Better Palabos 2.3 Grid Size: 400 a c b bb 20 40 60 80 100 74.93 71.40 71.13 50.73 1. (CXX) g++ options: -std=c++17 -pedantic -O3 -rdynamic -lcrypto -lcurl -lsz -lz -ldl -lm
Llama.cpp Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 1024 OpenBenchmarking.org Tokens Per Second, More Is Better Llama.cpp b4154 Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 1024 b bb a c 4 8 12 16 20 13.79 13.77 13.70 9.59 1. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas
Llama.cpp Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 2048 OpenBenchmarking.org Tokens Per Second, More Is Better Llama.cpp b4154 Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 2048 bb a c 3 6 9 12 15 13.39 13.34 9.36 1. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas
Llama.cpp Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 2048 OpenBenchmarking.org Tokens Per Second, More Is Better Llama.cpp b4154 Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 2048 b bb a c 3 6 9 12 15 13.40 13.38 12.48 9.38 1. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU b bb a c 0.468 0.936 1.404 1.872 2.34 1.53 1.53 1.66 2.08 MIN: 0.48 / MAX: 5.15 MIN: 0.48 / MAX: 4.89 MIN: 0.45 / MAX: 6.8 MIN: 0.46 / MAX: 11.03 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU bb b a c 2K 4K 6K 8K 10K 9615.64 9570.87 8888.15 7143.56 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU bb b a c 1.0778 2.1556 3.2334 4.3112 5.389 3.62 3.63 4.01 4.79 MIN: 1.25 / MAX: 11.17 MIN: 1.26 / MAX: 10.8 MIN: 1.23 / MAX: 11.41 MIN: 1.1 / MAX: 20.47 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
Blender Blend File: Pabellon Barcelona - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.3 Blend File: Pabellon Barcelona - Compute: CPU-Only b bb a c 200 400 600 800 1000 801.74 801.96 916.89 1054.24
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU bb b a c 900 1800 2700 3600 4500 4149.86 4146.33 3750.57 3171.54 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenVINO Model: Face Detection Retail FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Face Detection Retail FP16-INT8 - Device: CPU bb b a c 160 320 480 640 800 737.31 731.87 678.84 565.21 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenVINO Model: Person Re-Identification Retail FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Person Re-Identification Retail FP16 - Device: CPU bb b a c 40 80 120 160 200 204.40 203.39 183.94 157.14 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenVINO Model: Person Re-Identification Retail FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Person Re-Identification Retail FP16 - Device: CPU bb b a c 9 18 27 36 45 29.28 29.42 32.52 38.00 MIN: 13.23 / MAX: 56.48 MIN: 13.3 / MAX: 50.36 MIN: 13.27 / MAX: 98.34 MIN: 13.58 / MAX: 150.48 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
Llama.cpp Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Text Generation 128 OpenBenchmarking.org Tokens Per Second, More Is Better Llama.cpp b4154 Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Text Generation 128 bb a c 2 4 6 8 10 6.60 6.60 5.09 1. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas
OpenVINO Model: Face Detection Retail FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Face Detection Retail FP16-INT8 - Device: CPU bb b a c 3 6 9 12 15 8.09 8.15 8.78 10.48 MIN: 3.69 / MAX: 17.48 MIN: 3.56 / MAX: 16.97 MIN: 3.74 / MAX: 28.34 MIN: 3.94 / MAX: 72.26 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
Blender Blend File: Fishy Cat - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.3 Blend File: Fishy Cat - Compute: CPU-Only b bb a c 100 200 300 400 500 349.60 399.23 403.53 450.68
OpenVINO Model: Noise Suppression Poconet-Like FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Noise Suppression Poconet-Like FP16 - Device: CPU bb b a c 50 100 150 200 250 224.66 223.62 205.02 175.67 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenVINO Model: Noise Suppression Poconet-Like FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Noise Suppression Poconet-Like FP16 - Device: CPU bb b a c 8 16 24 32 40 26.59 26.71 29.11 33.81 MIN: 13.16 / MAX: 47.31 MIN: 13.32 / MAX: 44.78 MIN: 13.53 / MAX: 79.9 MIN: 13.51 / MAX: 143.78 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
Renaissance Test: In-Memory Database Shootout OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.16 Test: In-Memory Database Shootout c bb a b 1300 2600 3900 5200 6500 4797.6 5054.4 5302.8 6086.2 MIN: 4238.93 / MAX: 5345.86 MIN: 4319.98 / MAX: 5749.04 MIN: 4531.82 / MAX: 5427.64 MIN: 5581.49 / MAX: 6632.91
Blender Blend File: Classroom - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.3 Blend File: Classroom - Compute: CPU-Only b bb a c 200 400 600 800 1000 687.92 753.66 755.48 864.22
OpenVINO GenAI Model: Gemma-7b-int4-ov - Device: CPU OpenBenchmarking.org tokens/s, More Is Better OpenVINO GenAI 2024.5 Model: Gemma-7b-int4-ov - Device: CPU bb c 1.0103 2.0206 3.0309 4.0412 5.0515 4.49 3.59
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Person Vehicle Bike Detection FP16 - Device: CPU bb b a c 40 80 120 160 200 196.37 195.02 174.78 157.38 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Person Vehicle Bike Detection FP16 - Device: CPU bb b a c 9 18 27 36 45 30.48 30.68 34.21 37.93 MIN: 13.66 / MAX: 56.89 MIN: 16.13 / MAX: 55.32 MIN: 14.72 / MAX: 152.84 MIN: 15.71 / MAX: 152.86 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Machine Translation EN To DE FP16 - Device: CPU b bb a c 4 8 12 16 20 17.05 16.96 15.25 13.75 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Face Detection FP16-INT8 - Device: CPU bb b a c 1.0395 2.079 3.1185 4.158 5.1975 4.62 4.61 4.27 3.73 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
Renaissance Test: Apache Spark Bayes OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.16 Test: Apache Spark Bayes a bb b c 200 400 600 800 1000 638.2 716.9 745.2 789.7 MIN: 580.8 / MAX: 828.74 MIN: 591.68 / MAX: 844.76 MIN: 609.15 / MAX: 891.9 MIN: 640.59 / MAX: 897.21
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Machine Translation EN To DE FP16 - Device: CPU b bb a c 90 180 270 360 450 350.74 352.81 392.48 432.55 MIN: 169.89 / MAX: 756.81 MIN: 183.5 / MAX: 837.79 MIN: 168.33 / MAX: 1771.01 MIN: 164.06 / MAX: 1770.86 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenVINO GenAI Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU OpenBenchmarking.org tokens/s, More Is Better OpenVINO GenAI 2024.5 Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU a bb c 3 6 9 12 15 10.10 9.99 8.20
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Face Detection FP16-INT8 - Device: CPU bb b a c 300 600 900 1200 1500 1281.77 1285.29 1402.50 1568.68 MIN: 663.22 / MAX: 2901.61 MIN: 661.66 / MAX: 2931.41 MIN: 660.35 / MAX: 5619.27 MIN: 666.6 / MAX: 9839.79 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenVINO Model: Face Detection Retail FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Face Detection Retail FP16 - Device: CPU bb b a c 80 160 240 320 400 373.56 372.29 335.00 306.99 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Face Detection FP16 - Device: CPU bb b a c 0.2948 0.5896 0.8844 1.1792 1.474 1.31 1.31 1.17 1.08 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenVINO Model: Face Detection Retail FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Face Detection Retail FP16 - Device: CPU bb b a c 5 10 15 20 25 15.99 16.04 17.79 19.39 MIN: 7.49 / MAX: 39.2 MIN: 7.67 / MAX: 35.36 MIN: 6.93 / MAX: 78.65 MIN: 8.01 / MAX: 78.86 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Face Detection FP16 - Device: CPU b bb a c 1200 2400 3600 4800 6000 4489.06 4504.41 5004.25 5415.46 MIN: 2543.37 / MAX: 7801.22 MIN: 2560.7 / MAX: 7228.61 MIN: 2565.77 / MAX: 11954.25 MIN: 2567.66 / MAX: 21634.63 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
Llama.cpp Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 1024 OpenBenchmarking.org Tokens Per Second, More Is Better Llama.cpp b4154 Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 1024 a bb c 13 26 39 52 65 57.88 57.70 48.15 1. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas
OpenVINO Model: Road Segmentation ADAS FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU bb b a c 20 40 60 80 100 100.83 100.47 91.10 83.92 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenVINO Model: Road Segmentation ADAS FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU bb b a c 16 32 48 64 80 59.42 59.62 65.68 71.13 MIN: 29.99 / MAX: 117.72 MIN: 31.69 / MAX: 109.78 MIN: 30.63 / MAX: 319.44 MIN: 30.21 / MAX: 364.45 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
vkpeak int16-vec4 OpenBenchmarking.org GIOPS, More Is Better vkpeak 20240505 int16-vec4 a b c bb 400 800 1200 1600 2000 1919.65 1919.43 1919.40 1609.56
Llama.cpp Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 512 OpenBenchmarking.org Tokens Per Second, More Is Better Llama.cpp b4154 Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 512 a bb c 14 28 42 56 70 61.51 61.42 51.60 1. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas
Llama.cpp Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Text Generation 128 OpenBenchmarking.org Tokens Per Second, More Is Better Llama.cpp b4154 Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Text Generation 128 bb a c 7 14 21 28 35 28.18 28.13 23.68 1. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas
Llama.cpp Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 2048 OpenBenchmarking.org Tokens Per Second, More Is Better Llama.cpp b4154 Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 2048 bb a c 12 24 36 48 60 52.31 52.18 44.05 1. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas
SuperTuxKart Resolution: 1920 x 1080 - Graphics Effects: Ultimate - Renderer: Vulkan - Steady FPS OpenBenchmarking.org Frames Per Second, More Is Better SuperTuxKart 1.5 Beta 1 Resolution: 1920 x 1080 - Graphics Effects: Ultimate - Renderer: Vulkan - Steady FPS a c b bb 50 100 150 200 250 245 236 236 211
Blender Blend File: BMW27 - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.3 Blend File: BMW27 - Compute: CPU-Only b c bb a 60 120 180 240 300 235.55 237.14 270.09 271.37
OpenVINO Model: Handwritten English Recognition FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Handwritten English Recognition FP16-INT8 - Device: CPU bb b a c 20 40 60 80 100 75.74 73.28 66.62 65.86 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenVINO Model: Handwritten English Recognition FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Handwritten English Recognition FP16-INT8 - Device: CPU bb b a c 50 100 150 200 250 210.75 217.86 238.66 241.56 MIN: 103.37 / MAX: 548.96 MIN: 103.9 / MAX: 635.93 MIN: 101.28 / MAX: 947.08 MIN: 104.83 / MAX: 911.97 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
Blender Blend File: Junkshop - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.3 Blend File: Junkshop - Compute: CPU-Only b c bb a 80 160 240 320 400 322.47 355.04 366.21 368.84
OpenVINO Model: Handwritten English Recognition FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Handwritten English Recognition FP16 - Device: CPU bb b a c 15 30 45 60 75 66.33 64.71 61.05 58.06 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenVINO Model: Handwritten English Recognition FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Handwritten English Recognition FP16 - Device: CPU bb b a c 60 120 180 240 300 240.71 246.56 259.96 273.66 MIN: 129.63 / MAX: 979.78 MIN: 128.61 / MAX: 661.55 MIN: 130.23 / MAX: 1000.64 MIN: 131.85 / MAX: 999.97 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
Renaissance Test: Finagle HTTP Requests OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.16 Test: Finagle HTTP Requests b c bb a 900 1800 2700 3600 4500 3884.6 3929.9 4297.2 4385.9 MIN: 3335.79 / MAX: 4399.52 MIN: 3248.37 / MAX: 4520.84 MAX: 4817.4 MAX: 5421.32
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Person Detection FP16 - Device: CPU bb b a c 4 8 12 16 20 14.57 14.53 13.38 13.01 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenVINO GenAI Model: Falcon-7b-instruct-int4-ov - Device: CPU OpenBenchmarking.org tokens/s, More Is Better OpenVINO GenAI 2024.5 Model: Falcon-7b-instruct-int4-ov - Device: CPU a bb c 3 6 9 12 15 10.57 10.55 9.53
OpenVINO GenAI Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU OpenBenchmarking.org tokens/s, More Is Better OpenVINO GenAI 2024.5 Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU a bb c 5 10 15 20 25 22.66 22.58 20.49
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Person Detection FP16 - Device: CPU bb b a c 100 200 300 400 500 410.91 411.33 439.61 454.25 MIN: 222.81 / MAX: 845.42 MIN: 224.97 / MAX: 963.04 MIN: 232.29 / MAX: 1903.58 MIN: 192.15 / MAX: 1904.48 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
SuperTuxKart Resolution: 1920 x 1080 - Graphics Effects: Ultimate - Renderer: OpenGL - Steady FPS OpenBenchmarking.org Frames Per Second, More Is Better SuperTuxKart 1.5 Beta 1 Resolution: 1920 x 1080 - Graphics Effects: Ultimate - Renderer: OpenGL - Steady FPS a c b bb 12 24 36 48 60 55 52 51 50
SuperTuxKart Resolution: 1920 x 1080 - Graphics Effects: Medium - Renderer: Vulkan - Mostly Stable FPS OpenBenchmarking.org Frames Per Second, More Is Better SuperTuxKart 1.5 Beta 1 Resolution: 1920 x 1080 - Graphics Effects: Medium - Renderer: Vulkan - Mostly Stable FPS a c b bb 70 140 210 280 350 314 307 302 286
SuperTuxKart Resolution: 1920 x 1080 - Graphics Effects: Ultimate - Renderer: Vulkan - Mostly Stable FPS OpenBenchmarking.org Frames Per Second, More Is Better SuperTuxKart 1.5 Beta 1 Resolution: 1920 x 1080 - Graphics Effects: Ultimate - Renderer: Vulkan - Mostly Stable FPS a c b bb 60 120 180 240 300 294 286 286 268
Renaissance Test: Random Forest OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.16 Test: Random Forest a b c bb 130 260 390 520 650 570.1 600.6 601.9 624.2 MIN: 534.15 / MAX: 651.47 MIN: 560.53 / MAX: 656.17 MIN: 554.87 / MAX: 660.27 MIN: 564.93 / MAX: 776.27
Renaissance Test: Apache Spark PageRank OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.16 Test: Apache Spark PageRank b c bb a 700 1400 2100 2800 3500 2809.0 2815.1 2922.2 3063.2 MIN: 2658.75 MIN: 2628.83 / MAX: 2815.13 MIN: 2752.32 / MAX: 3030.18 MIN: 2879.98 / MAX: 3230.31
SuperTuxKart Resolution: 1920 x 1080 - Graphics Effects: Medium - Renderer: OpenGL - Steady FPS OpenBenchmarking.org Frames Per Second, More Is Better SuperTuxKart 1.5 Beta 1 Resolution: 1920 x 1080 - Graphics Effects: Medium - Renderer: OpenGL - Steady FPS a c b bb 20 40 60 80 100 76 75 73 70
Renaissance Test: Scala Dotty OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.16 Test: Scala Dotty a b c bb 130 260 390 520 650 550.0 561.4 573.8 596.6 MIN: 463.24 / MAX: 928.24 MIN: 478.02 / MAX: 968.67 MIN: 477.81 / MAX: 939.92 MIN: 486.85 / MAX: 1078.3
SuperTuxKart Resolution: 1920 x 1080 - Graphics Effects: High - Renderer: Vulkan - Steady FPS OpenBenchmarking.org Frames Per Second, More Is Better SuperTuxKart 1.5 Beta 1 Resolution: 1920 x 1080 - Graphics Effects: High - Renderer: Vulkan - Steady FPS b a c bb 50 100 150 200 250 248 245 244 229
Rustls Benchmark: handshake-resume - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384 OpenBenchmarking.org handshakes/s, More Is Better Rustls 0.23.17 Benchmark: handshake-resume - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384 c b bb a 100K 200K 300K 400K 500K 448873.55 445443.44 416122.79 415559.30 1. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs
Rustls Benchmark: handshake - Suite: TLS13_CHACHA20_POLY1305_SHA256 OpenBenchmarking.org handshakes/s, More Is Better Rustls 0.23.17 Benchmark: handshake - Suite: TLS13_CHACHA20_POLY1305_SHA256 b bb c a 2K 4K 6K 8K 10K 10102.42 9387.98 9367.73 9355.19 1. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs
vkpeak int16-scalar OpenBenchmarking.org GIOPS, More Is Better vkpeak 20240505 int16-scalar a b c bb 200 400 600 800 1000 1013.63 1013.52 1013.51 939.02
SuperTuxKart Resolution: 1920 x 1080 - Graphics Effects: Medium - Renderer: OpenGL - Mostly Stable FPS OpenBenchmarking.org Frames Per Second, More Is Better SuperTuxKart 1.5 Beta 1 Resolution: 1920 x 1080 - Graphics Effects: Medium - Renderer: OpenGL - Mostly Stable FPS c b a bb 20 40 60 80 100 87 86 86 81
Rustls Benchmark: handshake-ticket - Suite: TLS13_CHACHA20_POLY1305_SHA256 OpenBenchmarking.org handshakes/s, More Is Better Rustls 0.23.17 Benchmark: handshake-ticket - Suite: TLS13_CHACHA20_POLY1305_SHA256 b a c bb 20K 40K 60K 80K 100K 112736.73 106054.04 105650.04 104991.40 1. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs
SuperTuxKart Resolution: 1920 x 1080 - Graphics Effects: High - Renderer: OpenGL - Steady FPS OpenBenchmarking.org Frames Per Second, More Is Better SuperTuxKart 1.5 Beta 1 Resolution: 1920 x 1080 - Graphics Effects: High - Renderer: OpenGL - Steady FPS a c b bb 13 26 39 52 65 59 57 57 55
Renaissance Test: Akka Unbalanced Cobwebbed Tree OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.16 Test: Akka Unbalanced Cobwebbed Tree c bb b a 2K 4K 6K 8K 10K 8570.6 8669.3 9157.1 9185.6 MIN: 8210.22 / MAX: 9186.21 MIN: 8535.62 / MAX: 9221.73 MAX: 9628.95 MIN: 9185.56 / MAX: 9829.42
SuperTuxKart Resolution: 1920 x 1080 - Graphics Effects: Ultimate - Renderer: OpenGL - Mostly Stable FPS OpenBenchmarking.org Frames Per Second, More Is Better SuperTuxKart 1.5 Beta 1 Resolution: 1920 x 1080 - Graphics Effects: Ultimate - Renderer: OpenGL - Mostly Stable FPS a c bb b 13 26 39 52 65 60 58 56 56
Rustls Benchmark: handshake-resume - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 OpenBenchmarking.org handshakes/s, More Is Better Rustls 0.23.17 Benchmark: handshake-resume - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 b c a bb 200K 400K 600K 800K 1000K 1154350.71 1083026.43 1082805.90 1079421.74 1. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs
Rustls Benchmark: handshake-ticket - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 OpenBenchmarking.org handshakes/s, More Is Better Rustls 0.23.17 Benchmark: handshake-ticket - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 b c a bb 200K 400K 600K 800K 1000K 864815.55 811877.86 809762.81 808705.16 1. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs
SuperTuxKart Resolution: 1920 x 1080 - Graphics Effects: Medium - Renderer: Vulkan - Steady FPS OpenBenchmarking.org Frames Per Second, More Is Better SuperTuxKart 1.5 Beta 1 Resolution: 1920 x 1080 - Graphics Effects: Medium - Renderer: Vulkan - Steady FPS c b a bb 60 120 180 240 300 252 247 247 236
Rustls Benchmark: handshake - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 OpenBenchmarking.org handshakes/s, More Is Better Rustls 0.23.17 Benchmark: handshake - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 b c bb a 2K 4K 6K 8K 10K 10169.47 9594.00 9571.62 9526.43 1. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs
Rustls Benchmark: handshake-ticket - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384 OpenBenchmarking.org handshakes/s, More Is Better Rustls 0.23.17 Benchmark: handshake-ticket - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384 c b a bb 80K 160K 240K 320K 400K 379788.60 379460.51 356237.68 355887.32 1. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs
SuperTuxKart Resolution: 1920 x 1080 - Graphics Effects: High - Renderer: OpenGL - Mostly Stable FPS OpenBenchmarking.org Frames Per Second, More Is Better SuperTuxKart 1.5 Beta 1 Resolution: 1920 x 1080 - Graphics Effects: High - Renderer: OpenGL - Mostly Stable FPS a c bb b 15 30 45 60 75 65 63 62 61
Rustls Benchmark: handshake - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384 OpenBenchmarking.org handshakes/s, More Is Better Rustls 0.23.17 Benchmark: handshake - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384 b c a bb 20K 40K 60K 80K 100K 97635.30 92487.82 92044.90 91665.53 1. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Vehicle Detection FP16 - Device: CPU b bb a c 20 40 60 80 100 100.76 99.98 96.28 94.65 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
Rustls Benchmark: handshake-resume - Suite: TLS13_CHACHA20_POLY1305_SHA256 OpenBenchmarking.org handshakes/s, More Is Better Rustls 0.23.17 Benchmark: handshake-resume - Suite: TLS13_CHACHA20_POLY1305_SHA256 b a bb c 20K 40K 60K 80K 100K 111914.76 105546.18 105168.67 105132.05 1. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs
SuperTuxKart Resolution: 1920 x 1080 - Graphics Effects: High - Renderer: Vulkan - Mostly Stable FPS OpenBenchmarking.org Frames Per Second, More Is Better SuperTuxKart 1.5 Beta 1 Resolution: 1920 x 1080 - Graphics Effects: High - Renderer: Vulkan - Mostly Stable FPS c a b bb 60 120 180 240 300 298 297 296 280
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Vehicle Detection FP16 - Device: CPU b bb a c 14 28 42 56 70 59.37 59.87 62.01 63.15 MIN: 31.87 / MAX: 215.48 MIN: 26.15 / MAX: 156.54 MIN: 27.87 / MAX: 273.2 MIN: 32.01 / MAX: 273.44 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
Renaissance Test: ALS Movie Lens OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.16 Test: ALS Movie Lens c a bb b 3K 6K 9K 12K 15K 14302.4 14459.4 14475.6 15204.0 MIN: 13229.02 / MAX: 14790.02 MIN: 13527.85 / MAX: 14809.99 MIN: 13363.8 / MAX: 14850.22 MIN: 14604.93 / MAX: 15315.73
SuperTuxKart Resolution: 1920 x 1080 - Graphics Effects: Low - Renderer: Vulkan - Mostly Stable FPS OpenBenchmarking.org Frames Per Second, More Is Better SuperTuxKart 1.5 Beta 1 Resolution: 1920 x 1080 - Graphics Effects: Low - Renderer: Vulkan - Mostly Stable FPS a c b bb 70 140 210 280 350 321 320 318 303
OpenVINO Model: Road Segmentation ADAS FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Road Segmentation ADAS FP16 - Device: CPU b bb a c 12 24 36 48 60 52.36 52.24 50.76 50.07 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenVINO Model: Road Segmentation ADAS FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Road Segmentation ADAS FP16 - Device: CPU b bb a c 30 60 90 120 150 114.32 114.65 117.50 119.53 MIN: 48.61 / MAX: 405.31 MIN: 76.78 / MAX: 342.17 MIN: 45.67 / MAX: 445.31 MIN: 72.87 / MAX: 434.2 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
SuperTuxKart Resolution: 1920 x 1080 - Graphics Effects: Low - Renderer: OpenGL - Mostly Stable FPS OpenBenchmarking.org Frames Per Second, More Is Better SuperTuxKart 1.5 Beta 1 Resolution: 1920 x 1080 - Graphics Effects: Low - Renderer: OpenGL - Mostly Stable FPS c b a bb 30 60 90 120 150 135 135 135 131
Renaissance Test: Savina Reactors.IO OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.16 Test: Savina Reactors.IO b c a bb 1100 2200 3300 4400 5500 5229.6 5250.6 5338.7 5360.8 MAX: 7901.15 MIN: 5250.57 / MAX: 7316.25 MAX: 7566.83 MIN: 5360.76 / MAX: 7595.61
Renaissance Test: Gaussian Mixture Model OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.16 Test: Gaussian Mixture Model c b bb a 1000 2000 3000 4000 5000 4534.2 4581.1 4616.0 4643.4 MIN: 4412.76 / MAX: 4943.27 MIN: 4423.98 / MAX: 5050.76 MAX: 5157.94 MIN: 4643.38 / MAX: 5248.85
Renaissance Test: Genetic Algorithm Using Jenetics + Futures OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.16 Test: Genetic Algorithm Using Jenetics + Futures b bb a c 300 600 900 1200 1500 1222.8 1230.5 1244.5 1251.9 MIN: 1123.42 / MAX: 1307.54 MIN: 1114.96 / MAX: 1356.94 MIN: 1130.89 / MAX: 1359.65 MIN: 1146.96 / MAX: 1404.63
vkpeak int32-vec4 OpenBenchmarking.org GIOPS, More Is Better vkpeak 20240505 int32-vec4 a c b bb 120 240 360 480 600 550.78 550.72 550.70 542.62
ACES DGEMM Sustained Floating-Point Rate OpenBenchmarking.org GFLOP/s, More Is Better ACES DGEMM 1.0 Sustained Floating-Point Rate bb b c a 40 80 120 160 200 181.33 181.14 180.52 179.46 1. (CC) gcc options: -ffast-math -mavx2 -O3 -fopenmp -lopenblas
Timed Eigen Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Eigen Compilation 3.4.0 Time To Compile a bb b c 30 60 90 120 150 147.80 147.96 148.03 148.04
vkpeak fp32-scalar OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20240505 fp32-scalar a c b bb 400 800 1200 1600 2000 1868.44 1868.28 1868.13 1868.01
vkpeak fp32-vec4 OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20240505 fp32-vec4 a b c bb 400 800 1200 1600 2000 1652.72 1652.47 1652.46 1652.35
vkpeak fp16-scalar OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20240505 fp16-scalar a c b bb 500 1000 1500 2000 2500 2503.32 2502.98 2502.95 2502.82
vkpeak fp16-vec4 OpenBenchmarking.org GFLOPS, More Is Better vkpeak 20240505 fp16-vec4 a b c bb 800 1600 2400 3200 4000 3551.69 3551.19 3551.16 3551.00
vkpeak int32-scalar OpenBenchmarking.org GIOPS, More Is Better vkpeak 20240505 int32-scalar a b c bb 100 200 300 400 500 473.56 473.51 473.50 473.49
OpenVINO GenAI Model: Gemma-7b-int4-ov - Device: CPU - Time Per Output Token OpenBenchmarking.org ms, Fewer Is Better OpenVINO GenAI 2024.5 Model: Gemma-7b-int4-ov - Device: CPU - Time Per Output Token bb c 60 120 180 240 300 222.88 278.26
OpenVINO GenAI Model: Gemma-7b-int4-ov - Device: CPU - Time To First Token OpenBenchmarking.org ms, Fewer Is Better OpenVINO GenAI 2024.5 Model: Gemma-7b-int4-ov - Device: CPU - Time To First Token bb c 200 400 600 800 1000 943.04 1158.18
OpenVINO GenAI Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time Per Output Token OpenBenchmarking.org ms, Fewer Is Better OpenVINO GenAI 2024.5 Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time Per Output Token a bb c 30 60 90 120 150 98.98 100.11 121.95
OpenVINO GenAI Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time To First Token OpenBenchmarking.org ms, Fewer Is Better OpenVINO GenAI 2024.5 Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time To First Token bb a c 100 200 300 400 500 335.04 345.80 473.05
OpenVINO GenAI Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time Per Output Token OpenBenchmarking.org ms, Fewer Is Better OpenVINO GenAI 2024.5 Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time Per Output Token a bb c 20 40 60 80 100 94.57 94.78 104.88
OpenVINO GenAI Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time To First Token OpenBenchmarking.org ms, Fewer Is Better OpenVINO GenAI 2024.5 Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time To First Token a bb c 50 100 150 200 250 191.33 191.74 238.24
OpenVINO GenAI Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU - Time Per Output Token OpenBenchmarking.org ms, Fewer Is Better OpenVINO GenAI 2024.5 Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU - Time Per Output Token a bb c 11 22 33 44 55 44.12 44.28 48.81
OpenVINO GenAI Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU - Time To First Token OpenBenchmarking.org ms, Fewer Is Better OpenVINO GenAI 2024.5 Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU - Time To First Token bb a c 20 40 60 80 100 73.03 80.64 88.24
Phoronix Test Suite v10.8.5