nov

Intel Core i7-1280P testing with a MSI Prestige 14Evo A12M MS-14C6 (E14C6IMS.115 BIOS) and MSI Intel ADL GT2 8GB on Ubuntu 24.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2411271-NE-NOV20712723
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
a
November 26
  4 Hours, 20 Minutes
b
November 26
  3 Hours, 33 Minutes
bb
November 27
  4 Hours, 33 Minutes
c
November 27
  5 Hours, 11 Minutes
Invert Behavior (Only Show Selected Data)
  4 Hours, 24 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


novOpenBenchmarking.orgPhoronix Test SuiteIntel Core i7-1280P @ 4.70GHz (14 Cores / 20 Threads)MSI Prestige 14Evo A12M MS-14C6 (E14C6IMS.115 BIOS)Intel Alder Lake PCH8 x 2GB LPDDR4-4267MT/s SK Hynix H9HCNNNCPMMLXR-1024GB Micron_3400_MTFDKBA1T0TFHMSI Intel ADL GT2 8GBRealtek ALC274Intel Alder Lake-P PCH CNVi WiFiUbuntu 24.106.11.0-rc6-phx (x86_64)GNOME Shell 47.0X Server + Wayland4.6 Mesa 24.2.3-1ubuntu1GCC 14.2.0ext41920x1080ProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerOpenGLCompilerFile-SystemScreen ResolutionNov BenchmarksSystem Logs- Transparent Huge Pages: madvise- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2,rust --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-14-zdkDXv/gcc-14-14.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-14-zdkDXv/gcc-14-14.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x434 - Thermald 2.5.8 - OpenJDK Runtime Environment (build 21.0.5-ea+8-Ubuntu-1)- Python 3.12.7- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Mitigation of Clear Register File + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; RSB filling; PBRSB-eIBRS: SW sequence; BHI: BHI_DIS_S + srbds: Not affected + tsx_async_abort: Not affected

abbbcResult OverviewPhoronix Test Suite100%118%136%154%Llama.cppPalabosOpenVINOBlenderSuperTuxKartRustlsvkpeakRenaissanceACES DGEMMTimed Eigen Compilation

novllama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 2048llama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 2048blender: Pabellon Barcelona - CPU-Onlyblender: Classroom - CPU-Onlyrustls: handshake-resume - TLS13_CHACHA20_POLY1305_SHA256llama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 1024rustls: handshake-ticket - TLS13_CHACHA20_POLY1305_SHA256rustls: handshake-ticket - TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 1024rustls: handshake-resume - TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384blender: Fishy Cat - CPU-Onlyblender: Junkshop - CPU-Onlyopenvino-genai: Gemma-7b-int4-ov - CPU - Time Per Output Tokenopenvino-genai: Gemma-7b-int4-ov - CPU - Time To First Tokenmt-dgemm: Sustained Floating-Point Raterustls: handshake - TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384llama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 512blender: BMW27 - CPU-Onlyllama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 2048llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 512palabos: 100openvino-genai: Gemma-7b-int4-ov - CPUrustls: handshake - TLS13_CHACHA20_POLY1305_SHA256rustls: handshake - TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256build-eigen: Time To Compilepalabos: 400llama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Text Generation 128vkpeak: int16-vec4vkpeak: int16-scalarvkpeak: int32-vec4vkpeak: int32-scalarvkpeak: fp16-vec4vkpeak: fp16-scalarvkpeak: fp32-vec4vkpeak: fp32-scalaropenvino-genai: Falcon-7b-instruct-int4-ov - CPU - Time Per Output Tokenopenvino-genai: Falcon-7b-instruct-int4-ov - CPU - Time To First Tokenopenvino-genai: Falcon-7b-instruct-int4-ov - CPUllama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 1024rustls: handshake-ticket - TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256renaissance: ALS Movie Lensrustls: handshake-resume - TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Text Generation 128openvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPU - Time Per Output Tokenopenvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPU - Time To First Tokenopenvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPUrenaissance: In-Memory Database Shootoutrenaissance: Apache Spark PageRankrenaissance: Akka Unbalanced Cobwebbed Treeopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUrenaissance: Savina Reactors.IOrenaissance: Gaussian Mixture Modelrenaissance: Finagle HTTP Requestsrenaissance: Apache Spark Bayesopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUrenaissance: Rand Forestrenaissance: Genetic Algorithm Using Jenetics + Futuresrenaissance: Scala Dottyopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPU - Time Per Output Tokenopenvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPU - Time To First Tokenopenvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPUsupertuxkart: 1920 x 1080 - High - Vulkan - Mostly Stable FPSsupertuxkart: 1920 x 1080 - High - Vulkan - Steady FPSsupertuxkart: 1920 x 1080 - Ultimate - Vulkan - Mostly Stable FPSsupertuxkart: 1920 x 1080 - Ultimate - Vulkan - Steady FPSllama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 512supertuxkart: 1920 x 1080 - Low - Vulkan - Mostly Stable FPSsupertuxkart: 1920 x 1080 - Low - Vulkan - Steady FPSsupertuxkart: 1920 x 1080 - Medium - Vulkan - Mostly Stable FPSsupertuxkart: 1920 x 1080 - Medium - Vulkan - Steady FPSsupertuxkart: 1920 x 1080 - High - OpenGL - Mostly Stable FPSsupertuxkart: 1920 x 1080 - High - OpenGL - Steady FPSsupertuxkart: 1920 x 1080 - Low - OpenGL - Mostly Stable FPSsupertuxkart: 1920 x 1080 - Low - OpenGL - Steady FPSsupertuxkart: 1920 x 1080 - Ultimate - OpenGL - Mostly Stable FPSsupertuxkart: 1920 x 1080 - Ultimate - OpenGL - Steady FPSsupertuxkart: 1920 x 1080 - Medium - OpenGL - Mostly Stable FPSsupertuxkart: 1920 x 1080 - Medium - OpenGL - Steady FPSllama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Text Generation 128renaissance: Apache Spark ALSabbbc13.3412.48916.89755.48105546.1812.77106054.04356237.6813.7415559.3403.53368.84179.4640292044.913.09271.3752.1814.0743.31049355.199526.43147.80374.92556.181919.651013.63550.78473.563551.692503.321652.721868.4494.57191.3310.5757.88809762.8114459.41082805.96.698.98345.810.15302.83063.29185.65004.251.175338.74643.44385.9638.21402.54.27570.11244.5550.0439.6113.38392.4815.25259.9661.0565.6891.1238.6666.62117.550.7629.11205.0234.21174.7832.52183.9462.0196.288.78678.8417.793351.668888.154.013750.5744.1280.6422.6629724529424561.5132125031424765591351136055867628.1313.4801.74687.92111914.7613.76112736.73379460.5113.79445443.44349.6322.47181.14305797635.314.11235.5514.8240.838710102.4210169.47148.02571.13476.421919.431013.52550.7473.513551.192502.951652.471868.13864815.5515204.01154350.716086.22809.09157.14489.061.315229.64581.13884.6745.21285.294.61600.61222.8561.4411.3314.53350.7417.05246.5664.7159.62100.47217.8673.28114.3252.3626.71223.6230.68195.0229.42203.3959.37100.768.15731.8716.04372.291.539570.873.634146.332962482862363181513022476157135465651867313.3913.38801.96753.66105168.6713.76104991.4355887.3213.77416122.79399.23366.21222.88943.04181.33411291665.5314.13270.0952.3114.126.5294.499387.989571.62147.95550.72956.421609.56939.02542.62473.4935512502.821652.351868.0194.78191.7410.5557.7808705.1614475.61079421.746.6100.11335.049.995054.42922.28669.34504.411.315360.84616.04297.2716.91281.774.62624.21230.5596.6410.9114.57352.8116.96240.7166.3359.42100.83210.7575.74114.6552.2426.59224.6630.48196.3729.28204.459.8799.988.09737.3115.99373.561.539615.643.624149.8644.2873.0322.5828022926821161.423032482862366255131595650817028.189.369.381054.24864.22105132.057.17105650.04379788.69.59448873.55450.68355.04278.261158.18180.51615192487.827.21237.1444.059.7241.18773.599367.739594148.03971.40354.151919.41013.51550.72473.53551.162502.981652.461868.28104.88238.249.5348.15811877.8614302.41083026.435.09121.95473.058.24797.62815.18570.65415.461.085250.64534.23929.9789.71568.683.73601.91251.9573.8454.2513.01432.5513.75273.6658.0671.1383.92241.5665.86119.5350.0733.81175.6737.93157.3838157.1463.1594.6510.48565.2119.39306.992.087143.564.793171.5448.8188.2420.4929824428623651.63202513072526357135475852877523.68OpenBenchmarking.org

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 2048cabb36912159.3613.3413.391. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 2048cabbb36912159.3812.4813.3813.401. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Pabellon Barcelona - Compute: CPU-Onlycabbb20040060080010001054.24916.89801.96801.74

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Classroom - Compute: CPU-Onlycabbb2004006008001000864.22755.48753.66687.92

Rustls

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake-resume - Suite: TLS13_CHACHA20_POLY1305_SHA256cbbab20K40K60K80K100K105132.05105168.67105546.18111914.761. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 1024cabbb481216207.1712.7713.7613.761. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Rustls

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake-ticket - Suite: TLS13_CHACHA20_POLY1305_SHA256bbcab20K40K60K80K100K104991.40105650.04106054.04112736.731. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake-ticket - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384bbabc80K160K240K320K400K355887.32356237.68379460.51379788.601. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 1024cabbb481216209.5913.7013.7713.791. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Rustls

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake-resume - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384abbbc100K200K300K400K500K415559.30416122.79445443.44448873.551. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Fishy Cat - Compute: CPU-Onlycabbb100200300400500450.68403.53399.23349.60

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Junkshop - Compute: CPU-Onlyabbcb80160240320400368.84366.21355.04322.47

OpenVINO GenAI

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: Gemma-7b-int4-ov - Device: CPU - Time Per Output Tokencbb60120180240300278.26222.88

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: Gemma-7b-int4-ov - Device: CPU - Time To First Tokencbb20040060080010001158.18943.04

ACES DGEMM

OpenBenchmarking.orgGFLOP/s, More Is BetterACES DGEMM 1.0Sustained Floating-Point Rateacbbb4080120160200179.46180.52181.14181.331. (CC) gcc options: -ffast-math -mavx2 -O3 -fopenmp -lopenblas

Rustls

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384bbacb20K40K60K80K100K91665.5392044.9092487.8297635.301. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 512cabbb481216207.2113.0914.1114.131. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: BMW27 - Compute: CPU-Onlyabbcb60120180240300271.37270.09237.14235.55

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 2048cabb122436486044.0552.1852.311. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 512cabbb481216209.7214.0714.1014.821. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Palabos

OpenBenchmarking.orgMega Site Updates Per Second, More Is BetterPalabos 2.3Grid Size: 100bbbca102030405026.5340.8441.1943.311. (CXX) g++ options: -std=c++17 -pedantic -O3 -rdynamic -lcrypto -lcurl -lsz -lz -ldl -lm

OpenVINO GenAI

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: Gemma-7b-int4-ov - Device: CPUcbb1.01032.02063.03094.04125.05153.594.49

Model: Gemma-7b-int4-ov - Device: CPU

a: The test quit with a non-zero exit status.

Rustls

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake - Suite: TLS13_CHACHA20_POLY1305_SHA256acbbb2K4K6K8K10K9355.199367.739387.9810102.421. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256abbcb2K4K6K8K10K9526.439571.629594.0010169.471. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

Timed Eigen Compilation

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Eigen Compilation 3.4.0Time To Compilecbbba306090120150148.04148.03147.96147.80

Palabos

OpenBenchmarking.orgMega Site Updates Per Second, More Is BetterPalabos 2.3Grid Size: 400bbbca2040608010050.7371.1371.4074.931. (CXX) g++ options: -std=c++17 -pedantic -O3 -rdynamic -lcrypto -lcurl -lsz -lz -ldl -lm

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Text Generation 128cabbb2468104.156.186.426.421. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

vkpeak

OpenBenchmarking.orgGIOPS, More Is Bettervkpeak 20240505int16-vec4bbcba4008001200160020001609.561919.401919.431919.65

OpenBenchmarking.orgGIOPS, More Is Bettervkpeak 20240505int16-scalarbbcba2004006008001000939.021013.511013.521013.63

OpenBenchmarking.orgGIOPS, More Is Bettervkpeak 20240505int32-vec4bbbca120240360480600542.62550.70550.72550.78

OpenBenchmarking.orgGIOPS, More Is Bettervkpeak 20240505int32-scalarbbcba100200300400500473.49473.50473.51473.56

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20240505fp16-vec4bbcba80016002400320040003551.003551.163551.193551.69

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20240505fp16-scalarbbbca50010001500200025002502.822502.952502.982503.32

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20240505fp32-vec4bbcba4008001200160020001652.351652.461652.471652.72

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20240505fp32-scalarbbbca4008001200160020001868.011868.131868.281868.44

OpenVINO GenAI

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time Per Output Tokencbba20406080100104.8894.7894.57

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time To First Tokencbba50100150200250238.24191.74191.33

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: Falcon-7b-instruct-int4-ov - Device: CPUcbba36912159.5310.5510.57

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 1024cbba132639526548.1557.7057.881. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Rustls

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake-ticket - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256bbacb200K400K600K800K1000K808705.16809762.81811877.86864815.551. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

Renaissance

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: ALS Movie Lensbbbac3K6K9K12K15K15204.014475.614459.414302.4MIN: 14604.93 / MAX: 15315.73MIN: 13363.8 / MAX: 14850.22MIN: 13527.85 / MAX: 14809.99MIN: 13229.02 / MAX: 14790.02

Rustls

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake-resume - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256bbacb200K400K600K800K1000K1079421.741082805.901083026.431154350.711. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Text Generation 128cabb2468105.096.606.601. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Text Generation 128

b: The test quit with a non-zero exit status.

OpenVINO GenAI

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time Per Output Tokencbba306090120150121.95100.1198.98

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time To First Tokencabb100200300400500473.05345.80335.04

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPUcbba36912158.209.9910.10

Renaissance

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: In-Memory Database Shootoutbabbc130026003900520065006086.25302.85054.44797.6MIN: 5581.49 / MAX: 6632.91MIN: 4531.82 / MAX: 5427.64MIN: 4319.98 / MAX: 5749.04MIN: 4238.93 / MAX: 5345.86

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Apache Spark PageRankabbcb70014002100280035003063.22922.22815.12809.0MIN: 2879.98 / MAX: 3230.31MIN: 2752.32 / MAX: 3030.18MIN: 2628.83 / MAX: 2815.13MIN: 2658.75

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Akka Unbalanced Cobwebbed Treeabbbc2K4K6K8K10K9185.69157.18669.38570.6MIN: 9185.56 / MAX: 9829.42MAX: 9628.95MIN: 8535.62 / MAX: 9221.73MIN: 8210.22 / MAX: 9186.21

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Face Detection FP16 - Device: CPUcabbb120024003600480060005415.465004.254504.414489.06MIN: 2567.66 / MAX: 21634.63MIN: 2565.77 / MAX: 11954.25MIN: 2560.7 / MAX: 7228.61MIN: 2543.37 / MAX: 7801.221. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Face Detection FP16 - Device: CPUcabbb0.29480.58960.88441.17921.4741.081.171.311.311. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

Renaissance

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Savina Reactors.IObbacb110022003300440055005360.85338.75250.65229.6MIN: 5360.76 / MAX: 7595.61MAX: 7566.83MIN: 5250.57 / MAX: 7316.25MAX: 7901.15

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Gaussian Mixture Modelabbbc100020003000400050004643.44616.04581.14534.2MIN: 4643.38 / MAX: 5248.85MAX: 5157.94MIN: 4423.98 / MAX: 5050.76MIN: 4412.76 / MAX: 4943.27

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Finagle HTTP Requestsabbcb90018002700360045004385.94297.23929.93884.6MAX: 5421.32MAX: 4817.4MIN: 3248.37 / MAX: 4520.84MIN: 3335.79 / MAX: 4399.52

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Apache Spark Bayescbbba2004006008001000789.7745.2716.9638.2MIN: 640.59 / MAX: 897.21MIN: 609.15 / MAX: 891.9MIN: 591.68 / MAX: 844.76MIN: 580.8 / MAX: 828.74

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Face Detection FP16-INT8 - Device: CPUcabbb300600900120015001568.681402.501285.291281.77MIN: 666.6 / MAX: 9839.79MIN: 660.35 / MAX: 5619.27MIN: 661.66 / MAX: 2931.41MIN: 663.22 / MAX: 2901.611. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Face Detection FP16-INT8 - Device: CPUcabbb1.03952.0793.11854.1585.19753.734.274.614.621. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

Renaissance

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Random Forestbbcba130260390520650624.2601.9600.6570.1MIN: 564.93 / MAX: 776.27MIN: 554.87 / MAX: 660.27MIN: 560.53 / MAX: 656.17MIN: 534.15 / MAX: 651.47

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Genetic Algorithm Using Jenetics + Futurescabbb300600900120015001251.91244.51230.51222.8MIN: 1146.96 / MAX: 1404.63MIN: 1130.89 / MAX: 1359.65MIN: 1114.96 / MAX: 1356.94MIN: 1123.42 / MAX: 1307.54

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Scala Dottybbcba130260390520650596.6573.8561.4550.0MIN: 486.85 / MAX: 1078.3MIN: 477.81 / MAX: 939.92MIN: 478.02 / MAX: 968.67MIN: 463.24 / MAX: 928.24

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Person Detection FP16 - Device: CPUcabbb100200300400500454.25439.61411.33410.91MIN: 192.15 / MAX: 1904.48MIN: 232.29 / MAX: 1903.58MIN: 224.97 / MAX: 963.04MIN: 222.81 / MAX: 845.421. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Person Detection FP16 - Device: CPUcabbb4812162013.0113.3814.5314.571. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Machine Translation EN To DE FP16 - Device: CPUcabbb90180270360450432.55392.48352.81350.74MIN: 164.06 / MAX: 1770.86MIN: 168.33 / MAX: 1771.01MIN: 183.5 / MAX: 837.79MIN: 169.89 / MAX: 756.811. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Machine Translation EN To DE FP16 - Device: CPUcabbb4812162013.7515.2516.9617.051. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Handwritten English Recognition FP16 - Device: CPUcabbb60120180240300273.66259.96246.56240.71MIN: 131.85 / MAX: 999.97MIN: 130.23 / MAX: 1000.64MIN: 128.61 / MAX: 661.55MIN: 129.63 / MAX: 979.781. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Handwritten English Recognition FP16 - Device: CPUcabbb153045607558.0661.0564.7166.331. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Road Segmentation ADAS FP16-INT8 - Device: CPUcabbb163248648071.1365.6859.6259.42MIN: 30.21 / MAX: 364.45MIN: 30.63 / MAX: 319.44MIN: 31.69 / MAX: 109.78MIN: 29.99 / MAX: 117.721. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Road Segmentation ADAS FP16-INT8 - Device: CPUcabbb2040608010083.9291.10100.47100.831. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Handwritten English Recognition FP16-INT8 - Device: CPUcabbb50100150200250241.56238.66217.86210.75MIN: 104.83 / MAX: 911.97MIN: 101.28 / MAX: 947.08MIN: 103.9 / MAX: 635.93MIN: 103.37 / MAX: 548.961. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Handwritten English Recognition FP16-INT8 - Device: CPUcabbb2040608010065.8666.6273.2875.741. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Road Segmentation ADAS FP16 - Device: CPUcabbb306090120150119.53117.50114.65114.32MIN: 72.87 / MAX: 434.2MIN: 45.67 / MAX: 445.31MIN: 76.78 / MAX: 342.17MIN: 48.61 / MAX: 405.311. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Road Segmentation ADAS FP16 - Device: CPUcabbb122436486050.0750.7652.2452.361. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Noise Suppression Poconet-Like FP16 - Device: CPUcabbb81624324033.8129.1126.7126.59MIN: 13.51 / MAX: 143.78MIN: 13.53 / MAX: 79.9MIN: 13.32 / MAX: 44.78MIN: 13.16 / MAX: 47.311. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Noise Suppression Poconet-Like FP16 - Device: CPUcabbb50100150200250175.67205.02223.62224.661. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Person Vehicle Bike Detection FP16 - Device: CPUcabbb91827364537.9334.2130.6830.48MIN: 15.71 / MAX: 152.86MIN: 14.72 / MAX: 152.84MIN: 16.13 / MAX: 55.32MIN: 13.66 / MAX: 56.891. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Person Vehicle Bike Detection FP16 - Device: CPUcabbb4080120160200157.38174.78195.02196.371. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Person Re-Identification Retail FP16 - Device: CPUcabbb91827364538.0032.5229.4229.28MIN: 13.58 / MAX: 150.48MIN: 13.27 / MAX: 98.34MIN: 13.3 / MAX: 50.36MIN: 13.23 / MAX: 56.481. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Person Re-Identification Retail FP16 - Device: CPUcabbb4080120160200157.14183.94203.39204.401. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Vehicle Detection FP16 - Device: CPUcabbb142842567063.1562.0159.8759.37MIN: 32.01 / MAX: 273.44MIN: 27.87 / MAX: 273.2MIN: 26.15 / MAX: 156.54MIN: 31.87 / MAX: 215.481. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Vehicle Detection FP16 - Device: CPUcabbb2040608010094.6596.2899.98100.761. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Face Detection Retail FP16-INT8 - Device: CPUcabbb369121510.488.788.158.09MIN: 3.94 / MAX: 72.26MIN: 3.74 / MAX: 28.34MIN: 3.56 / MAX: 16.97MIN: 3.69 / MAX: 17.481. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Face Detection Retail FP16-INT8 - Device: CPUcabbb160320480640800565.21678.84731.87737.311. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Face Detection Retail FP16 - Device: CPUcabbb51015202519.3917.7916.0415.99MIN: 8.01 / MAX: 78.86MIN: 6.93 / MAX: 78.65MIN: 7.67 / MAX: 35.36MIN: 7.49 / MAX: 39.21. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Face Detection Retail FP16 - Device: CPUcabbb80160240320400306.99335.00372.29373.561. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUcabbb0.4680.9361.4041.8722.342.081.661.531.53MIN: 0.46 / MAX: 11.03MIN: 0.45 / MAX: 6.8MIN: 0.48 / MAX: 4.89MIN: 0.48 / MAX: 5.151. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUcabbb2K4K6K8K10K7143.568888.159570.879615.641. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUcabbb1.07782.15563.23344.31125.3894.794.013.633.62MIN: 1.1 / MAX: 20.47MIN: 1.23 / MAX: 11.41MIN: 1.26 / MAX: 10.8MIN: 1.25 / MAX: 11.171. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUcabbb90018002700360045003171.543750.574146.334149.861. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenVINO GenAI

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU - Time Per Output Tokencbba112233445548.8144.2844.12

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU - Time To First Tokencabb2040608010088.2480.6473.03

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPUcbba51015202520.4922.5822.66

SuperTuxKart

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: High - Renderer: Vulkan - Mostly Stable FPSbbbac60120180240300280296297298

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: High - Renderer: Vulkan - Steady FPSbbcab50100150200250229244245248

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Ultimate - Renderer: Vulkan - Mostly Stable FPSbbbca60120180240300268286286294

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Ultimate - Renderer: Vulkan - Steady FPSbbbca50100150200250211236236245

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 512cbba142842567051.6061.4261.511. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

SuperTuxKart

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Low - Renderer: Vulkan - Mostly Stable FPSbbbca70140210280350303318320321

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Low - Renderer: Vulkan - Steady FPSbbbac50100150200250151248250251

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Medium - Renderer: Vulkan - Mostly Stable FPSbbbca70140210280350286302307314

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Medium - Renderer: Vulkan - Steady FPSbbabc60120180240300236247247252

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: High - Renderer: OpenGL - Mostly Stable FPSbbbca153045607561626365

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: High - Renderer: OpenGL - Steady FPSbbbca132639526555575759

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Low - Renderer: OpenGL - Mostly Stable FPSbbabc306090120150131135135135

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Low - Renderer: OpenGL - Steady FPSbcbba306090120150464759113

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Ultimate - Renderer: OpenGL - Mostly Stable FPSbbbca132639526556565860

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Ultimate - Renderer: OpenGL - Steady FPSbbbca122436486050515255

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Medium - Renderer: OpenGL - Mostly Stable FPSbbabc2040608010081868687

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Medium - Renderer: OpenGL - Steady FPSbbbca2040608010070737576

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Text Generation 128cabb71421283523.6828.1328.181. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Renaissance

Test: Apache Spark ALS

a: The test quit with a non-zero exit status.

b: The test quit with a non-zero exit status.

bb: The test quit with a non-zero exit status.

c: The test quit with a non-zero exit status.

109 Results Shown

Llama.cpp:
  CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 2048
  CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 2048
Blender:
  Pabellon Barcelona - CPU-Only
  Classroom - CPU-Only
Rustls
Llama.cpp
Rustls:
  handshake-ticket - TLS13_CHACHA20_POLY1305_SHA256
  handshake-ticket - TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384
Llama.cpp
Rustls
Blender:
  Fishy Cat - CPU-Only
  Junkshop - CPU-Only
OpenVINO GenAI:
  Gemma-7b-int4-ov - CPU - Time Per Output Token
  Gemma-7b-int4-ov - CPU - Time To First Token
ACES DGEMM
Rustls
Llama.cpp
Blender
Llama.cpp:
  CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 2048
  CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 512
Palabos
OpenVINO GenAI
Rustls:
  handshake - TLS13_CHACHA20_POLY1305_SHA256
  handshake - TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256
Timed Eigen Compilation
Palabos
Llama.cpp
vkpeak:
  int16-vec4
  int16-scalar
  int32-vec4
  int32-scalar
  fp16-vec4
  fp16-scalar
  fp32-vec4
  fp32-scalar
OpenVINO GenAI:
  Falcon-7b-instruct-int4-ov - CPU - Time Per Output Token
  Falcon-7b-instruct-int4-ov - CPU - Time To First Token
  Falcon-7b-instruct-int4-ov - CPU
Llama.cpp
Rustls
Renaissance
Rustls
Llama.cpp
OpenVINO GenAI:
  Phi-3-mini-128k-instruct-int4-ov - CPU - Time Per Output Token
  Phi-3-mini-128k-instruct-int4-ov - CPU - Time To First Token
  Phi-3-mini-128k-instruct-int4-ov - CPU
Renaissance:
  In-Memory Database Shootout
  Apache Spark PageRank
  Akka Unbalanced Cobwebbed Tree
OpenVINO:
  Face Detection FP16 - CPU:
    ms
    FPS
Renaissance:
  Savina Reactors.IO
  Gaussian Mixture Model
  Finagle HTTP Requests
  Apache Spark Bayes
OpenVINO:
  Face Detection FP16-INT8 - CPU:
    ms
    FPS
Renaissance:
  Rand Forest
  Genetic Algorithm Using Jenetics + Futures
  Scala Dotty
OpenVINO:
  Person Detection FP16 - CPU:
    ms
    FPS
  Machine Translation EN To DE FP16 - CPU:
    ms
    FPS
  Handwritten English Recognition FP16 - CPU:
    ms
    FPS
  Road Segmentation ADAS FP16-INT8 - CPU:
    ms
    FPS
  Handwritten English Recognition FP16-INT8 - CPU:
    ms
    FPS
  Road Segmentation ADAS FP16 - CPU:
    ms
    FPS
  Noise Suppression Poconet-Like FP16 - CPU:
    ms
    FPS
  Person Vehicle Bike Detection FP16 - CPU:
    ms
    FPS
  Person Re-Identification Retail FP16 - CPU:
    ms
    FPS
  Vehicle Detection FP16 - CPU:
    ms
    FPS
  Face Detection Retail FP16-INT8 - CPU:
    ms
    FPS
  Face Detection Retail FP16 - CPU:
    ms
    FPS
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU:
    ms
    FPS
  Age Gender Recognition Retail 0013 FP16 - CPU:
    ms
    FPS
OpenVINO GenAI:
  TinyLlama-1.1B-Chat-v1.0 - CPU - Time Per Output Token
  TinyLlama-1.1B-Chat-v1.0 - CPU - Time To First Token
  TinyLlama-1.1B-Chat-v1.0 - CPU
SuperTuxKart:
  1920 x 1080 - High - Vulkan - Mostly Stable FPS
  1920 x 1080 - High - Vulkan - Steady FPS
  1920 x 1080 - Ultimate - Vulkan - Mostly Stable FPS
  1920 x 1080 - Ultimate - Vulkan - Steady FPS
Llama.cpp
SuperTuxKart:
  1920 x 1080 - Low - Vulkan - Mostly Stable FPS
  1920 x 1080 - Low - Vulkan - Steady FPS
  1920 x 1080 - Medium - Vulkan - Mostly Stable FPS
  1920 x 1080 - Medium - Vulkan - Steady FPS
  1920 x 1080 - High - OpenGL - Mostly Stable FPS
  1920 x 1080 - High - OpenGL - Steady FPS
  1920 x 1080 - Low - OpenGL - Mostly Stable FPS
  1920 x 1080 - Low - OpenGL - Steady FPS
  1920 x 1080 - Ultimate - OpenGL - Mostly Stable FPS
  1920 x 1080 - Ultimate - OpenGL - Steady FPS
  1920 x 1080 - Medium - OpenGL - Mostly Stable FPS
  1920 x 1080 - Medium - OpenGL - Steady FPS
Llama.cpp