nov

Intel Core i7-1280P testing with a MSI Prestige 14Evo A12M MS-14C6 (E14C6IMS.115 BIOS) and MSI Intel ADL GT2 8GB on Ubuntu 24.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2411271-NE-NOV20712723
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
a
November 26
  4 Hours, 20 Minutes
b
November 26
  3 Hours, 33 Minutes
bb
November 27
  4 Hours, 33 Minutes
c
November 27
  5 Hours, 11 Minutes
Invert Behavior (Only Show Selected Data)
  4 Hours, 24 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


novOpenBenchmarking.orgPhoronix Test SuiteIntel Core i7-1280P @ 4.70GHz (14 Cores / 20 Threads)MSI Prestige 14Evo A12M MS-14C6 (E14C6IMS.115 BIOS)Intel Alder Lake PCH8 x 2GB LPDDR4-4267MT/s SK Hynix H9HCNNNCPMMLXR-1024GB Micron_3400_MTFDKBA1T0TFHMSI Intel ADL GT2 8GBRealtek ALC274Intel Alder Lake-P PCH CNVi WiFiUbuntu 24.106.11.0-rc6-phx (x86_64)GNOME Shell 47.0X Server + Wayland4.6 Mesa 24.2.3-1ubuntu1GCC 14.2.0ext41920x1080ProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerOpenGLCompilerFile-SystemScreen ResolutionNov BenchmarksSystem Logs- Transparent Huge Pages: madvise- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2,rust --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-14-zdkDXv/gcc-14-14.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-14-zdkDXv/gcc-14-14.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x434 - Thermald 2.5.8 - OpenJDK Runtime Environment (build 21.0.5-ea+8-Ubuntu-1)- Python 3.12.7- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Mitigation of Clear Register File + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; RSB filling; PBRSB-eIBRS: SW sequence; BHI: BHI_DIS_S + srbds: Not affected + tsx_async_abort: Not affected

abbbcResult OverviewPhoronix Test Suite100%118%136%154%Llama.cppPalabosOpenVINOBlenderSuperTuxKartRustlsvkpeakRenaissanceACES DGEMMTimed Eigen Compilation

novsupertuxkart: 1920 x 1080 - Low - OpenGL - Steady FPSllama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 512llama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 1024supertuxkart: 1920 x 1080 - Low - Vulkan - Steady FPSpalabos: 100llama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Text Generation 128llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 512palabos: 400llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 1024llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 2048llama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 2048openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUblender: Pabellon Barcelona - CPU-Onlyopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Person Re-Identification Retail FP16 - CPUllama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Text Generation 128openvino: Face Detection Retail FP16-INT8 - CPUblender: Fishy Cat - CPU-Onlyopenvino: Noise Suppression Poconet-Like FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUrenaissance: In-Memory Database Shootoutblender: Classroom - CPU-Onlyopenvino-genai: Gemma-7b-int4-ov - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUrenaissance: Apache Spark Bayesopenvino: Machine Translation EN To DE FP16 - CPUopenvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Face Detection FP16 - CPUllama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 1024openvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUvkpeak: int16-vec4llama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 512llama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Text Generation 128llama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 2048supertuxkart: 1920 x 1080 - Ultimate - Vulkan - Steady FPSblender: BMW27 - CPU-Onlyopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUblender: Junkshop - CPU-Onlyopenvino: Handwritten English Recognition FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUrenaissance: Finagle HTTP Requestsopenvino: Person Detection FP16 - CPUopenvino-genai: Falcon-7b-instruct-int4-ov - CPUopenvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPUopenvino: Person Detection FP16 - CPUsupertuxkart: 1920 x 1080 - Ultimate - OpenGL - Steady FPSsupertuxkart: 1920 x 1080 - Medium - Vulkan - Mostly Stable FPSsupertuxkart: 1920 x 1080 - Ultimate - Vulkan - Mostly Stable FPSrenaissance: Rand Forestrenaissance: Apache Spark PageRanksupertuxkart: 1920 x 1080 - Medium - OpenGL - Steady FPSrenaissance: Scala Dottysupertuxkart: 1920 x 1080 - High - Vulkan - Steady FPSrustls: handshake-resume - TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384rustls: handshake - TLS13_CHACHA20_POLY1305_SHA256vkpeak: int16-scalarsupertuxkart: 1920 x 1080 - Medium - OpenGL - Mostly Stable FPSrustls: handshake-ticket - TLS13_CHACHA20_POLY1305_SHA256supertuxkart: 1920 x 1080 - High - OpenGL - Steady FPSrenaissance: Akka Unbalanced Cobwebbed Treesupertuxkart: 1920 x 1080 - Ultimate - OpenGL - Mostly Stable FPSrustls: handshake-resume - TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256rustls: handshake-ticket - TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256supertuxkart: 1920 x 1080 - Medium - Vulkan - Steady FPSrustls: handshake - TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256rustls: handshake-ticket - TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384supertuxkart: 1920 x 1080 - High - OpenGL - Mostly Stable FPSrustls: handshake - TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384openvino: Vehicle Detection FP16 - CPUrustls: handshake-resume - TLS13_CHACHA20_POLY1305_SHA256supertuxkart: 1920 x 1080 - High - Vulkan - Mostly Stable FPSopenvino: Vehicle Detection FP16 - CPUrenaissance: ALS Movie Lenssupertuxkart: 1920 x 1080 - Low - Vulkan - Mostly Stable FPSopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUsupertuxkart: 1920 x 1080 - Low - OpenGL - Mostly Stable FPSrenaissance: Savina Reactors.IOrenaissance: Gaussian Mixture Modelrenaissance: Genetic Algorithm Using Jenetics + Futuresvkpeak: int32-vec4mt-dgemm: Sustained Floating-Point Ratebuild-eigen: Time To Compilevkpeak: fp32-scalarvkpeak: fp32-vec4vkpeak: fp16-scalarvkpeak: fp16-vec4vkpeak: int32-scalaropenvino-genai: Gemma-7b-int4-ov - CPU - Time Per Output Tokenopenvino-genai: Gemma-7b-int4-ov - CPU - Time To First Tokenopenvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPU - Time Per Output Tokenopenvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPU - Time To First Tokenopenvino-genai: Falcon-7b-instruct-int4-ov - CPU - Time Per Output Tokenopenvino-genai: Falcon-7b-instruct-int4-ov - CPU - Time To First Tokenopenvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPU - Time Per Output Tokenopenvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPU - Time To First Tokenrenaissance: Apache Spark ALSabbbc11313.0912.7725043.31046.1814.0774.925513.713.3412.481.668888.154.01916.893750.57678.84183.9432.526.68.78403.53205.0229.115302.8755.48174.7834.2115.254.27638.2392.4810.11402.53351.1717.795004.2557.8891.165.681919.6561.5128.1352.18245271.3766.62238.66368.8461.05259.964385.913.3810.5722.66439.6155314294570.13063.276550.0245415559.39355.191013.6386106054.04599185.6601082805.9809762.812479526.43356237.686592044.996.28105546.1829762.0114459.432150.76117.51355338.74643.41244.5550.78179.46402147.8031868.441652.722503.323551.69473.5698.98345.894.57191.3344.1280.644614.1113.7615140.83876.4214.8271.134713.7913.41.539570.873.63801.744146.33731.87203.3929.428.15349.6223.6226.716086.2687.92195.0230.6817.054.61745.2350.741285.29372.291.3116.044489.06100.4759.621919.43236235.5573.28217.86322.4764.71246.563884.614.53411.3351302286600.62809.073561.4248445443.4410102.421013.5286112736.73579157.1561154350.71864815.5524710169.47379460.516197635.3100.76111914.7629659.3715204.031852.36114.321355229.64581.11222.8550.7181.143057148.0251868.131652.472502.953551.19473.515914.1313.7624826.5296.4214.150.729513.7713.3913.381.539615.643.62801.964149.86737.31204.429.286.68.09399.23224.6626.595054.4753.664.49196.3730.4816.964.62716.9352.819.991281.77373.561.3115.994504.4157.7100.8359.421609.5661.4228.1852.31211270.0975.74210.75366.2166.33240.714297.214.5710.5522.58410.9150286268624.22922.270596.6229416122.799387.98939.0281104991.4558669.3561079421.74808705.162369571.62355887.326291665.5399.98105168.6728059.8714475.630352.24114.651315360.84616.01230.5542.62181.334112147.9551868.011652.352502.823551473.49222.88943.04100.11335.0494.78191.7444.2873.03477.217.1725141.18774.159.7271.40359.599.369.382.087143.564.791054.243171.54565.21157.14385.0910.48450.68175.6733.814797.6864.223.59157.3837.9313.753.73789.7432.558.21568.68306.991.0819.395415.4648.1583.9271.131919.451.623.6844.05236237.1465.86241.56355.0458.06273.663929.913.019.5320.49454.2552307286601.92815.175573.8244448873.559367.731013.5187105650.04578570.6581083026.43811877.862529594379788.66392487.8294.65105132.0529863.1514302.432050.07119.531355250.64534.21251.9550.72180.516151148.0391868.281652.462502.983551.16473.5278.261158.18121.95473.05104.88238.2448.8188.24OpenBenchmarking.org

SuperTuxKart

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Low - Renderer: OpenGL - Steady FPScbbba306090120150475946113

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 512cbbba481216207.2114.1314.1113.091. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 1024cbbba481216207.1713.7613.7612.771. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

SuperTuxKart

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Low - Renderer: Vulkan - Steady FPScbbba50100150200250251248151250

Palabos

OpenBenchmarking.orgMega Site Updates Per Second, More Is BetterPalabos 2.3Grid Size: 100cbbba102030405041.1926.5340.8443.311. (CXX) g++ options: -std=c++17 -pedantic -O3 -rdynamic -lcrypto -lcurl -lsz -lz -ldl -lm

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Text Generation 128cbbba2468104.156.426.426.181. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 512cbbba481216209.7214.1014.8214.071. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Palabos

OpenBenchmarking.orgMega Site Updates Per Second, More Is BetterPalabos 2.3Grid Size: 400cbbba2040608010071.4050.7371.1374.931. (CXX) g++ options: -std=c++17 -pedantic -O3 -rdynamic -lcrypto -lcurl -lsz -lz -ldl -lm

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 1024cbbba481216209.5913.7713.7913.701. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 2048cbba36912159.3613.3913.341. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 2048cbbba36912159.3813.3813.4012.481. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUcbbba0.4680.9361.4041.8722.342.081.531.531.66MIN: 0.46 / MAX: 11.03MIN: 0.48 / MAX: 4.89MIN: 0.48 / MAX: 5.15MIN: 0.45 / MAX: 6.81. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUcbbba2K4K6K8K10K7143.569615.649570.878888.151. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUcbbba1.07782.15563.23344.31125.3894.793.623.634.01MIN: 1.1 / MAX: 20.47MIN: 1.25 / MAX: 11.17MIN: 1.26 / MAX: 10.8MIN: 1.23 / MAX: 11.411. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Pabellon Barcelona - Compute: CPU-Onlycbbba20040060080010001054.24801.96801.74916.89

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUcbbba90018002700360045003171.544149.864146.333750.571. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Face Detection Retail FP16-INT8 - Device: CPUcbbba160320480640800565.21737.31731.87678.841. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Person Re-Identification Retail FP16 - Device: CPUcbbba4080120160200157.14204.40203.39183.941. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Person Re-Identification Retail FP16 - Device: CPUcbbba91827364538.0029.2829.4232.52MIN: 13.58 / MAX: 150.48MIN: 13.23 / MAX: 56.48MIN: 13.3 / MAX: 50.36MIN: 13.27 / MAX: 98.341. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Text Generation 128cbba2468105.096.606.601. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Text Generation 128

b: The test quit with a non-zero exit status.

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Face Detection Retail FP16-INT8 - Device: CPUcbbba369121510.488.098.158.78MIN: 3.94 / MAX: 72.26MIN: 3.69 / MAX: 17.48MIN: 3.56 / MAX: 16.97MIN: 3.74 / MAX: 28.341. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Fishy Cat - Compute: CPU-Onlycbbba100200300400500450.68399.23349.60403.53

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Noise Suppression Poconet-Like FP16 - Device: CPUcbbba50100150200250175.67224.66223.62205.021. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Noise Suppression Poconet-Like FP16 - Device: CPUcbbba81624324033.8126.5926.7129.11MIN: 13.51 / MAX: 143.78MIN: 13.16 / MAX: 47.31MIN: 13.32 / MAX: 44.78MIN: 13.53 / MAX: 79.91. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

Renaissance

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: In-Memory Database Shootoutcbbba130026003900520065004797.65054.46086.25302.8MIN: 4238.93 / MAX: 5345.86MIN: 4319.98 / MAX: 5749.04MIN: 5581.49 / MAX: 6632.91MIN: 4531.82 / MAX: 5427.64

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Classroom - Compute: CPU-Onlycbbba2004006008001000864.22753.66687.92755.48

OpenVINO GenAI

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: Gemma-7b-int4-ov - Device: CPUcbb1.01032.02063.03094.04125.05153.594.49

Model: Gemma-7b-int4-ov - Device: CPU

a: The test quit with a non-zero exit status.

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Person Vehicle Bike Detection FP16 - Device: CPUcbbba4080120160200157.38196.37195.02174.781. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Person Vehicle Bike Detection FP16 - Device: CPUcbbba91827364537.9330.4830.6834.21MIN: 15.71 / MAX: 152.86MIN: 13.66 / MAX: 56.89MIN: 16.13 / MAX: 55.32MIN: 14.72 / MAX: 152.841. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Machine Translation EN To DE FP16 - Device: CPUcbbba4812162013.7516.9617.0515.251. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Face Detection FP16-INT8 - Device: CPUcbbba1.03952.0793.11854.1585.19753.734.624.614.271. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

Renaissance

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Apache Spark Bayescbbba2004006008001000789.7716.9745.2638.2MIN: 640.59 / MAX: 897.21MIN: 591.68 / MAX: 844.76MIN: 609.15 / MAX: 891.9MIN: 580.8 / MAX: 828.74

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Machine Translation EN To DE FP16 - Device: CPUcbbba90180270360450432.55352.81350.74392.48MIN: 164.06 / MAX: 1770.86MIN: 183.5 / MAX: 837.79MIN: 169.89 / MAX: 756.81MIN: 168.33 / MAX: 1771.011. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenVINO GenAI

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPUcbba36912158.209.9910.10

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Face Detection FP16-INT8 - Device: CPUcbbba300600900120015001568.681281.771285.291402.50MIN: 666.6 / MAX: 9839.79MIN: 663.22 / MAX: 2901.61MIN: 661.66 / MAX: 2931.41MIN: 660.35 / MAX: 5619.271. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Face Detection Retail FP16 - Device: CPUcbbba80160240320400306.99373.56372.29335.001. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Face Detection FP16 - Device: CPUcbbba0.29480.58960.88441.17921.4741.081.311.311.171. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Face Detection Retail FP16 - Device: CPUcbbba51015202519.3915.9916.0417.79MIN: 8.01 / MAX: 78.86MIN: 7.49 / MAX: 39.2MIN: 7.67 / MAX: 35.36MIN: 6.93 / MAX: 78.651. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Face Detection FP16 - Device: CPUcbbba120024003600480060005415.464504.414489.065004.25MIN: 2567.66 / MAX: 21634.63MIN: 2560.7 / MAX: 7228.61MIN: 2543.37 / MAX: 7801.22MIN: 2565.77 / MAX: 11954.251. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 1024cbba132639526548.1557.7057.881. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Road Segmentation ADAS FP16-INT8 - Device: CPUcbbba2040608010083.92100.83100.4791.101. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Road Segmentation ADAS FP16-INT8 - Device: CPUcbbba163248648071.1359.4259.6265.68MIN: 30.21 / MAX: 364.45MIN: 29.99 / MAX: 117.72MIN: 31.69 / MAX: 109.78MIN: 30.63 / MAX: 319.441. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

vkpeak

OpenBenchmarking.orgGIOPS, More Is Bettervkpeak 20240505int16-vec4cbbba4008001200160020001919.401609.561919.431919.65

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 512cbba142842567051.6061.4261.511. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Text Generation 128cbba71421283523.6828.1828.131. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 2048cbba122436486044.0552.3152.181. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

SuperTuxKart

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Ultimate - Renderer: Vulkan - Steady FPScbbba50100150200250236211236245

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: BMW27 - Compute: CPU-Onlycbbba60120180240300237.14270.09235.55271.37

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Handwritten English Recognition FP16-INT8 - Device: CPUcbbba2040608010065.8675.7473.2866.621. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Handwritten English Recognition FP16-INT8 - Device: CPUcbbba50100150200250241.56210.75217.86238.66MIN: 104.83 / MAX: 911.97MIN: 103.37 / MAX: 548.96MIN: 103.9 / MAX: 635.93MIN: 101.28 / MAX: 947.081. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Junkshop - Compute: CPU-Onlycbbba80160240320400355.04366.21322.47368.84

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Handwritten English Recognition FP16 - Device: CPUcbbba153045607558.0666.3364.7161.051. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Handwritten English Recognition FP16 - Device: CPUcbbba60120180240300273.66240.71246.56259.96MIN: 131.85 / MAX: 999.97MIN: 129.63 / MAX: 979.78MIN: 128.61 / MAX: 661.55MIN: 130.23 / MAX: 1000.641. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

Renaissance

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Finagle HTTP Requestscbbba90018002700360045003929.94297.23884.64385.9MIN: 3248.37 / MAX: 4520.84MAX: 4817.4MIN: 3335.79 / MAX: 4399.52MAX: 5421.32

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Person Detection FP16 - Device: CPUcbbba4812162013.0114.5714.5313.381. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenVINO GenAI

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: Falcon-7b-instruct-int4-ov - Device: CPUcbba36912159.5310.5510.57

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPUcbba51015202520.4922.5822.66

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Person Detection FP16 - Device: CPUcbbba100200300400500454.25410.91411.33439.61MIN: 192.15 / MAX: 1904.48MIN: 222.81 / MAX: 845.42MIN: 224.97 / MAX: 963.04MIN: 232.29 / MAX: 1903.581. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

SuperTuxKart

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Ultimate - Renderer: OpenGL - Steady FPScbbba122436486052505155

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Medium - Renderer: Vulkan - Mostly Stable FPScbbba70140210280350307286302314

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Ultimate - Renderer: Vulkan - Mostly Stable FPScbbba60120180240300286268286294

Renaissance

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Random Forestcbbba130260390520650601.9624.2600.6570.1MIN: 554.87 / MAX: 660.27MIN: 564.93 / MAX: 776.27MIN: 560.53 / MAX: 656.17MIN: 534.15 / MAX: 651.47

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Apache Spark PageRankcbbba70014002100280035002815.12922.22809.03063.2MIN: 2628.83 / MAX: 2815.13MIN: 2752.32 / MAX: 3030.18MIN: 2658.75MIN: 2879.98 / MAX: 3230.31

SuperTuxKart

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Medium - Renderer: OpenGL - Steady FPScbbba2040608010075707376

Renaissance

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Scala Dottycbbba130260390520650573.8596.6561.4550.0MIN: 477.81 / MAX: 939.92MIN: 486.85 / MAX: 1078.3MIN: 478.02 / MAX: 968.67MIN: 463.24 / MAX: 928.24

SuperTuxKart

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: High - Renderer: Vulkan - Steady FPScbbba50100150200250244229248245

Rustls

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake-resume - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384cbbba100K200K300K400K500K448873.55416122.79445443.44415559.301. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake - Suite: TLS13_CHACHA20_POLY1305_SHA256cbbba2K4K6K8K10K9367.739387.9810102.429355.191. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

vkpeak

OpenBenchmarking.orgGIOPS, More Is Bettervkpeak 20240505int16-scalarcbbba20040060080010001013.51939.021013.521013.63

SuperTuxKart

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Medium - Renderer: OpenGL - Mostly Stable FPScbbba2040608010087818686

Rustls

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake-ticket - Suite: TLS13_CHACHA20_POLY1305_SHA256cbbba20K40K60K80K100K105650.04104991.40112736.73106054.041. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

SuperTuxKart

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: High - Renderer: OpenGL - Steady FPScbbba132639526557555759

Renaissance

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Akka Unbalanced Cobwebbed Treecbbba2K4K6K8K10K8570.68669.39157.19185.6MIN: 8210.22 / MAX: 9186.21MIN: 8535.62 / MAX: 9221.73MAX: 9628.95MIN: 9185.56 / MAX: 9829.42

SuperTuxKart

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Ultimate - Renderer: OpenGL - Mostly Stable FPScbbba132639526558565660

Rustls

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake-resume - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256cbbba200K400K600K800K1000K1083026.431079421.741154350.711082805.901. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake-ticket - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256cbbba200K400K600K800K1000K811877.86808705.16864815.55809762.811. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

SuperTuxKart

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Medium - Renderer: Vulkan - Steady FPScbbba60120180240300252236247247

Rustls

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256cbbba2K4K6K8K10K9594.009571.6210169.479526.431. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake-ticket - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384cbbba80K160K240K320K400K379788.60355887.32379460.51356237.681. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

SuperTuxKart

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: High - Renderer: OpenGL - Mostly Stable FPScbbba153045607563626165

Rustls

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384cbbba20K40K60K80K100K92487.8291665.5397635.3092044.901. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Vehicle Detection FP16 - Device: CPUcbbba2040608010094.6599.98100.7696.281. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

Rustls

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake-resume - Suite: TLS13_CHACHA20_POLY1305_SHA256cbbba20K40K60K80K100K105132.05105168.67111914.76105546.181. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

SuperTuxKart

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: High - Renderer: Vulkan - Mostly Stable FPScbbba60120180240300298280296297

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Vehicle Detection FP16 - Device: CPUcbbba142842567063.1559.8759.3762.01MIN: 32.01 / MAX: 273.44MIN: 26.15 / MAX: 156.54MIN: 31.87 / MAX: 215.48MIN: 27.87 / MAX: 273.21. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

Renaissance

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: ALS Movie Lenscbbba3K6K9K12K15K14302.414475.615204.014459.4MIN: 13229.02 / MAX: 14790.02MIN: 13363.8 / MAX: 14850.22MIN: 14604.93 / MAX: 15315.73MIN: 13527.85 / MAX: 14809.99

SuperTuxKart

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Low - Renderer: Vulkan - Mostly Stable FPScbbba70140210280350320303318321

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Road Segmentation ADAS FP16 - Device: CPUcbbba122436486050.0752.2452.3650.761. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Road Segmentation ADAS FP16 - Device: CPUcbbba306090120150119.53114.65114.32117.50MIN: 72.87 / MAX: 434.2MIN: 76.78 / MAX: 342.17MIN: 48.61 / MAX: 405.31MIN: 45.67 / MAX: 445.311. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

SuperTuxKart

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Low - Renderer: OpenGL - Mostly Stable FPScbbba306090120150135131135135

Renaissance

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Savina Reactors.IOcbbba110022003300440055005250.65360.85229.65338.7MIN: 5250.57 / MAX: 7316.25MIN: 5360.76 / MAX: 7595.61MAX: 7901.15MAX: 7566.83

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Gaussian Mixture Modelcbbba100020003000400050004534.24616.04581.14643.4MIN: 4412.76 / MAX: 4943.27MAX: 5157.94MIN: 4423.98 / MAX: 5050.76MIN: 4643.38 / MAX: 5248.85

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Genetic Algorithm Using Jenetics + Futurescbbba300600900120015001251.91230.51222.81244.5MIN: 1146.96 / MAX: 1404.63MIN: 1114.96 / MAX: 1356.94MIN: 1123.42 / MAX: 1307.54MIN: 1130.89 / MAX: 1359.65

vkpeak

OpenBenchmarking.orgGIOPS, More Is Bettervkpeak 20240505int32-vec4cbbba120240360480600550.72542.62550.70550.78

ACES DGEMM

OpenBenchmarking.orgGFLOP/s, More Is BetterACES DGEMM 1.0Sustained Floating-Point Ratecbbba4080120160200180.52181.33181.14179.461. (CC) gcc options: -ffast-math -mavx2 -O3 -fopenmp -lopenblas

Timed Eigen Compilation

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Eigen Compilation 3.4.0Time To Compilecbbba306090120150148.04147.96148.03147.80

vkpeak

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20240505fp32-scalarcbbba4008001200160020001868.281868.011868.131868.44

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20240505fp32-vec4cbbba4008001200160020001652.461652.351652.471652.72

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20240505fp16-scalarcbbba50010001500200025002502.982502.822502.952503.32

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20240505fp16-vec4cbbba80016002400320040003551.163551.003551.193551.69

OpenBenchmarking.orgGIOPS, More Is Bettervkpeak 20240505int32-scalarcbbba100200300400500473.50473.49473.51473.56

Renaissance

Test: Apache Spark ALS

a: The test quit with a non-zero exit status.

b: The test quit with a non-zero exit status.

bb: The test quit with a non-zero exit status.

c: The test quit with a non-zero exit status.

101 Results Shown

SuperTuxKart
Llama.cpp:
  CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 512
  CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 1024
SuperTuxKart
Palabos
Llama.cpp:
  CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Text Generation 128
  CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 512
Palabos
Llama.cpp:
  CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 1024
  CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 2048
  CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 2048
OpenVINO:
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU:
    ms
    FPS
  Age Gender Recognition Retail 0013 FP16 - CPU:
    ms
Blender
OpenVINO:
  Age Gender Recognition Retail 0013 FP16 - CPU
  Face Detection Retail FP16-INT8 - CPU
  Person Re-Identification Retail FP16 - CPU
  Person Re-Identification Retail FP16 - CPU
Llama.cpp
OpenVINO
Blender
OpenVINO:
  Noise Suppression Poconet-Like FP16 - CPU:
    FPS
    ms
Renaissance
Blender
OpenVINO GenAI
OpenVINO:
  Person Vehicle Bike Detection FP16 - CPU:
    FPS
    ms
  Machine Translation EN To DE FP16 - CPU:
    FPS
  Face Detection FP16-INT8 - CPU:
    FPS
Renaissance
OpenVINO
OpenVINO GenAI
OpenVINO:
  Face Detection FP16-INT8 - CPU
  Face Detection Retail FP16 - CPU
  Face Detection FP16 - CPU
  Face Detection Retail FP16 - CPU
  Face Detection FP16 - CPU
Llama.cpp
OpenVINO:
  Road Segmentation ADAS FP16-INT8 - CPU:
    FPS
    ms
vkpeak
Llama.cpp:
  CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 512
  CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Text Generation 128
  CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 2048
SuperTuxKart
Blender
OpenVINO:
  Handwritten English Recognition FP16-INT8 - CPU:
    FPS
    ms
Blender
OpenVINO:
  Handwritten English Recognition FP16 - CPU:
    FPS
    ms
Renaissance
OpenVINO
OpenVINO GenAI:
  Falcon-7b-instruct-int4-ov - CPU
  TinyLlama-1.1B-Chat-v1.0 - CPU
OpenVINO
SuperTuxKart:
  1920 x 1080 - Ultimate - OpenGL - Steady FPS
  1920 x 1080 - Medium - Vulkan - Mostly Stable FPS
  1920 x 1080 - Ultimate - Vulkan - Mostly Stable FPS
Renaissance:
  Rand Forest
  Apache Spark PageRank
SuperTuxKart
Renaissance
SuperTuxKart
Rustls:
  handshake-resume - TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384
  handshake - TLS13_CHACHA20_POLY1305_SHA256
vkpeak
SuperTuxKart
Rustls
SuperTuxKart
Renaissance
SuperTuxKart
Rustls:
  handshake-resume - TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256
  handshake-ticket - TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256
SuperTuxKart
Rustls:
  handshake - TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256
  handshake-ticket - TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384
SuperTuxKart
Rustls
OpenVINO
Rustls
SuperTuxKart
OpenVINO
Renaissance
SuperTuxKart
OpenVINO:
  Road Segmentation ADAS FP16 - CPU:
    FPS
    ms
SuperTuxKart
Renaissance:
  Savina Reactors.IO
  Gaussian Mixture Model
  Genetic Algorithm Using Jenetics + Futures
vkpeak
ACES DGEMM
Timed Eigen Compilation
vkpeak:
  fp32-scalar
  fp32-vec4
  fp16-scalar
  fp16-vec4
  int32-scalar