nov

Intel Core i7-1280P testing with a MSI Prestige 14Evo A12M MS-14C6 (E14C6IMS.115 BIOS) and MSI Intel ADL GT2 8GB on Ubuntu 24.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2411271-NE-NOV20712723
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
a
November 26
  4 Hours, 20 Minutes
b
November 26
  3 Hours, 33 Minutes
bb
November 27
  4 Hours, 33 Minutes
c
November 27
  5 Hours, 11 Minutes
Invert Behavior (Only Show Selected Data)
  4 Hours, 24 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


novOpenBenchmarking.orgPhoronix Test SuiteIntel Core i7-1280P @ 4.70GHz (14 Cores / 20 Threads)MSI Prestige 14Evo A12M MS-14C6 (E14C6IMS.115 BIOS)Intel Alder Lake PCH8 x 2GB LPDDR4-4267MT/s SK Hynix H9HCNNNCPMMLXR-1024GB Micron_3400_MTFDKBA1T0TFHMSI Intel ADL GT2 8GBRealtek ALC274Intel Alder Lake-P PCH CNVi WiFiUbuntu 24.106.11.0-rc6-phx (x86_64)GNOME Shell 47.0X Server + Wayland4.6 Mesa 24.2.3-1ubuntu1GCC 14.2.0ext41920x1080ProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerOpenGLCompilerFile-SystemScreen ResolutionNov BenchmarksSystem Logs- Transparent Huge Pages: madvise- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2,rust --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-14-zdkDXv/gcc-14-14.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-14-zdkDXv/gcc-14-14.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x434 - Thermald 2.5.8 - OpenJDK Runtime Environment (build 21.0.5-ea+8-Ubuntu-1)- Python 3.12.7- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Mitigation of Clear Register File + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; RSB filling; PBRSB-eIBRS: SW sequence; BHI: BHI_DIS_S + srbds: Not affected + tsx_async_abort: Not affected

abbbcResult OverviewPhoronix Test Suite100%118%136%154%Llama.cppPalabosOpenVINOBlenderSuperTuxKartRustlsvkpeakRenaissanceACES DGEMMTimed Eigen Compilation

novrenaissance: Scala Dottysupertuxkart: 1920 x 1080 - Ultimate - OpenGL - Steady FPSrenaissance: Rand Forestsupertuxkart: 1920 x 1080 - High - Vulkan - Steady FPSsupertuxkart: 1920 x 1080 - High - Vulkan - Mostly Stable FPSsupertuxkart: 1920 x 1080 - High - OpenGL - Steady FPSsupertuxkart: 1920 x 1080 - High - OpenGL - Mostly Stable FPSsupertuxkart: 1920 x 1080 - Low - Vulkan - Steady FPSsupertuxkart: 1920 x 1080 - Low - Vulkan - Mostly Stable FPSsupertuxkart: 1920 x 1080 - Low - OpenGL - Steady FPSsupertuxkart: 1920 x 1080 - Low - OpenGL - Mostly Stable FPSrenaissance: ALS Movie Lensrenaissance: Apache Spark Bayessupertuxkart: 1920 x 1080 - Medium - OpenGL - Steady FPSsupertuxkart: 1920 x 1080 - Medium - OpenGL - Mostly Stable FPSrenaissance: Savina Reactors.IOpalabos: 100supertuxkart: 1920 x 1080 - Ultimate - Vulkan - Steady FPSpalabos: 400supertuxkart: 1920 x 1080 - Ultimate - OpenGL - Mostly Stable FPSsupertuxkart: 1920 x 1080 - Ultimate - Vulkan - Mostly Stable FPSsupertuxkart: 1920 x 1080 - Medium - Vulkan - Mostly Stable FPSsupertuxkart: 1920 x 1080 - Medium - Vulkan - Steady FPSrenaissance: Apache Spark PageRankrenaissance: Finagle HTTP Requestsrenaissance: Gaussian Mixture Modelrenaissance: In-Memory Database Shootoutrenaissance: Akka Unbalanced Cobwebbed Treerenaissance: Genetic Algorithm Using Jenetics + Futuresopenvino-genai: Gemma-7b-int4-ov - CPUopenvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPUopenvino-genai: Falcon-7b-instruct-int4-ov - CPUopenvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPUllama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Text Generation 128llama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 512llama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 1024llama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 2048llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Text Generation 128llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 512llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 1024llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 2048llama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Text Generation 128llama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 512llama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 1024llama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 2048openvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUmt-dgemm: Sustained Floating-Point Rateblender: BMW27 - CPU-Onlyblender: Junkshop - CPU-Onlyblender: Classroom - CPU-Onlyblender: Fishy Cat - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlybuild-eigen: Time To Compilevkpeak: fp32-scalarvkpeak: fp32-vec4vkpeak: fp16-scalarvkpeak: fp16-vec4vkpeak: int32-scalarvkpeak: int32-vec4vkpeak: int16-scalarvkpeak: int16-vec4rustls: handshake - TLS13_CHACHA20_POLY1305_SHA256rustls: handshake - TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256rustls: handshake-resume - TLS13_CHACHA20_POLY1305_SHA256rustls: handshake-ticket - TLS13_CHACHA20_POLY1305_SHA256rustls: handshake - TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384rustls: handshake-resume - TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256rustls: handshake-ticket - TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256rustls: handshake-resume - TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384rustls: handshake-ticket - TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384openvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPU - Time To First Tokenopenvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPU - Time Per Output Tokenopenvino-genai: Falcon-7b-instruct-int4-ov - CPU - Time To First Tokenopenvino-genai: Falcon-7b-instruct-int4-ov - CPU - Time Per Output Tokenopenvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPU - Time To First Tokenopenvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPU - Time Per Output Tokenopenvino-genai: Gemma-7b-int4-ov - CPU - Time To First Tokenopenvino-genai: Gemma-7b-int4-ov - CPU - Time Per Output Tokenabbbc550.055570.1245297596525032111313514459.4638.276865338.743.310424574.9255602943142473063.24385.94643.45302.89185.61244.522.6610.5710.16.1813.0912.7712.486.614.0713.713.3428.1361.5157.8852.181.175004.2513.38439.6196.2862.014.271402.533517.7950.76117.5678.848.7891.165.6815.25392.48174.7834.21205.0229.1161.05259.96183.9432.523750.574.0166.62238.668888.151.66179.46402271.37368.84755.48403.53916.89147.8031868.441652.722503.323551.69473.56550.781013.631919.659355.199526.43105546.18106054.0492044.91082805.9809762.81415559.3356237.6880.6444.12191.3394.57345.898.98561.451600.624829657611513184613515204.0745.273865229.640.838723671.1347562863022472809.03884.64581.16086.29157.11222.86.4214.1113.7613.414.8213.791.314489.0614.53411.33100.7659.374.611285.29372.2916.0452.36114.32731.878.15100.4759.6217.05350.74195.0230.68223.6226.7164.71246.56203.3929.424146.333.6373.28217.869570.871.53181.143057235.55322.47687.92349.6801.74148.0251868.131652.472502.953551.19473.51550.71013.521919.4310102.4210169.47111914.76112736.7397635.31154350.71864815.55445443.44379460.51596.650624.222928055622483035913114475.6716.970815360.826.52921150.7295562682862362922.24297.24616.05054.48669.31230.54.4922.5810.559.996.4214.1313.7613.386.614.113.7713.3928.1861.4257.752.311.314504.4114.57410.9199.9859.874.621281.77373.5615.9952.24114.65737.318.09100.8359.4216.96352.81196.3730.48224.6626.5966.33240.71204.429.284149.863.6275.74210.759615.641.53181.334112270.09366.21753.66399.23801.96147.9551868.011652.352502.823551473.49542.62939.021609.569387.989571.62105168.67104991.491665.531079421.74808705.16416122.79355887.3273.0344.28191.7494.78335.04100.11943.04222.88573.852601.924429857632513204713514302.4789.775875250.641.187723671.4035582863072522815.13929.94534.24797.68570.61251.93.5920.499.538.24.157.217.179.385.099.729.599.3623.6851.648.1544.051.085415.4613.01454.2594.6563.153.731568.68306.9919.3950.07119.53565.2110.4883.9271.1313.75432.55157.3837.93175.6733.8158.06273.66157.14383171.544.7965.86241.567143.562.08180.516151237.14355.04864.22450.681054.24148.0391868.281652.462502.983551.16473.5550.721013.511919.49367.739594105132.05105650.0492487.821083026.43811877.86448873.55379788.688.2448.81238.24104.88473.05121.951158.18278.26OpenBenchmarking.org

Renaissance

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Scala Dottyabcbb130260390520650550.0561.4573.8596.6MIN: 463.24 / MAX: 928.24MIN: 478.02 / MAX: 968.67MIN: 477.81 / MAX: 939.92MIN: 486.85 / MAX: 1078.3

SuperTuxKart

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Ultimate - Renderer: OpenGL - Steady FPSacbbb122436486055525150

Renaissance

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Random Forestabcbb130260390520650570.1600.6601.9624.2MIN: 534.15 / MAX: 651.47MIN: 560.53 / MAX: 656.17MIN: 554.87 / MAX: 660.27MIN: 564.93 / MAX: 776.27

SuperTuxKart

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: High - Renderer: Vulkan - Steady FPSbacbb50100150200250248245244229

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: High - Renderer: Vulkan - Mostly Stable FPScabbb60120180240300298297296280

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: High - Renderer: OpenGL - Steady FPSacbbb132639526559575755

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: High - Renderer: OpenGL - Mostly Stable FPSacbbb153045607565636261

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Low - Renderer: Vulkan - Steady FPScabbb50100150200250251250248151

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Low - Renderer: Vulkan - Mostly Stable FPSacbbb70140210280350321320318303

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Low - Renderer: OpenGL - Steady FPSabbcb306090120150113594746

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Low - Renderer: OpenGL - Mostly Stable FPScbabb306090120150135135135131

Renaissance

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: ALS Movie Lenscabbb3K6K9K12K15K14302.414459.414475.615204.0MIN: 13229.02 / MAX: 14790.02MIN: 13527.85 / MAX: 14809.99MIN: 13363.8 / MAX: 14850.22MIN: 14604.93 / MAX: 15315.73

Test: Apache Spark ALS

a: The test quit with a non-zero exit status.

b: The test quit with a non-zero exit status.

bb: The test quit with a non-zero exit status.

c: The test quit with a non-zero exit status.

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Apache Spark Bayesabbbc2004006008001000638.2716.9745.2789.7MIN: 580.8 / MAX: 828.74MIN: 591.68 / MAX: 844.76MIN: 609.15 / MAX: 891.9MIN: 640.59 / MAX: 897.21

SuperTuxKart

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Medium - Renderer: OpenGL - Steady FPSacbbb2040608010076757370

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Medium - Renderer: OpenGL - Mostly Stable FPScbabb2040608010087868681

Renaissance

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Savina Reactors.IObcabb110022003300440055005229.65250.65338.75360.8MAX: 7901.15MIN: 5250.57 / MAX: 7316.25MAX: 7566.83MIN: 5360.76 / MAX: 7595.61

Palabos

OpenBenchmarking.orgMega Site Updates Per Second, More Is BetterPalabos 2.3Grid Size: 100acbbb102030405043.3141.1940.8426.531. (CXX) g++ options: -std=c++17 -pedantic -O3 -rdynamic -lcrypto -lcurl -lsz -lz -ldl -lm

SuperTuxKart

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Ultimate - Renderer: Vulkan - Steady FPSacbbb50100150200250245236236211

Palabos

OpenBenchmarking.orgMega Site Updates Per Second, More Is BetterPalabos 2.3Grid Size: 400acbbb2040608010074.9371.4071.1350.731. (CXX) g++ options: -std=c++17 -pedantic -O3 -rdynamic -lcrypto -lcurl -lsz -lz -ldl -lm

SuperTuxKart

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Ultimate - Renderer: OpenGL - Mostly Stable FPSacbbb132639526560585656

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Ultimate - Renderer: Vulkan - Mostly Stable FPSacbbb60120180240300294286286268

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Medium - Renderer: Vulkan - Mostly Stable FPSacbbb70140210280350314307302286

OpenBenchmarking.orgFrames Per Second, More Is BetterSuperTuxKart 1.5 Beta 1Resolution: 1920 x 1080 - Graphics Effects: Medium - Renderer: Vulkan - Steady FPScbabb60120180240300252247247236

Renaissance

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Apache Spark PageRankbcbba70014002100280035002809.02815.12922.23063.2MIN: 2658.75MIN: 2628.83 / MAX: 2815.13MIN: 2752.32 / MAX: 3030.18MIN: 2879.98 / MAX: 3230.31

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Finagle HTTP Requestsbcbba90018002700360045003884.63929.94297.24385.9MIN: 3335.79 / MAX: 4399.52MIN: 3248.37 / MAX: 4520.84MAX: 4817.4MAX: 5421.32

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Gaussian Mixture Modelcbbba100020003000400050004534.24581.14616.04643.4MIN: 4412.76 / MAX: 4943.27MIN: 4423.98 / MAX: 5050.76MAX: 5157.94MIN: 4643.38 / MAX: 5248.85

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: In-Memory Database Shootoutcbbab130026003900520065004797.65054.45302.86086.2MIN: 4238.93 / MAX: 5345.86MIN: 4319.98 / MAX: 5749.04MIN: 4531.82 / MAX: 5427.64MIN: 5581.49 / MAX: 6632.91

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Akka Unbalanced Cobwebbed Treecbbba2K4K6K8K10K8570.68669.39157.19185.6MIN: 8210.22 / MAX: 9186.21MIN: 8535.62 / MAX: 9221.73MAX: 9628.95MIN: 9185.56 / MAX: 9829.42

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Genetic Algorithm Using Jenetics + Futuresbbbac300600900120015001222.81230.51244.51251.9MIN: 1123.42 / MAX: 1307.54MIN: 1114.96 / MAX: 1356.94MIN: 1130.89 / MAX: 1359.65MIN: 1146.96 / MAX: 1404.63

OpenVINO GenAI

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: Gemma-7b-int4-ov - Device: CPUbbc1.01032.02063.03094.04125.05154.493.59

Model: Gemma-7b-int4-ov - Device: CPU

a: The test quit with a non-zero exit status.

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPUabbc51015202522.6622.5820.49

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: Falcon-7b-instruct-int4-ov - Device: CPUabbc369121510.5710.559.53

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPUabbc369121510.109.998.20

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Text Generation 128bbbac2468106.426.426.184.151. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 512bbbac4812162014.1314.1113.097.211. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 1024bbbac4812162013.7613.7612.777.171. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 2048bbbac369121513.4013.3812.489.381. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Text Generation 128bbac2468106.606.605.091. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Text Generation 128

b: The test quit with a non-zero exit status.

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 512bbbac4812162014.8214.1014.079.721. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 1024bbbac4812162013.7913.7713.709.591. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 2048bbac369121513.3913.349.361. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Text Generation 128bbac71421283528.1828.1323.681. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 512abbc142842567061.5161.4251.601. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 1024abbc132639526557.8857.7048.151. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 2048bbac122436486052.3152.1844.051. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Face Detection FP16 - Device: CPUbbbac0.29480.58960.88441.17921.4741.311.311.171.081. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Face Detection FP16 - Device: CPUbbbac120024003600480060004489.064504.415004.255415.46MIN: 2543.37 / MAX: 7801.22MIN: 2560.7 / MAX: 7228.61MIN: 2565.77 / MAX: 11954.25MIN: 2567.66 / MAX: 21634.631. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Person Detection FP16 - Device: CPUbbbac4812162014.5714.5313.3813.011. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Person Detection FP16 - Device: CPUbbbac100200300400500410.91411.33439.61454.25MIN: 222.81 / MAX: 845.42MIN: 224.97 / MAX: 963.04MIN: 232.29 / MAX: 1903.58MIN: 192.15 / MAX: 1904.481. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Vehicle Detection FP16 - Device: CPUbbbac20406080100100.7699.9896.2894.651. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Vehicle Detection FP16 - Device: CPUbbbac142842567059.3759.8762.0163.15MIN: 31.87 / MAX: 215.48MIN: 26.15 / MAX: 156.54MIN: 27.87 / MAX: 273.2MIN: 32.01 / MAX: 273.441. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Face Detection FP16-INT8 - Device: CPUbbbac1.03952.0793.11854.1585.19754.624.614.273.731. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Face Detection FP16-INT8 - Device: CPUbbbac300600900120015001281.771285.291402.501568.68MIN: 663.22 / MAX: 2901.61MIN: 661.66 / MAX: 2931.41MIN: 660.35 / MAX: 5619.27MIN: 666.6 / MAX: 9839.791. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Face Detection Retail FP16 - Device: CPUbbbac80160240320400373.56372.29335.00306.991. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Face Detection Retail FP16 - Device: CPUbbbac51015202515.9916.0417.7919.39MIN: 7.49 / MAX: 39.2MIN: 7.67 / MAX: 35.36MIN: 6.93 / MAX: 78.65MIN: 8.01 / MAX: 78.861. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Road Segmentation ADAS FP16 - Device: CPUbbbac122436486052.3652.2450.7650.071. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Road Segmentation ADAS FP16 - Device: CPUbbbac306090120150114.32114.65117.50119.53MIN: 48.61 / MAX: 405.31MIN: 76.78 / MAX: 342.17MIN: 45.67 / MAX: 445.31MIN: 72.87 / MAX: 434.21. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Face Detection Retail FP16-INT8 - Device: CPUbbbac160320480640800737.31731.87678.84565.211. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Face Detection Retail FP16-INT8 - Device: CPUbbbac36912158.098.158.7810.48MIN: 3.69 / MAX: 17.48MIN: 3.56 / MAX: 16.97MIN: 3.74 / MAX: 28.34MIN: 3.94 / MAX: 72.261. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Road Segmentation ADAS FP16-INT8 - Device: CPUbbbac20406080100100.83100.4791.1083.921. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Road Segmentation ADAS FP16-INT8 - Device: CPUbbbac163248648059.4259.6265.6871.13MIN: 29.99 / MAX: 117.72MIN: 31.69 / MAX: 109.78MIN: 30.63 / MAX: 319.44MIN: 30.21 / MAX: 364.451. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Machine Translation EN To DE FP16 - Device: CPUbbbac4812162017.0516.9615.2513.751. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Machine Translation EN To DE FP16 - Device: CPUbbbac90180270360450350.74352.81392.48432.55MIN: 169.89 / MAX: 756.81MIN: 183.5 / MAX: 837.79MIN: 168.33 / MAX: 1771.01MIN: 164.06 / MAX: 1770.861. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Person Vehicle Bike Detection FP16 - Device: CPUbbbac4080120160200196.37195.02174.78157.381. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Person Vehicle Bike Detection FP16 - Device: CPUbbbac91827364530.4830.6834.2137.93MIN: 13.66 / MAX: 56.89MIN: 16.13 / MAX: 55.32MIN: 14.72 / MAX: 152.84MIN: 15.71 / MAX: 152.861. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Noise Suppression Poconet-Like FP16 - Device: CPUbbbac50100150200250224.66223.62205.02175.671. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Noise Suppression Poconet-Like FP16 - Device: CPUbbbac81624324026.5926.7129.1133.81MIN: 13.16 / MAX: 47.31MIN: 13.32 / MAX: 44.78MIN: 13.53 / MAX: 79.9MIN: 13.51 / MAX: 143.781. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Handwritten English Recognition FP16 - Device: CPUbbbac153045607566.3364.7161.0558.061. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Handwritten English Recognition FP16 - Device: CPUbbbac60120180240300240.71246.56259.96273.66MIN: 129.63 / MAX: 979.78MIN: 128.61 / MAX: 661.55MIN: 130.23 / MAX: 1000.64MIN: 131.85 / MAX: 999.971. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Person Re-Identification Retail FP16 - Device: CPUbbbac4080120160200204.40203.39183.94157.141. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Person Re-Identification Retail FP16 - Device: CPUbbbac91827364529.2829.4232.5238.00MIN: 13.23 / MAX: 56.48MIN: 13.3 / MAX: 50.36MIN: 13.27 / MAX: 98.34MIN: 13.58 / MAX: 150.481. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUbbbac90018002700360045004149.864146.333750.573171.541. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUbbbac1.07782.15563.23344.31125.3893.623.634.014.79MIN: 1.25 / MAX: 11.17MIN: 1.26 / MAX: 10.8MIN: 1.23 / MAX: 11.41MIN: 1.1 / MAX: 20.471. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Handwritten English Recognition FP16-INT8 - Device: CPUbbbac2040608010075.7473.2866.6265.861. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Handwritten English Recognition FP16-INT8 - Device: CPUbbbac50100150200250210.75217.86238.66241.56MIN: 103.37 / MAX: 548.96MIN: 103.9 / MAX: 635.93MIN: 101.28 / MAX: 947.08MIN: 104.83 / MAX: 911.971. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.5Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUbbbac2K4K6K8K10K9615.649570.878888.157143.561. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.5Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUbbbac0.4680.9361.4041.8722.341.531.531.662.08MIN: 0.48 / MAX: 5.15MIN: 0.48 / MAX: 4.89MIN: 0.45 / MAX: 6.8MIN: 0.46 / MAX: 11.031. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs

ACES DGEMM

OpenBenchmarking.orgGFLOP/s, More Is BetterACES DGEMM 1.0Sustained Floating-Point Ratebbbca4080120160200181.33181.14180.52179.461. (CC) gcc options: -ffast-math -mavx2 -O3 -fopenmp -lopenblas

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: BMW27 - Compute: CPU-Onlybcbba60120180240300235.55237.14270.09271.37

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Junkshop - Compute: CPU-Onlybcbba80160240320400322.47355.04366.21368.84

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Classroom - Compute: CPU-Onlybbbac2004006008001000687.92753.66755.48864.22

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Fishy Cat - Compute: CPU-Onlybbbac100200300400500349.60399.23403.53450.68

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Pabellon Barcelona - Compute: CPU-Onlybbbac2004006008001000801.74801.96916.891054.24

Timed Eigen Compilation

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Eigen Compilation 3.4.0Time To Compileabbbc306090120150147.80147.96148.03148.04

vkpeak

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20240505fp32-scalaracbbb4008001200160020001868.441868.281868.131868.01

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20240505fp32-vec4abcbb4008001200160020001652.721652.471652.461652.35

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20240505fp16-scalaracbbb50010001500200025002503.322502.982502.952502.82

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20240505fp16-vec4abcbb80016002400320040003551.693551.193551.163551.00

OpenBenchmarking.orgGIOPS, More Is Bettervkpeak 20240505int32-scalarabcbb100200300400500473.56473.51473.50473.49

OpenBenchmarking.orgGIOPS, More Is Bettervkpeak 20240505int32-vec4acbbb120240360480600550.78550.72550.70542.62

OpenBenchmarking.orgGIOPS, More Is Bettervkpeak 20240505int16-scalarabcbb20040060080010001013.631013.521013.51939.02

OpenBenchmarking.orgGIOPS, More Is Bettervkpeak 20240505int16-vec4abcbb4008001200160020001919.651919.431919.401609.56

Rustls

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake - Suite: TLS13_CHACHA20_POLY1305_SHA256bbbca2K4K6K8K10K10102.429387.989367.739355.191. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256bcbba2K4K6K8K10K10169.479594.009571.629526.431. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake-resume - Suite: TLS13_CHACHA20_POLY1305_SHA256babbc20K40K60K80K100K111914.76105546.18105168.67105132.051. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake-ticket - Suite: TLS13_CHACHA20_POLY1305_SHA256bacbb20K40K60K80K100K112736.73106054.04105650.04104991.401. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384bcabb20K40K60K80K100K97635.3092487.8292044.9091665.531. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake-resume - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256bcabb200K400K600K800K1000K1154350.711083026.431082805.901079421.741. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake-ticket - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256bcabb200K400K600K800K1000K864815.55811877.86809762.81808705.161. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake-resume - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384cbbba100K200K300K400K500K448873.55445443.44416122.79415559.301. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake-ticket - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384cbabb80K160K240K320K400K379788.60379460.51356237.68355887.321. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

101 Results Shown

Renaissance
SuperTuxKart
Renaissance
SuperTuxKart:
  1920 x 1080 - High - Vulkan - Steady FPS
  1920 x 1080 - High - Vulkan - Mostly Stable FPS
  1920 x 1080 - High - OpenGL - Steady FPS
  1920 x 1080 - High - OpenGL - Mostly Stable FPS
  1920 x 1080 - Low - Vulkan - Steady FPS
  1920 x 1080 - Low - Vulkan - Mostly Stable FPS
  1920 x 1080 - Low - OpenGL - Steady FPS
  1920 x 1080 - Low - OpenGL - Mostly Stable FPS
Renaissance:
  ALS Movie Lens
  Apache Spark Bayes
SuperTuxKart:
  1920 x 1080 - Medium - OpenGL - Steady FPS
  1920 x 1080 - Medium - OpenGL - Mostly Stable FPS
Renaissance
Palabos
SuperTuxKart
Palabos
SuperTuxKart:
  1920 x 1080 - Ultimate - OpenGL - Mostly Stable FPS
  1920 x 1080 - Ultimate - Vulkan - Mostly Stable FPS
  1920 x 1080 - Medium - Vulkan - Mostly Stable FPS
  1920 x 1080 - Medium - Vulkan - Steady FPS
Renaissance:
  Apache Spark PageRank
  Finagle HTTP Requests
  Gaussian Mixture Model
  In-Memory Database Shootout
  Akka Unbalanced Cobwebbed Tree
  Genetic Algorithm Using Jenetics + Futures
OpenVINO GenAI:
  Gemma-7b-int4-ov - CPU
  TinyLlama-1.1B-Chat-v1.0 - CPU
  Falcon-7b-instruct-int4-ov - CPU
  Phi-3-mini-128k-instruct-int4-ov - CPU
Llama.cpp:
  CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Text Generation 128
  CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 512
  CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 1024
  CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 2048
  CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Text Generation 128
  CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 512
  CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 1024
  CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 2048
  CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Text Generation 128
  CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 512
  CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 1024
  CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 2048
OpenVINO:
  Face Detection FP16 - CPU:
    FPS
    ms
  Person Detection FP16 - CPU:
    FPS
    ms
  Vehicle Detection FP16 - CPU:
    FPS
    ms
  Face Detection FP16-INT8 - CPU:
    FPS
    ms
  Face Detection Retail FP16 - CPU:
    FPS
    ms
  Road Segmentation ADAS FP16 - CPU:
    FPS
    ms
  Face Detection Retail FP16-INT8 - CPU:
    FPS
    ms
  Road Segmentation ADAS FP16-INT8 - CPU:
    FPS
    ms
  Machine Translation EN To DE FP16 - CPU:
    FPS
    ms
  Person Vehicle Bike Detection FP16 - CPU:
    FPS
    ms
  Noise Suppression Poconet-Like FP16 - CPU:
    FPS
    ms
  Handwritten English Recognition FP16 - CPU:
    FPS
    ms
  Person Re-Identification Retail FP16 - CPU:
    FPS
    ms
  Age Gender Recognition Retail 0013 FP16 - CPU:
    FPS
    ms
  Handwritten English Recognition FP16-INT8 - CPU:
    FPS
    ms
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU:
    FPS
    ms
ACES DGEMM
Blender:
  BMW27 - CPU-Only
  Junkshop - CPU-Only
  Classroom - CPU-Only
  Fishy Cat - CPU-Only
  Pabellon Barcelona - CPU-Only
Timed Eigen Compilation
vkpeak:
  fp32-scalar
  fp32-vec4
  fp16-scalar
  fp16-vec4
  int32-scalar
  int32-vec4
  int16-scalar
  int16-vec4
Rustls:
  handshake - TLS13_CHACHA20_POLY1305_SHA256
  handshake - TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256
  handshake-resume - TLS13_CHACHA20_POLY1305_SHA256
  handshake-ticket - TLS13_CHACHA20_POLY1305_SHA256
  handshake - TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384
  handshake-resume - TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256
  handshake-ticket - TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256
  handshake-resume - TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384
  handshake-ticket - TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384