Large Language Models Large Language Models

Various large language model (LLM) AI benchmarks, complementing other AI / machine learning benchmarks within the Phoronix Test Suite / OpenBenchmarking.org.

See how your system performs with this suite using the Phoronix Test Suite. It's as easy as running the phoronix-test-suite benchmark llm command..

Tests In This Suite

  • Llama.cpp

  •         Model: llama-2-7b.Q4_0.gguf
  •         Model: llama-2-13b.Q4_0.gguf
  •         Model: llama-2-70b-chat.Q5_0.gguf

  • Llamafile

  •         Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU
  •         Test: llava-v1.5-7b-q4 - Acceleration: CPU
  •         Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU

Revision History Revision History

pts/llm-1.0.0     Sat, 27 Jan 2024 19:45:47 GMT
Add Large Language Model (LLM) benchmark test suite.