01sysinfo

Intel Xeon E5-2670 v2 testing with a American Megatrends 4.6.5 and NVIDIA GeForce GTX 650 OEM on Arch Linux via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2410284-NE-01SYSINFO68&grr.

01sysinfoProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDisplay DriverCompilerFile-SystemScreen Resolution01sysinfoIntel Xeon E5-2670 v2 @ 3.30GHz (10 Cores / 20 Threads)American Megatrends 4.6.5Intel Xeon E7 v2/Xeon2 x 16GB DDR3-1600MT/s Samsung M393B2G70DB0-SSD 256GBNVIDIA GeForce GTX 650 OEMRealtek ALC662 rev3HP L2445wRealtek RTL8111/8168/8211/8411Arch Linux6.11.5-arch1-1 (x86_64)nouveauGCC 14.2.1 20240910btrfs1920x1200OpenBenchmarking.org- Transparent Huge Pages: always- Scaling Governor: intel_cpufreq schedutil - CPU Microcode: 0x42e- gather_data_sampling: Not affected + itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + mmio_stale_data: Unknown: No mitigations + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines; IBPB: conditional; IBRS_FW; STIBP: conditional; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

01sysinfollamafile: mistral-7b-instruct-v0.2.Q5_K_M - GPU AUTOllamafile: mistral-7b-instruct-v0.2.Q5_K_M - CPU01sysinfo4.364.36OpenBenchmarking.org

Llamafile

Test: mistral-7b-instruct-v0.2.Q5_K_M - Acceleration: GPU AUTO

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.6Test: mistral-7b-instruct-v0.2.Q5_K_M - Acceleration: GPU AUTO01sysinfo0.9811.9622.9433.9244.905SE +/- 0.00, N = 34.36

Llamafile

Test: mistral-7b-instruct-v0.2.Q5_K_M - Acceleration: CPU

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.6Test: mistral-7b-instruct-v0.2.Q5_K_M - Acceleration: CPU01sysinfo0.9811.9622.9433.9244.905SE +/- 0.01, N = 34.36

Phoronix Test Suite v10.8.5