2019 Intel LLVM Clang Compiler Comparison

Tests for a future article by Michael Larabel.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1912190-HU-COREI759690
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Limit displaying results to tests within:

AV1 3 Tests
Bioinformatics 3 Tests
Chess Test Suite 2 Tests
C/C++ Compiler Tests 24 Tests
Compression Tests 2 Tests
CPU Massive 24 Tests
Creator Workloads 13 Tests
Encoding 8 Tests
HPC - High Performance Computing 3 Tests
Imaging 2 Tests
Common Kernel Benchmarks 2 Tests
Multi-Core 19 Tests
Programmer / Developer System Benchmarks 2 Tests
Renderers 3 Tests
Scientific Computing 3 Tests
Server 4 Tests
Server CPU Tests 13 Tests
Single-Threaded 5 Tests
Video Encoding 8 Tests
Common Workstation Benchmarks 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
LLVM Clang 6.0.1
December 19 2019
  3 Hours, 2 Minutes
LLVM Clang 7.1.0
December 18 2019
  3 Hours, 3 Minutes
LLVM Clang 8.0.1
December 18 2019
  3 Hours, 5 Minutes
LLVM Clang 9.0.1
December 18 2019
  3 Hours, 2 Minutes
LLVM Clang 10 20191217
December 17 2019
  3 Hours, 17 Minutes
Invert Hiding All Results Option
  3 Hours, 6 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


2019 Intel LLVM Clang Compiler ComparisonOpenBenchmarking.orgPhoronix Test SuiteIntel Core i7-5960X @ 3.50GHz (8 Cores / 16 Threads)ASRock X99 Extreme3 (P3.70 BIOS)Intel Xeon E7 v3/Xeon16384MB120GB INTEL SSDSC2BW12AMD FirePro V7900 2GBRealtek ALC1150VA2431Intel I218-VUbuntu 19.105.3.0-24-generic (x86_64)GNOME Shell 3.34.1X Server 1.20.5modesetting 1.20.5Clang 10.0.0Clang 9.0.1 + LLVM 9.0.1Clang 8.0.1 + LLVM 8.0.1Clang 7.1.0 + LLVM 7.1.0Clang 6.0.1 + LLVM 6.0.1ext41920x1080ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverCompilersFile-SystemScreen Resolution2019 Intel LLVM Clang Compiler Comparison BenchmarksSystem Logs- CXXFLAGS="-O3 -march=native" CFLAGS="-O3 -march=native"- Optimized build; Default target: x86_64-unknown-linux-gnu; Host CPU: haswell- Scaling Governor: intel_pstate powersave - CPU Microcode: 0x43- LLVM Clang 10 20191217: Python 2.7.17rc1 + Python 3.7.5- itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + tsx_async_abort: Not affected

LLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.1Result OverviewPhoronix Test Suite100%107%114%121%Timed PHP CompilationApache BenchmarkGraphicsMagickHimeno BenchmarkCoremarkC-RayCppPerformanceBenchmarksZstd CompressionebizzyTSCPlibjpeg-turbo tjbenchx264SVT-HEVCXZ Compressionx265asmFishNGINX BenchmarkJohn The RipperTimed HMMer SearchAOBenchVP9 libvpx EncodingPostgreSQL pgbenchMinionSVT-AV1libgav1Tungsten Rendererdav1dTimed MrBayes AnalysisSciMarkSVT-VP9

2019 Intel LLVM Clang Compiler Comparisonaobench: 2048 x 2048 - Total Timeapache: Static Web Page Servingasmfish: 1024 Hash Memory, 26 Depthc-ray: Total Time - 4K, 16 Rays Per Pixelcoremark: CoreMark Size 666 - Iterations Per Secondcpp-perf-bench: Ctypecpp-perf-bench: Math Librarycpp-perf-bench: Function Objectsdav1d: Chimera 1080pdav1d: Summer Nature 4Kdav1d: Summer Nature 1080pebizzy: graphics-magick: Swirlgraphics-magick: Rotategraphics-magick: Sharpengraphics-magick: Resizinggraphics-magick: Noise-Gaussiangraphics-magick: HWB Color Spacehimeno: Poisson Pressure Solverjohn-the-ripper: Blowfishjohn-the-ripper: MD5libgav1: Chimera 1080plibgav1: Summer Nature 4Klibgav1: Summer Nature 1080ptjbench: Decompression Throughputminion: Gracefulminion: Solitaireminion: Quasigroupnginx: Static Web Page Servingpgbench: Buffer Test - Normal Load - Read Onlyscimark2: Compositescimark2: Monte Carloscimark2: Fast Fourier Transformscimark2: Sparse Matrix Multiplyscimark2: Dense LU Matrix Factorizationsvt-av1: Enc Mode 8 - 1080psvt-hevc: 1080p 8-bit YUV To HEVC Video Encodesvt-vp9: VMAF Optimized - Bosphorus 1080psvt-vp9: PSNR/SSIM Optimized - Bosphorus 1080psvt-vp9: Visual Quality Optimized - Bosphorus 1080phmmer: Pfam Database Searchmrbayes: Primate Phylogeny Analysisbuild-php: Time To Compiletscp: AI Chess Performancetungsten: Hairtungsten: Water Caustictungsten: Non-Exponentialtungsten: Volumetric Causticvpxenc: vpxenc VP9 1080p Video Encodex264: H.264 Video Encodingx265: H.265 1080p Video Encodingcompress-xz: Compressing ubuntu-16.04.3-server-i386.img, Compression Level 9compress-zstd: Compressing ubuntu-16.04.3-server-i386.img, Compression Level 19LLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.141.79918326.2721917065127.246212568.23853232.959408.08215.939351.63106.56305.08272998385911280221413145.24452012937738436.3815.8951.73168.24561463.62364986.850014144.57413225528.14148890.9237862114.14555.76455.492828.625219.6223.39535.90102.66110.2581.147.201108.448127.013134533134.900031.16679.8303212.1656110.9857.8434.5232.12820.36442.10920345.0222125493125.180215756.72152734.939408.07616.135354.96106.53304.73278849355841281221123148.07210512937662736.2315.7451.18166.39207863.04010387.056188141.48490225695.32149135.2079482114.81555.78455.312807.845243.4923.45135.88102.90109.5680.827.311109.030115.967135127234.966031.010510.0068512.2433111.0557.3735.1031.59520.82941.60420224.7821716998127.086222924.20303731.093406.92715.998353.14106.57305.15285846365781280221113085.75164712937662336.2515.7650.88167.20458363.47223186.960693139.84275225503.69148726.6996542100.14557.09455.342754.425222.1823.41935.48101.77110.0981.507.302108.616112.170129594835.634631.13599.9548012.2350111.7157.6034.5232.19121.33942.20019824.9622113202127.178228736.34303235.698406.43216.139354.12107.13303.93278134355781279211093098.96807713437648736.2115.7250.94169.25630464.36664086.975667141.39409625579.00147812.1267882103.77557.10459.852771.845218.3823.20835.11102.26110.1780.237.181108.759110.278131262835.248531.46549.9317512.1987110.7856.9534.5932.11120.95341.54919278.2521773169133.539222703.38469435.312407.30016.134352.92105.51300.97284282355771279201092915.16422913377642136.3215.8351.30172.99571564.30626086.677773140.38502225228.44147464.4540752100.40557.24453.812739.175239.8623.28335.06102.84110.6181.147.307109.25299.443130516135.284231.15099.9702412.3110110.2456.2634.4532.17020.938OpenBenchmarking.org

AOBench

AOBench is a lightweight ambient occlusion renderer, written in C. The test profile is using a size of 2048 x 2048. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterAOBenchSize: 2048 x 2048 - Total TimeLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.11020304050SE +/- 0.30, N = 3SE +/- 0.50, N = 6SE +/- 0.08, N = 3SE +/- 0.57, N = 3SE +/- 0.06, N = 341.8042.1141.6042.2041.551. (CC) gcc options: -lm -O3 -march=native

Apache Benchmark

This is a test of ab, which is the Apache benchmark program. This test profile measures how many requests per second a given system can sustain when carrying out 1,000,000 requests with 100 requests being carried out concurrently. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.4.29Static Web Page ServingLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.14K8K12K16K20KSE +/- 149.42, N = 15SE +/- 106.43, N = 3SE +/- 218.99, N = 3SE +/- 250.20, N = 4SE +/- 245.39, N = 318326.2720345.0220224.7819824.9619278.251. (CC) gcc options: -shared -fPIC -pthread -O3 -march=native

asmFish

This is a test of asmFish, an advanced chess benchmark written in Assembly. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgNodes/second, More Is BetterasmFish 2017-09-191024 Hash Memory, 26 DepthLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.15M10M15M20M25MSE +/- 244509.85, N = 3SE +/- 140093.10, N = 3SE +/- 149705.12, N = 3SE +/- 104295.84, N = 3SE +/- 134705.52, N = 32191706522125493217169982211320221773169

C-Ray

This is a test of C-Ray, a simple raytracer designed to test the floating-point CPU performance. This test is multi-threaded (16 threads per core), will shoot 8 rays per pixel for anti-aliasing, and will generate a 1600 x 1200 image. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 1.1Total Time - 4K, 16 Rays Per PixelLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.1306090120150SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 3127.25125.18127.09127.18133.541. (CC) gcc options: -lm -lpthread -O3 -march=native

Coremark

This is a test of EEMBC CoreMark processor benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgIterations/Sec, More Is BetterCoremark 1.0CoreMark Size 666 - Iterations Per SecondLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.150K100K150K200K250KSE +/- 126.38, N = 3SE +/- 238.33, N = 3SE +/- 142.79, N = 3SE +/- 418.39, N = 3SE +/- 38.36, N = 3212568.24215756.72222924.20228736.34222703.381. (CC) gcc options: -O2 -O3 -march=native -lrt" -lrt

CppPerformanceBenchmarks

CppPerformanceBenchmarks is a set of C++ compiler performance benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterCppPerformanceBenchmarks 9Test: CtypeLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.1816243240SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 332.9634.9431.0935.7035.311. (CXX) g++ options: -O3 -march=native -std=c++11

OpenBenchmarking.orgSeconds, Fewer Is BetterCppPerformanceBenchmarks 9Test: Math LibraryLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.190180270360450SE +/- 1.19, N = 3SE +/- 1.36, N = 3SE +/- 0.18, N = 3SE +/- 0.16, N = 3SE +/- 1.15, N = 3408.08408.08406.93406.43407.301. (CXX) g++ options: -O3 -march=native -std=c++11

OpenBenchmarking.orgSeconds, Fewer Is BetterCppPerformanceBenchmarks 9Test: Function ObjectsLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.148121620SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 315.9416.1416.0016.1416.131. (CXX) g++ options: -O3 -march=native -std=c++11

dav1d

Dav1d is an open-source, speedy AV1 video decoder. This test profile times how long it takes to decode sample AV1 video content. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is Betterdav1d 0.5.0Video Input: Chimera 1080pLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.180160240320400SE +/- 2.55, N = 3SE +/- 1.80, N = 3SE +/- 2.43, N = 3SE +/- 0.33, N = 3SE +/- 0.90, N = 3351.63354.96353.14354.12352.92MIN: 267.95 / MAX: 448.44MIN: 268.16 / MAX: 453.67MIN: 267.42 / MAX: 450.26MIN: 269.23 / MAX: 447.72MIN: 269.39 / MAX: 445.71. (CC) gcc options: -O3 -march=native -pthread

OpenBenchmarking.orgFPS, More Is Betterdav1d 0.5.0Video Input: Summer Nature 4KLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.120406080100SE +/- 0.14, N = 3SE +/- 0.10, N = 3SE +/- 0.21, N = 3SE +/- 0.18, N = 3SE +/- 0.51, N = 3106.56106.53106.57107.13105.51MIN: 95.24 / MAX: 114.76MIN: 96.43 / MAX: 114.96MIN: 94.07 / MAX: 115.12MIN: 92.6 / MAX: 115.37MIN: 93.72 / MAX: 114.771. (CC) gcc options: -O3 -march=native -pthread

OpenBenchmarking.orgFPS, More Is Betterdav1d 0.5.0Video Input: Summer Nature 1080pLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.170140210280350SE +/- 0.34, N = 3SE +/- 0.59, N = 3SE +/- 0.62, N = 3SE +/- 0.72, N = 3SE +/- 0.69, N = 3305.08304.73305.15303.93300.97MIN: 263.43 / MAX: 331.34MIN: 251.66 / MAX: 332.09MIN: 252.78 / MAX: 332.07MIN: 252.19 / MAX: 331.33MIN: 225.55 / MAX: 327.761. (CC) gcc options: -O3 -march=native -pthread

ebizzy

This is a test of ebizzy, a program to generate workloads resembling web server workloads. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRecords/s, More Is Betterebizzy 0.3LLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.160K120K180K240K300KSE +/- 2688.53, N = 9SE +/- 3251.33, N = 3SE +/- 3400.35, N = 6SE +/- 2600.36, N = 10SE +/- 3713.82, N = 52729982788492858462781342842821. (CC) gcc options: -pthread -lpthread -O3 -march=native

GraphicsMagick

This is a test of GraphicsMagick with its OpenMP implementation that performs various imaging tests on a sample 6000x4000 pixel JPEG image. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: SwirlLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.1918273645SE +/- 0.33, N = 338353635351. (CC) gcc options: -O3 -march=native -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lbz2 -lxml2 -lz -lm -lpthread

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: RotateLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.11302603905206505915845785785771. (CC) gcc options: -O3 -march=native -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lbz2 -lxml2 -lz -lm -lpthread

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: SharpenLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.1369121512121212121. (CC) gcc options: -O3 -march=native -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lbz2 -lxml2 -lz -lm -lpthread

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: ResizingLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.120406080100SE +/- 0.33, N = 3SE +/- 0.67, N = 380818079791. (CC) gcc options: -O3 -march=native -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lbz2 -lxml2 -lz -lm -lpthread

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: Noise-GaussianLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.151015202522222221201. (CC) gcc options: -O3 -march=native -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lbz2 -lxml2 -lz -lm -lpthread

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: HWB Color SpaceLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.1306090120150SE +/- 1.53, N = 3SE +/- 0.33, N = 31411121111091091. (CC) gcc options: -O3 -march=native -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lbz2 -lxml2 -lz -lm -lpthread

Himeno Benchmark

The Himeno benchmark is a linear solver of pressure Poisson using a point-Jacobi method. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMFLOPS, More Is BetterHimeno Benchmark 3.0Poisson Pressure SolverLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.17001400210028003500SE +/- 1.63, N = 3SE +/- 2.82, N = 3SE +/- 4.88, N = 3SE +/- 3.21, N = 3SE +/- 3.05, N = 33145.243148.073085.753098.972915.161. (CC) gcc options: -O3 -march=native -mavx2

John The Ripper

This is a benchmark of John The Ripper, which is a password cracker. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.9.0-jumbo-1Test: BlowfishLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.130060090012001500SE +/- 0.33, N = 3129312931293134313371. (CC) gcc options: -m64 -lssl -lcrypto -lgmp -pthread -lm -lz -ldl -lcrypt -lbz2 -mavx2 -O3 -march=native -std=gnu89 -Qunused-arguments -funroll-loops

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.9.0-jumbo-1Test: MD5LLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.117K34K51K68K85KSE +/- 92.51, N = 3SE +/- 48.51, N = 3SE +/- 54.41, N = 3SE +/- 160.39, N = 3SE +/- 103.04, N = 377384766277662376487764211. (CC) gcc options: -m64 -lssl -lcrypto -lgmp -pthread -lm -lz -ldl -lcrypt -lbz2 -mavx2 -O3 -march=native -std=gnu89 -Qunused-arguments -funroll-loops

libgav1

Libgav1 is an AV1 decoder developed by Google for AV1 profile 0/1 compliance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is Betterlibgav1 2019-10-05Video Input: Chimera 1080pLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.1816243240SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 336.3836.2336.2536.2136.321. (CXX) g++ options: -O3 -march=native -lpthread

OpenBenchmarking.orgFPS, More Is Betterlibgav1 2019-10-05Video Input: Summer Nature 4KLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.148121620SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 315.8915.7415.7615.7215.831. (CXX) g++ options: -O3 -march=native -lpthread

OpenBenchmarking.orgFPS, More Is Betterlibgav1 2019-10-05Video Input: Summer Nature 1080pLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.11224364860SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.04, N = 3SE +/- 0.08, N = 351.7351.1850.8850.9451.301. (CXX) g++ options: -O3 -march=native -lpthread

libjpeg-turbo tjbench

tjbench is a JPEG decompression/compression benchmark part of libjpeg-turbo. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMegapixels/sec, More Is Betterlibjpeg-turbo tjbench 2.0.2Test: Decompression ThroughputLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.14080120160200SE +/- 0.22, N = 3SE +/- 0.72, N = 3SE +/- 0.67, N = 3SE +/- 0.50, N = 3SE +/- 0.29, N = 3168.25166.39167.20169.26173.00-lm-lm-lm1. (CC) gcc options: -O3 -march=native -rdynamic

Minion

Minion is an open-source constraint solver that is designed to be very scalable. This test profile uses Minion's integrated benchmarking problems to solve. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterMinion 1.8Benchmark: GracefulLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.11428425670SE +/- 0.14, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 363.6263.0463.4764.3764.311. (CXX) g++ options: -std=gnu++11 -O3 -fomit-frame-pointer -rdynamic

OpenBenchmarking.orgSeconds, Fewer Is BetterMinion 1.8Benchmark: SolitaireLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.120406080100SE +/- 0.13, N = 3SE +/- 0.15, N = 3SE +/- 0.15, N = 3SE +/- 0.15, N = 3SE +/- 0.07, N = 386.8587.0686.9686.9886.681. (CXX) g++ options: -std=gnu++11 -O3 -fomit-frame-pointer -rdynamic

OpenBenchmarking.orgSeconds, Fewer Is BetterMinion 1.8Benchmark: QuasigroupLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.1306090120150SE +/- 1.97, N = 4SE +/- 0.19, N = 3SE +/- 0.18, N = 3SE +/- 0.14, N = 3SE +/- 0.05, N = 3144.57141.48139.84141.39140.391. (CXX) g++ options: -std=gnu++11 -O3 -fomit-frame-pointer -rdynamic

NGINX Benchmark

This is a test of ab, which is the Apache Benchmark program running against nginx. This test profile measures how many requests per second a given system can sustain when carrying out 2,000,000 requests with 500 requests being carried out concurrently. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterNGINX Benchmark 1.9.9Static Web Page ServingLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.16K12K18K24K30KSE +/- 296.45, N = 3SE +/- 42.55, N = 3SE +/- 159.38, N = 3SE +/- 71.67, N = 3SE +/- 196.08, N = 325528.1425695.3225503.6925579.0025228.441. (CC) gcc options: -lpthread -lcrypt -lcrypto -lz -O3 -march=native

PostgreSQL pgbench

This is a simple benchmark of PostgreSQL using pgbench. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 12.0Scaling: Buffer Test - Test: Normal Load - Mode: Read OnlyLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.130K60K90K120K150KSE +/- 324.39, N = 3SE +/- 125.00, N = 3SE +/- 145.94, N = 3SE +/- 53.59, N = 3SE +/- 25.26, N = 3148890.92149135.21148726.70147812.13147464.451. (CC) gcc options: -fno-strict-aliasing -fwrapv -O3 -march=native -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

SciMark

This test runs the ANSI C version of SciMark 2.0, which is a benchmark for scientific and numerical computing developed by programmers at the National Institute of Standards and Technology. This test is made up of Fast Foruier Transform, Jacobi Successive Over-relaxation, Monte Carlo, Sparse Matrix Multiply, and dense LU matrix factorization benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMflops, More Is BetterSciMark 2.0Computational Test: CompositeLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.15001000150020002500SE +/- 1.97, N = 3SE +/- 2.35, N = 3SE +/- 4.23, N = 3SE +/- 0.44, N = 3SE +/- 2.85, N = 32114.142114.812100.142103.772100.401. (CC) gcc options: -O3 -march=native -lm

OpenBenchmarking.orgMflops, More Is BetterSciMark 2.0Computational Test: Monte CarloLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.1120240360480600SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3555.76555.78557.09557.10557.241. (CC) gcc options: -O3 -march=native -lm

OpenBenchmarking.orgMflops, More Is BetterSciMark 2.0Computational Test: Fast Fourier TransformLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.1100200300400500SE +/- 0.64, N = 3SE +/- 1.74, N = 3SE +/- 0.86, N = 3SE +/- 1.14, N = 3SE +/- 0.35, N = 3455.49455.31455.34459.85453.811. (CC) gcc options: -O3 -march=native -lm

OpenBenchmarking.orgMflops, More Is BetterSciMark 2.0Computational Test: Sparse Matrix MultiplyLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.16001200180024003000SE +/- 9.09, N = 3SE +/- 6.04, N = 3SE +/- 1.60, N = 3SE +/- 3.36, N = 3SE +/- 6.59, N = 32828.622807.842754.422771.842739.171. (CC) gcc options: -O3 -march=native -lm

OpenBenchmarking.orgMflops, More Is BetterSciMark 2.0Computational Test: Dense LU Matrix FactorizationLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.111002200330044005500SE +/- 1.21, N = 3SE +/- 14.87, N = 3SE +/- 19.54, N = 3SE +/- 2.17, N = 3SE +/- 11.11, N = 35219.625243.495222.185218.385239.861. (CC) gcc options: -O3 -march=native -lm

SVT-AV1

This is a test of the Intel Open Visual Cloud Scalable Video Technology SVT-AV1 CPU-based multi-threaded video encoder for the AV1 video format with a sample 1080p YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 0.7Encoder Mode: Enc Mode 8 - Input: 1080pLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.1612182430SE +/- 0.02, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 323.4023.4523.4223.2123.281. (CXX) g++ options: -O3 -march=native -fPIE -fPIC -pie

SVT-HEVC

This is a test of the Intel Open Visual Cloud Scalable Video Technology SVT-HEVC CPU-based multi-threaded video encoder for the HEVC / H.265 video format with a sample 1080p YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-HEVC 1.4.11080p 8-bit YUV To HEVC Video EncodeLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.1816243240SE +/- 0.20, N = 3SE +/- 0.18, N = 3SE +/- 0.15, N = 3SE +/- 0.18, N = 3SE +/- 0.16, N = 335.9035.8835.4835.1135.061. (CC) gcc options: -O3 -march=native -fPIE -fPIC -O2 -pie -rdynamic -lpthread -lrt

SVT-VP9

This is a test of the Intel Open Visual Cloud Scalable Video Technology SVT-VP9 CPU-based multi-threaded video encoder for the VP9 video format with a sample 1080p YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-VP9 0.1Tuning: VMAF Optimized - Input: Bosphorus 1080pLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.120406080100SE +/- 0.99, N = 9SE +/- 0.97, N = 10SE +/- 1.23, N = 6SE +/- 1.03, N = 8SE +/- 1.11, N = 7102.66102.90101.77102.26102.841. (CC) gcc options: -O3 -march=native -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-VP9 0.1Tuning: PSNR/SSIM Optimized - Input: Bosphorus 1080pLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.120406080100SE +/- 0.72, N = 3SE +/- 0.65, N = 3SE +/- 0.72, N = 3SE +/- 1.08, N = 3SE +/- 0.82, N = 3110.25109.56110.09110.17110.611. (CC) gcc options: -O3 -march=native -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-VP9 0.1Tuning: Visual Quality Optimized - Input: Bosphorus 1080pLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.120406080100SE +/- 0.26, N = 3SE +/- 0.32, N = 3SE +/- 0.33, N = 3SE +/- 0.16, N = 3SE +/- 0.11, N = 381.1480.8281.5080.2381.141. (CC) gcc options: -O3 -march=native -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm

Timed HMMer Search

This test searches through the Pfam database of profile hidden markov models. The search finds the domain structure of Drosophila Sevenless protein. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed HMMer Search 2.3.2Pfam Database SearchLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.1246810SE +/- 0.073, N = 3SE +/- 0.088, N = 3SE +/- 0.109, N = 3SE +/- 0.055, N = 3SE +/- 0.085, N = 37.2017.3117.3027.1817.3071. (CC) gcc options: -O3 -march=native -pthread -lhmmer -lsquid -lm

Timed MrBayes Analysis

This test performs a bayesian analysis of a set of primate genome sequences in order to estimate their phylogeny. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MrBayes Analysis 3.2.7Primate Phylogeny AnalysisLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.120406080100SE +/- 0.26, N = 3SE +/- 0.20, N = 3SE +/- 0.34, N = 3SE +/- 0.13, N = 3SE +/- 0.22, N = 3108.45109.03108.62108.76109.251. (CC) gcc options: -mmmx -msse -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -maes -mavx -mfma -mavx2 -mrdrnd -mbmi -mbmi2 -O3 -std=c99 -pedantic -march=native -lm

Timed PHP Compilation

This test times how long it takes to build PHP 5 with the Zend engine. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed PHP Compilation 7.1.9Time To CompileLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.1306090120150SE +/- 0.17, N = 3SE +/- 0.08, N = 3SE +/- 0.23, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3127.01115.97112.17110.2899.441. (CC) gcc options: -O3 -march=native -pedantic -ldl -lz -lm

TSCP

This is a performance test of TSCP, Tom Kerrigan's Simple Chess Program, which has a built-in performance benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgNodes Per Second, More Is BetterTSCP 1.81AI Chess PerformanceLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.1300K600K900K1200K1500KSE +/- 804.66, N = 5SE +/- 812.25, N = 5SE +/- 766.45, N = 5134533113512721295948131262813051611. (CC) gcc options: -O3 -march=native

Tungsten Renderer

Tungsten is a C++ physically based renderer that makes use of Intel's Embree ray tracing library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTungsten Renderer 0.2.2Scene: HairLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.1816243240SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 334.9034.9735.6335.2535.281. (CXX) g++ options: -O3 -march=native -std=c++0x -march=haswell -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mfma -mbmi2 -mno-sse4a -mno-avx -mno-avx2 -mno-xop -mno-fma4 -mno-avx512f -mno-avx512vl -mno-avx512pf -mno-avx512er -mno-avx512cd -mno-avx512dq -mno-avx512bw -mno-avx512ifma -mno-avx512vbmi -rdynamic -ljpeg -lpthread -ldl

OpenBenchmarking.orgSeconds, Fewer Is BetterTungsten Renderer 0.2.2Scene: Water CausticLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.1714212835SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.08, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 331.1731.0131.1431.4731.151. (CXX) g++ options: -O3 -march=native -std=c++0x -march=haswell -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mfma -mbmi2 -mno-sse4a -mno-avx -mno-avx2 -mno-xop -mno-fma4 -mno-avx512f -mno-avx512vl -mno-avx512pf -mno-avx512er -mno-avx512cd -mno-avx512dq -mno-avx512bw -mno-avx512ifma -mno-avx512vbmi -rdynamic -ljpeg -lpthread -ldl

OpenBenchmarking.orgSeconds, Fewer Is BetterTungsten Renderer 0.2.2Scene: Non-ExponentialLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.13691215SE +/- 0.03792, N = 3SE +/- 0.03959, N = 3SE +/- 0.00807, N = 3SE +/- 0.01192, N = 3SE +/- 0.04142, N = 39.8303210.006859.954809.931759.970241. (CXX) g++ options: -O3 -march=native -std=c++0x -march=haswell -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mfma -mbmi2 -mno-sse4a -mno-avx -mno-avx2 -mno-xop -mno-fma4 -mno-avx512f -mno-avx512vl -mno-avx512pf -mno-avx512er -mno-avx512cd -mno-avx512dq -mno-avx512bw -mno-avx512ifma -mno-avx512vbmi -rdynamic -ljpeg -lpthread -ldl

OpenBenchmarking.orgSeconds, Fewer Is BetterTungsten Renderer 0.2.2Scene: Volumetric CausticLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.13691215SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 312.1712.2412.2412.2012.311. (CXX) g++ options: -O3 -march=native -std=c++0x -march=haswell -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mfma -mbmi2 -mno-sse4a -mno-avx -mno-avx2 -mno-xop -mno-fma4 -mno-avx512f -mno-avx512vl -mno-avx512pf -mno-avx512er -mno-avx512cd -mno-avx512dq -mno-avx512bw -mno-avx512ifma -mno-avx512vbmi -rdynamic -ljpeg -lpthread -ldl

VP9 libvpx Encoding

This is a standard video encoding performance test of Google's libvpx library and the vpxenc command for the VP9/WebM format using a sample 1080p video. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterVP9 libvpx Encoding 1.8.1vpxenc VP9 1080p Video EncodeLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.1306090120150SE +/- 2.99, N = 11SE +/- 2.99, N = 11SE +/- 2.81, N = 12SE +/- 2.98, N = 11SE +/- 2.97, N = 11110.98111.05111.71110.78110.241. (CXX) g++ options: -m64 -lm -lpthread -O3 -march=native -fPIC -U_FORTIFY_SOURCE -std=c++11

x264

This is a simple test of the x264 encoder run on the CPU (OpenCL support disabled) with a sample video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betterx264 2018-09-25H.264 Video EncodingLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.11326395265SE +/- 0.70, N = 5SE +/- 0.81, N = 3SE +/- 0.53, N = 10SE +/- 0.64, N = 6SE +/- 0.97, N = 357.8457.3757.6056.9556.261. (CC) gcc options: -ldl -m64 -lm -lpthread -O3 -ffast-math -march=native -std=gnu99 -mstack-alignment=64 -fPIC -fomit-frame-pointer -fno-tree-vectorize

x265

This is a simple test of the x265 encoder run on the CPU with a sample 1080p video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betterx265 3.1.2H.265 1080p Video EncodingLLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.1816243240SE +/- 0.12, N = 3SE +/- 0.33, N = 3SE +/- 0.10, N = 3SE +/- 0.30, N = 3SE +/- 0.14, N = 334.5235.1034.5234.5934.451. (CXX) g++ options: -O3 -march=native -rdynamic -lpthread -lrt -ldl -lnuma

XZ Compression

This test measures the time needed to compress a sample file (an Ubuntu file-system image) using XZ compression. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterXZ Compression 5.2.4Compressing ubuntu-16.04.3-server-i386.img, Compression Level 9LLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.1714212835SE +/- 0.10, N = 3SE +/- 0.14, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 332.1331.6032.1932.1132.171. (CC) gcc options: -pthread -fvisibility=hidden -O3 -march=native

Zstd Compression

This test measures the time needed to compress a sample file (an Ubuntu file-system image) using Zstd compression. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterZstd Compression 1.3.4Compressing ubuntu-16.04.3-server-i386.img, Compression Level 19LLVM Clang 10 20191217LLVM Clang 9.0.1LLVM Clang 8.0.1LLVM Clang 7.1.0LLVM Clang 6.0.1510152025SE +/- 0.16, N = 3SE +/- 0.10, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 320.3620.8321.3420.9520.941. (CC) gcc options: -O3 -march=native -pthread -lz