2019 Intel LLVM Clang Compiler Comparison

Tests for a future article by Michael Larabel.

HTML result view exported from: https://openbenchmarking.org/result/1912190-HU-COREI759690&grs.

2019 Intel LLVM Clang Compiler ComparisonProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverCompilerFile-SystemScreen ResolutionLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 20191217Intel Core i7-5960X @ 3.50GHz (8 Cores / 16 Threads)ASRock X99 Extreme3 (P3.70 BIOS)Intel Xeon E7 v3/Xeon16384MB120GB INTEL SSDSC2BW12AMD FirePro V7900 2GBRealtek ALC1150VA2431Intel I218-VUbuntu 19.105.3.0-24-generic (x86_64)GNOME Shell 3.34.1X Server 1.20.5modesetting 1.20.5Clang 6.0.1 + LLVM 6.0.1ext41920x1080Clang 7.1.0 + LLVM 7.1.0Clang 8.0.1 + LLVM 8.0.1Clang 9.0.1 + LLVM 9.0.1Clang 10.0.0OpenBenchmarking.orgEnvironment Details- CXXFLAGS="-O3 -march=native" CFLAGS="-O3 -march=native"Compiler Details- Optimized build; Default target: x86_64-unknown-linux-gnu; Host CPU: haswellProcessor Details- Scaling Governor: intel_pstate powersave - CPU Microcode: 0x43Security Details- itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + tsx_async_abort: Not affected Python Details- LLVM Clang 10 20191217: Python 2.7.17rc1 + Python 3.7.5

2019 Intel LLVM Clang Compiler Comparisongraphics-magick: HWB Color Spacebuild-php: Time To Compilecpp-perf-bench: Ctypeapache: Static Web Page Servinggraphics-magick: Noise-Gaussiangraphics-magick: Swirlhimeno: Poisson Pressure Solvercoremark: CoreMark Size 666 - Iterations Per Secondc-ray: Total Time - 4K, 16 Rays Per Pixelcompress-zstd: Compressing ubuntu-16.04.3-server-i386.img, Compression Level 19ebizzy: tscp: AI Chess Performancetjbench: Decompression Throughputjohn-the-ripper: Blowfishminion: Quasigroupscimark2: Sparse Matrix Multiplyx264: H.264 Video Encodinggraphics-magick: Resizinggraphics-magick: Rotatesvt-hevc: 1080p 8-bit YUV To HEVC Video Encodetungsten: Hairminion: Gracefulx265: H.265 1080p Video Encodingcompress-xz: Compressing ubuntu-16.04.3-server-i386.img, Compression Level 9asmfish: 1024 Hash Memory, 26 Depthnginx: Static Web Page Servinghmmer: Pfam Database Searchtungsten: Non-Exponentiallibgav1: Summer Nature 1080psvt-vp9: Visual Quality Optimized - Bosphorus 1080paobench: 2048 x 2048 - Total Timedav1d: Summer Nature 4Ktungsten: Water Causticdav1d: Summer Nature 1080pscimark2: Fast Fourier Transformjohn-the-ripper: MD5cpp-perf-bench: Function Objectstungsten: Volumetric Causticpgbench: Buffer Test - Normal Load - Read Onlysvt-vp9: VMAF Optimized - Bosphorus 1080plibgav1: Summer Nature 4Ksvt-av1: Enc Mode 8 - 1080psvt-vp9: PSNR/SSIM Optimized - Bosphorus 1080pdav1d: Chimera 1080pmrbayes: Primate Phylogeny Analysisscimark2: Compositescimark2: Dense LU Matrix Factorizationlibgav1: Chimera 1080pminion: Solitairecpp-perf-bench: Math Libraryscimark2: Monte Carlographics-magick: Sharpenvpxenc: vpxenc VP9 1080p Video EncodeLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 2019121710999.44335.31219278.2520352915.164229222703.384694133.53920.9382842821305161172.9957151337140.3850222739.1756.267957735.0635.284264.30626034.4532.1702177316925228.447.3079.9702451.3081.1441.549105.5131.1509300.97453.817642116.13412.3110147464.454075102.8415.8323.283110.61352.92109.2522100.405239.8636.3286.677773407.300557.2412110.24109110.27835.69819824.9621353098.968077228736.343032127.17820.9532781341312628169.2563041343141.3940962771.8456.957957835.1135.248564.36664034.5932.1112211320225579.007.1819.9317550.9480.2342.200107.1331.4654303.93459.857648716.13912.1987147812.126788102.2615.7223.208110.17354.12108.7592103.775218.3836.2186.975667406.432557.1012110.78111112.17031.09320224.7822363085.751647222924.203037127.08621.3392858461295948167.2045831293139.8427522754.4257.608057835.4835.634663.47223134.5232.1912171699825503.697.3029.9548050.8881.5041.604106.5731.1359305.15455.347662315.99812.2350148726.699654101.7715.7623.419110.09353.14108.6162100.145222.1836.2586.960693406.927557.0912111.71112115.96734.93920345.0222353148.072105215756.721527125.18020.8292788491351272166.3920781293141.4849022807.8457.378158435.8834.966063.04010335.1031.5952212549325695.327.31110.0068551.1880.8242.109106.5331.0105304.73455.317662716.13512.2433149135.207948102.9015.7423.451109.56354.96109.0302114.815243.4936.2387.056188408.076555.7812111.05141127.01332.95918326.2722383145.244520212568.238532127.24620.3642729981345331168.2456141293144.5741322828.6257.848059135.9034.900063.62364934.5232.1282191706525528.147.2019.8303251.7381.1441.799106.5631.1667305.08455.497738415.93912.1656148890.923786102.6615.8923.395110.25351.63108.4482114.145219.6236.3886.850014408.082555.7612110.98OpenBenchmarking.org

GraphicsMagick

Operation: HWB Color Space

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: HWB Color SpaceLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 20191217306090120150SE +/- 0.33, N = 3SE +/- 1.53, N = 31091091111121411. (CC) gcc options: -O3 -march=native -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lbz2 -lxml2 -lz -lm -lpthread

Timed PHP Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed PHP Compilation 7.1.9Time To CompileLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 20191217306090120150SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.23, N = 3SE +/- 0.08, N = 3SE +/- 0.17, N = 399.44110.28112.17115.97127.011. (CC) gcc options: -O3 -march=native -pedantic -ldl -lz -lm

CppPerformanceBenchmarks

Test: Ctype

OpenBenchmarking.orgSeconds, Fewer Is BetterCppPerformanceBenchmarks 9Test: CtypeLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 20191217816243240SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 335.3135.7031.0934.9432.961. (CXX) g++ options: -O3 -march=native -std=c++11

Apache Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.4.29Static Web Page ServingLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 201912174K8K12K16K20KSE +/- 245.39, N = 3SE +/- 250.20, N = 4SE +/- 218.99, N = 3SE +/- 106.43, N = 3SE +/- 149.42, N = 1519278.2519824.9620224.7820345.0218326.271. (CC) gcc options: -shared -fPIC -pthread -O3 -march=native

GraphicsMagick

Operation: Noise-Gaussian

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: Noise-GaussianLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 2019121751015202520212222221. (CC) gcc options: -O3 -march=native -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lbz2 -lxml2 -lz -lm -lpthread

GraphicsMagick

Operation: Swirl

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: SwirlLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 20191217918273645SE +/- 0.33, N = 335353635381. (CC) gcc options: -O3 -march=native -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lbz2 -lxml2 -lz -lm -lpthread

Himeno Benchmark

Poisson Pressure Solver

OpenBenchmarking.orgMFLOPS, More Is BetterHimeno Benchmark 3.0Poisson Pressure SolverLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 201912177001400210028003500SE +/- 3.05, N = 3SE +/- 3.21, N = 3SE +/- 4.88, N = 3SE +/- 2.82, N = 3SE +/- 1.63, N = 32915.163098.973085.753148.073145.241. (CC) gcc options: -O3 -march=native -mavx2

Coremark

CoreMark Size 666 - Iterations Per Second

OpenBenchmarking.orgIterations/Sec, More Is BetterCoremark 1.0CoreMark Size 666 - Iterations Per SecondLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 2019121750K100K150K200K250KSE +/- 38.36, N = 3SE +/- 418.39, N = 3SE +/- 142.79, N = 3SE +/- 238.33, N = 3SE +/- 126.38, N = 3222703.38228736.34222924.20215756.72212568.241. (CC) gcc options: -O2 -O3 -march=native -lrt" -lrt

C-Ray

Total Time - 4K, 16 Rays Per Pixel

OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 1.1Total Time - 4K, 16 Rays Per PixelLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 20191217306090120150SE +/- 0.06, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 3133.54127.18127.09125.18127.251. (CC) gcc options: -lm -lpthread -O3 -march=native

Zstd Compression

Compressing ubuntu-16.04.3-server-i386.img, Compression Level 19

OpenBenchmarking.orgSeconds, Fewer Is BetterZstd Compression 1.3.4Compressing ubuntu-16.04.3-server-i386.img, Compression Level 19LLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 20191217510152025SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 0.16, N = 320.9420.9521.3420.8320.361. (CC) gcc options: -O3 -march=native -pthread -lz

ebizzy

OpenBenchmarking.orgRecords/s, More Is Betterebizzy 0.3LLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 2019121760K120K180K240K300KSE +/- 3713.82, N = 5SE +/- 2600.36, N = 10SE +/- 3400.35, N = 6SE +/- 3251.33, N = 3SE +/- 2688.53, N = 92842822781342858462788492729981. (CC) gcc options: -pthread -lpthread -O3 -march=native

TSCP

AI Chess Performance

OpenBenchmarking.orgNodes Per Second, More Is BetterTSCP 1.81AI Chess PerformanceLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 20191217300K600K900K1200K1500KSE +/- 766.45, N = 5SE +/- 812.25, N = 5SE +/- 804.66, N = 5130516113126281295948135127213453311. (CC) gcc options: -O3 -march=native

libjpeg-turbo tjbench

Test: Decompression Throughput

OpenBenchmarking.orgMegapixels/sec, More Is Betterlibjpeg-turbo tjbench 2.0.2Test: Decompression ThroughputLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 201912174080120160200SE +/- 0.29, N = 3SE +/- 0.50, N = 3SE +/- 0.67, N = 3SE +/- 0.72, N = 3SE +/- 0.22, N = 3173.00169.26167.20166.39168.25-lm-lm-lm1. (CC) gcc options: -O3 -march=native -rdynamic

John The Ripper

Test: Blowfish

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.9.0-jumbo-1Test: BlowfishLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 2019121730060090012001500SE +/- 0.33, N = 3133713431293129312931. (CC) gcc options: -m64 -lssl -lcrypto -lgmp -pthread -lm -lz -ldl -lcrypt -lbz2 -mavx2 -O3 -march=native -std=gnu89 -Qunused-arguments -funroll-loops

Minion

Benchmark: Quasigroup

OpenBenchmarking.orgSeconds, Fewer Is BetterMinion 1.8Benchmark: QuasigroupLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 20191217306090120150SE +/- 0.05, N = 3SE +/- 0.14, N = 3SE +/- 0.18, N = 3SE +/- 0.19, N = 3SE +/- 1.97, N = 4140.39141.39139.84141.48144.571. (CXX) g++ options: -std=gnu++11 -O3 -fomit-frame-pointer -rdynamic

SciMark

Computational Test: Sparse Matrix Multiply

OpenBenchmarking.orgMflops, More Is BetterSciMark 2.0Computational Test: Sparse Matrix MultiplyLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 201912176001200180024003000SE +/- 6.59, N = 3SE +/- 3.36, N = 3SE +/- 1.60, N = 3SE +/- 6.04, N = 3SE +/- 9.09, N = 32739.172771.842754.422807.842828.621. (CC) gcc options: -O3 -march=native -lm

x264

H.264 Video Encoding

OpenBenchmarking.orgFrames Per Second, More Is Betterx264 2018-09-25H.264 Video EncodingLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 201912171326395265SE +/- 0.97, N = 3SE +/- 0.64, N = 6SE +/- 0.53, N = 10SE +/- 0.81, N = 3SE +/- 0.70, N = 556.2656.9557.6057.3757.841. (CC) gcc options: -ldl -m64 -lm -lpthread -O3 -ffast-math -march=native -std=gnu99 -mstack-alignment=64 -fPIC -fomit-frame-pointer -fno-tree-vectorize

GraphicsMagick

Operation: Resizing

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: ResizingLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 2019121720406080100SE +/- 0.67, N = 3SE +/- 0.33, N = 379798081801. (CC) gcc options: -O3 -march=native -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lbz2 -lxml2 -lz -lm -lpthread

GraphicsMagick

Operation: Rotate

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: RotateLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 201912171302603905206505775785785845911. (CC) gcc options: -O3 -march=native -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lbz2 -lxml2 -lz -lm -lpthread

SVT-HEVC

1080p 8-bit YUV To HEVC Video Encode

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-HEVC 1.4.11080p 8-bit YUV To HEVC Video EncodeLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 20191217816243240SE +/- 0.16, N = 3SE +/- 0.18, N = 3SE +/- 0.15, N = 3SE +/- 0.18, N = 3SE +/- 0.20, N = 335.0635.1135.4835.8835.901. (CC) gcc options: -O3 -march=native -fPIE -fPIC -O2 -pie -rdynamic -lpthread -lrt

Tungsten Renderer

Scene: Hair

OpenBenchmarking.orgSeconds, Fewer Is BetterTungsten Renderer 0.2.2Scene: HairLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 20191217816243240SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 335.2835.2535.6334.9734.901. (CXX) g++ options: -O3 -march=native -std=c++0x -march=haswell -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mfma -mbmi2 -mno-sse4a -mno-avx -mno-avx2 -mno-xop -mno-fma4 -mno-avx512f -mno-avx512vl -mno-avx512pf -mno-avx512er -mno-avx512cd -mno-avx512dq -mno-avx512bw -mno-avx512ifma -mno-avx512vbmi -rdynamic -ljpeg -lpthread -ldl

Minion

Benchmark: Graceful

OpenBenchmarking.orgSeconds, Fewer Is BetterMinion 1.8Benchmark: GracefulLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 201912171428425670SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.14, N = 364.3164.3763.4763.0463.621. (CXX) g++ options: -std=gnu++11 -O3 -fomit-frame-pointer -rdynamic

x265

H.265 1080p Video Encoding

OpenBenchmarking.orgFrames Per Second, More Is Betterx265 3.1.2H.265 1080p Video EncodingLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 20191217816243240SE +/- 0.14, N = 3SE +/- 0.30, N = 3SE +/- 0.10, N = 3SE +/- 0.33, N = 3SE +/- 0.12, N = 334.4534.5934.5235.1034.521. (CXX) g++ options: -O3 -march=native -rdynamic -lpthread -lrt -ldl -lnuma

XZ Compression

Compressing ubuntu-16.04.3-server-i386.img, Compression Level 9

OpenBenchmarking.orgSeconds, Fewer Is BetterXZ Compression 5.2.4Compressing ubuntu-16.04.3-server-i386.img, Compression Level 9LLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 20191217714212835SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.14, N = 3SE +/- 0.10, N = 332.1732.1132.1931.6032.131. (CC) gcc options: -pthread -fvisibility=hidden -O3 -march=native

asmFish

1024 Hash Memory, 26 Depth

OpenBenchmarking.orgNodes/second, More Is BetterasmFish 2017-09-191024 Hash Memory, 26 DepthLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 201912175M10M15M20M25MSE +/- 134705.52, N = 3SE +/- 104295.84, N = 3SE +/- 149705.12, N = 3SE +/- 140093.10, N = 3SE +/- 244509.85, N = 32177316922113202217169982212549321917065

NGINX Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterNGINX Benchmark 1.9.9Static Web Page ServingLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 201912176K12K18K24K30KSE +/- 196.08, N = 3SE +/- 71.67, N = 3SE +/- 159.38, N = 3SE +/- 42.55, N = 3SE +/- 296.45, N = 325228.4425579.0025503.6925695.3225528.141. (CC) gcc options: -lpthread -lcrypt -lcrypto -lz -O3 -march=native

Timed HMMer Search

Pfam Database Search

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed HMMer Search 2.3.2Pfam Database SearchLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 20191217246810SE +/- 0.085, N = 3SE +/- 0.055, N = 3SE +/- 0.109, N = 3SE +/- 0.088, N = 3SE +/- 0.073, N = 37.3077.1817.3027.3117.2011. (CC) gcc options: -O3 -march=native -pthread -lhmmer -lsquid -lm

Tungsten Renderer

Scene: Non-Exponential

OpenBenchmarking.orgSeconds, Fewer Is BetterTungsten Renderer 0.2.2Scene: Non-ExponentialLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 201912173691215SE +/- 0.04142, N = 3SE +/- 0.01192, N = 3SE +/- 0.00807, N = 3SE +/- 0.03959, N = 3SE +/- 0.03792, N = 39.970249.931759.9548010.006859.830321. (CXX) g++ options: -O3 -march=native -std=c++0x -march=haswell -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mfma -mbmi2 -mno-sse4a -mno-avx -mno-avx2 -mno-xop -mno-fma4 -mno-avx512f -mno-avx512vl -mno-avx512pf -mno-avx512er -mno-avx512cd -mno-avx512dq -mno-avx512bw -mno-avx512ifma -mno-avx512vbmi -rdynamic -ljpeg -lpthread -ldl

libgav1

Video Input: Summer Nature 1080p

OpenBenchmarking.orgFPS, More Is Betterlibgav1 2019-10-05Video Input: Summer Nature 1080pLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 201912171224364860SE +/- 0.08, N = 3SE +/- 0.04, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 351.3050.9450.8851.1851.731. (CXX) g++ options: -O3 -march=native -lpthread

SVT-VP9

Tuning: Visual Quality Optimized - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-VP9 0.1Tuning: Visual Quality Optimized - Input: Bosphorus 1080pLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 2019121720406080100SE +/- 0.11, N = 3SE +/- 0.16, N = 3SE +/- 0.33, N = 3SE +/- 0.32, N = 3SE +/- 0.26, N = 381.1480.2381.5080.8281.141. (CC) gcc options: -O3 -march=native -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm

AOBench

Size: 2048 x 2048 - Total Time

OpenBenchmarking.orgSeconds, Fewer Is BetterAOBenchSize: 2048 x 2048 - Total TimeLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 201912171020304050SE +/- 0.06, N = 3SE +/- 0.57, N = 3SE +/- 0.08, N = 3SE +/- 0.50, N = 6SE +/- 0.30, N = 341.5542.2041.6042.1141.801. (CC) gcc options: -lm -O3 -march=native

dav1d

Video Input: Summer Nature 4K

OpenBenchmarking.orgFPS, More Is Betterdav1d 0.5.0Video Input: Summer Nature 4KLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 2019121720406080100SE +/- 0.51, N = 3SE +/- 0.18, N = 3SE +/- 0.21, N = 3SE +/- 0.10, N = 3SE +/- 0.14, N = 3105.51107.13106.57106.53106.56MIN: 93.72 / MAX: 114.77MIN: 92.6 / MAX: 115.37MIN: 94.07 / MAX: 115.12MIN: 96.43 / MAX: 114.96MIN: 95.24 / MAX: 114.761. (CC) gcc options: -O3 -march=native -pthread

Tungsten Renderer

Scene: Water Caustic

OpenBenchmarking.orgSeconds, Fewer Is BetterTungsten Renderer 0.2.2Scene: Water CausticLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 20191217714212835SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.08, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 331.1531.4731.1431.0131.171. (CXX) g++ options: -O3 -march=native -std=c++0x -march=haswell -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mfma -mbmi2 -mno-sse4a -mno-avx -mno-avx2 -mno-xop -mno-fma4 -mno-avx512f -mno-avx512vl -mno-avx512pf -mno-avx512er -mno-avx512cd -mno-avx512dq -mno-avx512bw -mno-avx512ifma -mno-avx512vbmi -rdynamic -ljpeg -lpthread -ldl

dav1d

Video Input: Summer Nature 1080p

OpenBenchmarking.orgFPS, More Is Betterdav1d 0.5.0Video Input: Summer Nature 1080pLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 2019121770140210280350SE +/- 0.69, N = 3SE +/- 0.72, N = 3SE +/- 0.62, N = 3SE +/- 0.59, N = 3SE +/- 0.34, N = 3300.97303.93305.15304.73305.08MIN: 225.55 / MAX: 327.76MIN: 252.19 / MAX: 331.33MIN: 252.78 / MAX: 332.07MIN: 251.66 / MAX: 332.09MIN: 263.43 / MAX: 331.341. (CC) gcc options: -O3 -march=native -pthread

SciMark

Computational Test: Fast Fourier Transform

OpenBenchmarking.orgMflops, More Is BetterSciMark 2.0Computational Test: Fast Fourier TransformLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 20191217100200300400500SE +/- 0.35, N = 3SE +/- 1.14, N = 3SE +/- 0.86, N = 3SE +/- 1.74, N = 3SE +/- 0.64, N = 3453.81459.85455.34455.31455.491. (CC) gcc options: -O3 -march=native -lm

John The Ripper

Test: MD5

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.9.0-jumbo-1Test: MD5LLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 2019121717K34K51K68K85KSE +/- 103.04, N = 3SE +/- 160.39, N = 3SE +/- 54.41, N = 3SE +/- 48.51, N = 3SE +/- 92.51, N = 376421764877662376627773841. (CC) gcc options: -m64 -lssl -lcrypto -lgmp -pthread -lm -lz -ldl -lcrypt -lbz2 -mavx2 -O3 -march=native -std=gnu89 -Qunused-arguments -funroll-loops

CppPerformanceBenchmarks

Test: Function Objects

OpenBenchmarking.orgSeconds, Fewer Is BetterCppPerformanceBenchmarks 9Test: Function ObjectsLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 2019121748121620SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 316.1316.1416.0016.1415.941. (CXX) g++ options: -O3 -march=native -std=c++11

Tungsten Renderer

Scene: Volumetric Caustic

OpenBenchmarking.orgSeconds, Fewer Is BetterTungsten Renderer 0.2.2Scene: Volumetric CausticLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 201912173691215SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 312.3112.2012.2412.2412.171. (CXX) g++ options: -O3 -march=native -std=c++0x -march=haswell -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mfma -mbmi2 -mno-sse4a -mno-avx -mno-avx2 -mno-xop -mno-fma4 -mno-avx512f -mno-avx512vl -mno-avx512pf -mno-avx512er -mno-avx512cd -mno-avx512dq -mno-avx512bw -mno-avx512ifma -mno-avx512vbmi -rdynamic -ljpeg -lpthread -ldl

PostgreSQL pgbench

Scaling: Buffer Test - Test: Normal Load - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 12.0Scaling: Buffer Test - Test: Normal Load - Mode: Read OnlyLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 2019121730K60K90K120K150KSE +/- 25.26, N = 3SE +/- 53.59, N = 3SE +/- 145.94, N = 3SE +/- 125.00, N = 3SE +/- 324.39, N = 3147464.45147812.13148726.70149135.21148890.921. (CC) gcc options: -fno-strict-aliasing -fwrapv -O3 -march=native -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

SVT-VP9

Tuning: VMAF Optimized - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-VP9 0.1Tuning: VMAF Optimized - Input: Bosphorus 1080pLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 2019121720406080100SE +/- 1.11, N = 7SE +/- 1.03, N = 8SE +/- 1.23, N = 6SE +/- 0.97, N = 10SE +/- 0.99, N = 9102.84102.26101.77102.90102.661. (CC) gcc options: -O3 -march=native -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm

libgav1

Video Input: Summer Nature 4K

OpenBenchmarking.orgFPS, More Is Betterlibgav1 2019-10-05Video Input: Summer Nature 4KLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 2019121748121620SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 315.8315.7215.7615.7415.891. (CXX) g++ options: -O3 -march=native -lpthread

SVT-AV1

Encoder Mode: Enc Mode 8 - Input: 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 0.7Encoder Mode: Enc Mode 8 - Input: 1080pLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 20191217612182430SE +/- 0.08, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.02, N = 323.2823.2123.4223.4523.401. (CXX) g++ options: -O3 -march=native -fPIE -fPIC -pie

SVT-VP9

Tuning: PSNR/SSIM Optimized - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-VP9 0.1Tuning: PSNR/SSIM Optimized - Input: Bosphorus 1080pLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 2019121720406080100SE +/- 0.82, N = 3SE +/- 1.08, N = 3SE +/- 0.72, N = 3SE +/- 0.65, N = 3SE +/- 0.72, N = 3110.61110.17110.09109.56110.251. (CC) gcc options: -O3 -march=native -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm

dav1d

Video Input: Chimera 1080p

OpenBenchmarking.orgFPS, More Is Betterdav1d 0.5.0Video Input: Chimera 1080pLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 2019121780160240320400SE +/- 0.90, N = 3SE +/- 0.33, N = 3SE +/- 2.43, N = 3SE +/- 1.80, N = 3SE +/- 2.55, N = 3352.92354.12353.14354.96351.63MIN: 269.39 / MAX: 445.7MIN: 269.23 / MAX: 447.72MIN: 267.42 / MAX: 450.26MIN: 268.16 / MAX: 453.67MIN: 267.95 / MAX: 448.441. (CC) gcc options: -O3 -march=native -pthread

Timed MrBayes Analysis

Primate Phylogeny Analysis

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MrBayes Analysis 3.2.7Primate Phylogeny AnalysisLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 2019121720406080100SE +/- 0.22, N = 3SE +/- 0.13, N = 3SE +/- 0.34, N = 3SE +/- 0.20, N = 3SE +/- 0.26, N = 3109.25108.76108.62109.03108.451. (CC) gcc options: -mmmx -msse -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -maes -mavx -mfma -mavx2 -mrdrnd -mbmi -mbmi2 -O3 -std=c99 -pedantic -march=native -lm

SciMark

Computational Test: Composite

OpenBenchmarking.orgMflops, More Is BetterSciMark 2.0Computational Test: CompositeLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 201912175001000150020002500SE +/- 2.85, N = 3SE +/- 0.44, N = 3SE +/- 4.23, N = 3SE +/- 2.35, N = 3SE +/- 1.97, N = 32100.402103.772100.142114.812114.141. (CC) gcc options: -O3 -march=native -lm

SciMark

Computational Test: Dense LU Matrix Factorization

OpenBenchmarking.orgMflops, More Is BetterSciMark 2.0Computational Test: Dense LU Matrix FactorizationLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 2019121711002200330044005500SE +/- 11.11, N = 3SE +/- 2.17, N = 3SE +/- 19.54, N = 3SE +/- 14.87, N = 3SE +/- 1.21, N = 35239.865218.385222.185243.495219.621. (CC) gcc options: -O3 -march=native -lm

libgav1

Video Input: Chimera 1080p

OpenBenchmarking.orgFPS, More Is Betterlibgav1 2019-10-05Video Input: Chimera 1080pLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 20191217816243240SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 336.3236.2136.2536.2336.381. (CXX) g++ options: -O3 -march=native -lpthread

Minion

Benchmark: Solitaire

OpenBenchmarking.orgSeconds, Fewer Is BetterMinion 1.8Benchmark: SolitaireLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 2019121720406080100SE +/- 0.07, N = 3SE +/- 0.15, N = 3SE +/- 0.15, N = 3SE +/- 0.15, N = 3SE +/- 0.13, N = 386.6886.9886.9687.0686.851. (CXX) g++ options: -std=gnu++11 -O3 -fomit-frame-pointer -rdynamic

CppPerformanceBenchmarks

Test: Math Library

OpenBenchmarking.orgSeconds, Fewer Is BetterCppPerformanceBenchmarks 9Test: Math LibraryLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 2019121790180270360450SE +/- 1.15, N = 3SE +/- 0.16, N = 3SE +/- 0.18, N = 3SE +/- 1.36, N = 3SE +/- 1.19, N = 3407.30406.43406.93408.08408.081. (CXX) g++ options: -O3 -march=native -std=c++11

SciMark

Computational Test: Monte Carlo

OpenBenchmarking.orgMflops, More Is BetterSciMark 2.0Computational Test: Monte CarloLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 20191217120240360480600SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3557.24557.10557.09555.78555.761. (CC) gcc options: -O3 -march=native -lm

GraphicsMagick

Operation: Sharpen

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: SharpenLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 20191217369121512121212121. (CC) gcc options: -O3 -march=native -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lbz2 -lxml2 -lz -lm -lpthread

VP9 libvpx Encoding

vpxenc VP9 1080p Video Encode

OpenBenchmarking.orgFrames Per Second, More Is BetterVP9 libvpx Encoding 1.8.1vpxenc VP9 1080p Video EncodeLLVM Clang 6.0.1LLVM Clang 7.1.0LLVM Clang 8.0.1LLVM Clang 9.0.1LLVM Clang 10 20191217306090120150SE +/- 2.97, N = 11SE +/- 2.98, N = 11SE +/- 2.81, N = 12SE +/- 2.99, N = 11SE +/- 2.99, N = 11110.24110.78111.71111.05110.981. (CXX) g++ options: -m64 -lm -lpthread -O3 -march=native -fPIC -U_FORTIFY_SOURCE -std=c++11

Phoronix Test Suite v10.8.5