Intel 10980XE  GCC Compiler Benchmarks

Intel Core i9-10980XE GCC compiler benchmarking by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2107032-IB-10980XECO53&grs.

Intel 10980XE  GCC Compiler BenchmarksProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLVulkanCompilerFile-SystemScreen ResolutionGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701Intel Core i9-10980XE @ 4.80GHz (18 Cores / 36 Threads)ASRock X299 Steel Legend (P1.30 BIOS)Intel Sky Lake-E DMI3 Registers32GBSamsung SSD 970 PRO 512GBNVIDIA NV132 11GBRealtek ALC1220ASUS VP28UIntel I219-V + Intel I211Ubuntu 21.045.11.0-22-generic (x86_64)GNOME Shell 3.38.4X Server + Waylandnouveau4.3 Mesa 21.0.11.0.2GCC 8.5.0ext42560x1600GCC 9.4.0GCC 10.3.0GCC 11.1.0GCC 12.0.0 20210701OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseEnvironment Details- CXXFLAGS="-O3 -march=native" CFLAGS="-O3 -march=native"Compiler Details- --disable-multilib --enable-checking=release --enable-languages=c,c++Processor Details- Scaling Governor: intel_cpufreq schedutil - CPU Microcode: 0x5003102Python Details- Python 3.9.5Security Details- itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

Intel 10980XE  GCC Compiler Benchmarksgraphics-magick: Sharpenfinancebench: Bonds OpenMPcompress-zstd: 8, Long Mode - Compression Speedespeak: Text-To-Speech Synthesisbotan: ChaCha20Poly1305botan: ChaCha20Poly1305 - Decryptfinancebench: Repo OpenMPgraphics-magick: Swirlonednn: Deconvolution Batch shapes_3d - u8s8f32 - CPUsmallpt: Global Illumination Renderer; 128 Samplesmnn: resnet-v2-50viennacl: CPU BLAS - dGEMM-NNbotan: Twofishviennacl: CPU BLAS - dGEMM-TNviennacl: CPU BLAS - dGEMM-NTviennacl: CPU BLAS - dGEMM-TTbotan: Twofish - Decryptgraphics-magick: Resizingtnn: CPU - MobileNet v2graphics-magick: Rotatebotan: Blowfishmrbayes: Primate Phylogeny Analysisonednn: Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPUbotan: Blowfish - Decryptquantlib: ncnn: CPU-v2-v2 - mobilenet-v2coremark: CoreMark Size 666 - Iterations Per Secondcompress-zstd: 19, Long Mode - Decompression Speedbotan: CAST-256 - Decryptbotan: CAST-256gcrypt: mnn: inception-v3ncnn: CPU - googlenettnn: CPU - SqueezeNet v2ncnn: CPU - efficientnet-b0compress-zstd: 19 - Decompression Speedgraphics-magick: HWB Color Spacencnn: CPU - resnet18ncnn: CPU - mnasnetvpxenc: Speed 5 - Bosphorus 4Kmnn: mobilenetV3webp: Quality 100, Highest Compressioncryptopp: Unkeyed Algorithmsonednn: Recurrent Neural Network Training - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Training - u8s8f32 - CPUonednn: Deconvolution Batch shapes_1d - bf16bf16bf16 - CPUcompress-zstd: 8 - Decompression Speedetcpak: DXT1stockfish: Total Timeonednn: IP Shapes 3D - u8s8f32 - CPUmnn: MobileNetV2_224compress-zstd: 8, Long Mode - Decompression Speedsvt-vp9: VMAF Optimized - Bosphorus 1080pncnn: CPU - resnet50graphics-magick: Noise-Gaussianliquid-dsp: 36 - 256 - 57ncnn: CPU-v3-v3 - mobilenet-v3mnn: SqueezeNetV1.0cryptopp: Keyed Algorithmswebp: Quality 100, Lossless, Highest Compressiondav1d: Chimera 1080p 10-bitncnn: CPU - squeezenet_ssdx265: Bosphorus 4Kdav1d: Summer Nature 4Kvpxenc: Speed 0 - Bosphorus 4Kviennacl: CPU BLAS - sAXPYtnn: CPU - SqueezeNet v1.1aom-av1: Speed 6 Two-Pass - Bosphorus 4Kaom-av1: Speed 9 Realtime - Bosphorus 4Kncnn: CPU - regnety_400metcpak: ETC1 + Ditheringviennacl: CPU BLAS - dGEMV-Nencode-opus: WAV To Opus Encodecompress-zstd: 8 - Compression Speedonednn: IP Shapes 3D - bf16bf16bf16 - CPUtachyon: Total Timeliquid-dsp: 32 - 256 - 57svt-vp9: PSNR/SSIM Optimized - Bosphorus 1080ponednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUncnn: CPU - blazefacencnn: CPU - mobilenetonednn: Matrix Multiply Batch Shapes Transformer - bf16bf16bf16 - CPUwebp: Quality 100, Losslessviennacl: CPU BLAS - sCOPYonednn: Recurrent Neural Network Inference - u8s8f32 - CPUhmmer: Pfam Database Searchbotan: KASUMIngspice: C7552encode-mp3: WAV To MP3compress-7zip: Compress Speed Testcompress-zstd: 19, Long Mode - Compression Speedonednn: Convolution Batch Shapes Auto - u8s8f32 - CPUetcpak: ETC2pjsip: OPTIONS, Statelessncnn: CPU - alexnetpjsip: INVITEc-ray: Total Time - 4K, 16 Rays Per Pixelvosk: aom-av1: Speed 8 Realtime - Bosphorus 4Kbotan: KASUMI - Decrypthimeno: Poisson Pressure Solverncnn: CPU - vgg16securemark: SecureMark-TLSgraphics-magick: Enhancedblosc: blosclzmnn: mobilenet-v1-1.0aom-av1: Speed 6 Realtime - Bosphorus 4Kcryptopp: Integer + Elliptic Curve Public Key Algorithmssvt-vp9: Visual Quality Optimized - Bosphorus 1080pkvazaar: Bosphorus 4K - Very Fastncnn: CPU - shufflenet-v2sqlite-speedtest: Timed Time - Size 1,000encode-flac: WAV To FLACcompress-zstd: 19 - Compression Speedtjbench: Decompression Throughputsvt-av1: Preset 4 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Kviennacl: CPU BLAS - sDOTkvazaar: Bosphorus 4K - Ultra Fastpjsip: OPTIONS, Statefulsvt-hevc: 1 - Bosphorus 1080pngspice: C2670svt-hevc: 10 - Bosphorus 1080ponednn: IP Shapes 1D - bf16bf16bf16 - CPUonednn: Deconvolution Batch shapes_3d - bf16bf16bf16 - CPUsvt-hevc: 7 - Bosphorus 1080pviennacl: CPU BLAS - dGEMV-Tbotan: AES-256gnupg: 2.7GB Sample File Encryptiontnn: CPU - DenseNetviennacl: CPU BLAS - dAXPYviennacl: CPU BLAS - dCOPYonednn: IP Shapes 1D - u8s8f32 - CPUonednn: Deconvolution Batch shapes_1d - u8s8f32 - CPUencode-wavpack: WAV To WavPackbotan: AES-256 - Decryptlibgav1: Chimera 1080p 10-bitlibgav1: Summer Nature 4Kncnn: CPU - yolov4-tinymnn: squeezenetv1.1viennacl: CPU BLAS - dDOTonednn: Convolution Batch Shapes Auto - bf16bf16bf16 - CPUGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070119774820.187500335.526.836984.019977.16542354.8984377920.6794825.28627.29755.5416.18456.054.755.2420.3661444321.387809491.138146.0960.441500482.7802586.35.36618050.8300092819.2152.429152.235194.12130.15412.7370.1246.692676.890310.544.828.222.4036.642377.7809021573.181573.039.828583361.71445.235511400131.232393.7043547.4306.0818.333909167900004.725.594714.48766937.695215.1615.6321.53197.464.7568.8289.9634.4627.1813.77329.12869.58.283425.72.9490348.1611924630000310.79939.9232.5614.161.7630817.20245.9937.607126.20499.716126.2008.7169971143.39.34766198.1091353029.05330729.81820.72119.4097.6444522.73117036.2025986942411800.72.4337.515519.144212247.4521.355.0557.6068.43660.3218.8135811.34011.92577.040.13580112.88134.346374.625.5406211.0180190.0379.93998.62764.2393505.93157.138.10.5284160.46145913.3553991.20120.844.56463.67.8903226576452.778646375.628.107951.152945.44942795.0533857520.8288666.04531.45256.1414.44556.254.154.9411.5731617347.436776486.315157.3320.467594475.4082568.85.10650499.4748883017.6150.879150.585193.97332.41212.4473.9386.572802.786410.584.738.612.2976.560375.2314921639.781636.969.791853436.81450.560506225521.279913.5943628.4295.0717.593879216700004.575.540719.76248436.869219.6915.0821.64199.894.8771.2296.1424.4427.2413.87336.10671.88.241429.42.8600847.8849930236667302.25961.3832.5413.941.7915016.82347.1960.128126.506100.411127.6888.5259829843.59.55455199.0971359039.15325230.03520.99319.3498.5574609.39856336.0126345742411802.62.4557.435538.547039243.4821.204.9757.0348.50060.2220.6177871.35512.02178.040.16572912.91134.222376.895.5953310.9596190.6279.73987.08064.2283527.68257.438.10.5267980.45945613.3753993.89021.354.42063.78.1003831749799.115885370.132.672788.573780.12335458.6627617610.6805226.13028.25558.7404.15758.956.457.1411.5221585311.604765486.288154.6290.426902474.8042529.85.12630485.5885102876.9151.248151.184193.41130.80413.0669.2976.622701.986411.164.808.592.3416.866372.5830411566.751565.419.390623285.51484.230499422761.227033.6693479.0299.9717.874039406600004.645.612717.16555937.869222.2715.2621.84195.154.8470.3286.2154.4827.8613.63329.48671.68.283424.02.9397847.9045939716667306.89938.2202.6113.811.7552017.25146.4935.962126.68798.200126.8778.7309742643.99.35095197.6291382229.18328130.43020.75319.2896.8794538.66196136.3526347242711713.42.4677.385503.078606246.7521.095.0257.3038.36960.1219.5427991.35912.06277.440.64574413.04133.912372.695.5333410.9199189.8879.63999.24864.4243508.29057.338.30.5260140.46048213.3403998.47921.264.27154.77.9016331948802.755208469.435.086779.376774.64534558.2239589240.6970806.20128.44551.0367.67751.949.850.5373.5621571314.561852442.670142.9340.430676439.5552749.15.06597455.1608122775.7140.850141.031208.34331.27512.8469.8026.562642.291610.974.728.632.4126.780360.4141921566.251563.059.413463351.91468.968522069631.230123.7543553.2297.3217.774039545366674.665.723692.98639936.471223.0615.2321.16192.954.8770.7288.9104.3328.0713.93327.32971.78.456419.52.9342847.8659951170000305.72936.8802.5513.791.7626416.80346.7938.043126.616100.697129.3968.7329814944.39.35550194.7591364449.08324029.96020.89419.6497.0014592.94740136.5625956543211926.82.4777.515593.130439244.0521.015.0557.4118.41161.0218.6181621.34712.09077.640.31576912.96134.711375.655.5454410.9199191.0279.33985.26664.2043508.39057.438.30.5281330.45995613.3533995.23221.374.60963.77.9047731948317.579427385.527.281781.383775.48834223.3033869030.6786265.99128.27251.2366.64851.949.851.5374.7071607318.056794442.265145.1740.425675442.4102773.64.89601830.2632922782.7140.480140.309196.22230.79712.2169.2316.272773.988410.934.588.652.3726.548374.6407951564.711567.419.594523332.71419.365507345711.224963.7293531.4293.7117.744039375533334.545.506714.20526937.161221.9415.2821.08194.064.9270.1287.4904.4028.1013.48325.27871.48.186432.72.9467049.3237944433333303.54935.3782.5413.811.7447116.89246.4936.491129.454100.609128.3208.5999849343.99.34206197.1281379668.99330429.97320.57419.6796.6104580.18807336.7026451442911889.42.4777.495532.467940244.5621.154.9856.7158.37960.8217.4258161.34811.96677.140.20576312.94135.428375.325.5367210.9330191.3379.53972.02064.6133524.74657.238.20.5279390.45966013.3313993.17321.3228.2422.834.28363.77.91258OpenBenchmarking.org

GraphicsMagick

Operation: Sharpen

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: SharpenGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070170140210280350SE +/- 0.33, N = 31972653173193191. (CC) gcc options: -fopenmp -O3 -march=native -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lz -lm -lpthread

FinanceBench

Benchmark: Bonds OpenMP

OpenBenchmarking.orgms, Fewer Is BetterFinanceBench 2016-07-25Benchmark: Bonds OpenMPGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070116K32K48K64K80KSE +/- 5.53, N = 3SE +/- 1061.39, N = 3SE +/- 11.94, N = 3SE +/- 36.89, N = 3SE +/- 48.36, N = 374820.1976452.7849799.1248802.7648317.581. (CXX) g++ options: -O3 -march=native -fopenmp

Zstd Compression

Compression Level: 8, Long Mode - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.0Compression Level: 8, Long Mode - Compression SpeedGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701100200300400500SE +/- 3.63, N = 3SE +/- 2.56, N = 13SE +/- 3.28, N = 15SE +/- 3.45, N = 3SE +/- 3.88, N = 15335.5375.6370.1469.4385.51. (CC) gcc options: -O3 -march=native -pthread -lz

eSpeak-NG Speech Engine

Text-To-Speech Synthesis

OpenBenchmarking.orgSeconds, Fewer Is BettereSpeak-NG Speech Engine 20200907Text-To-Speech SynthesisGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701816243240SE +/- 0.19, N = 4SE +/- 0.23, N = 4SE +/- 0.09, N = 4SE +/- 0.16, N = 4SE +/- 0.18, N = 426.8428.1132.6735.0927.281. (CC) gcc options: -O3 -march=native -std=c99

Botan

Test: ChaCha20Poly1305

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: ChaCha20Poly1305GCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107012004006008001000SE +/- 2.79, N = 3SE +/- 1.36, N = 3SE +/- 0.15, N = 3SE +/- 1.05, N = 3SE +/- 0.73, N = 3984.02951.15788.57779.38781.381. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

Botan

Test: ChaCha20Poly1305 - Decrypt

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: ChaCha20Poly1305 - DecryptGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107012004006008001000SE +/- 2.38, N = 3SE +/- 0.08, N = 3SE +/- 0.79, N = 3SE +/- 0.89, N = 3SE +/- 0.47, N = 3977.17945.45780.12774.65775.491. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

FinanceBench

Benchmark: Repo OpenMP

OpenBenchmarking.orgms, Fewer Is BetterFinanceBench 2016-07-25Benchmark: Repo OpenMPGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107019K18K27K36K45KSE +/- 34.41, N = 3SE +/- 10.60, N = 3SE +/- 120.35, N = 3SE +/- 43.71, N = 3SE +/- 22.03, N = 342354.9042795.0535458.6634558.2234223.301. (CXX) g++ options: -O3 -march=native -fopenmp

GraphicsMagick

Operation: Swirl

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: SwirlGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107012004006008001000SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 1.20, N = 37927527619249031. (CC) gcc options: -fopenmp -O3 -march=native -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lz -lm -lpthread

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPUGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107010.18650.3730.55950.7460.9325SE +/- 0.003298, N = 3SE +/- 0.008442, N = 15SE +/- 0.005954, N = 8SE +/- 0.005568, N = 3SE +/- 0.008934, N = 30.6794820.8288660.6805220.6970800.678626MIN: 0.66MIN: 0.74MIN: 0.63MIN: 0.67MIN: 0.651. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

Smallpt

Global Illumination Renderer; 128 Samples

OpenBenchmarking.orgSeconds, Fewer Is BetterSmallpt 1.0Global Illumination Renderer; 128 SamplesGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701246810SE +/- 0.007, N = 3SE +/- 0.011, N = 3SE +/- 0.033, N = 3SE +/- 0.004, N = 3SE +/- 0.017, N = 35.2866.0456.1306.2015.9911. (CXX) g++ options: -fopenmp -O3 -march=native

Mobile Neural Network

Model: resnet-v2-50

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: resnet-v2-50GCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701714212835SE +/- 0.10, N = 3SE +/- 0.47, N = 15SE +/- 0.24, N = 3SE +/- 0.06, N = 3SE +/- 0.19, N = 327.3031.4528.2628.4528.27MIN: 26.86 / MAX: 27.93MIN: 24.41 / MAX: 36.24MIN: 27.6 / MAX: 28.76MIN: 27.77 / MAX: 28.83MIN: 27.7 / MAX: 28.911. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

ViennaCL

Test: CPU BLAS - dGEMM-NN

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMM-NNGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107011326395265SE +/- 0.75, N = 3SE +/- 0.13, N = 3SE +/- 0.63, N = 3SE +/- 0.15, N = 3SE +/- 0.44, N = 355.556.158.751.051.21. (CXX) g++ options: -O3 -march=native -fopenmp -rdynamic -lOpenCL

Botan

Test: Twofish

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: TwofishGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070190180270360450SE +/- 0.33, N = 3SE +/- 0.12, N = 3SE +/- 0.23, N = 3SE +/- 1.13, N = 3SE +/- 0.30, N = 3416.18414.45404.16367.68366.651. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

ViennaCL

Test: CPU BLAS - dGEMM-TN

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMM-TNGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107011326395265SE +/- 1.55, N = 2SE +/- 0.36, N = 3SE +/- 1.17, N = 3SE +/- 0.10, N = 3SE +/- 0.10, N = 356.056.258.951.951.91. (CXX) g++ options: -O3 -march=native -fopenmp -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - dGEMM-NT

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMM-NTGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107011326395265SE +/- 0.25, N = 3SE +/- 0.27, N = 3SE +/- 0.48, N = 3SE +/- 0.15, N = 3SE +/- 0.37, N = 354.754.156.449.849.81. (CXX) g++ options: -O3 -march=native -fopenmp -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - dGEMM-TT

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMM-TTGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107011326395265SE +/- 0.32, N = 3SE +/- 0.07, N = 3SE +/- 0.70, N = 2SE +/- 0.20, N = 3SE +/- 0.09, N = 355.254.957.150.551.51. (CXX) g++ options: -O3 -march=native -fopenmp -rdynamic -lOpenCL

Botan

Test: Twofish - Decrypt

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: Twofish - DecryptGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070190180270360450SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.26, N = 3SE +/- 0.56, N = 3SE +/- 0.17, N = 3420.37411.57411.52373.56374.711. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

GraphicsMagick

Operation: Resizing

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: ResizingGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070130060090012001500SE +/- 2.91, N = 3SE +/- 4.93, N = 3SE +/- 8.67, N = 3SE +/- 3.51, N = 3SE +/- 7.21, N = 3144416171585157116071. (CC) gcc options: -fopenmp -O3 -march=native -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lz -lm -lpthread

TNN

Target: CPU - Model: MobileNet v2

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: MobileNet v2GCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070180160240320400SE +/- 0.29, N = 3SE +/- 0.34, N = 3SE +/- 0.31, N = 3SE +/- 0.19, N = 3SE +/- 0.17, N = 3321.39347.44311.60314.56318.06MIN: 319.29 / MAX: 341.28MIN: 345.68 / MAX: 356.59MIN: 309.73 / MAX: 322.67MIN: 312.66 / MAX: 328.44MIN: 316.44 / MAX: 326.161. (CXX) g++ options: -O3 -march=native -fopenmp -pthread -fvisibility=hidden -fvisibility=default -rdynamic -ldl

GraphicsMagick

Operation: Rotate

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: RotateGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107012004006008001000SE +/- 7.07, N = 15SE +/- 3.51, N = 3SE +/- 5.24, N = 3SE +/- 2.52, N = 3SE +/- 7.25, N = 158097767658527941. (CC) gcc options: -fopenmp -O3 -march=native -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lz -lm -lpthread

Botan

Test: Blowfish

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: BlowfishGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701110220330440550SE +/- 0.01, N = 3SE +/- 0.29, N = 3SE +/- 0.22, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3491.14486.32486.29442.67442.271. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

Timed MrBayes Analysis

Primate Phylogeny Analysis

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MrBayes Analysis 3.2.7Primate Phylogeny AnalysisGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701306090120150SE +/- 0.45, N = 3SE +/- 1.65, N = 12SE +/- 0.58, N = 3SE +/- 0.32, N = 3SE +/- 1.02, N = 3146.10157.33154.63142.93145.171. (CC) gcc options: -mmmx -msse -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -maes -mavx -mfma -mavx2 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mrdrnd -mbmi -mbmi2 -madx -mmpx -mabm -O3 -std=c99 -pedantic -march=native -lm

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPUGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107010.10520.21040.31560.42080.526SE +/- 0.003487, N = 3SE +/- 0.002588, N = 3SE +/- 0.004576, N = 4SE +/- 0.004665, N = 3SE +/- 0.000391, N = 30.4415000.4675940.4269020.4306760.425675MIN: 0.41MIN: 0.44MIN: 0.4MIN: 0.41MIN: 0.411. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

Botan

Test: Blowfish - Decrypt

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: Blowfish - DecryptGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701100200300400500SE +/- 0.04, N = 3SE +/- 0.21, N = 3SE +/- 0.30, N = 3SE +/- 0.13, N = 3SE +/- 0.07, N = 3482.78475.41474.80439.56442.411. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

QuantLib

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.21GCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107016001200180024003000SE +/- 19.67, N = 3SE +/- 35.29, N = 3SE +/- 18.68, N = 3SE +/- 33.86, N = 4SE +/- 0.85, N = 32586.32568.82529.82749.12773.61. (CXX) g++ options: -O3 -march=native -rdynamic

NCNN

Target: CPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU-v2-v2 - Model: mobilenet-v2GCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107011.2062.4123.6184.8246.03SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.10, N = 3SE +/- 0.04, N = 35.365.105.125.064.89MIN: 4.96 / MAX: 8.4MIN: 4.73 / MAX: 10.4MIN: 4.76 / MAX: 8.89MIN: 4.72 / MAX: 10.01MIN: 4.72 / MAX: 10.071. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread -pthread

Coremark

CoreMark Size 666 - Iterations Per Second

OpenBenchmarking.orgIterations/Sec, More Is BetterCoremark 1.0CoreMark Size 666 - Iterations Per SecondGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701140K280K420K560K700KSE +/- 3624.80, N = 3SE +/- 1621.16, N = 3SE +/- 2003.80, N = 3SE +/- 1267.23, N = 3SE +/- 2406.19, N = 3618050.83650499.47630485.59597455.16601830.261. (CC) gcc options: -O2 -O3 -march=native -lrt" -lrt

Zstd Compression

Compression Level: 19, Long Mode - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.0Compression Level: 19, Long Mode - Decompression SpeedGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107016001200180024003000SE +/- 10.70, N = 3SE +/- 4.29, N = 3SE +/- 2.75, N = 3SE +/- 14.84, N = 3SE +/- 2.25, N = 32819.23017.62876.92775.72782.71. (CC) gcc options: -O3 -march=native -pthread -lz

Botan

Test: CAST-256 - Decrypt

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: CAST-256 - DecryptGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701306090120150SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.50, N = 3SE +/- 0.28, N = 3152.43150.88151.25140.85140.481. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

Botan

Test: CAST-256

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: CAST-256GCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701306090120150SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.30, N = 3152.24150.59151.18141.03140.311. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

Gcrypt Library

OpenBenchmarking.orgSeconds, Fewer Is BetterGcrypt Library 1.9GCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070150100150200250SE +/- 0.27, N = 3SE +/- 0.21, N = 3SE +/- 0.44, N = 3SE +/- 0.18, N = 3SE +/- 0.33, N = 3194.12193.97193.41208.34196.221. (CC) gcc options: -O3 -march=native -fvisibility=hidden -lgpg-error

Mobile Neural Network

Model: inception-v3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: inception-v3GCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701816243240SE +/- 0.10, N = 3SE +/- 0.28, N = 15SE +/- 0.42, N = 3SE +/- 0.42, N = 3SE +/- 0.43, N = 330.1532.4130.8031.2830.80MIN: 29.77 / MAX: 30.53MIN: 29.17 / MAX: 33.89MIN: 30.12 / MAX: 31.88MIN: 30.28 / MAX: 31.97MIN: 30.14 / MAX: 31.871. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

NCNN

Target: CPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: googlenetGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107013691215SE +/- 0.23, N = 3SE +/- 0.28, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.31, N = 312.7312.4413.0612.8412.21MIN: 12.1 / MAX: 19.86MIN: 12 / MAX: 13.22MIN: 12.84 / MAX: 14.29MIN: 12.68 / MAX: 16.73MIN: 11.77 / MAX: 13.021. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread -pthread

TNN

Target: CPU - Model: SqueezeNet v2

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: SqueezeNet v2GCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107011632486480SE +/- 0.03, N = 3SE +/- 1.05, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 370.1273.9469.3069.8069.23MIN: 69.44 / MAX: 71.63MIN: 72.33 / MAX: 77.08MIN: 68.65 / MAX: 70.61MIN: 69.16 / MAX: 70.99MIN: 68.59 / MAX: 70.341. (CXX) g++ options: -O3 -march=native -fopenmp -pthread -fvisibility=hidden -fvisibility=default -rdynamic -ldl

NCNN

Target: CPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: efficientnet-b0GCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701246810SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.11, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 36.696.576.626.566.27MIN: 6.33 / MAX: 10.85MIN: 6.28 / MAX: 14.64MIN: 6.24 / MAX: 24.41MIN: 6.27 / MAX: 11.76MIN: 6.05 / MAX: 14.371. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread -pthread

Zstd Compression

Compression Level: 19 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.0Compression Level: 19 - Decompression SpeedGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107016001200180024003000SE +/- 3.24, N = 3SE +/- 14.28, N = 3SE +/- 9.76, N = 3SE +/- 7.69, N = 9SE +/- 16.86, N = 32676.82802.72701.92642.22773.91. (CC) gcc options: -O3 -march=native -pthread -lz

GraphicsMagick

Operation: HWB Color Space

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: HWB Color SpaceGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107012004006008001000SE +/- 1.15, N = 3SE +/- 1.33, N = 3SE +/- 0.88, N = 39038648649168841. (CC) gcc options: -fopenmp -O3 -march=native -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lz -lm -lpthread

NCNN

Target: CPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: resnet18GCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107013691215SE +/- 0.23, N = 3SE +/- 0.28, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 310.5410.5811.1610.9710.93MIN: 10.19 / MAX: 17.98MIN: 10.2 / MAX: 11.57MIN: 11.03 / MAX: 11.45MIN: 10.84 / MAX: 20.49MIN: 10.84 / MAX: 11.271. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: mnasnetGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107011.08452.1693.25354.3385.4225SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.10, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 34.824.734.804.724.58MIN: 4.55 / MAX: 12.4MIN: 4.44 / MAX: 11.54MIN: 4.42 / MAX: 16.22MIN: 4.46 / MAX: 10.72MIN: 4.39 / MAX: 10.871. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread -pthread

VP9 libvpx Encoding

Speed: Speed 5 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterVP9 libvpx Encoding 1.10.0Speed: Speed 5 - Input: Bosphorus 4KGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701246810SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 38.228.618.598.638.651. (CXX) g++ options: -m64 -lm -lpthread -O3 -march=native -fPIC -U_FORTIFY_SOURCE -std=gnu++11

Mobile Neural Network

Model: mobilenetV3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: mobilenetV3GCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107010.54271.08541.62812.17082.7135SE +/- 0.012, N = 3SE +/- 0.015, N = 15SE +/- 0.011, N = 3SE +/- 0.032, N = 3SE +/- 0.011, N = 32.4032.2972.3412.4122.372MIN: 2.28 / MAX: 2.54MIN: 1.96 / MAX: 2.53MIN: 2.16 / MAX: 2.53MIN: 2.23 / MAX: 2.61MIN: 2.25 / MAX: 2.51. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

WebP Image Encode

Encode Settings: Quality 100, Highest Compression

OpenBenchmarking.orgEncode Time - Seconds, Fewer Is BetterWebP Image Encode 1.1Encode Settings: Quality 100, Highest CompressionGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701246810SE +/- 0.007, N = 3SE +/- 0.007, N = 3SE +/- 0.003, N = 3SE +/- 0.002, N = 3SE +/- 0.043, N = 36.6426.5606.8666.7806.5481. (CC) gcc options: -fvisibility=hidden -O3 -march=native -pthread -lm -ljpeg -lpng16

Crypto++

Test: Unkeyed Algorithms

OpenBenchmarking.orgMiB/second, More Is BetterCrypto++ 8.2Test: Unkeyed AlgorithmsGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070180160240320400SE +/- 0.02, N = 3SE +/- 0.65, N = 3SE +/- 0.17, N = 3SE +/- 0.04, N = 3SE +/- 0.68, N = 3377.78375.23372.58360.41374.641. (CXX) g++ options: -O3 -march=native -fPIC -pthread -pipe

oneDNN

Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPUGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701400800120016002000SE +/- 0.81, N = 3SE +/- 1.53, N = 3SE +/- 1.06, N = 3SE +/- 3.72, N = 3SE +/- 1.54, N = 31573.181639.781566.751566.251564.71MIN: 1566.72MIN: 1630.86MIN: 1558.77MIN: 1553.36MIN: 1557.511. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

oneDNN

Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPUGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701400800120016002000SE +/- 1.09, N = 3SE +/- 2.09, N = 3SE +/- 0.93, N = 3SE +/- 2.29, N = 3SE +/- 0.75, N = 31573.031636.961565.411563.051567.41MIN: 1566.77MIN: 1629.18MIN: 1559.12MIN: 1555.64MIN: 1561.171. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPUGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107013691215SE +/- 0.02091, N = 3SE +/- 0.00795, N = 3SE +/- 0.02137, N = 3SE +/- 0.01742, N = 3SE +/- 0.02038, N = 39.828589.791859.390629.413469.59452MIN: 9.53MIN: 9.62MIN: 9.29MIN: 9.27MIN: 9.41. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

Zstd Compression

Compression Level: 8 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.0Compression Level: 8 - Decompression SpeedGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107017001400210028003500SE +/- 2.28, N = 3SE +/- 2.27, N = 5SE +/- 3.06, N = 3SE +/- 5.37, N = 3SE +/- 2.91, N = 33361.73436.83285.53351.93332.71. (CC) gcc options: -O3 -march=native -pthread -lz

Etcpak

Configuration: DXT1

OpenBenchmarking.orgMpx/s, More Is BetterEtcpak 0.7Configuration: DXT1GCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070130060090012001500SE +/- 1.51, N = 3SE +/- 0.45, N = 3SE +/- 0.37, N = 3SE +/- 0.47, N = 3SE +/- 1.30, N = 31445.241450.561484.231468.971419.371. (CXX) g++ options: -O3 -march=native -std=c++11 -lpthread

Stockfish

Total Time

OpenBenchmarking.orgNodes Per Second, More Is BetterStockfish 13Total TimeGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070111M22M33M44M55MSE +/- 562135.06, N = 15SE +/- 508293.85, N = 15SE +/- 623930.99, N = 3SE +/- 211973.29, N = 3SE +/- 432778.20, N = 851140013506225524994227652206963507345711. (CXX) g++ options: -lgcov -m64 -lpthread -O3 -march=native -fno-exceptions -std=c++17 -pedantic -msse -msse3 -mpopcnt -mavx2 -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -flto -fprofile-use -fno-peel-loops -fno-tracer -flto=jobserver

oneDNN

Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPUGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107010.2880.5760.8641.1521.44SE +/- 0.00683, N = 3SE +/- 0.00348, N = 3SE +/- 0.00554, N = 3SE +/- 0.00400, N = 3SE +/- 0.00255, N = 31.232391.279911.227031.230121.22496MIN: 1.18MIN: 1.23MIN: 1.18MIN: 1.19MIN: 1.181. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

Mobile Neural Network

Model: MobileNetV2_224

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: MobileNetV2_224GCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107010.84471.68942.53413.37884.2235SE +/- 0.069, N = 3SE +/- 0.040, N = 15SE +/- 0.090, N = 3SE +/- 0.018, N = 3SE +/- 0.058, N = 33.7043.5943.6693.7543.729MIN: 3.31 / MAX: 3.95MIN: 3.07 / MAX: 4.08MIN: 3.42 / MAX: 4.19MIN: 3.47 / MAX: 3.95MIN: 3.41 / MAX: 3.941. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Zstd Compression

Compression Level: 8, Long Mode - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.0Compression Level: 8, Long Mode - Decompression SpeedGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107018001600240032004000SE +/- 5.55, N = 3SE +/- 2.52, N = 13SE +/- 3.49, N = 15SE +/- 3.35, N = 3SE +/- 3.04, N = 153547.43628.43479.03553.23531.41. (CC) gcc options: -O3 -march=native -pthread -lz

SVT-VP9

Tuning: VMAF Optimized - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-VP9 0.3Tuning: VMAF Optimized - Input: Bosphorus 1080pGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070170140210280350SE +/- 2.56, N = 13SE +/- 4.16, N = 3SE +/- 1.76, N = 14SE +/- 2.83, N = 6SE +/- 3.01, N = 5306.08295.07299.97297.32293.711. (CC) gcc options: -O3 -fcommon -march=native -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm

NCNN

Target: CPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: resnet50GCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701510152025SE +/- 0.30, N = 3SE +/- 0.29, N = 3SE +/- 0.29, N = 3SE +/- 0.24, N = 3SE +/- 0.24, N = 318.3317.5917.8717.7717.74MIN: 17.58 / MAX: 24.57MIN: 17.07 / MAX: 18.69MIN: 17.16 / MAX: 18.62MIN: 17.07 / MAX: 28.68MIN: 17.09 / MAX: 18.961. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread -pthread

GraphicsMagick

Operation: Noise-Gaussian

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: Noise-GaussianGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070190180270360450SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 0.58, N = 33903874034034031. (CC) gcc options: -fopenmp -O3 -march=native -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lz -lm -lpthread

Liquid-DSP

Threads: 36 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 2021.01.31Threads: 36 - Buffer Length: 256 - Filter Length: 57GCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701200M400M600M800M1000MSE +/- 120554.28, N = 3SE +/- 588132.64, N = 3SE +/- 272213.15, N = 3SE +/- 1013283.99, N = 3SE +/- 1056729.76, N = 39167900009216700009406600009545366679375533331. (CC) gcc options: -O3 -march=native -pthread -lm -lc -lliquid

NCNN

Target: CPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU-v3-v3 - Model: mobilenet-v3GCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107011.0622.1243.1864.2485.31SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 34.724.574.644.664.54MIN: 4.49 / MAX: 7.39MIN: 4.37 / MAX: 9.05MIN: 4.36 / MAX: 10.01MIN: 4.46 / MAX: 12.92MIN: 4.37 / MAX: 11.471. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread -pthread

Mobile Neural Network

Model: SqueezeNetV1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: SqueezeNetV1.0GCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107011.28772.57543.86315.15086.4385SE +/- 0.056, N = 3SE +/- 0.039, N = 15SE +/- 0.083, N = 3SE +/- 0.020, N = 3SE +/- 0.079, N = 35.5945.5405.6125.7235.506MIN: 5.4 / MAX: 5.85MIN: 5.06 / MAX: 6.72MIN: 5.24 / MAX: 6.01MIN: 5.47 / MAX: 6.72MIN: 5.22 / MAX: 5.911. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Crypto++

Test: Keyed Algorithms

OpenBenchmarking.orgMiB/second, More Is BetterCrypto++ 8.2Test: Keyed AlgorithmsGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701160320480640800SE +/- 0.10, N = 3SE +/- 0.35, N = 3SE +/- 0.48, N = 3SE +/- 0.20, N = 3SE +/- 0.24, N = 3714.49719.76717.17692.99714.211. (CXX) g++ options: -O3 -march=native -fPIC -pthread -pipe

WebP Image Encode

Encode Settings: Quality 100, Lossless, Highest Compression

OpenBenchmarking.orgEncode Time - Seconds, Fewer Is BetterWebP Image Encode 1.1Encode Settings: Quality 100, Lossless, Highest CompressionGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701918273645SE +/- 0.11, N = 3SE +/- 0.13, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 337.7036.8737.8736.4737.161. (CC) gcc options: -fvisibility=hidden -O3 -march=native -pthread -lm -ljpeg -lpng16

dav1d

Video Input: Chimera 1080p 10-bit

OpenBenchmarking.orgFPS, More Is Betterdav1d 0.9.0Video Input: Chimera 1080p 10-bitGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070150100150200250SE +/- 0.39, N = 3SE +/- 0.34, N = 3SE +/- 0.50, N = 3SE +/- 1.18, N = 3SE +/- 0.48, N = 3215.16219.69222.27223.06221.94-lm - MIN: 151.62 / MAX: 411.26-lm - MIN: 156.35 / MAX: 406.23MIN: 157.09 / MAX: 436.51MIN: 157.45 / MAX: 397.96MIN: 157.38 / MAX: 404.981. (CC) gcc options: -O3 -march=native -pthread

NCNN

Target: CPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: squeezenet_ssdGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070148121620SE +/- 0.36, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.13, N = 315.6315.0815.2615.2315.28MIN: 15.02 / MAX: 16.85MIN: 14.88 / MAX: 21.62MIN: 14.97 / MAX: 18.92MIN: 14.88 / MAX: 17.07MIN: 14.89 / MAX: 16.11. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread -pthread

x265

Video Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is Betterx265 3.4Video Input: Bosphorus 4KGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701510152025SE +/- 0.10, N = 3SE +/- 0.12, N = 3SE +/- 0.13, N = 3SE +/- 0.11, N = 3SE +/- 0.11, N = 321.5321.6421.8421.1621.081. (CXX) g++ options: -O3 -march=native -rdynamic -lpthread -lrt -ldl -lnuma

dav1d

Video Input: Summer Nature 4K

OpenBenchmarking.orgFPS, More Is Betterdav1d 0.9.0Video Input: Summer Nature 4KGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107014080120160200SE +/- 0.89, N = 3SE +/- 1.65, N = 3SE +/- 2.16, N = 3SE +/- 1.13, N = 3SE +/- 1.97, N = 6197.46199.89195.15192.95194.06-lm - MIN: 150.4 / MAX: 226.05-lm - MIN: 143.79 / MAX: 228.44MIN: 149.2 / MAX: 222.59MIN: 132.83 / MAX: 217.9MIN: 131.48 / MAX: 225.931. (CC) gcc options: -O3 -march=native -pthread

VP9 libvpx Encoding

Speed: Speed 0 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterVP9 libvpx Encoding 1.10.0Speed: Speed 0 - Input: Bosphorus 4KGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107011.1072.2143.3214.4285.535SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 34.754.874.844.874.921. (CXX) g++ options: -m64 -lm -lpthread -O3 -march=native -fPIC -U_FORTIFY_SOURCE -std=gnu++11

ViennaCL

Test: CPU BLAS - sAXPY

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - sAXPYGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107011632486480SE +/- 1.48, N = 3SE +/- 0.12, N = 3SE +/- 0.30, N = 3SE +/- 0.31, N = 3SE +/- 0.35, N = 368.871.270.370.770.11. (CXX) g++ options: -O3 -march=native -fopenmp -rdynamic -lOpenCL

TNN

Target: CPU - Model: SqueezeNet v1.1

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: SqueezeNet v1.1GCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070160120180240300SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 0.63, N = 3SE +/- 0.19, N = 3289.96296.14286.22288.91287.49MIN: 288.43 / MAX: 291.61MIN: 294.66 / MAX: 298.56MIN: 285.02 / MAX: 287.82MIN: 286.05 / MAX: 294.45MIN: 285.88 / MAX: 299.621. (CXX) g++ options: -O3 -march=native -fopenmp -pthread -fvisibility=hidden -fvisibility=default -rdynamic -ldl

AOM AV1

Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.1Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 4KGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107011.0082.0163.0244.0325.04SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 104.464.444.484.334.401. (CXX) g++ options: -O3 -march=native -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

AOM AV1

Encoder Mode: Speed 9 Realtime - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.1Encoder Mode: Speed 9 Realtime - Input: Bosphorus 4KGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701714212835SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.15, N = 3SE +/- 0.08, N = 3SE +/- 0.04, N = 327.1827.2427.8628.0728.101. (CXX) g++ options: -O3 -march=native -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

NCNN

Target: CPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: regnety_400mGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070148121620SE +/- 0.14, N = 3SE +/- 0.21, N = 3SE +/- 0.14, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 313.7713.8713.6313.9313.48MIN: 12.93 / MAX: 14.62MIN: 13.18 / MAX: 15.01MIN: 13.01 / MAX: 14.57MIN: 13.17 / MAX: 14.48MIN: 13.11 / MAX: 14.041. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread -pthread

Etcpak

Configuration: ETC1 + Dithering

OpenBenchmarking.orgMpx/s, More Is BetterEtcpak 0.7Configuration: ETC1 + DitheringGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070170140210280350SE +/- 2.72, N = 3SE +/- 0.09, N = 3SE +/- 0.38, N = 3SE +/- 0.20, N = 3SE +/- 0.05, N = 3329.13336.11329.49327.33325.281. (CXX) g++ options: -O3 -march=native -std=c++11 -lpthread

ViennaCL

Test: CPU BLAS - dGEMV-N

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMV-NGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107011632486480SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.31, N = 369.571.871.671.771.41. (CXX) g++ options: -O3 -march=native -fopenmp -rdynamic -lOpenCL

Opus Codec Encoding

WAV To Opus Encode

OpenBenchmarking.orgSeconds, Fewer Is BetterOpus Codec Encoding 1.3.1WAV To Opus EncodeGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701246810SE +/- 0.011, N = 5SE +/- 0.021, N = 5SE +/- 0.031, N = 5SE +/- 0.013, N = 5SE +/- 0.011, N = 58.2838.2418.2838.4568.1861. (CXX) g++ options: -O3 -march=native -fvisibility=hidden -logg -lm

Zstd Compression

Compression Level: 8 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.0Compression Level: 8 - Compression SpeedGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070190180270360450SE +/- 4.99, N = 3SE +/- 4.23, N = 5SE +/- 4.87, N = 3SE +/- 5.64, N = 3SE +/- 5.56, N = 3425.7429.4424.0419.5432.71. (CC) gcc options: -O3 -march=native -pthread -lz

oneDNN

Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPUGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107010.66351.3271.99052.6543.3175SE +/- 0.01360, N = 3SE +/- 0.01601, N = 3SE +/- 0.01261, N = 3SE +/- 0.01584, N = 3SE +/- 0.01797, N = 32.949032.860082.939782.934282.94670MIN: 2.85MIN: 2.77MIN: 2.83MIN: 2.83MIN: 2.841. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

Tachyon

Total Time

OpenBenchmarking.orgSeconds, Fewer Is BetterTachyon 0.99b6Total TimeGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107011122334455SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.26, N = 3SE +/- 0.18, N = 348.1647.8847.9047.8749.321. (CC) gcc options: -m64 -O3 -fomit-frame-pointer -ffast-math -ltachyon -lm -lpthread

Liquid-DSP

Threads: 32 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 2021.01.31Threads: 32 - Buffer Length: 256 - Filter Length: 57GCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701200M400M600M800M1000MSE +/- 353836.12, N = 3SE +/- 539269.05, N = 3SE +/- 2904171.33, N = 3SE +/- 4781007.56, N = 3SE +/- 4623189.13, N = 39246300009302366679397166679511700009444333331. (CC) gcc options: -O3 -march=native -pthread -lm -lc -lliquid

SVT-VP9

Tuning: PSNR/SSIM Optimized - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-VP9 0.3Tuning: PSNR/SSIM Optimized - Input: Bosphorus 1080pGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070170140210280350SE +/- 0.21, N = 3SE +/- 1.42, N = 3SE +/- 1.79, N = 3SE +/- 2.35, N = 3SE +/- 0.68, N = 3310.79302.25306.89305.72303.541. (CC) gcc options: -O3 -fcommon -march=native -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPUGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107012004006008001000SE +/- 1.32, N = 3SE +/- 1.46, N = 3SE +/- 0.16, N = 3SE +/- 0.70, N = 3SE +/- 0.15, N = 3939.92961.38938.22936.88935.38MIN: 933.27MIN: 955.17MIN: 930.52MIN: 931.54MIN: 931.251. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

NCNN

Target: CPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: blazefaceGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107010.58731.17461.76192.34922.9365SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 32.562.542.612.552.54MIN: 2.5 / MAX: 3.31MIN: 2.45 / MAX: 3.32MIN: 2.47 / MAX: 3.3MIN: 2.47 / MAX: 3.17MIN: 2.46 / MAX: 3.121. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: mobilenetGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070148121620SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 314.1613.9413.8113.7913.81MIN: 13.93 / MAX: 14.76MIN: 13.68 / MAX: 22.27MIN: 13.51 / MAX: 20.36MIN: 13.61 / MAX: 14.23MIN: 13.64 / MAX: 14.541. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread -pthread

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPUGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107010.40310.80621.20931.61242.0155SE +/- 0.00719, N = 3SE +/- 0.00782, N = 3SE +/- 0.00494, N = 3SE +/- 0.00508, N = 3SE +/- 0.00613, N = 31.763081.791501.755201.762641.74471MIN: 1.7MIN: 1.74MIN: 1.69MIN: 1.69MIN: 1.661. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

WebP Image Encode

Encode Settings: Quality 100, Lossless

OpenBenchmarking.orgEncode Time - Seconds, Fewer Is BetterWebP Image Encode 1.1Encode Settings: Quality 100, LosslessGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070148121620SE +/- 0.06, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 317.2016.8217.2516.8016.891. (CC) gcc options: -fvisibility=hidden -O3 -march=native -pthread -lm -ljpeg -lpng16

ViennaCL

Test: CPU BLAS - sCOPY

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - sCOPYGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107011122334455SE +/- 0.27, N = 3SE +/- 0.17, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 345.947.146.446.746.41. (CXX) g++ options: -O3 -march=native -fopenmp -rdynamic -lOpenCL

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPUGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107012004006008001000SE +/- 0.50, N = 3SE +/- 0.63, N = 3SE +/- 0.69, N = 3SE +/- 0.60, N = 3SE +/- 0.46, N = 3937.61960.13935.96938.04936.49MIN: 932.91MIN: 955.07MIN: 930.6MIN: 933.04MIN: 932.181. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

Timed HMMer Search

Pfam Database Search

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed HMMer Search 3.3.2Pfam Database SearchGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701306090120150SE +/- 0.06, N = 3SE +/- 0.10, N = 3SE +/- 0.32, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 3126.20126.51126.69126.62129.451. (CC) gcc options: -O3 -march=native -pthread -lhmmer -leasel -lm -lmpi

Botan

Test: KASUMI

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: KASUMIGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070120406080100SE +/- 0.01, N = 3SE +/- 0.12, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.25, N = 399.72100.4198.20100.70100.611. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

Ngspice

Circuit: C7552

OpenBenchmarking.orgSeconds, Fewer Is BetterNgspice 34Circuit: C7552GCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701306090120150SE +/- 1.35, N = 3SE +/- 1.54, N = 3SE +/- 1.51, N = 3SE +/- 0.26, N = 3SE +/- 1.05, N = 3126.20127.69126.88129.40128.321. (CC) gcc options: -O3 -march=native -fopenmp -lm -lfftw3 -lXaw -lXmu -lXt -lXext -lX11 -lSM -lICE

LAME MP3 Encoding

WAV To MP3

OpenBenchmarking.orgSeconds, Fewer Is BetterLAME MP3 Encoding 3.100WAV To MP3GCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701246810SE +/- 0.002, N = 3SE +/- 0.011, N = 3SE +/- 0.004, N = 3SE +/- 0.005, N = 3SE +/- 0.003, N = 38.7168.5258.7308.7328.5991. (CC) gcc options: -O3 -ffast-math -funroll-loops -fschedule-insns2 -fbranch-count-reg -fforce-addr -pipe -march=native -lm

7-Zip Compression

Compress Speed Test

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 16.02Compress Speed TestGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070120K40K60K80K100KSE +/- 69.57, N = 3SE +/- 343.09, N = 3SE +/- 46.23, N = 3SE +/- 304.44, N = 3SE +/- 228.39, N = 399711982989742698149984931. (CXX) g++ options: -pipe -lpthread

Zstd Compression

Compression Level: 19, Long Mode - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.0Compression Level: 19, Long Mode - Compression SpeedGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107011020304050SE +/- 0.15, N = 3SE +/- 0.13, N = 3SE +/- 0.19, N = 3SE +/- 0.07, N = 3SE +/- 0.15, N = 343.343.543.944.343.91. (CC) gcc options: -O3 -march=native -pthread -lz

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPUGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107013691215SE +/- 0.01311, N = 3SE +/- 0.01517, N = 3SE +/- 0.01276, N = 3SE +/- 0.01164, N = 3SE +/- 0.00808, N = 39.347669.554559.350959.355509.34206MIN: 9.29MIN: 9.5MIN: 9.29MIN: 9.29MIN: 9.281. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

Etcpak

Configuration: ETC2

OpenBenchmarking.orgMpx/s, More Is BetterEtcpak 0.7Configuration: ETC2GCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107014080120160200SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3198.11199.10197.63194.76197.131. (CXX) g++ options: -O3 -march=native -std=c++11 -lpthread

PJSIP

Method: OPTIONS, Stateless

OpenBenchmarking.orgResponses Per Second, More Is BetterPJSIP 2.11Method: OPTIONS, StatelessGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070130K60K90K120K150KSE +/- 578.10, N = 3SE +/- 1635.40, N = 4SE +/- 1006.09, N = 3SE +/- 946.90, N = 3SE +/- 734.59, N = 31353021359031382221364441379661. (CC) gcc options: -lstdc++ -lssl -lcrypto -lm -lrt -lpthread -O3 -march=native

NCNN

Target: CPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: alexnetGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107013691215SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 39.059.159.189.088.99MIN: 8.96 / MAX: 19.48MIN: 9.08 / MAX: 9.59MIN: 9.11 / MAX: 9.74MIN: 9 / MAX: 11.81MIN: 8.73 / MAX: 9.391. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread -pthread

PJSIP

Method: INVITE

OpenBenchmarking.orgResponses Per Second, More Is BetterPJSIP 2.11Method: INVITEGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107017001400210028003500SE +/- 25.16, N = 15SE +/- 27.02, N = 3SE +/- 6.36, N = 3SE +/- 7.22, N = 3SE +/- 25.40, N = 15330732523281324033041. (CC) gcc options: -lstdc++ -lssl -lcrypto -lm -lrt -lpthread -O3 -march=native

C-Ray

Total Time - 4K, 16 Rays Per Pixel

OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 1.1Total Time - 4K, 16 Rays Per PixelGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701714212835SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 329.8230.0430.4329.9629.971. (CC) gcc options: -lm -lpthread -O3 -march=native

VOSK Speech Recognition Toolkit

OpenBenchmarking.orgSeconds, Fewer Is BetterVOSK Speech Recognition Toolkit 0.3.21GCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701510152025SE +/- 0.15, N = 3SE +/- 0.13, N = 3SE +/- 0.12, N = 3SE +/- 0.26, N = 3SE +/- 0.07, N = 320.7220.9920.7520.8920.57

AOM AV1

Encoder Mode: Speed 8 Realtime - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.1Encoder Mode: Speed 8 Realtime - Input: Bosphorus 4KGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701510152025SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 319.4019.3419.2819.6419.671. (CXX) g++ options: -O3 -march=native -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

Botan

Test: KASUMI - Decrypt

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: KASUMI - DecryptGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070120406080100SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 397.6498.5696.8897.0096.611. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

Himeno Benchmark

Poisson Pressure Solver

OpenBenchmarking.orgMFLOPS, More Is BetterHimeno Benchmark 3.0Poisson Pressure SolverGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070110002000300040005000SE +/- 0.61, N = 3SE +/- 5.70, N = 3SE +/- 13.08, N = 3SE +/- 0.64, N = 3SE +/- 2.82, N = 34522.734609.404538.664592.954580.191. (CC) gcc options: -O3 -march=native -mavx2

NCNN

Target: CPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: vgg16GCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701816243240SE +/- 0.37, N = 3SE +/- 0.49, N = 3SE +/- 0.47, N = 3SE +/- 0.52, N = 3SE +/- 0.53, N = 336.2036.0136.3536.5636.70MIN: 35.36 / MAX: 47.25MIN: 35.37 / MAX: 37.68MIN: 35.3 / MAX: 37.7MIN: 35.42 / MAX: 58.41MIN: 35.5 / MAX: 41.991. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread -pthread

SecureMark

Benchmark: SecureMark-TLS

OpenBenchmarking.orgmarks, More Is BetterSecureMark 1.0.4Benchmark: SecureMark-TLSGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070160K120K180K240K300KSE +/- 106.27, N = 3SE +/- 247.29, N = 3SE +/- 95.66, N = 3SE +/- 68.80, N = 3SE +/- 101.43, N = 32598692634572634722595652645141. (CC) gcc options: -pedantic -O3

GraphicsMagick

Operation: Enhanced

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: EnhancedGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701901802703604504244244274324291. (CC) gcc options: -fopenmp -O3 -march=native -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lz -lm -lpthread

C-Blosc

Compressor: blosclz

OpenBenchmarking.orgMB/s, More Is BetterC-Blosc 2.0Compressor: blosclzGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107013K6K9K12K15KSE +/- 11.42, N = 3SE +/- 18.15, N = 3SE +/- 21.15, N = 3SE +/- 69.56, N = 3SE +/- 37.20, N = 311800.711802.611713.411926.811889.41. (CC) gcc options: -std=gnu99 -O3 -pthread -lrt -lm

Mobile Neural Network

Model: mobilenet-v1-1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: mobilenet-v1-1.0GCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107010.55731.11461.67192.22922.7865SE +/- 0.025, N = 3SE +/- 0.012, N = 15SE +/- 0.025, N = 3SE +/- 0.024, N = 3SE +/- 0.029, N = 32.4332.4552.4672.4772.477MIN: 2.32 / MAX: 2.62MIN: 2.23 / MAX: 3.16MIN: 2.32 / MAX: 2.68MIN: 2.3 / MAX: 2.65MIN: 2.3 / MAX: 2.741. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

AOM AV1

Encoder Mode: Speed 6 Realtime - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.1Encoder Mode: Speed 6 Realtime - Input: Bosphorus 4KGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701246810SE +/- 0.05, N = 3SE +/- 0.08, N = 15SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.08, N = 127.517.437.387.517.491. (CXX) g++ options: -O3 -march=native -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

Crypto++

Test: Integer + Elliptic Curve Public Key Algorithms

OpenBenchmarking.orgMiB/second, More Is BetterCrypto++ 8.2Test: Integer + Elliptic Curve Public Key AlgorithmsGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070112002400360048006000SE +/- 1.33, N = 3SE +/- 6.16, N = 3SE +/- 1.85, N = 3SE +/- 1.99, N = 3SE +/- 5.19, N = 35519.145538.555503.085593.135532.471. (CXX) g++ options: -O3 -march=native -fPIC -pthread -pipe

SVT-VP9

Tuning: Visual Quality Optimized - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-VP9 0.3Tuning: Visual Quality Optimized - Input: Bosphorus 1080pGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070150100150200250SE +/- 1.34, N = 3SE +/- 1.22, N = 3SE +/- 3.33, N = 3SE +/- 3.10, N = 3SE +/- 1.58, N = 3247.45243.48246.75244.05244.561. (CC) gcc options: -O3 -fcommon -march=native -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.0Video Input: Bosphorus 4K - Video Preset: Very FastGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701510152025SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 321.3521.2021.0921.0121.151. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O3 -march=native -lpthread -lm -lrt

NCNN

Target: CPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: shufflenet-v2GCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107011.13632.27263.40894.54525.6815SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 35.054.975.025.054.98MIN: 4.83 / MAX: 14.14MIN: 4.8 / MAX: 8.9MIN: 4.83 / MAX: 15.94MIN: 4.88 / MAX: 9.37MIN: 4.88 / MAX: 8.61. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread -pthread

SQLite Speedtest

Timed Time - Size 1,000

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite Speedtest 3.30Timed Time - Size 1,000GCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107011326395265SE +/- 0.22, N = 3SE +/- 0.09, N = 3SE +/- 0.19, N = 3SE +/- 0.10, N = 3SE +/- 0.11, N = 357.6157.0357.3057.4156.721. (CC) gcc options: -O3 -march=native -ldl -lz -lpthread

FLAC Audio Encoding

WAV To FLAC

OpenBenchmarking.orgSeconds, Fewer Is BetterFLAC Audio Encoding 1.3.2WAV To FLACGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701246810SE +/- 0.012, N = 5SE +/- 0.006, N = 5SE +/- 0.004, N = 5SE +/- 0.009, N = 5SE +/- 0.014, N = 58.4368.5008.3698.4118.3791. (CXX) g++ options: -O3 -march=native -fvisibility=hidden -logg -lm

Zstd Compression

Compression Level: 19 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.0Compression Level: 19 - Compression SpeedGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107011428425670SE +/- 0.19, N = 3SE +/- 0.50, N = 3SE +/- 0.56, N = 3SE +/- 0.50, N = 9SE +/- 0.47, N = 360.360.260.161.060.81. (CC) gcc options: -O3 -march=native -pthread -lz

libjpeg-turbo tjbench

Test: Decompression Throughput

OpenBenchmarking.orgMegapixels/sec, More Is Betterlibjpeg-turbo tjbench 2.1.0Test: Decompression ThroughputGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070150100150200250SE +/- 0.03, N = 3SE +/- 0.84, N = 3SE +/- 0.30, N = 3SE +/- 0.47, N = 3SE +/- 0.26, N = 3218.81220.62219.54218.62217.431. (CC) gcc options: -O3 -march=native -rdynamic

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 0.8.7Encoder Mode: Preset 4 - Input: Bosphorus 4KGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107010.30580.61160.91741.22321.529SE +/- 0.005, N = 3SE +/- 0.001, N = 3SE +/- 0.003, N = 3SE +/- 0.003, N = 3SE +/- 0.002, N = 31.3401.3551.3591.3471.3481. (CXX) g++ options: -O3 -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq -pie

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 0.8.7Encoder Mode: Preset 8 - Input: Bosphorus 4KGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107013691215SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 311.9312.0212.0612.0911.971. (CXX) g++ options: -O3 -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq -pie

ViennaCL

Test: CPU BLAS - sDOT

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - sDOTGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070120406080100SE +/- 0.42, N = 3SE +/- 0.26, N = 3SE +/- 0.33, N = 3SE +/- 0.43, N = 3SE +/- 0.49, N = 377.078.077.477.677.11. (CXX) g++ options: -O3 -march=native -fopenmp -rdynamic -lOpenCL

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.0Video Input: Bosphorus 4K - Video Preset: Ultra FastGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701918273645SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.15, N = 3SE +/- 0.11, N = 3SE +/- 0.08, N = 340.1340.1640.6440.3140.201. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O3 -march=native -lpthread -lm -lrt

PJSIP

Method: OPTIONS, Stateful

OpenBenchmarking.orgResponses Per Second, More Is BetterPJSIP 2.11Method: OPTIONS, StatefulGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070112002400360048006000SE +/- 16.26, N = 3SE +/- 24.67, N = 3SE +/- 8.67, N = 3SE +/- 53.69, N = 3SE +/- 23.13, N = 3580157295744576957631. (CC) gcc options: -lstdc++ -lssl -lcrypto -lm -lrt -lpthread -O3 -march=native

SVT-HEVC

Tuning: 1 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-HEVC 1.5.0Tuning: 1 - Input: Bosphorus 1080pGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107013691215SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 312.8812.9113.0412.9612.941. (CC) gcc options: -O3 -march=native -fPIE -fPIC -O2 -pie -rdynamic -lpthread -lrt

Ngspice

Circuit: C2670

OpenBenchmarking.orgSeconds, Fewer Is BetterNgspice 34Circuit: C2670GCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701306090120150SE +/- 0.81, N = 3SE +/- 0.71, N = 3SE +/- 1.13, N = 3SE +/- 0.92, N = 3SE +/- 0.83, N = 3134.35134.22133.91134.71135.431. (CC) gcc options: -O3 -march=native -fopenmp -lm -lfftw3 -lXaw -lXmu -lXt -lXext -lX11 -lSM -lICE

SVT-HEVC

Tuning: 10 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-HEVC 1.5.0Tuning: 10 - Input: Bosphorus 1080pGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070180160240320400SE +/- 0.95, N = 3SE +/- 0.96, N = 3SE +/- 1.74, N = 3SE +/- 1.99, N = 3SE +/- 0.75, N = 3374.62376.89372.69375.65375.321. (CC) gcc options: -O3 -march=native -fPIE -fPIC -O2 -pie -rdynamic -lpthread -lrt

oneDNN

Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPUGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107011.25892.51783.77675.03566.2945SE +/- 0.02371, N = 3SE +/- 0.02285, N = 3SE +/- 0.01959, N = 3SE +/- 0.02335, N = 3SE +/- 0.02089, N = 35.540625.595335.533345.545445.53672MIN: 5.4MIN: 5.45MIN: 5.38MIN: 5.4MIN: 5.381. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPUGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107013691215SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 311.0210.9610.9210.9210.93MIN: 10.79MIN: 10.74MIN: 10.74MIN: 10.74MIN: 10.771. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

SVT-HEVC

Tuning: 7 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-HEVC 1.5.0Tuning: 7 - Input: Bosphorus 1080pGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107014080120160200SE +/- 0.58, N = 3SE +/- 0.18, N = 3SE +/- 0.44, N = 3SE +/- 0.31, N = 3SE +/- 0.32, N = 3190.03190.62189.88191.02191.331. (CC) gcc options: -O3 -march=native -fPIE -fPIC -O2 -pie -rdynamic -lpthread -lrt

ViennaCL

Test: CPU BLAS - dGEMV-T

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMV-TGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070120406080100SE +/- 0.25, N = 3SE +/- 0.10, N = 3SE +/- 0.07, N = 3SE +/- 0.38, N = 3SE +/- 0.09, N = 379.979.779.679.379.51. (CXX) g++ options: -O3 -march=native -fopenmp -rdynamic -lOpenCL

Botan

Test: AES-256

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: AES-256GCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107019001800270036004500SE +/- 0.87, N = 3SE +/- 0.82, N = 3SE +/- 4.08, N = 3SE +/- 2.67, N = 3SE +/- 7.30, N = 33998.633987.083999.253985.273972.021. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

GnuPG

2.7GB Sample File Encryption

OpenBenchmarking.orgSeconds, Fewer Is BetterGnuPG 2.2.272.7GB Sample File EncryptionGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107011428425670SE +/- 0.17, N = 3SE +/- 0.19, N = 3SE +/- 0.36, N = 3SE +/- 0.23, N = 3SE +/- 0.56, N = 364.2464.2364.4264.2064.611. (CC) gcc options: -O3 -march=native

TNN

Target: CPU - Model: DenseNet

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: DenseNetGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107018001600240032004000SE +/- 0.16, N = 3SE +/- 2.55, N = 3SE +/- 0.59, N = 3SE +/- 0.77, N = 3SE +/- 0.21, N = 33505.933527.683508.293508.393524.75MIN: 3487.54 / MAX: 3535.34MIN: 3508.67 / MAX: 3981.67MIN: 3489.27 / MAX: 3603.98MIN: 3486.98 / MAX: 3606.8MIN: 3509.67 / MAX: 3548.511. (CXX) g++ options: -O3 -march=native -fopenmp -pthread -fvisibility=hidden -fvisibility=default -rdynamic -ldl

ViennaCL

Test: CPU BLAS - dAXPY

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dAXPYGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107011326395265SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.12, N = 357.157.457.357.457.21. (CXX) g++ options: -O3 -march=native -fopenmp -rdynamic -lOpenCL

ViennaCL

Test: CPU BLAS - dCOPY

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dCOPYGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701918273645SE +/- 0.00, N = 3SE +/- 0.15, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 338.138.138.338.338.21. (CXX) g++ options: -O3 -march=native -fopenmp -rdynamic -lOpenCL

oneDNN

Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPUGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107010.11890.23780.35670.47560.5945SE +/- 0.003001, N = 3SE +/- 0.003361, N = 3SE +/- 0.003324, N = 3SE +/- 0.003036, N = 3SE +/- 0.003225, N = 30.5284160.5267980.5260140.5281330.527939MIN: 0.5MIN: 0.5MIN: 0.5MIN: 0.5MIN: 0.51. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPUGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107010.10380.20760.31140.41520.519SE +/- 0.000631, N = 3SE +/- 0.001062, N = 3SE +/- 0.001585, N = 3SE +/- 0.000687, N = 3SE +/- 0.001427, N = 30.4614590.4594560.4604820.4599560.459660MIN: 0.45MIN: 0.45MIN: 0.45MIN: 0.45MIN: 0.451. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

WavPack Audio Encoding

WAV To WavPack

OpenBenchmarking.orgSeconds, Fewer Is BetterWavPack Audio Encoding 5.3WAV To WavPackGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107013691215SE +/- 0.00, N = 5SE +/- 0.00, N = 5SE +/- 0.02, N = 5SE +/- 0.00, N = 5SE +/- 0.00, N = 513.3613.3813.3413.3513.331. (CXX) g++ options: -O3 -march=native -rdynamic

Botan

Test: AES-256 - Decrypt

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: AES-256 - DecryptGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107019001800270036004500SE +/- 1.28, N = 3SE +/- 0.39, N = 3SE +/- 0.87, N = 3SE +/- 0.79, N = 3SE +/- 4.17, N = 33991.203993.893998.483995.233993.171. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

libgav1

Video Input: Chimera 1080p 10-bit

OpenBenchmarking.orgFPS, More Is Betterlibgav1 0.16.3Video Input: Chimera 1080p 10-bitGCC 12.0.0 20210701510152025SE +/- 0.01, N = 321.321. (CXX) g++ options: -O3 -march=native -lpthread -lrt

libgav1

Video Input: Summer Nature 4K

OpenBenchmarking.orgFPS, More Is Betterlibgav1 0.16.3Video Input: Summer Nature 4KGCC 12.0.0 20210701714212835SE +/- 0.01, N = 328.241. (CXX) g++ options: -O3 -march=native -lpthread -lrt

NCNN

Target: CPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: yolov4-tinyGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701510152025SE +/- 0.25, N = 3SE +/- 0.19, N = 3SE +/- 0.17, N = 3SE +/- 0.10, N = 3SE +/- 1.86, N = 320.8421.3521.2621.3722.83MIN: 19.92 / MAX: 24.91MIN: 20.42 / MAX: 33.9MIN: 20 / MAX: 24.4MIN: 20.44 / MAX: 22.72MIN: 20.18 / MAX: 937.41. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread -pthread

Mobile Neural Network

Model: squeezenetv1.1

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: squeezenetv1.1GCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107011.0372.0743.1114.1485.185SE +/- 0.036, N = 3SE +/- 0.061, N = 15SE +/- 0.162, N = 3SE +/- 0.007, N = 3SE +/- 0.149, N = 34.5644.4204.2714.6094.283MIN: 4.42 / MAX: 4.75MIN: 3.98 / MAX: 4.76MIN: 3.97 / MAX: 4.72MIN: 4.51 / MAX: 4.78MIN: 3.97 / MAX: 4.711. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

ViennaCL

Test: CPU BLAS - dDOT

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dDOTGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 202107011428425670SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 9.10, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 363.663.754.763.763.71. (CXX) g++ options: -O3 -march=native -fopenmp -rdynamic -lOpenCL

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPUGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701246810SE +/- 0.02602, N = 3SE +/- 0.17046, N = 14SE +/- 0.03159, N = 3SE +/- 0.03513, N = 3SE +/- 0.03413, N = 37.890328.100387.901637.904777.91258MIN: 7.58MIN: 7.58MIN: 7.61MIN: 7.56MIN: 7.631. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl


Phoronix Test Suite v10.8.5