extra tests2

AMD EPYC 9334 32-Core testing with a Supermicro H13SSW (1.1 BIOS) and astdrmfb on AlmaLinux 9.2 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2310249-NE-EXTRATEST98
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable
Show Perf Per Clock Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs
Condense Test Profiles With Multiple Version Results Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
a
October 07 2023
  5 Hours, 38 Minutes
b
October 07 2023
  5 Hours, 6 Minutes
c
October 07 2023
  4 Hours, 48 Minutes
d
October 20 2023
  5 Hours, 58 Minutes
e
October 20 2023
  6 Hours, 40 Minutes
f
October 21 2023
  6 Hours, 19 Minutes
g
October 22 2023
  5 Hours, 59 Minutes
h
October 24 2023
  6 Hours, 2 Minutes
i
October 24 2023
  6 Hours, 8 Minutes
j
October 24 2023
  5 Hours, 52 Minutes
Invert Behavior (Only Show Selected Data)
  5 Hours, 51 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


extra tests2ProcessorMotherboardMemoryDiskGraphicsMonitorOSKernelCompilerFile-SystemScreen Resolutionabcdefghij2 x AMD EPYC 9254 24-Core @ 2.90GHz (48 Cores / 96 Threads)Supermicro H13DSH (1.5 BIOS)24 x 32 GB DDR5-4800MT/s Samsung M321R4GA3BB6-CQKET2 x 1920GB SAMSUNG MZQL21T9HCJR-00A07astdrmfbAlmaLinux 9.25.14.0-284.25.1.el9_2.x86_64 (x86_64)GCC 11.3.1 20221121ext41024x768AMD EPYC 9124 16-Core @ 3.00GHz (16 Cores / 32 Threads)Supermicro H13SSW (1.1 BIOS)12 x 64 GB DDR5-4800MT/s HMCG94MEBRA123NAMD EPYC 9334 32-Core @ 2.70GHz (32 Cores / 64 Threads)DELL E207WFP1680x1050OpenBenchmarking.orgKernel Details- Transparent Huge Pages: alwaysCompiler Details- --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-isl Processor Details- a: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa10113e- b: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa10113e- c: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa10113e- d: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111- e: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111- f: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111- g: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111- h: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111- i: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111- j: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111Java Details- OpenJDK Runtime Environment (Red_Hat-11.0.20.0.8-1) (build 11.0.20+8-LTS)Python Details- Python 3.9.16Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

abcdefghijResult OverviewPhoronix Test Suite100%143%187%230%273%BlenderBRL-CADIntel Open Image DenoiseEmbreeSPECFEM3DOSPRayTiDB Community ServerTimed Linux Kernel CompilationRemhosOpenVINONeural Magic DeepSparseApache CassandraApache HadoopLiquid-DSPSVT-AV1nekRS

extra tests2specfem3d: Tomographic Modelspecfem3d: Homogeneous Halfspacespecfem3d: Mount St. Helensspecfem3d: Layered Halfspacebrl-cad: VGR Performance Metricremhos: Sample Remap Examplequantlib: Single-Threadedspecfem3d: Water-layered Halfspacequantlib: Multi-Threadednekrs: Kershawnekrs: TurboPipe Periodicdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamtidb: oltp_update_index - 16deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamtidb: oltp_read_write - 32deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamonednn: Convolution Batch Shapes Auto - f32 - CPUtidb: oltp_read_write - 64onednn: Convolution Batch Shapes Auto - u8s8f32 - CPUtidb: oltp_update_non_index - 1tidb: oltp_update_non_index - 32onednn: Convolution Batch Shapes Auto - bf16bf16bf16 - CPUtidb: oltp_point_select - 128onednn: Deconvolution Batch shapes_1d - f32 - CPUonednn: Deconvolution Batch shapes_1d - u8s8f32 - CPUonednn: Deconvolution Batch shapes_1d - bf16bf16bf16 - CPUonednn: Deconvolution Batch shapes_3d - f32 - CPUonednn: Deconvolution Batch shapes_3d - u8s8f32 - CPUonednn: Deconvolution Batch shapes_3d - bf16bf16bf16 - CPUonednn: IP Shapes 1D - f32 - CPUonednn: IP Shapes 1D - u8s8f32 - CPUonednn: IP Shapes 1D - bf16bf16bf16 - CPUtidb: oltp_update_non_index - 128tidb: oltp_read_write - 1onednn: Recurrent Neural Network Training - bf16bf16bf16 - CPUtidb: oltp_read_write - 16tidb: oltp_point_select - 64tidb: oltp_point_select - 32tidb: oltp_point_select - 16tidb: oltp_update_index - 1onednn: Recurrent Neural Network Inference - f32 - CPUtidb: oltp_update_index - 64onednn: IP Shapes 3D - u8s8f32 - CPUtidb: oltp_update_index - 128onednn: IP Shapes 3D - bf16bf16bf16 - CPUtidb: oltp_update_non_index - 16onednn: Recurrent Neural Network Training - f32 - CPUtidb: oltp_update_non_index - 64tidb: oltp_read_write - 128tidb: oltp_point_select - 1onednn: IP Shapes 3D - f32 - CPUtidb: oltp_update_index - 32onednn: Recurrent Neural Network Training - u8s8f32 - CPUonednn: Recurrent Neural Network Inference - u8s8f32 - CPUonednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUkripke: build-linux-kernel: defconfigsvt-av1: Preset 4 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 13 - Bosphorus 4Ksvt-av1: Preset 4 - Bosphorus 1080psvt-av1: Preset 8 - Bosphorus 1080psvt-av1: Preset 12 - Bosphorus 1080psvt-av1: Preset 13 - Bosphorus 1080pblender: BMW27 - CPU-Onlyblender: Classroom - CPU-Onlyblender: Fishy Cat - CPU-Onlyblender: Barbershop - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlyembree: Pathtracer - Crownembree: Pathtracer ISPC - Crownembree: Pathtracer - Asian Dragonembree: Pathtracer - Asian Dragon Objembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Asian Dragon Objembree: Pathtracer - Asian Dragonembree: Pathtracer - Asian Dragon Objembree: Pathtracer - Crownembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Asian Dragon Objembree: Pathtracer ISPC - Crownoidn: RT.hdr_alb_nrm.3840x2160 - CPU-Onlyoidn: RT.ldr_alb_nrm.3840x2160 - CPU-Onlyoidn: RTLightmap.hdr.4096x4096 - CPU-Onlyoidn: RT.hdr_alb_nrm.3840x2160 - CPU-Onlyoidn: RT.ldr_alb_nrm.3840x2160 - CPU-Onlyoidn: RTLightmap.hdr.4096x4096 - CPU-Onlyopenvkl: vklBenchmarkCPU Scalaropenvkl: vklBenchmarkCPU ISPCospray: particle_volume/ao/real_timeospray: particle_volume/scivis/real_timeospray: particle_volume/pathtracer/real_timeospray: gravity_spheres_volume/dim_512/ao/real_timeospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: gravity_spheres_volume/dim_512/pathtracer/real_timeliquid-dsp: 1 - 256 - 32liquid-dsp: 1 - 256 - 57liquid-dsp: 2 - 256 - 32liquid-dsp: 2 - 256 - 57easywave: e2Asean Grid + BengkuluSept2007 Source - 240easywave: e2Asean Grid + BengkuluSept2007 Source - 1200easywave: e2Asean Grid + BengkuluSept2007 Source - 2400liquid-dsp: 4 - 256 - 32liquid-dsp: 4 - 256 - 57liquid-dsp: 8 - 256 - 32liquid-dsp: 8 - 256 - 57liquid-dsp: 1 - 256 - 512liquid-dsp: 16 - 256 - 32liquid-dsp: 16 - 256 - 57liquid-dsp: 2 - 256 - 512liquid-dsp: 32 - 256 - 32liquid-dsp: 32 - 256 - 57liquid-dsp: 4 - 256 - 512liquid-dsp: 64 - 256 - 32liquid-dsp: 64 - 256 - 57liquid-dsp: 8 - 256 - 512liquid-dsp: 96 - 256 - 32liquid-dsp: 96 - 256 - 57liquid-dsp: 16 - 256 - 512liquid-dsp: 32 - 256 - 512liquid-dsp: 64 - 256 - 512liquid-dsp: 96 - 256 - 512hadoop: Open - 50 - 100000hadoop: Open - 100 - 100000hadoop: Open - 50 - 1000000hadoop: Create - 50 - 100000hadoop: Delete - 50 - 100000hadoop: Open - 100 - 1000000hadoop: Rename - 50 - 100000hadoop: Create - 100 - 100000hadoop: Create - 50 - 1000000hadoop: Delete - 100 - 100000hadoop: Delete - 50 - 1000000hadoop: Rename - 100 - 100000hadoop: Rename - 50 - 1000000hadoop: Create - 100 - 1000000hadoop: Delete - 100 - 1000000hadoop: Rename - 100 - 1000000hadoop: File Status - 50 - 100000hadoop: File Status - 100 - 100000hadoop: File Status - 50 - 1000000hadoop: File Status - 100 - 1000000cassandra: Writesabcdefghij12.31294665215.1051177311.02476577526.88598380477216216.34626.98502090811106900000676771000039.4951605.03881417.070616.9074672.463535.628201.3925118.7509485.672549.36535137.01144.6508215.6383111.013149.3258485.7175489.120349.0092218.1464109.8027322.250574.321168.5988347.6612718.918933.341212558158.924150.58975897439.4391605.758790901328287351592425110525403833112756710462712122708718095412818575743311836130.41393.6282.5542.44283.9742.242033.175.8956.01213.945882.912.03748.4416.022873.244.172945.2616.269837.584.86842.9114.23317.2237.85776.948.282454.094.881560.0330.7286884.640.541244.6938.5120606.380.3427.3545.20390.811163.459163.01312.477141.219422.994510.36126.266.4233.22254.8880.5454.901756.087160.144953.573367.337856.48531.831.840.8615.98615.9528215.09614.236913.873916.346839499000594010007718100011749000015385000019622000030754000036943000013909000594230000699740000279010001183500000119210000052911000220770000019944000001098700003005800000255980000021608000042581000062256000071164000046082942016811261264364991075215332705224073353665875669893275529732394614590114730785291015154642173913188679224809512.10059594714.4605869811.31849570928.6521086376851716.79129.46076119711240300000675736000039.4681605.73071403.06517.0669672.373435.6422201.2528118.9482488.126449.10825138.83414.6476215.9254110.915249.1666487.3599489.446448.9703219.5263109.2332321.182974.555368.6617347.2189717.969333.3798159.0596150.60556152039.4539606.66938018313122891415972825103695013080210618067515243712746418068397598909944051781730.44393.23284.2242.2284.9942.092028.015.9156.06213.625836.272.05750.4915.982880.584.162986.4616.029849.074.85854.5114.03317.2837.795780.448.272450.264.891546.023187359.230.541239.6738.66120728.220.3427.2415.14991.322166.378166.69212.591138.338427.686542.61126.2466.6433.17255.380.7655.392556.455159.912453.813567.195156.69021.831.840.8615.978515.9888214.07414.178313.766616.43653948600059296000770190001140100001536900001965900003051100003669300001402100060247000069276000027736000119030000012142000005558800022121000002001900000108080000299540000025711000002161500004296200006109500007181400004694844048581020408412887380117382273046374255211990827973146934871679444378671572129862069458716194174816197025666112.04091787714.80827336511.3273597727.49085015776252916.24327.06023507910826700000675417000039.4464605.91831418.904116.8863671.255435.6825201.5402118.7801489.110649.01735153.66444.6348215.647111.02547.1535507.4786487.052249.2055218.5162109.5847321.508274.503168.6287347.3728716.140433.463712681164.6131145.25625963039.4183605.87657846913811499625286524853736865406118923324265463910644711756530.43393.37282.6742.43284.3142.192029.795.956.02213.795840.532.05757.3815.832881.144.162987.3316.029845.274.86849.314.12317.3337.795802.658.242455.514.881551.6330.8986789.80.541237.2938.75123484.280.3427.4085.04990.417163.055161.49512.617143.545431.895516.90626.1266.7233.03254.7280.4155.403756.807859.792953.692767.503856.93271.831.820.8715.987215.9778214.13614.139913.831716.535394530005751900076924000118550000153670000194510000306760000366990000142250006036500006749300002822700011848000001254800000551650002206800000201030000010914000029998000002564900000214910000424400000622630000715030000401606403226683995439379058018587477101350755226073475901476715974638440019703166827657895729927284252189393927048027.33098558835.57168490826.73641411871.61429432729806430.76162.44174958510318900000793457000013.0694606.101508.08715.7246257.272831.052571.137112.2499162.850249.08631599.20794.99671.9189111.108116.1648493.596163.555948.872972.455110.1114108.90973.305824.4833325.8763240.552933.22421262255.6132143.76434697713.1312606.57732.13332553341.558241693262731.337891294923.815760.6282363.059913.377820.8478051.913742.494080.6522591.037491643.9936480115675981491479838.516211080.603951.02875185631641.92342245972758981.25758176121642.51849.163847.3810.47761.59107.0274.71106.974.81797.6410.0120.03398.522564.783.11344.6723.21175.676.791039.6115.363540.884.51370.5721.57124.1264.412013.777.931036.997.7532.5930.0232002.620.49395.6640.444958.070.3524099450055.1734.10766.988163.189161.85410.91118.946526.216604.98672182.9990.03670.87224.1521.481122.58524.687222.261428.364323.873324.84522.351721.894327.743823.353122.39220.720.720.340.720.720.341914875.574695.57001151.9055.607475.453296.587453522800052665000670540001056500001.65738.10598.981386000001889300002780300003633100001268300054536000068915000024627000104710000010350000005025800010595000001093300000995940001065200000112080000019385000027376000028292000028625000057803552910127831958617101010124843982372579717213410570811101282102839217129611261381208632911591716181818260060119786627.45982130835.03013488926.79914344670.18902850629612530.84562.32514682810264000000793101000012.9433607.913511.409815.6245257.89430.986771.2727112.0574163.136149.00941599.15434.985971.9146111.088816.1392494.2575162.929849.059872.6571109.9654109.093873.260924.4725325.7416240.234933.26251256755.4634144.10134673713.1187606.7552.1257538931.549111708262851.338611299043.844210.6339753.06373.384360.8444341.917812.565220.657611.144324213832091643.973678411865796907702501490849.712212710.575794246111.05425185571641338816014559761.28043171171639.36851.659841.07810.47761.16107.2774.5107.2474.54793.7510.0620398.912562.543.11342.8123.321174.66.81039.8215.363544.184.51373.6421.4123.6164.682007.537.961028.647.77530.9930.132032.060.49432.3236.9844933.270.3523624390055.0934.11467.721162.608162.05110.984119.307525.173597.01171.44182.5690.31670.64224.121.435722.569424.734322.157728.314123.939324.828222.291121.990927.829323.528322.34220.720.720.340.720.720.341904875.541075.56353151.5065.62045.461536.58273531500052827000688460001054800001.65438.06799.41513862000019123000027778000035799000012366000545140000692920000252070001046600000103200000050380000105750000010954000009700500010651000001117800000196040000273480000281830000285880000552486294985251004586171006041204819822375882470897980391133278382284041700571132258436038910561349732092423562719579826.97375739535.53507300126.87316845570.54225590529560330.72561.2817691249976450000795579000013.0853607.8171508.208815.721257.504631.029271.044112.413162.929449.07121600.52754.987771.9401110.885216.1307494.2211162.897649.071472.5736110.0001109.0973.216324.5238324.9568240.164233.27511269255.5428143.69224714113.0934606.78522.13062549561.572821697266951.341831303893.818230.6303253.056743.379560.8506911.914222.497140.6531821.001364142432181642.353612511909297368701051483851.494210670.600834248301.061441636.76344706031059541.206531636.44849.344845.30810.48760.57107.3974.43106.7674.87791.7410.0920.01399.242539.973.14343.4923.281180.856.761038.4715.383548.784.5369.2621.65124.364.312004.767.971041.877.67533.7429.9531951.640.49431.9437.0144968.430.3523659100055.1484.13867.393161.847160.79810.736118.486521.518585.36871.96181.790.26667.87223.9521.591322.656624.704722.14928.323723.935424.88722.267621.774627.82623.504222.44070.720.720.340.720.720.341914885.57325.55581151.785.614545.452276.595633527100052879000688610001057400001.65738.01597.9871385800001898800002763900003504500001268100054502000069334000025199000104190000010246000004997700010571000001094600000994410001065300000112050000019450000027339000028303000028592000057803552356012210015834396993130378181633593826992099404111198794918250170537110803858157092204784691795332196463719628727.74647516235.37860002127.69663137169.95560916529552230.7562.81092437610500600000796491000013.073607.1628509.13915.6892257.280831.057470.9275112.4779162.993749.02591602.52214.978771.9003110.975916.0672495.6033163.228248.983772.6879109.9037109.219173.186724.4607325.5075239.517633.36741262755.4264144.10534699313.0596608.71632.11813553011.5511817051.335643.823810.6291083.054583.381560.8434921.912742.514410.64771.127234169531951641.43608811854996840699231481848.0320.61232245741.04567187351637.3734107599441.27918171351631.99837.595847.41710.48759.92107.0474.71107.2474.58793.910.0620.05398.132557.663.12341.3623.421175.586.791039.3715.373533.644.52372.2621.47123.4164.772006.097.961031.67.74538.0129.7232008.030.49432.236.9845097.990.3523717570055.1724.14367.811160.322161.32411.016118.481528.533586.74872.01183.2990.63669.09224.1221.584722.774524.819322.190128.479323.879624.961922.255921.830527.9123.709122.42150.720.720.340.720.720.341914895.575535.56539151.6815.622785.477256.600853523600052854000686780001048000001.64837.9597.529138460000190750000277410000357810000122560005430500006820700002272700010471000001033400000495560001056200000109930000010017000010657000001118200000194670000274070000281730000286530000546448460829654022606801039501107420822375892872706102564110828803868481070922113895857635617984878052036660204918019709215.98949194819.96151934815.03269371140.32936342857250020.4423357.936.445871583116781.59145900000676127000025.7096613.05461003.517115.9249507.63431.4896136.9614116.5064327.019248.88123324.81824.8005144.1181110.810832.0042495.2237326.927148.8889145.4778109.7922216.238473.880247.1323337.9568488.064832.752616965109.0251146.11917548625.7916613.16391.14749955790.7785431861360410.7344612003273.722470.4264261.78171.733810.4400061.0411.742030.8927012.0988658163480987.83747576138538872181666564.12313320.30246371260.7045523794986.9585119110418061250.92628324286993.564568.747568.64919.82804.58197.9480.77196.0781.581481.7110.7837.82421.84803.653.32643.824.842252.77.091963.916.276653.864.8710.6922.5234.1868.273780.88.462180.837.331034.3530.9259615.880.53810.7139.4468931.350.3535480800033.9455.07599.099230.026223.41612.23151.437580.163726.88938.499.5449.1352.4119.342.893245.475748.118843.505654.388846.378548.906843.844643.572154.220345.923445.191.371.380.651.371.380.6536392610.798810.7832192.64510.852410.591312.54383714500051443000724680001052800001.28426.10668.57314582000020093000029262000037833000012909000585850000741420000256480001172400000135290000052890000205750000019168000001044400002068300000199550000020759000039168000051202000051970000064516152631612330465872010040232372983056604967341110526311340479808851217361111178284310925926595238426439235294132457515.59023785919.61963726515.19244731839.83358978857045820.3023365.437.5052638491171999269890000676807000025.6331612.9837999.461915.9895508.360431.4411136.684116.8908327.731448.79013327.18914.8015144.0005110.983331.9586494.4953326.775748.8928145.6474109.7363216.216373.940447.3497336.7673486.706832.835416817109.4649145.83257525425.704613.64021.15012942610.798541848356500.7350941981373.659070.4275121.788761.734990.4403681.043121.644781.94191.243083485985.74347501180179138173864711656566.178305220.301535361410.64425223541991.0735034610462061650.93179323773987.355564.454563.33419.83804.75193.882.49197.6680.881488.0410.7437.57425.684848.423.29642.924.872264.937.051964.6116.276646.914.81709.7322.53233.6568.423777.758.462224.087.181036.1130.8759654.980.53815.1339.2368945.320.3535015120033.8695.07998.573227.865227.20512.259149.051591.319728.53838.5799.3548.69351.66119.4243.268145.400648.190843.573654.506346.363348.71843.767443.811654.187746.087245.71061.371.380.651.371.380.6536392210.74310.7904192.410.882910.584812.49873714100055841000724910001097000001.28826.39368.23614592000019864000029243000037725000013363000583870000735800000259100001172900000139410000052129000205260000018997000001047800002069900000199700000020972000039320000051231000052014000058139555555625367858997102249382995908275903272464102041110436823728631172010114692852158695658474581930502250626631810915.84389531719.72558666315.09991232639.86742377756906620.363371.637.808113034117263.39242080000683536000025.727614.23031002.811315.9389507.364531.5024136.5656116.8464327.185548.82913324.69524.8016144.0515110.903832.0639494.0076326.90448.8934145.3726109.8573216.50873.77747.3339336.675487.229832.808516972109.4068145.90157425225.769612.52091.155780.768314356550.7316181977383.680870.430271.786911.735010.4401561.043331.754530.8800161.94941640663479991.12347414180581137618874121660569.795306380.309278366440.7149723543988.589503041058020.93600124366994.612563.575566.38619.84805.38194.8282.09196.2681.51483.2510.7737.48425.884892.273.26648.2724.672254.727.081964.7116.276638.244.81709.7522.53233.8868.353783.658.452194.367.281012.9831.5759505.780.53812.7639.3468895.50.3534901980033.9345.1699.345224.406228.76512.175149.451584.12726.50338.5199.2948.82351.38119.0443.314145.322748.095643.416154.515746.432748.711543.904343.933554.147346.023245.39561.371.380.651.371.380.6536392210.693210.7664192.70110.874310.57412.51043712000055715000724000001113700001.24525.55568.5191457400002001200002924900003816600001289900058567000073712000026378000116990000013698000004978100020565000001922300000104220000207100000019995000002094900003932700005110700005194400006172843703701251564593479560228910189206580057315397371113572834728855072754110693871617518806849321941748558036316485OpenBenchmarking.org

SPECFEM3D

simulates acoustic (fluid), elastic (solid), coupled acoustic/elastic, poroelastic or seismic wave propagation in any type of conforming mesh of hexahedra. This test profile currently relies on CPU-based execution for SPECFEM3D and using a variety of their built-in examples/models for benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Tomographic Modelabcdefghij71421283512.3112.1012.0427.3327.4626.9727.7515.9915.5915.841. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi

OpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Homogeneous Halfspaceabcdefghij81624324015.1114.4614.8135.5735.0335.5435.3819.9619.6219.731. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi

OpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Mount St. Helensabcdefghij71421283511.0211.3211.3326.7426.8026.8727.7015.0315.1915.101. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi

OpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Layered Halfspaceabcdefghij163248648026.8928.6527.4971.6170.1970.5469.9640.3339.8339.871. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi

BRL-CAD

BRL-CAD is a cross-platform, open-source solid modeling system with built-in benchmark mode. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.36VGR Performance Metricabcdefghij170K340K510K680K850K7721627685177625292980642961252956032955225725005704585690661. (CXX) g++ options: -std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6

Remhos

Remhos (REMap High-Order Solver) is a miniapp that solves the pure advection equations that are used to perform monotonic and conservative discontinuous field interpolation (remap) as part of the Eulerian phase in Arbitrary Lagrangian Eulerian (ALE) simulations. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterRemhos 1.0Test: Sample Remap Exampleabcdefghij71421283516.3516.7916.2430.7630.8530.7330.7520.4420.3020.361. (CXX) g++ options: -O3 -std=c++11 -lmfem -lHYPRE -lmetis -lrt -lmpi_cxx -lmpi

QuantLib

QuantLib is an open-source library/framework around quantitative finance for modeling, trading and risk management scenarios. QuantLib is written in C++ with Boost and its built-in benchmark used reports the QuantLib Benchmark Index benchmark score. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Single-Threadedhij70014002100280035003357.93365.43371.61. (CXX) g++ options: -O3 -march=native -fPIE -pie

SPECFEM3D

simulates acoustic (fluid), elastic (solid), coupled acoustic/elastic, poroelastic or seismic wave propagation in any type of conforming mesh of hexahedra. This test profile currently relies on CPU-based execution for SPECFEM3D and using a variety of their built-in examples/models for benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Water-layered Halfspaceabcdefghij142842567026.9929.4627.0662.4462.3361.2862.8136.4537.5137.811. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi

QuantLib

QuantLib is an open-source library/framework around quantitative finance for modeling, trading and risk management scenarios. QuantLib is written in C++ with Boost and its built-in benchmark used reports the QuantLib Benchmark Index benchmark score. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Multi-Threadedhij30K60K90K120K150K116781.5117199.0117263.31. (CXX) g++ options: -O3 -march=native -fPIE -pie

nekRS

nekRS is an open-source Navier Stokes solver based on the spectral element method. NekRS supports both CPU and GPU/accelerator support though this test profile is currently configured for CPU execution. NekRS is part of Nek5000 of the Mathematics and Computer Science MCS at Argonne National Laboratory. This nekRS benchmark is primarily relevant to large core count HPC servers and otherwise may be very time consuming on smaller systems. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgflops/rank, More Is BetternekRS 23.0Input: Kershawabcdefghij2000M4000M6000M8000M10000M11106900000112403000001082670000010318900000102640000009976450000105006000009145900000926989000092420800001. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi

OpenBenchmarking.orgflops/rank, More Is BetternekRS 23.0Input: TurboPipe Periodicabcdefghij2000M4000M6000M8000M10000M67677100006757360000675417000079345700007931010000795579000079649100006761270000676807000068353600001. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi

OpenRadioss

OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/ and https://github.com/OpenRadioss/ModelExchange/tree/main/Examples. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.

Model: Bumper Beam

a: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

b: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

c: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

d: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

e: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

f: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

g: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

h: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

i: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

j: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

Model: Chrysler Neon 1M

a: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

b: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

c: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

d: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

e: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

f: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

g: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

h: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

i: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

j: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

Model: Cell Phone Drop Test

a: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

b: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

c: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

d: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

e: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

f: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

g: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

h: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

i: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

j: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

Model: Bird Strike on Windshield

a: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

b: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

c: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

d: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

e: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

f: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

g: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

h: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

i: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

j: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

Model: Rubber O-Ring Seal Installation

a: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

b: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

c: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

d: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

e: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

f: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

g: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

h: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

i: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

j: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

Model: INIVOL and Fluid Structure Interaction Drop Container

a: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

b: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

c: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

d: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

e: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

f: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

g: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

h: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

i: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

j: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

Neural Magic DeepSparse

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Streamabcdefghij91827364539.5039.4739.4513.0712.9413.0913.0725.7125.6325.73

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Streamabcdefghij130260390520650605.04605.73605.92606.10607.91607.82607.16613.05612.98614.23

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Streamabcdefghij300600900120015001417.071403.071418.90508.09511.41508.21509.141003.52999.461002.81

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Streamabcdefghij4812162016.9117.0716.8915.7215.6215.7215.6915.9215.9915.94

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Streamabcdefghij150300450600750672.46672.37671.26257.27257.89257.50257.28507.63508.36507.36

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Streamabcdefghij81624324035.6335.6435.6831.0530.9931.0331.0631.4931.4431.50

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Streamabcdefghij4080120160200201.39201.25201.5471.1471.2771.0470.93136.96136.68136.57

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Streamabcdefghij306090120150118.75118.95118.78112.25112.06112.41112.48116.51116.89116.85

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Streamabcdefghij110220330440550485.67488.13489.11162.85163.14162.93162.99327.02327.73327.19

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Streamabcdefghij112233445549.3749.1149.0249.0949.0149.0749.0348.8848.7948.83

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Streamabcdefghij110022003300440055005137.015138.835153.661599.211599.151600.531602.523324.823327.193324.70

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Streamabcdefghij1.12412.24823.37234.49645.62054.65084.64764.63484.99604.98594.98774.97874.80054.80154.8016

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Streamabcdefghij50100150200250215.64215.93215.6571.9271.9171.9471.90144.12144.00144.05

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Streamabcdefghij20406080100111.01110.92111.03111.11111.09110.89110.98110.81110.98110.90

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Streamabcdefghij112233445549.3349.1747.1516.1616.1416.1316.0732.0031.9632.06

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Streamabcdefghij110220330440550485.72487.36507.48493.60494.26494.22495.60495.22494.50494.01

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Streamabcdefghij110220330440550489.12489.45487.05163.56162.93162.90163.23326.93326.78326.90

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Streamabcdefghij112233445549.0148.9749.2148.8749.0649.0748.9848.8948.8948.89

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Streamabcdefghij50100150200250218.15219.53218.5272.4672.6672.5772.69145.48145.65145.37

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Streamabcdefghij20406080100109.80109.23109.58110.11109.97110.00109.90109.79109.74109.86

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Streamabcdefghij70140210280350322.25321.18321.51108.91109.09109.09109.22216.24216.22216.51

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Streamabcdefghij2040608010074.3274.5674.5073.3173.2673.2273.1973.8873.9473.78

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Streamabcdefghij153045607568.6068.6668.6324.4824.4724.5224.4647.1347.3547.33

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Streamabcdefghij80160240320400347.66347.22347.37325.88325.74324.96325.51337.96336.77336.68

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Streamabcdefghij160320480640800718.92717.97716.14240.55240.23240.16239.52488.06486.71487.23

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Streamabcdefghij81624324033.3433.3833.4633.2233.2633.2833.3732.7532.8432.81

TiDB Community Server

This is a PingCAP TiDB Community Server benchmark facilitated using the sysbench OLTP database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_index - Threads: 16acdefghij4K8K12K16K20K125581268112622125671269212627169651681716972

Test: oltp_update_index - Threads: 16

b: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

Neural Magic DeepSparse

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Streamabcdefghij4080120160200158.92159.06164.6155.6155.4655.5455.43109.03109.46109.41

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Streamabcdefghij306090120150150.59150.61145.26143.76144.10143.69144.11146.12145.83145.90

TiDB Community Server

This is a PingCAP TiDB Community Server benchmark facilitated using the sysbench OLTP database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_read_write - Threads: 32abcdefghij16K32K48K64K80K58974615205963046977467374714146993754867525474252

Neural Magic DeepSparse

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Streamabcdefghij91827364539.4439.4539.4213.1313.1213.0913.0625.7925.7025.77

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Streamabcdefghij130260390520650605.76606.67605.88606.58606.76606.79608.72613.16613.64612.52

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPUdefghij0.480.961.441.922.42.133322.125702.130622.118131.147491.150121.15578MIN: 2MIN: 2.01MIN: 1.97MIN: 1.99MIN: 1.01MIN: 1MIN: 1.031. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

TiDB Community Server

This is a PingCAP TiDB Community Server benchmark facilitated using the sysbench OLTP database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_read_write - Threads: 64abcdefghi20K40K60K80K100K790908018378469553345389354956553019557994261

Test: oltp_read_write - Threads: 64

j: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPUdefghij0.35390.70781.06171.41561.76951.5582401.5491101.5728201.5511800.7785430.7985400.768314MIN: 1.51MIN: 1.51MIN: 1.53MIN: 1.52MIN: 0.71MIN: 0.7MIN: 0.711. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

TiDB Community Server

This is a PingCAP TiDB Community Server benchmark facilitated using the sysbench OLTP database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_non_index - Threads: 1abcdefghi400800120016002000132813121381169317081697170518611848

Test: oltp_update_non_index - Threads: 1

j: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_non_index - Threads: 32abdefhij8K16K24K32K40K2873528914262732628526695360413565035655

Test: oltp_update_non_index - Threads: 32

c: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

g: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPUdefghij0.30190.60380.90571.20761.50951.3378901.3386101.3418301.3356400.7344610.7350940.731618MIN: 1.31MIN: 1.31MIN: 1.31MIN: 1.31MIN: 0.66MIN: 0.66MIN: 0.661. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

TiDB Community Server

This is a PingCAP TiDB Community Server benchmark facilitated using the sysbench OLTP database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_point_select - Threads: 128abcdefhij40K80K120K160K200K159242159728149962129492129904130389200327198137197738

Test: oltp_point_select - Threads: 128

g: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPUdefghij0.86491.72982.59473.45964.32453.815763.844213.818233.823813.722473.659073.68087MIN: 3.26MIN: 3.27MIN: 3.25MIN: 3.29MIN: 2.83MIN: 2.81MIN: 2.851. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPUdefghij0.14260.28520.42780.57040.7130.6282360.6339750.6303250.6291080.4264260.4275120.430270MIN: 0.6MIN: 0.6MIN: 0.6MIN: 0.6MIN: 0.38MIN: 0.39MIN: 0.381. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPUdefghij0.68931.37862.06792.75723.44653.059913.063703.056743.054581.781701.788761.78691MIN: 2.96MIN: 2.97MIN: 2.97MIN: 2.97MIN: 1.64MIN: 1.65MIN: 1.661. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPUdefghij0.76151.5232.28453.0463.80753.377823.384363.379563.381561.733811.734991.73501MIN: 3.33MIN: 3.33MIN: 3.33MIN: 3.33MIN: 1.64MIN: 1.65MIN: 1.641. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPUdefghij0.19140.38280.57420.76560.9570.8478050.8444340.8506910.8434920.4400060.4403680.440156MIN: 0.83MIN: 0.83MIN: 0.83MIN: 0.83MIN: 0.41MIN: 0.41MIN: 0.411. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPUdefghij0.43150.8631.29451.7262.15751.913741.917811.914221.912741.041001.043121.04333MIN: 1.88MIN: 1.88MIN: 1.88MIN: 1.88MIN: 0.94MIN: 0.94MIN: 0.941. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: IP Shapes 1D - Data Type: f32 - Engine: CPUdefghij0.57721.15441.73162.30882.8862.494082.565222.497142.514411.742031.644781.75453MIN: 2.3MIN: 2.32MIN: 2.26MIN: 2.3MIN: 1.51MIN: 1.42MIN: 1.521. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPUdefghij0.43690.87381.31071.74762.18450.6522590.6576100.6531820.6477000.8927011.9419000.880016MIN: 0.57MIN: 0.57MIN: 0.57MIN: 0.57MIN: 0.79MIN: 0.87MIN: 0.781. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPUdefghij0.47220.94441.41661.88882.3611.037491.144321.001361.127232.098801.243081.94941MIN: 0.92MIN: 1.07MIN: 0.92MIN: 0.93MIN: 1.29MIN: 1.04MIN: 1.261. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

TiDB Community Server

This is a PingCAP TiDB Community Server benchmark facilitated using the sysbench OLTP database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_non_index - Threads: 128acefghj14K28K42K56K70K51105528654213841424416956581664066

Test: oltp_update_non_index - Threads: 128

b: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

d: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

i: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_read_write - Threads: 1abcefghij7001400210028003500254025102485320932183195348034853479

Test: oltp_read_write - Threads: 1

d: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPUdefghij4008001200160020001643.991643.971642.351641.40987.84985.74991.12MIN: 1588.03MIN: 1590.89MIN: 1586.17MIN: 1589.91MIN: 952.67MIN: 949.93MIN: 954.921. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

TiDB Community Server

This is a PingCAP TiDB Community Server benchmark facilitated using the sysbench OLTP database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_read_write - Threads: 16abcdefghij10K20K30K40K50K38331369503736836480367843612536088475764750147414

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_point_select - Threads: 64abdefgij40K80K120K160K200K127567130802115675118657119092118549180179180581

Test: oltp_point_select - Threads: 64

c: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

h: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_point_select - Threads: 32abdefghij30K60K90K120K150K10462710618098149969079736896840138538138173137618

Test: oltp_point_select - Threads: 32

c: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_point_select - Threads: 16bcefghij20K40K60K80K100K6751565406702507010569923872188647187412

Test: oltp_point_select - Threads: 16

a: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

d: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_index - Threads: 1acdefghij400800120016002000121211891479149014831481166616561660

Test: oltp_update_index - Threads: 1

b: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPUdefghij2004006008001000838.52849.71851.49848.03564.12566.18569.80MIN: 796.3MIN: 805.98MIN: 807.97MIN: 807.34MIN: 545.13MIN: 544.56MIN: 548.081. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

TiDB Community Server

This is a PingCAP TiDB Community Server benchmark facilitated using the sysbench OLTP database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_index - Threads: 64bcdefhij7K14K21K28K35K2437123324211082127121067313323052230638

Test: oltp_update_index - Threads: 64

a: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

g: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPUdefghij0.13780.27560.41340.55120.6890.6039500.5757940.6008340.6123200.3024600.3015350.309278MIN: 0.53MIN: 0.52MIN: 0.53MIN: 0.53MIN: 0.27MIN: 0.28MIN: 0.281. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

TiDB Community Server

This is a PingCAP TiDB Community Server benchmark facilitated using the sysbench OLTP database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_index - Threads: 128abcefghij8K16K24K32K40K270872746426546246112483024574371263614136644

Test: oltp_update_index - Threads: 128

d: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPUdefghij0.23880.47760.71640.95521.1941.0287501.0542501.0614401.0456700.7045500.6442520.714970MIN: 0.96MIN: 0.97MIN: 0.98MIN: 0.98MIN: 0.66MIN: 0.61MIN: 0.671. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

TiDB Community Server

This is a PingCAP TiDB Community Server benchmark facilitated using the sysbench OLTP database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_non_index - Threads: 16abdeghij5K10K15K20K25K1809518068185631855718735237942354123543

Test: oltp_update_non_index - Threads: 16

c: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

f: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPUdefghij4008001200160020001641.921641.001636.761637.37986.96991.07988.59MIN: 1584.81MIN: 1595.55MIN: 1585.98MIN: 1584.58MIN: 949.02MIN: 953.96MIN: 950.961. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

TiDB Community Server

This is a PingCAP TiDB Community Server benchmark facilitated using the sysbench OLTP database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_non_index - Threads: 64abcdefghij11K22K33K44K55K41281397593910634224338813447034107511915034650304

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_read_write - Threads: 128abdefghij20K40K60K80K100K857578909959727601456031059944104180104620105802

Test: oltp_read_write - Threads: 128

c: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_point_select - Threads: 1abcdefhi1300260039005200650043314405447158985976595461256165

Test: oltp_point_select - Threads: 1

g: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

j: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: IP Shapes 3D - Data Type: f32 - Engine: CPUdefghij0.28810.57620.86431.15241.44051.2575801.2804301.2065301.2791800.9262830.9317930.936001MIN: 1.21MIN: 1.24MIN: 1.18MIN: 1.24MIN: 0.85MIN: 0.86MIN: 0.861. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

TiDB Community Server

This is a PingCAP TiDB Community Server benchmark facilitated using the sysbench OLTP database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_index - Threads: 32abcdeghij5K10K15K20K25K183611781717565176121711717135242862377324366

Test: oltp_update_index - Threads: 32

f: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPUdefghij4008001200160020001642.511639.361636.441631.99993.56987.36994.61MIN: 1593.16MIN: 1581.93MIN: 1585.81MIN: 1581.62MIN: 955.42MIN: 952.16MIN: 960.21. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPUdefghij2004006008001000849.16851.66849.34837.60568.75564.45563.58MIN: 806.44MIN: 809.45MIN: 805.8MIN: 796.61MIN: 546.79MIN: 545.57MIN: 543.651. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPUdefghij2004006008001000847.38841.08845.31847.42568.65563.33566.39MIN: 806.33MIN: 798.46MIN: 803.78MIN: 806.72MIN: 547.26MIN: 544.04MIN: 542.71. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection FP16 - Device: CPUabcdefghij71421283530.4130.4430.4310.4710.4710.4810.4819.8219.8319.841. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection FP16 - Device: CPUabcdefghij2004006008001000393.60393.23393.37761.59761.16760.57759.92804.58804.75805.38MIN: 363.29 / MAX: 431.61MIN: 360.87 / MAX: 433.13MIN: 362.57 / MAX: 433.51MIN: 738.34 / MAX: 772.36MIN: 741.99 / MAX: 776.56MIN: 741.4 / MAX: 770.88MIN: 737.63 / MAX: 771.07MIN: 772.52 / MAX: 820.63MIN: 776.93 / MAX: 819.19MIN: 783.22 / MAX: 819.231. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Person Detection FP16 - Device: CPUabcdefghij60120180240300282.55284.22282.67107.02107.27107.39107.04197.94193.80194.821. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Person Detection FP16 - Device: CPUabcdefghij2040608010042.4442.2042.4374.7174.5074.4374.7180.7782.4982.09MIN: 36.14 / MAX: 61.98MIN: 36.84 / MAX: 61.97MIN: 36.31 / MAX: 62.36MIN: 66.12 / MAX: 81.09MIN: 66.5 / MAX: 80.32MIN: 65.68 / MAX: 83.49MIN: 66.29 / MAX: 79.68MIN: 69.54 / MAX: 95.42MIN: 70.77 / MAX: 94.62MIN: 68.73 / MAX: 91.871. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Person Detection FP32 - Device: CPUabcdefghij60120180240300283.97284.99284.31106.90107.24106.76107.24196.07197.66196.261. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Person Detection FP32 - Device: CPUabcdefghij2040608010042.2442.0942.1974.8174.5474.8774.5881.5880.8881.50MIN: 36.59 / MAX: 61.56MIN: 37.13 / MAX: 58.71MIN: 36.21 / MAX: 65.64MIN: 66.88 / MAX: 80.7MIN: 65.97 / MAX: 82.9MIN: 66.72 / MAX: 80.96MIN: 67.63 / MAX: 78.73MIN: 68.74 / MAX: 95.81MIN: 39.72 / MAX: 92.54MIN: 68.9 / MAX: 92.661. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16 - Device: CPUabcdefghij4008001200160020002033.172028.012029.79797.64793.75791.74793.901481.711488.041483.251. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16 - Device: CPUabcdefghij36912155.895.915.9010.0110.0610.0910.0610.7810.7410.77MIN: 4.67 / MAX: 18.4MIN: 4.84 / MAX: 12.9MIN: 4.83 / MAX: 13.4MIN: 5.7 / MAX: 19.52MIN: 5.29 / MAX: 19.07MIN: 5.4 / MAX: 19.17MIN: 5.2 / MAX: 19.38MIN: 5.59 / MAX: 21.13MIN: 5.92 / MAX: 24.44MIN: 6 / MAX: 18.161. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection FP16-INT8 - Device: CPUabcdefghij132639526556.0156.0656.0220.0320.0020.0120.0537.8237.5737.481. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection FP16-INT8 - Device: CPUabcdefghij90180270360450213.94213.62213.79398.52398.91399.24398.13421.80425.68425.88MIN: 201.64 / MAX: 242.71MIN: 197.2 / MAX: 235.23MIN: 197.29 / MAX: 236.32MIN: 382.1 / MAX: 404.98MIN: 386.2 / MAX: 407.29MIN: 387.9 / MAX: 408.93MIN: 379.09 / MAX: 404.71MIN: 269.94 / MAX: 598.22MIN: 402.91 / MAX: 432.03MIN: 404.76 / MAX: 434.061. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16 - Device: CPUabcdefghij130026003900520065005882.915836.275840.532564.782562.542539.972557.664803.654848.424892.271. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16 - Device: CPUabcdefghij0.7471.4942.2412.9883.7352.032.052.053.113.113.143.123.323.293.26MIN: 1.66 / MAX: 7.51MIN: 1.6 / MAX: 7MIN: 1.62 / MAX: 6.96MIN: 1.94 / MAX: 11.57MIN: 1.93 / MAX: 9.72MIN: 1.93 / MAX: 11.65MIN: 1.88 / MAX: 11.92MIN: 2.11 / MAX: 12.58MIN: 1.89 / MAX: 12.75MIN: 2.1 / MAX: 14.31. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16 - Device: CPUabcdefghij160320480640800748.44750.49757.38344.67342.81343.49341.36643.80642.90648.271. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16 - Device: CPUabcdefghij61218243016.0215.9815.8323.2023.3223.2823.4224.8424.8724.67MIN: 12.5 / MAX: 33.94MIN: 12.74 / MAX: 33.34MIN: 12.38 / MAX: 32.97MIN: 15.1 / MAX: 31.6MIN: 19.49 / MAX: 30.99MIN: 15.73 / MAX: 30.77MIN: 20.46 / MAX: 32.43MIN: 16.93 / MAX: 33.96MIN: 17 / MAX: 33.34MIN: 20.15 / MAX: 37.891. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16-INT8 - Device: CPUabcdefghij60012001800240030002873.242880.582881.141175.671174.601180.851175.582252.702264.932254.721. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16-INT8 - Device: CPUabcdefghij2468104.174.164.166.796.806.766.797.097.057.08MIN: 3.39 / MAX: 10.07MIN: 3.42 / MAX: 11.2MIN: 3.43 / MAX: 10.26MIN: 3.8 / MAX: 15.48MIN: 4.04 / MAX: 15.37MIN: 4.04 / MAX: 15.47MIN: 3.79 / MAX: 15.41MIN: 4.43 / MAX: 16.88MIN: 4.44 / MAX: 16.57MIN: 4.35 / MAX: 16.861. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16 - Device: CPUabcdefghij60012001800240030002945.262986.462987.331039.611039.821038.471039.371963.901964.611964.711. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16 - Device: CPUabcdefghij4812162016.2616.0216.0215.3615.3615.3815.3716.2716.2716.27MIN: 14.71 / MAX: 28.14MIN: 14.41 / MAX: 30.55MIN: 14.63 / MAX: 33.79MIN: 8.08 / MAX: 24.34MIN: 8.02 / MAX: 23.81MIN: 7.99 / MAX: 24MIN: 7.99 / MAX: 23.98MIN: 8.92 / MAX: 25.52MIN: 8.5 / MAX: 25.86MIN: 8.44 / MAX: 25.481. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16-INT8 - Device: CPUabcdefghij2K4K6K8K10K9837.589849.079845.273540.883544.183548.783533.646653.866646.916638.241. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16-INT8 - Device: CPUabcdefghij1.09352.1873.28054.3745.46754.864.854.864.514.514.504.524.804.814.81MIN: 4.23 / MAX: 12.81MIN: 4.25 / MAX: 12.86MIN: 4.34 / MAX: 12.27MIN: 2.98 / MAX: 13.05MIN: 2.96 / MAX: 16.06MIN: 2.98 / MAX: 13.86MIN: 2.77 / MAX: 13.57MIN: 3.23 / MAX: 14.95MIN: 3.23 / MAX: 15.04MIN: 3.23 / MAX: 14.451. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16-INT8 - Device: CPUabcdefghij2004006008001000842.91854.51849.30370.57373.64369.26372.26710.69709.73709.751. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16-INT8 - Device: CPUabcdefghij51015202514.2314.0314.1221.5721.4021.6521.4722.5022.5322.53MIN: 11.51 / MAX: 25.86MIN: 11.59 / MAX: 26.04MIN: 11.51 / MAX: 26.04MIN: 19.5 / MAX: 24.76MIN: 19.07 / MAX: 25.3MIN: 19.48 / MAX: 24.27MIN: 17.62 / MAX: 28.13MIN: 13.76 / MAX: 30.22MIN: 19.09 / MAX: 30.15MIN: 18.74 / MAX: 31.081. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Machine Translation EN To DE FP16 - Device: CPUabcdefghij70140210280350317.22317.28317.33124.12123.61124.30123.41234.18233.65233.881. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Machine Translation EN To DE FP16 - Device: CPUabcdefghij153045607537.8037.7937.7964.4164.6864.3164.7768.2768.4268.35MIN: 33.35 / MAX: 56.45MIN: 32.97 / MAX: 53.7MIN: 33.29 / MAX: 54.88MIN: 37.44 / MAX: 73.04MIN: 38.02 / MAX: 72.52MIN: 50.85 / MAX: 70.77MIN: 55.8 / MAX: 69.46MIN: 56.41 / MAX: 79.96MIN: 56.13 / MAX: 75.77MIN: 55.82 / MAX: 74.841. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16-INT8 - Device: CPUabcdefghij120024003600480060005776.945780.445802.652013.772007.532004.762006.093780.803777.753783.651. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16-INT8 - Device: CPUabcdefghij2468108.288.278.247.937.967.977.968.468.468.45MIN: 7.44 / MAX: 23.35MIN: 7.37 / MAX: 25.18MIN: 7.62 / MAX: 23.32MIN: 4.2 / MAX: 16.92MIN: 4.19 / MAX: 16.59MIN: 4.37 / MAX: 16.86MIN: 4.19 / MAX: 14.2MIN: 4.67 / MAX: 18MIN: 4.49 / MAX: 17.8MIN: 4.46 / MAX: 17.311. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Person Vehicle Bike Detection FP16 - Device: CPUabcdefghij50010001500200025002454.092450.262455.511036.991028.641041.871031.602180.832224.082194.361. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Person Vehicle Bike Detection FP16 - Device: CPUabcdefghij2468104.884.894.887.707.777.677.747.337.187.28MIN: 3.95 / MAX: 16.05MIN: 3.93 / MAX: 13.44MIN: 3.9 / MAX: 14.94MIN: 5.51 / MAX: 16.06MIN: 5.42 / MAX: 16.35MIN: 5.32 / MAX: 16.6MIN: 6.06 / MAX: 12.66MIN: 5.45 / MAX: 15.94MIN: 4.98 / MAX: 16.11MIN: 5.53 / MAX: 15.781. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16 - Device: CPUabcdefghij300600900120015001560.031546.021551.63532.59530.99533.74538.011034.351036.111012.981. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16 - Device: CPUabcdefghij71421283530.7231.0030.8930.0230.1029.9529.7230.9230.8731.57MIN: 29.51 / MAX: 35.07MIN: 29.59 / MAX: 36.33MIN: 29.48 / MAX: 36.29MIN: 18.78 / MAX: 38.72MIN: 22.61 / MAX: 39.15MIN: 19.01 / MAX: 38.08MIN: 19.46 / MAX: 38.99MIN: 25.94 / MAX: 41.77MIN: 20.13 / MAX: 42.34MIN: 20.39 / MAX: 39.221. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUabcdefghij20K40K60K80K100K86884.6487359.2386789.8032002.6232032.0631951.6432008.0359615.8859654.9859505.781. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUabcdefghij0.12150.2430.36450.4860.60750.540.540.540.490.490.490.490.530.530.53MIN: 0.45 / MAX: 7.64MIN: 0.45 / MAX: 7.81MIN: 0.45 / MAX: 5.03MIN: 0.3 / MAX: 9.28MIN: 0.3 / MAX: 9.07MIN: 0.3 / MAX: 8.2MIN: 0.3 / MAX: 8.84MIN: 0.31 / MAX: 10.06MIN: 0.31 / MAX: 10.06MIN: 0.31 / MAX: 7.181. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16-INT8 - Device: CPUabcdefghij300600900120015001244.691239.671237.29395.66432.32431.94432.20810.71815.13812.761. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16-INT8 - Device: CPUabcdefghij91827364538.5038.6638.7540.4036.9837.0136.9839.4439.2339.34MIN: 36.77 / MAX: 44.23MIN: 37.22 / MAX: 43.52MIN: 37.46 / MAX: 43.52MIN: 26.93 / MAX: 74.83MIN: 32.02 / MAX: 44.78MIN: 32.25 / MAX: 43.6MIN: 32.61 / MAX: 41.91MIN: 33.14 / MAX: 45.28MIN: 34.71 / MAX: 47.63MIN: 25.19 / MAX: 46.891. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUabcdefghij30K60K90K120K150K120606.38120728.22123484.2844958.0744933.2744968.4345097.9968931.3568945.3268895.501. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUabcdefghij0.07880.15760.23640.31520.3940.340.340.340.350.350.350.350.350.350.35MIN: 0.29 / MAX: 7.33MIN: 0.29 / MAX: 10.87MIN: 0.29 / MAX: 7.09MIN: 0.23 / MAX: 9.09MIN: 0.23 / MAX: 8.84MIN: 0.23 / MAX: 9.15MIN: 0.23 / MAX: 8.63MIN: 0.21 / MAX: 8.91MIN: 0.22 / MAX: 8.62MIN: 0.22 / MAX: 8.351. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Kripke

Kripke is a simple, scalable, 3D Sn deterministic particle transport code. Its primary purpose is to research how data layout, programming paradigms and architectures effect the implementation and performance of Sn transport. Kripke is developed by LLNL. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgThroughput FoM, More Is BetterKripke 1.2.6defghij80M160M240M320M400M2409945002362439002365910002371757003548080003501512003490198001. (CXX) g++ options: -O3 -fopenmp -ldl

a: The test quit with a non-zero exit status.

b: The test quit with a non-zero exit status.

c: The test quit with a non-zero exit status.

Timed Linux Kernel Compilation

This test times how long it takes to build the Linux kernel in a default configuration (defconfig) for the architecture being tested or alternatively an allmodconfig for building all possible kernel modules for the build. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigabcdefghij122436486027.3527.2427.4155.1755.0955.1555.1733.9533.8733.93

Build: allmodconfig

a: The test quit with a non-zero exit status.

b: The test quit with a non-zero exit status.

c: The test quit with a non-zero exit status.

d: The test quit with a non-zero exit status.

e: The test quit with a non-zero exit status.

f: The test quit with a non-zero exit status.

g: The test quit with a non-zero exit status.

h: The test quit with a non-zero exit status.

i: The test quit with a non-zero exit status.

j: The test quit with a non-zero exit status.

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 4 - Input: Bosphorus 4Kabcdefghij1.17072.34143.51214.68285.85355.2035.1495.0494.1074.1144.1384.1435.0755.0795.1601. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 8 - Input: Bosphorus 4Kabcdefghij2040608010090.8191.3290.4266.9967.7267.3967.8199.1098.5799.351. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 12 - Input: Bosphorus 4Kabcdefghij50100150200250163.46166.38163.06163.19162.61161.85160.32230.03227.87224.411. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 13 - Input: Bosphorus 4Kabcdefghij50100150200250163.01166.69161.50161.85162.05160.80161.32223.42227.21228.771. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 4 - Input: Bosphorus 1080pabcdefghij369121512.4812.5912.6210.9110.9810.7411.0212.2312.2612.181. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 8 - Input: Bosphorus 1080pabcdefghij306090120150141.22138.34143.55118.95119.31118.49118.48151.44149.05149.451. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 12 - Input: Bosphorus 1080pabcdefghij130260390520650422.99427.69431.90526.22525.17521.52528.53580.16591.32584.121. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 13 - Input: Bosphorus 1080pabcdefghij160320480640800510.36542.61516.91604.99597.01585.37586.75726.89728.54726.501. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: BMW27 - Compute: CPU-Onlyabcdefghij163248648026.2026.2426.1272.0071.4471.9672.0138.4038.5738.51

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Classroom - Compute: CPU-Onlyabcdefghij408012016020066.4266.6466.72182.99182.56181.70183.2999.5499.3599.29

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Fishy Cat - Compute: CPU-Onlyabcdefghij2040608010033.2233.1733.0390.0390.3190.2690.6349.1048.6948.82

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Barbershop - Compute: CPU-Onlyabcdefghij140280420560700254.88255.30254.72670.87670.64667.87669.09352.40351.66351.38

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Pabellon Barcelona - Compute: CPU-Onlyabcdefghij5010015020025080.5480.7680.41224.15224.10223.95224.12119.30119.42119.04

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer - Model: Crownabcdefghij122436486054.9055.3955.4021.4821.4421.5921.5842.8943.2743.31MIN: 53.27 / MAX: 57.28MIN: 54.02 / MAX: 57.64MIN: 53.71 / MAX: 58.99MIN: 21.32 / MAX: 21.8MIN: 21.3 / MAX: 21.78MIN: 21.45 / MAX: 21.84MIN: 21.43 / MAX: 21.89MIN: 42.47 / MAX: 43.88MIN: 42.82 / MAX: 44.23MIN: 42.83 / MAX: 44.44

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer ISPC - Model: Crownabcdefghij132639526556.0956.4656.8122.5922.5722.6622.7745.4845.4045.32MIN: 54.05 / MAX: 59.82MIN: 54.53 / MAX: 59.89MIN: 55.27 / MAX: 59.91MIN: 22.39 / MAX: 22.98MIN: 22.39 / MAX: 22.93MIN: 22.45 / MAX: 22.99MIN: 22.57 / MAX: 23.16MIN: 44.92 / MAX: 46.64MIN: 44.87 / MAX: 46.45MIN: 44.74 / MAX: 46.66

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer - Model: Asian Dragonabcdefghij132639526560.1459.9159.7924.6924.7324.7024.8248.1248.1948.10MIN: 58.97 / MAX: 62MIN: 58.66 / MAX: 61.96MIN: 58.46 / MAX: 62.03MIN: 24.62 / MAX: 24.84MIN: 24.67 / MAX: 24.86MIN: 24.63 / MAX: 24.84MIN: 24.74 / MAX: 25MIN: 47.91 / MAX: 48.91MIN: 47.96 / MAX: 48.63MIN: 47.86 / MAX: 48.8

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer - Model: Asian Dragon Objabcdefghij122436486053.5753.8153.6922.2622.1622.1522.1943.5143.5743.42MIN: 52.17 / MAX: 55.38MIN: 52.72 / MAX: 55.86MIN: 52.63 / MAX: 55.24MIN: 22.18 / MAX: 22.42MIN: 22.08 / MAX: 22.35MIN: 22.07 / MAX: 22.32MIN: 22.12 / MAX: 22.33MIN: 43.26 / MAX: 44.02MIN: 43.34 / MAX: 44.03MIN: 43.14 / MAX: 43.89

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer ISPC - Model: Asian Dragonabcdefghij153045607567.3467.2067.5028.3628.3128.3228.4854.3954.5154.52MIN: 65.61 / MAX: 70.54MIN: 65.48 / MAX: 70.41MIN: 65.64 / MAX: 71.17MIN: 28.26 / MAX: 28.59MIN: 28.21 / MAX: 28.56MIN: 28.23 / MAX: 28.55MIN: 28.37 / MAX: 28.69MIN: 54.12 / MAX: 55.15MIN: 54.22 / MAX: 55.08MIN: 54.24 / MAX: 55.1

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer ISPC - Model: Asian Dragon Objabcdefghij132639526556.4956.6956.9323.8723.9423.9423.8846.3846.3646.43MIN: 55.29 / MAX: 58.38MIN: 55.42 / MAX: 58.97MIN: 55.56 / MAX: 59.67MIN: 23.78 / MAX: 24.08MIN: 23.84 / MAX: 24.18MIN: 23.84 / MAX: 24.16MIN: 23.79 / MAX: 24.08MIN: 46.09 / MAX: 47.08MIN: 46.13 / MAX: 46.98MIN: 46.17 / MAX: 47.23

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: Asian Dragondefghij112233445524.8524.8324.8924.9648.9148.7248.71MIN: 24.78 / MAX: 25MIN: 24.76 / MAX: 24.96MIN: 24.81 / MAX: 25.06MIN: 24.9 / MAX: 25.13MIN: 48.64 / MAX: 49.47MIN: 48.48 / MAX: 49.3MIN: 48.45 / MAX: 49.47

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: Asian Dragon Objdefghij102030405022.3522.2922.2722.2643.8443.7743.90MIN: 22.28 / MAX: 22.5MIN: 22.22 / MAX: 22.46MIN: 22.2 / MAX: 22.44MIN: 22.18 / MAX: 22.43MIN: 43.64 / MAX: 44.38MIN: 43.51 / MAX: 44.16MIN: 43.66 / MAX: 44.27

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: Crowndefghij102030405021.8921.9921.7721.8343.5743.8143.93MIN: 21.74 / MAX: 22.23MIN: 21.84 / MAX: 22.32MIN: 21.63 / MAX: 22.18MIN: 21.69 / MAX: 22.17MIN: 43.11 / MAX: 44.65MIN: 43.36 / MAX: 45.05MIN: 43.46 / MAX: 45.01

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragondefghij122436486027.7427.8327.8327.9154.2254.1954.15MIN: 27.64 / MAX: 27.98MIN: 27.72 / MAX: 28.1MIN: 27.73 / MAX: 28.13MIN: 27.81 / MAX: 28.17MIN: 53.93 / MAX: 54.77MIN: 53.91 / MAX: 54.97MIN: 53.87 / MAX: 54.79

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon Objdefghij102030405023.3523.5323.5023.7145.9246.0946.02MIN: 23.26 / MAX: 23.57MIN: 23.43 / MAX: 23.73MIN: 23.4 / MAX: 23.74MIN: 23.61 / MAX: 23.93MIN: 45.64 / MAX: 46.53MIN: 45.82 / MAX: 46.6MIN: 45.75 / MAX: 46.57

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Crowndefghij102030405022.3922.3422.4422.4245.1945.7145.40MIN: 22.2 / MAX: 22.85MIN: 22.15 / MAX: 22.75MIN: 22.25 / MAX: 22.78MIN: 22.22 / MAX: 22.85MIN: 44.65 / MAX: 46.39MIN: 45.11 / MAX: 47.49MIN: 44.88 / MAX: 46.68

Intel Open Image Denoise

Open Image Denoise is a denoising library for ray-tracing and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.0Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Onlyabcdefghij0.41180.82361.23541.64722.0591.831.831.830.720.720.720.721.371.371.37

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.0Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Onlyabcdefghij0.4140.8281.2421.6562.071.841.841.820.720.720.720.721.381.381.38

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.0Run: RTLightmap.hdr.4096x4096 - Device: CPU-Onlyabcdefghij0.19580.39160.58740.78320.9790.860.860.870.340.340.340.340.650.650.65

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.1Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Onlydefghij0.30830.61660.92491.23321.54150.720.720.720.721.371.371.37

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.1Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Onlydefghij0.31050.6210.93151.2421.55250.720.720.720.721.381.381.38

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.1Run: RTLightmap.hdr.4096x4096 - Device: CPU-Onlydefghij0.14630.29260.43890.58520.73150.340.340.340.340.650.650.65

OpenVKL

OpenVKL is the Intel Open Volume Kernel Library that offers high-performance volume computation kernels and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU Scalardefghij80160240320400191190191191363363363MIN: 13 / MAX: 3471MIN: 13 / MAX: 3484MIN: 13 / MAX: 3484MIN: 13 / MAX: 3483MIN: 24 / MAX: 6610MIN: 24 / MAX: 6577MIN: 24 / MAX: 6613

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCdefghij2004006008001000487487488489926922922MIN: 36 / MAX: 6949MIN: 36 / MAX: 6956MIN: 36 / MAX: 6952MIN: 36 / MAX: 6969MIN: 67 / MAX: 12416MIN: 67 / MAX: 12374MIN: 67 / MAX: 12356

OSPRay

Intel OSPRay is a portable ray-tracing engine for high-performance, high-fidelity scientific visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/ao/real_timeabcdefghij4812162015.9860015.9785015.987205.574695.541075.573205.5755310.7988010.7430010.69320

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/scivis/real_timeabcdefghij4812162015.9528015.9888015.977805.570015.563535.555815.5653910.7832010.7904010.76640

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/pathtracer/real_timeabcdefghij50100150200250215.10214.07214.14151.91151.51151.78151.68192.65192.40192.70

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/ao/real_timeabcdefghij4812162014.2369014.1783014.139905.607475.620405.614545.6227810.8524010.8829010.87430

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeabcdefghij4812162013.8739013.7666013.831705.453295.461535.452275.4772510.5913010.5848010.57400

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeabcdefghij4812162016.3468016.4365016.535006.587456.582706.595636.6008512.5438012.4987012.51040

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 32abcdefghij8M16M24M32M40M394990003948600039453000352280003531500035271000352360003714500037141000371200001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 57abcdefghij13M26M39M52M65M594010005929600057519000526650005282700052879000528540005144300055841000557150001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 2 - Buffer Length: 256 - Filter Length: 32abcdefghij17M34M51M68M85M771810007701900076924000670540006884600068861000686780007246800072491000724000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 2 - Buffer Length: 256 - Filter Length: 57abcdefghij30M60M90M120M150M1174900001140100001185500001056500001054800001057400001048000001052800001097000001113700001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

easyWave

The easyWave software allows simulating tsunami generation and propagation in the context of early warning systems. EasyWave supports making use of OpenMP for CPU multi-threading and there are also GPU ports available but not currently incorporated as part of this test profile. The easyWave tsunami generation software is run with one of the example/reference input files for measuring the CPU execution time. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BettereasyWave r34Input: e2Asean Grid + BengkuluSept2007 Source - Time: 240defghij0.37280.74561.11841.49121.8641.6571.6541.6571.6481.2841.2881.2451. (CXX) g++ options: -O3 -fopenmp

OpenBenchmarking.orgSeconds, Fewer Is BettereasyWave r34Input: e2Asean Grid + BengkuluSept2007 Source - Time: 1200defghij91827364538.1138.0738.0237.9526.1126.3925.561. (CXX) g++ options: -O3 -fopenmp

OpenBenchmarking.orgSeconds, Fewer Is BettereasyWave r34Input: e2Asean Grid + BengkuluSept2007 Source - Time: 2400defghij2040608010098.9899.4297.9997.5368.5768.2468.521. (CXX) g++ options: -O3 -fopenmp

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 4 - Buffer Length: 256 - Filter Length: 32abcdefghij30M60M90M120M150M1538500001536900001536700001386000001386200001385800001384600001458200001459200001457400001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 4 - Buffer Length: 256 - Filter Length: 57abcdefghij40M80M120M160M200M1962200001965900001945100001889300001912300001898800001907500002009300001986400002001200001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 8 - Buffer Length: 256 - Filter Length: 32abcdefghij70M140M210M280M350M3075400003051100003067600002780300002777800002763900002774100002926200002924300002924900001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 8 - Buffer Length: 256 - Filter Length: 57abcdefghij80M160M240M320M400M3694300003669300003669900003633100003579900003504500003578100003783300003772500003816600001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 512abcdefghij3M6M9M12M15M139090001402100014225000126830001236600012681000122560001290900013363000128990001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 16 - Buffer Length: 256 - Filter Length: 32abcdefghij130M260M390M520M650M5942300006024700006036500005453600005451400005450200005430500005858500005838700005856700001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 16 - Buffer Length: 256 - Filter Length: 57abcdefghij160M320M480M640M800M6997400006927600006749300006891500006929200006933400006820700007414200007358000007371200001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 2 - Buffer Length: 256 - Filter Length: 512abcdefghij6M12M18M24M30M279010002773600028227000246270002520700025199000227270002564800025910000263780001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 32 - Buffer Length: 256 - Filter Length: 32abcdefghij300M600M900M1200M1500M11835000001190300000118480000010471000001046600000104190000010471000001172400000117290000011699000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 32 - Buffer Length: 256 - Filter Length: 57abcdefghij300M600M900M1200M1500M11921000001214200000125480000010350000001032000000102460000010334000001352900000139410000013698000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 4 - Buffer Length: 256 - Filter Length: 512abcdefghij12M24M36M48M60M529110005558800055165000502580005038000049977000495560005289000052129000497810001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 32abcdefghij500M1000M1500M2000M2500M22077000002212100000220680000010595000001057500000105710000010562000002057500000205260000020565000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 57abcdefghij400M800M1200M1600M2000M19944000002001900000201030000010933000001095400000109460000010993000001916800000189970000019223000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 8 - Buffer Length: 256 - Filter Length: 512abcdefghij20M40M60M80M100M1098700001080800001091400009959400097005000994410001001700001044400001047800001042200001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 96 - Buffer Length: 256 - Filter Length: 32abcdefghij600M1200M1800M2400M3000M30058000002995400000299980000010652000001065100000106530000010657000002068300000206990000020710000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 96 - Buffer Length: 256 - Filter Length: 57abcdefghij600M1200M1800M2400M3000M25598000002571100000256490000011208000001117800000112050000011182000001995500000199700000019995000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 16 - Buffer Length: 256 - Filter Length: 512abcdefghij50M100M150M200M250M2160800002161500002149100001938500001960400001945000001946700002075900002097200002094900001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 32 - Buffer Length: 256 - Filter Length: 512abcdefghij90M180M270M360M450M4258100004296200004244000002737600002734800002733900002740700003916800003932000003932700001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 512abcdefghij130M260M390M520M650M6225600006109500006226300002829200002818300002830300002817300005120200005123100005110700001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 96 - Buffer Length: 256 - Filter Length: 512abcdefghij150M300M450M600M750M7116400007181400007150300002862500002858800002859200002865300005197000005201400005194400001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Apache Hadoop

This is a benchmark of the Apache Hadoop making use of its built-in name-node throughput benchmark (NNThroughputBenchmark). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Open - Threads: 50 - Files: 100000abcdefghij140K280K420K560K700K460829469484401606578035552486578035546448645161581395617284

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Open - Threads: 100 - Files: 100000abcdefghij120K240K360K480K600K420168404858403226529101294985523560460829526316555556370370

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Open - Threads: 50 - Files: 1000000abcdefghij300K600K900K1200K1500K11261261020408683995278319251004122100165402212330462536781251564

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Create - Threads: 50 - Files: 100000abcdefghij13K26K39K52K65K43649412884393758617586175834360680587205899759347

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Delete - Threads: 50 - Files: 100000abcdefghij20K40K60K80K100K9107573801905801010101006049699310395010040210224995602

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Open - Threads: 100 - Files: 1000000abcdefghij300K600K900K1200K1500K2153321738221858741248439120481913037811107420323729382995289101

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Rename - Threads: 50 - Files: 100000abcdefghij20K40K60K80K100K70522730467710182372822378163382237830569082789206

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Create - Threads: 100 - Files: 100000abcdefghij13K26K39K52K65K40733374253507557971588245938258928604965903258005

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Create - Threads: 50 - Files: 1000000abcdefghij16K32K48K64K80K53665521195226072134708976992072706734117246473153

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Delete - Threads: 100 - Files: 100000abcdefghij20K40K60K80K100K875669082773475105708980399940410256410526310204197371

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Delete - Threads: 50 - Files: 1000000abcdefghij20K40K60K80K100K989329731490147111012113327111198110828113404110436113572

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Rename - Threads: 100 - Files: 100000abcdefghij20K40K60K80K100K75529693486715982102838227949180386798088237283472

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Rename - Threads: 50 - Files: 1000000abcdefghij20K40K60K80K100K73239716797463883921840418250184810851218631188550

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Create - Threads: 100 - Files: 1000000abcdefghij16K32K48K64K80K46145444374400171296700577053770922736117201072754

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Delete - Threads: 100 - Files: 1000000abcdefghij20K40K60K80K100K901148671597031112613113225110803113895111782114692110693

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Rename - Threads: 100 - Files: 1000000abcdefghij20K40K60K80K100K73078721296682781208843608581585763843108521587161

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: File Status - Threads: 50 - Files: 100000abcdefghij200K400K600K800K1000K529101862069657895632911389105709220561798925926869565751880

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: File Status - Threads: 100 - Files: 100000abcdefghij200K400K600K800K1000K515464458716729927591716613497478469487805595238847458684932

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: File Status - Threads: 50 - Files: 1000000abcdefghij500K1000K1500K2000K2500K2173913194174828425218181823209241795332203666042643919305021941748

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: File Status - Threads: 100 - Files: 1000000abcdefghij500K1000K1500K2000K2500K188679216197018939396006012356271964637204918023529412506266558036

Apache Cassandra

This is a benchmark of the Apache Cassandra NoSQL database management system making use of cassandra-stress. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.1.3Test: Writesabcdefghij70K140K210K280K350K248095256661270480197866195798196287197092324575318109316485

207 Results Shown

SPECFEM3D:
  Tomographic Model
  Homogeneous Halfspace
  Mount St. Helens
  Layered Halfspace
BRL-CAD
Remhos
QuantLib
SPECFEM3D
QuantLib
nekRS:
  Kershaw
  TurboPipe Periodic
Neural Magic DeepSparse:
  NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  ResNet-50, Baseline - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  ResNet-50, Sparse INT8 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  BERT-Large, NLP Question Answering - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
TiDB Community Server
Neural Magic DeepSparse:
  NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
TiDB Community Server
Neural Magic DeepSparse:
  NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
oneDNN
TiDB Community Server
oneDNN
TiDB Community Server:
  oltp_update_non_index - 1
  oltp_update_non_index - 32
oneDNN
TiDB Community Server
oneDNN:
  Deconvolution Batch shapes_1d - f32 - CPU
  Deconvolution Batch shapes_1d - u8s8f32 - CPU
  Deconvolution Batch shapes_1d - bf16bf16bf16 - CPU
  Deconvolution Batch shapes_3d - f32 - CPU
  Deconvolution Batch shapes_3d - u8s8f32 - CPU
  Deconvolution Batch shapes_3d - bf16bf16bf16 - CPU
  IP Shapes 1D - f32 - CPU
  IP Shapes 1D - u8s8f32 - CPU
  IP Shapes 1D - bf16bf16bf16 - CPU
TiDB Community Server:
  oltp_update_non_index - 128
  oltp_read_write - 1
oneDNN
TiDB Community Server:
  oltp_read_write - 16
  oltp_point_select - 64
  oltp_point_select - 32
  oltp_point_select - 16
  oltp_update_index - 1
oneDNN
TiDB Community Server
oneDNN
TiDB Community Server
oneDNN
TiDB Community Server
oneDNN
TiDB Community Server:
  oltp_update_non_index - 64
  oltp_read_write - 128
  oltp_point_select - 1
oneDNN
TiDB Community Server
oneDNN:
  Recurrent Neural Network Training - u8s8f32 - CPU
  Recurrent Neural Network Inference - u8s8f32 - CPU
  Recurrent Neural Network Inference - bf16bf16bf16 - CPU
OpenVINO:
  Face Detection FP16 - CPU:
    FPS
    ms
  Person Detection FP16 - CPU:
    FPS
    ms
  Person Detection FP32 - CPU:
    FPS
    ms
  Vehicle Detection FP16 - CPU:
    FPS
    ms
  Face Detection FP16-INT8 - CPU:
    FPS
    ms
  Face Detection Retail FP16 - CPU:
    FPS
    ms
  Road Segmentation ADAS FP16 - CPU:
    FPS
    ms
  Vehicle Detection FP16-INT8 - CPU:
    FPS
    ms
  Weld Porosity Detection FP16 - CPU:
    FPS
    ms
  Face Detection Retail FP16-INT8 - CPU:
    FPS
    ms
  Road Segmentation ADAS FP16-INT8 - CPU:
    FPS
    ms
  Machine Translation EN To DE FP16 - CPU:
    FPS
    ms
  Weld Porosity Detection FP16-INT8 - CPU:
    FPS
    ms
  Person Vehicle Bike Detection FP16 - CPU:
    FPS
    ms
  Handwritten English Recognition FP16 - CPU:
    FPS
    ms
  Age Gender Recognition Retail 0013 FP16 - CPU:
    FPS
    ms
  Handwritten English Recognition FP16-INT8 - CPU:
    FPS
    ms
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU:
    FPS
    ms
Kripke
Timed Linux Kernel Compilation
SVT-AV1:
  Preset 4 - Bosphorus 4K
  Preset 8 - Bosphorus 4K
  Preset 12 - Bosphorus 4K
  Preset 13 - Bosphorus 4K
  Preset 4 - Bosphorus 1080p
  Preset 8 - Bosphorus 1080p
  Preset 12 - Bosphorus 1080p
  Preset 13 - Bosphorus 1080p
Blender:
  BMW27 - CPU-Only
  Classroom - CPU-Only
  Fishy Cat - CPU-Only
  Barbershop - CPU-Only
  Pabellon Barcelona - CPU-Only
Embree:
  Pathtracer - Crown
  Pathtracer ISPC - Crown
  Pathtracer - Asian Dragon
  Pathtracer - Asian Dragon Obj
  Pathtracer ISPC - Asian Dragon
  Pathtracer ISPC - Asian Dragon Obj
Embree:
  Pathtracer - Asian Dragon
  Pathtracer - Asian Dragon Obj
  Pathtracer - Crown
  Pathtracer ISPC - Asian Dragon
  Pathtracer ISPC - Asian Dragon Obj
  Pathtracer ISPC - Crown
Intel Open Image Denoise:
  RT.hdr_alb_nrm.3840x2160 - CPU-Only
  RT.ldr_alb_nrm.3840x2160 - CPU-Only
  RTLightmap.hdr.4096x4096 - CPU-Only
Intel Open Image Denoise:
  RT.hdr_alb_nrm.3840x2160 - CPU-Only
  RT.ldr_alb_nrm.3840x2160 - CPU-Only
  RTLightmap.hdr.4096x4096 - CPU-Only
OpenVKL:
  vklBenchmarkCPU Scalar
  vklBenchmarkCPU ISPC
OSPRay:
  particle_volume/ao/real_time
  particle_volume/scivis/real_time
  particle_volume/pathtracer/real_time
  gravity_spheres_volume/dim_512/ao/real_time
  gravity_spheres_volume/dim_512/scivis/real_time
  gravity_spheres_volume/dim_512/pathtracer/real_time
Liquid-DSP:
  1 - 256 - 32
  1 - 256 - 57
  2 - 256 - 32
  2 - 256 - 57
easyWave:
  e2Asean Grid + BengkuluSept2007 Source - 240
  e2Asean Grid + BengkuluSept2007 Source - 1200
  e2Asean Grid + BengkuluSept2007 Source - 2400
Liquid-DSP:
  4 - 256 - 32
  4 - 256 - 57
  8 - 256 - 32
  8 - 256 - 57
  1 - 256 - 512
  16 - 256 - 32
  16 - 256 - 57
  2 - 256 - 512
  32 - 256 - 32
  32 - 256 - 57
  4 - 256 - 512
  64 - 256 - 32
  64 - 256 - 57
  8 - 256 - 512
  96 - 256 - 32
  96 - 256 - 57
  16 - 256 - 512
  32 - 256 - 512
  64 - 256 - 512
  96 - 256 - 512
Apache Hadoop:
  Open - 50 - 100000
  Open - 100 - 100000
  Open - 50 - 1000000
  Create - 50 - 100000
  Delete - 50 - 100000
  Open - 100 - 1000000
  Rename - 50 - 100000
  Create - 100 - 100000
  Create - 50 - 1000000
  Delete - 100 - 100000
  Delete - 50 - 1000000
  Rename - 100 - 100000
  Rename - 50 - 1000000
  Create - 100 - 1000000
  Delete - 100 - 1000000
  Rename - 100 - 1000000
  File Status - 50 - 100000
  File Status - 100 - 100000
  File Status - 50 - 1000000
  File Status - 100 - 1000000
Apache Cassandra