extra tests2

AMD EPYC 9334 32-Core testing with a Supermicro H13SSW (1.1 BIOS) and astdrmfb on AlmaLinux 9.2 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2310249-NE-EXTRATEST98
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable
Show Perf Per Clock Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs
Condense Test Profiles With Multiple Version Results Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
a
October 07 2023
  5 Hours, 38 Minutes
b
October 07 2023
  5 Hours, 6 Minutes
c
October 07 2023
  4 Hours, 48 Minutes
d
October 20 2023
  5 Hours, 58 Minutes
e
October 20 2023
  6 Hours, 40 Minutes
f
October 21 2023
  6 Hours, 19 Minutes
g
October 22 2023
  5 Hours, 59 Minutes
h
October 24 2023
  6 Hours, 2 Minutes
i
October 24 2023
  6 Hours, 8 Minutes
j
October 24 2023
  5 Hours, 52 Minutes
Invert Behavior (Only Show Selected Data)
  5 Hours, 51 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


extra tests2ProcessorMotherboardMemoryDiskGraphicsMonitorOSKernelCompilerFile-SystemScreen Resolutionabcdefghij2 x AMD EPYC 9254 24-Core @ 2.90GHz (48 Cores / 96 Threads)Supermicro H13DSH (1.5 BIOS)24 x 32 GB DDR5-4800MT/s Samsung M321R4GA3BB6-CQKET2 x 1920GB SAMSUNG MZQL21T9HCJR-00A07astdrmfbAlmaLinux 9.25.14.0-284.25.1.el9_2.x86_64 (x86_64)GCC 11.3.1 20221121ext41024x768AMD EPYC 9124 16-Core @ 3.00GHz (16 Cores / 32 Threads)Supermicro H13SSW (1.1 BIOS)12 x 64 GB DDR5-4800MT/s HMCG94MEBRA123NAMD EPYC 9334 32-Core @ 2.70GHz (32 Cores / 64 Threads)DELL E207WFP1680x1050OpenBenchmarking.orgKernel Details- Transparent Huge Pages: alwaysCompiler Details- --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-isl Processor Details- a: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa10113e- b: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa10113e- c: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa10113e- d: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111- e: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111- f: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111- g: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111- h: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111- i: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111- j: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111Java Details- OpenJDK Runtime Environment (Red_Hat-11.0.20.0.8-1) (build 11.0.20+8-LTS)Python Details- Python 3.9.16Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

abcdefghijResult OverviewPhoronix Test Suite100%143%187%230%273%BlenderBRL-CADIntel Open Image DenoiseEmbreeSPECFEM3DOSPRayTiDB Community ServerTimed Linux Kernel CompilationRemhosOpenVINONeural Magic DeepSparseApache CassandraApache HadoopLiquid-DSPSVT-AV1nekRS

extra tests2specfem3d: Tomographic Modelspecfem3d: Homogeneous Halfspacespecfem3d: Mount St. Helensspecfem3d: Layered Halfspacebrl-cad: VGR Performance Metricremhos: Sample Remap Examplequantlib: Single-Threadedspecfem3d: Water-layered Halfspacequantlib: Multi-Threadednekrs: Kershawnekrs: TurboPipe Periodicdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamtidb: oltp_update_index - 16deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamtidb: oltp_read_write - 32deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamonednn: Convolution Batch Shapes Auto - f32 - CPUtidb: oltp_read_write - 64onednn: Convolution Batch Shapes Auto - u8s8f32 - CPUtidb: oltp_update_non_index - 1tidb: oltp_update_non_index - 32onednn: Convolution Batch Shapes Auto - bf16bf16bf16 - CPUtidb: oltp_point_select - 128onednn: Deconvolution Batch shapes_1d - f32 - CPUonednn: Deconvolution Batch shapes_1d - u8s8f32 - CPUonednn: Deconvolution Batch shapes_1d - bf16bf16bf16 - CPUonednn: Deconvolution Batch shapes_3d - f32 - CPUonednn: Deconvolution Batch shapes_3d - u8s8f32 - CPUonednn: Deconvolution Batch shapes_3d - bf16bf16bf16 - CPUonednn: IP Shapes 1D - f32 - CPUonednn: IP Shapes 1D - u8s8f32 - CPUonednn: IP Shapes 1D - bf16bf16bf16 - CPUtidb: oltp_update_non_index - 128tidb: oltp_read_write - 1onednn: Recurrent Neural Network Training - bf16bf16bf16 - CPUtidb: oltp_read_write - 16tidb: oltp_point_select - 64tidb: oltp_point_select - 32tidb: oltp_point_select - 16tidb: oltp_update_index - 1onednn: Recurrent Neural Network Inference - f32 - CPUtidb: oltp_update_index - 64onednn: IP Shapes 3D - u8s8f32 - CPUtidb: oltp_update_index - 128onednn: IP Shapes 3D - bf16bf16bf16 - CPUtidb: oltp_update_non_index - 16onednn: Recurrent Neural Network Training - f32 - CPUtidb: oltp_update_non_index - 64tidb: oltp_read_write - 128tidb: oltp_point_select - 1onednn: IP Shapes 3D - f32 - CPUtidb: oltp_update_index - 32onednn: Recurrent Neural Network Training - u8s8f32 - CPUonednn: Recurrent Neural Network Inference - u8s8f32 - CPUonednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUkripke: build-linux-kernel: defconfigsvt-av1: Preset 4 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 13 - Bosphorus 4Ksvt-av1: Preset 4 - Bosphorus 1080psvt-av1: Preset 8 - Bosphorus 1080psvt-av1: Preset 12 - Bosphorus 1080psvt-av1: Preset 13 - Bosphorus 1080pblender: BMW27 - CPU-Onlyblender: Classroom - CPU-Onlyblender: Fishy Cat - CPU-Onlyblender: Barbershop - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlyembree: Pathtracer - Crownembree: Pathtracer ISPC - Crownembree: Pathtracer - Asian Dragonembree: Pathtracer - Asian Dragon Objembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Asian Dragon Objembree: Pathtracer - Asian Dragonembree: Pathtracer - Asian Dragon Objembree: Pathtracer - Crownembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Asian Dragon Objembree: Pathtracer ISPC - Crownoidn: RT.hdr_alb_nrm.3840x2160 - CPU-Onlyoidn: RT.ldr_alb_nrm.3840x2160 - CPU-Onlyoidn: RTLightmap.hdr.4096x4096 - CPU-Onlyoidn: RT.hdr_alb_nrm.3840x2160 - CPU-Onlyoidn: RT.ldr_alb_nrm.3840x2160 - CPU-Onlyoidn: RTLightmap.hdr.4096x4096 - CPU-Onlyopenvkl: vklBenchmarkCPU Scalaropenvkl: vklBenchmarkCPU ISPCospray: particle_volume/ao/real_timeospray: particle_volume/scivis/real_timeospray: particle_volume/pathtracer/real_timeospray: gravity_spheres_volume/dim_512/ao/real_timeospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: gravity_spheres_volume/dim_512/pathtracer/real_timeliquid-dsp: 1 - 256 - 32liquid-dsp: 1 - 256 - 57liquid-dsp: 2 - 256 - 32liquid-dsp: 2 - 256 - 57easywave: e2Asean Grid + BengkuluSept2007 Source - 240easywave: e2Asean Grid + BengkuluSept2007 Source - 1200easywave: e2Asean Grid + BengkuluSept2007 Source - 2400liquid-dsp: 4 - 256 - 32liquid-dsp: 4 - 256 - 57liquid-dsp: 8 - 256 - 32liquid-dsp: 8 - 256 - 57liquid-dsp: 1 - 256 - 512liquid-dsp: 16 - 256 - 32liquid-dsp: 16 - 256 - 57liquid-dsp: 2 - 256 - 512liquid-dsp: 32 - 256 - 32liquid-dsp: 32 - 256 - 57liquid-dsp: 4 - 256 - 512liquid-dsp: 64 - 256 - 32liquid-dsp: 64 - 256 - 57liquid-dsp: 8 - 256 - 512liquid-dsp: 96 - 256 - 32liquid-dsp: 96 - 256 - 57liquid-dsp: 16 - 256 - 512liquid-dsp: 32 - 256 - 512liquid-dsp: 64 - 256 - 512liquid-dsp: 96 - 256 - 512hadoop: Open - 50 - 100000hadoop: Open - 100 - 100000hadoop: Open - 50 - 1000000hadoop: Create - 50 - 100000hadoop: Delete - 50 - 100000hadoop: Open - 100 - 1000000hadoop: Rename - 50 - 100000hadoop: Create - 100 - 100000hadoop: Create - 50 - 1000000hadoop: Delete - 100 - 100000hadoop: Delete - 50 - 1000000hadoop: Rename - 100 - 100000hadoop: Rename - 50 - 1000000hadoop: Create - 100 - 1000000hadoop: Delete - 100 - 1000000hadoop: Rename - 100 - 1000000hadoop: File Status - 50 - 100000hadoop: File Status - 100 - 100000hadoop: File Status - 50 - 1000000hadoop: File Status - 100 - 1000000cassandra: Writesabcdefghij12.31294665215.1051177311.02476577526.88598380477216216.34626.98502090811106900000676771000039.4951605.03881417.070616.9074672.463535.628201.3925118.7509485.672549.36535137.01144.6508215.6383111.013149.3258485.7175489.120349.0092218.1464109.8027322.250574.321168.5988347.6612718.918933.341212558158.924150.58975897439.4391605.758790901328287351592425110525403833112756710462712122708718095412818575743311836130.41393.6282.5542.44283.9742.242033.175.8956.01213.945882.912.03748.4416.022873.244.172945.2616.269837.584.86842.9114.23317.2237.85776.948.282454.094.881560.0330.7286884.640.541244.6938.5120606.380.3427.3545.20390.811163.459163.01312.477141.219422.994510.36126.266.4233.22254.8880.5454.901756.087160.144953.573367.337856.48531.831.840.8615.98615.9528215.09614.236913.873916.346839499000594010007718100011749000015385000019622000030754000036943000013909000594230000699740000279010001183500000119210000052911000220770000019944000001098700003005800000255980000021608000042581000062256000071164000046082942016811261264364991075215332705224073353665875669893275529732394614590114730785291015154642173913188679224809512.10059594714.4605869811.31849570928.6521086376851716.79129.46076119711240300000675736000039.4681605.73071403.06517.0669672.373435.6422201.2528118.9482488.126449.10825138.83414.6476215.9254110.915249.1666487.3599489.446448.9703219.5263109.2332321.182974.555368.6617347.2189717.969333.3798159.0596150.60556152039.4539606.66938018313122891415972825103695013080210618067515243712746418068397598909944051781730.44393.23284.2242.2284.9942.092028.015.9156.06213.625836.272.05750.4915.982880.584.162986.4616.029849.074.85854.5114.03317.2837.795780.448.272450.264.891546.023187359.230.541239.6738.66120728.220.3427.2415.14991.322166.378166.69212.591138.338427.686542.61126.2466.6433.17255.380.7655.392556.455159.912453.813567.195156.69021.831.840.8615.978515.9888214.07414.178313.766616.43653948600059296000770190001140100001536900001965900003051100003669300001402100060247000069276000027736000119030000012142000005558800022121000002001900000108080000299540000025711000002161500004296200006109500007181400004694844048581020408412887380117382273046374255211990827973146934871679444378671572129862069458716194174816197025666112.04091787714.80827336511.3273597727.49085015776252916.24327.06023507910826700000675417000039.4464605.91831418.904116.8863671.255435.6825201.5402118.7801489.110649.01735153.66444.6348215.647111.02547.1535507.4786487.052249.2055218.5162109.5847321.508274.503168.6287347.3728716.140433.463712681164.6131145.25625963039.4183605.87657846913811499625286524853736865406118923324265463910644711756530.43393.37282.6742.43284.3142.192029.795.956.02213.795840.532.05757.3815.832881.144.162987.3316.029845.274.86849.314.12317.3337.795802.658.242455.514.881551.6330.8986789.80.541237.2938.75123484.280.3427.4085.04990.417163.055161.49512.617143.545431.895516.90626.1266.7233.03254.7280.4155.403756.807859.792953.692767.503856.93271.831.820.8715.987215.9778214.13614.139913.831716.535394530005751900076924000118550000153670000194510000306760000366990000142250006036500006749300002822700011848000001254800000551650002206800000201030000010914000029998000002564900000214910000424400000622630000715030000401606403226683995439379058018587477101350755226073475901476715974638440019703166827657895729927284252189393927048027.33098558835.57168490826.73641411871.61429432729806430.76162.44174958510318900000793457000013.0694606.101508.08715.7246257.272831.052571.137112.2499162.850249.08631599.20794.99671.9189111.108116.1648493.596163.555948.872972.455110.1114108.90973.305824.4833325.8763240.552933.22421262255.6132143.76434697713.1312606.57732.13332553341.558241693262731.337891294923.815760.6282363.059913.377820.8478051.913742.494080.6522591.037491643.9936480115675981491479838.516211080.603951.02875185631641.92342245972758981.25758176121642.51849.163847.3810.47761.59107.0274.71106.974.81797.6410.0120.03398.522564.783.11344.6723.21175.676.791039.6115.363540.884.51370.5721.57124.1264.412013.777.931036.997.7532.5930.0232002.620.49395.6640.444958.070.3524099450055.1734.10766.988163.189161.85410.91118.946526.216604.98672182.9990.03670.87224.1521.481122.58524.687222.261428.364323.873324.84522.351721.894327.743823.353122.39220.720.720.340.720.720.341914875.574695.57001151.9055.607475.453296.587453522800052665000670540001056500001.65738.10598.981386000001889300002780300003633100001268300054536000068915000024627000104710000010350000005025800010595000001093300000995940001065200000112080000019385000027376000028292000028625000057803552910127831958617101010124843982372579717213410570811101282102839217129611261381208632911591716181818260060119786627.45982130835.03013488926.79914344670.18902850629612530.84562.32514682810264000000793101000012.9433607.913511.409815.6245257.89430.986771.2727112.0574163.136149.00941599.15434.985971.9146111.088816.1392494.2575162.929849.059872.6571109.9654109.093873.260924.4725325.7416240.234933.26251256755.4634144.10134673713.1187606.7552.1257538931.549111708262851.338611299043.844210.6339753.06373.384360.8444341.917812.565220.657611.144324213832091643.973678411865796907702501490849.712212710.575794246111.05425185571641338816014559761.28043171171639.36851.659841.07810.47761.16107.2774.5107.2474.54793.7510.0620398.912562.543.11342.8123.321174.66.81039.8215.363544.184.51373.6421.4123.6164.682007.537.961028.647.77530.9930.132032.060.49432.3236.9844933.270.3523624390055.0934.11467.721162.608162.05110.984119.307525.173597.01171.44182.5690.31670.64224.121.435722.569424.734322.157728.314123.939324.828222.291121.990927.829323.528322.34220.720.720.340.720.720.341904875.541075.56353151.5065.62045.461536.58273531500052827000688460001054800001.65438.06799.41513862000019123000027778000035799000012366000545140000692920000252070001046600000103200000050380000105750000010954000009700500010651000001117800000196040000273480000281830000285880000552486294985251004586171006041204819822375882470897980391133278382284041700571132258436038910561349732092423562719579826.97375739535.53507300126.87316845570.54225590529560330.72561.2817691249976450000795579000013.0853607.8171508.208815.721257.504631.029271.044112.413162.929449.07121600.52754.987771.9401110.885216.1307494.2211162.897649.071472.5736110.0001109.0973.216324.5238324.9568240.164233.27511269255.5428143.69224714113.0934606.78522.13062549561.572821697266951.341831303893.818230.6303253.056743.379560.8506911.914222.497140.6531821.001364142432181642.353612511909297368701051483851.494210670.600834248301.061441636.76344706031059541.206531636.44849.344845.30810.48760.57107.3974.43106.7674.87791.7410.0920.01399.242539.973.14343.4923.281180.856.761038.4715.383548.784.5369.2621.65124.364.312004.767.971041.877.67533.7429.9531951.640.49431.9437.0144968.430.3523659100055.1484.13867.393161.847160.79810.736118.486521.518585.36871.96181.790.26667.87223.9521.591322.656624.704722.14928.323723.935424.88722.267621.774627.82623.504222.44070.720.720.340.720.720.341914885.57325.55581151.785.614545.452276.595633527100052879000688610001057400001.65738.01597.9871385800001898800002763900003504500001268100054502000069334000025199000104190000010246000004997700010571000001094600000994410001065300000112050000019450000027339000028303000028592000057803552356012210015834396993130378181633593826992099404111198794918250170537110803858157092204784691795332196463719628727.74647516235.37860002127.69663137169.95560916529552230.7562.81092437610500600000796491000013.073607.1628509.13915.6892257.280831.057470.9275112.4779162.993749.02591602.52214.978771.9003110.975916.0672495.6033163.228248.983772.6879109.9037109.219173.186724.4607325.5075239.517633.36741262755.4264144.10534699313.0596608.71632.11813553011.5511817051.335643.823810.6291083.054583.381560.8434921.912742.514410.64771.127234169531951641.43608811854996840699231481848.0320.61232245741.04567187351637.3734107599441.27918171351631.99837.595847.41710.48759.92107.0474.71107.2474.58793.910.0620.05398.132557.663.12341.3623.421175.586.791039.3715.373533.644.52372.2621.47123.4164.772006.097.961031.67.74538.0129.7232008.030.49432.236.9845097.990.3523717570055.1724.14367.811160.322161.32411.016118.481528.533586.74872.01183.2990.63669.09224.1221.584722.774524.819322.190128.479323.879624.961922.255921.830527.9123.709122.42150.720.720.340.720.720.341914895.575535.56539151.6815.622785.477256.600853523600052854000686780001048000001.64837.9597.529138460000190750000277410000357810000122560005430500006820700002272700010471000001033400000495560001056200000109930000010017000010657000001118200000194670000274070000281730000286530000546448460829654022606801039501107420822375892872706102564110828803868481070922113895857635617984878052036660204918019709215.98949194819.96151934815.03269371140.32936342857250020.4423357.936.445871583116781.59145900000676127000025.7096613.05461003.517115.9249507.63431.4896136.9614116.5064327.019248.88123324.81824.8005144.1181110.810832.0042495.2237326.927148.8889145.4778109.7922216.238473.880247.1323337.9568488.064832.752616965109.0251146.11917548625.7916613.16391.14749955790.7785431861360410.7344612003273.722470.4264261.78171.733810.4400061.0411.742030.8927012.0988658163480987.83747576138538872181666564.12313320.30246371260.7045523794986.9585119110418061250.92628324286993.564568.747568.64919.82804.58197.9480.77196.0781.581481.7110.7837.82421.84803.653.32643.824.842252.77.091963.916.276653.864.8710.6922.5234.1868.273780.88.462180.837.331034.3530.9259615.880.53810.7139.4468931.350.3535480800033.9455.07599.099230.026223.41612.23151.437580.163726.88938.499.5449.1352.4119.342.893245.475748.118843.505654.388846.378548.906843.844643.572154.220345.923445.191.371.380.651.371.380.6536392610.798810.7832192.64510.852410.591312.54383714500051443000724680001052800001.28426.10668.57314582000020093000029262000037833000012909000585850000741420000256480001172400000135290000052890000205750000019168000001044400002068300000199550000020759000039168000051202000051970000064516152631612330465872010040232372983056604967341110526311340479808851217361111178284310925926595238426439235294132457515.59023785919.61963726515.19244731839.83358978857045820.3023365.437.5052638491171999269890000676807000025.6331612.9837999.461915.9895508.360431.4411136.684116.8908327.731448.79013327.18914.8015144.0005110.983331.9586494.4953326.775748.8928145.6474109.7363216.216373.940447.3497336.7673486.706832.835416817109.4649145.83257525425.704613.64021.15012942610.798541848356500.7350941981373.659070.4275121.788761.734990.4403681.043121.644781.94191.243083485985.74347501180179138173864711656566.178305220.301535361410.64425223541991.0735034610462061650.93179323773987.355564.454563.33419.83804.75193.882.49197.6680.881488.0410.7437.57425.684848.423.29642.924.872264.937.051964.6116.276646.914.81709.7322.53233.6568.423777.758.462224.087.181036.1130.8759654.980.53815.1339.2368945.320.3535015120033.8695.07998.573227.865227.20512.259149.051591.319728.53838.5799.3548.69351.66119.4243.268145.400648.190843.573654.506346.363348.71843.767443.811654.187746.087245.71061.371.380.651.371.380.6536392210.74310.7904192.410.882910.584812.49873714100055841000724910001097000001.28826.39368.23614592000019864000029243000037725000013363000583870000735800000259100001172900000139410000052129000205260000018997000001047800002069900000199700000020972000039320000051231000052014000058139555555625367858997102249382995908275903272464102041110436823728631172010114692852158695658474581930502250626631810915.84389531719.72558666315.09991232639.86742377756906620.363371.637.808113034117263.39242080000683536000025.727614.23031002.811315.9389507.364531.5024136.5656116.8464327.185548.82913324.69524.8016144.0515110.903832.0639494.0076326.90448.8934145.3726109.8573216.50873.77747.3339336.675487.229832.808516972109.4068145.90157425225.769612.52091.155780.768314356550.7316181977383.680870.430271.786911.735010.4401561.043331.754530.8800161.94941640663479991.12347414180581137618874121660569.795306380.309278366440.7149723543988.589503041058020.93600124366994.612563.575566.38619.84805.38194.8282.09196.2681.51483.2510.7737.48425.884892.273.26648.2724.672254.727.081964.7116.276638.244.81709.7522.53233.8868.353783.658.452194.367.281012.9831.5759505.780.53812.7639.3468895.50.3534901980033.9345.1699.345224.406228.76512.175149.451584.12726.50338.5199.2948.82351.38119.0443.314145.322748.095643.416154.515746.432748.711543.904343.933554.147346.023245.39561.371.380.651.371.380.6536392210.693210.7664192.70110.874310.57412.51043712000055715000724000001113700001.24525.55568.5191457400002001200002924900003816600001289900058567000073712000026378000116990000013698000004978100020565000001922300000104220000207100000019995000002094900003932700005110700005194400006172843703701251564593479560228910189206580057315397371113572834728855072754110693871617518806849321941748558036316485OpenBenchmarking.org

SPECFEM3D

simulates acoustic (fluid), elastic (solid), coupled acoustic/elastic, poroelastic or seismic wave propagation in any type of conforming mesh of hexahedra. This test profile currently relies on CPU-based execution for SPECFEM3D and using a variety of their built-in examples/models for benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Tomographic Modelcbaijhfdeg71421283512.0412.1012.3115.5915.8415.9926.9727.3327.4627.751. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi

OpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Homogeneous Halfspacebcaijhegfd81624324014.4614.8115.1119.6219.7319.9635.0335.3835.5435.571. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi

OpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Mount St. Helensabchjidefg71421283511.0211.3211.3315.0315.1015.1926.7426.8026.8727.701. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi

OpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Layered Halfspaceacbijhgefd163248648026.8927.4928.6539.8339.8740.3369.9670.1970.5471.611. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi

BRL-CAD

BRL-CAD is a cross-platform, open-source solid modeling system with built-in benchmark mode. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.36VGR Performance Metricabchijdefg170K340K510K680K850K7721627685177625295725005704585690662980642961252956032955221. (CXX) g++ options: -std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6

Remhos

Remhos (REMap High-Order Solver) is a miniapp that solves the pure advection equations that are used to perform monotonic and conservative discontinuous field interpolation (remap) as part of the Eulerian phase in Arbitrary Lagrangian Eulerian (ALE) simulations. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterRemhos 1.0Test: Sample Remap Examplecabijhfgde71421283516.2416.3516.7920.3020.3620.4430.7330.7530.7630.851. (CXX) g++ options: -O3 -std=c++11 -lmfem -lHYPRE -lmetis -lrt -lmpi_cxx -lmpi

QuantLib

QuantLib is an open-source library/framework around quantitative finance for modeling, trading and risk management scenarios. QuantLib is written in C++ with Boost and its built-in benchmark used reports the QuantLib Benchmark Index benchmark score. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Single-Threadedjih70014002100280035003371.63365.43357.91. (CXX) g++ options: -O3 -march=native -fPIE -pie

SPECFEM3D

simulates acoustic (fluid), elastic (solid), coupled acoustic/elastic, poroelastic or seismic wave propagation in any type of conforming mesh of hexahedra. This test profile currently relies on CPU-based execution for SPECFEM3D and using a variety of their built-in examples/models for benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Water-layered Halfspaceacbhijfedg142842567026.9927.0629.4636.4537.5137.8161.2862.3362.4462.811. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi

QuantLib

QuantLib is an open-source library/framework around quantitative finance for modeling, trading and risk management scenarios. QuantLib is written in C++ with Boost and its built-in benchmark used reports the QuantLib Benchmark Index benchmark score. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Multi-Threadedjih30K60K90K120K150K117263.3117199.0116781.51. (CXX) g++ options: -O3 -march=native -fPIE -pie

nekRS

nekRS is an open-source Navier Stokes solver based on the spectral element method. NekRS supports both CPU and GPU/accelerator support though this test profile is currently configured for CPU execution. NekRS is part of Nek5000 of the Mathematics and Computer Science MCS at Argonne National Laboratory. This nekRS benchmark is primarily relevant to large core count HPC servers and otherwise may be very time consuming on smaller systems. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgflops/rank, More Is BetternekRS 23.0Input: Kershawbacgdefijh2000M4000M6000M8000M10000M11240300000111069000001082670000010500600000103189000001026400000099764500009269890000924208000091459000001. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi

OpenBenchmarking.orgflops/rank, More Is BetternekRS 23.0Input: TurboPipe Periodicgfdejiahbc2000M4000M6000M8000M10000M79649100007955790000793457000079310100006835360000676807000067677100006761270000675736000067541700001. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi

OpenRadioss

OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/ and https://github.com/OpenRadioss/ModelExchange/tree/main/Examples. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.

Model: Bumper Beam

a: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

b: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

c: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

d: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

e: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

f: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

g: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

h: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

i: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

j: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

Model: Chrysler Neon 1M

a: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

b: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

c: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

d: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

e: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

f: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

g: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

h: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

i: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

j: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

Model: Cell Phone Drop Test

a: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

b: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

c: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

d: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

e: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

f: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

g: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

h: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

i: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

j: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

Model: Bird Strike on Windshield

a: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

b: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

c: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

d: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

e: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

f: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

g: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

h: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

i: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

j: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

Model: Rubber O-Ring Seal Installation

a: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

b: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

c: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

d: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

e: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

f: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

g: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

h: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

i: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

j: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

Model: INIVOL and Fluid Structure Interaction Drop Container

a: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

b: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

c: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

d: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

e: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

f: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

g: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

h: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

i: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

j: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory

Neural Magic DeepSparse

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Streamabcjhifgde91827364539.5039.4739.4525.7325.7125.6313.0913.0713.0712.94

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Streamabcdgfeihj130260390520650605.04605.73605.92606.10607.16607.82607.91612.98613.05614.23

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Streamcabhjiegfd300600900120015001418.901417.071403.071003.521002.81999.46511.41509.14508.21508.09

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Streamegfdhjicab4812162015.6215.6915.7215.7215.9215.9415.9916.8916.9117.07

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Streamabcihjefgd150300450600750672.46672.37671.26508.36507.63507.36257.89257.50257.28257.27

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Streamefdgihjabc81624324030.9931.0331.0531.0631.4431.4931.5035.6335.6435.68

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Streamcabhijedfg4080120160200201.54201.39201.25136.96136.68136.5771.2771.1471.0470.93

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Streamedfghjiacb306090120150112.06112.25112.41112.48116.51116.85116.89118.75118.78118.95

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Streamcbaijhegfd110220330440550489.11488.13485.67327.73327.19327.02163.14162.99162.93162.85

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Streamijhecgfdba112233445548.7948.8348.8849.0149.0249.0349.0749.0949.1149.37

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Streamcbaihjgfde110022003300440055005153.665138.835137.013327.193324.823324.701602.521600.531599.211599.15

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Streamcbahijgefd1.12412.24823.37234.49645.62054.63484.64764.65084.80054.80154.80164.97874.98594.98774.9960

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Streambcahjifdeg50100150200250215.93215.65215.64144.12144.05144.0071.9471.9271.9171.90

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Streamhfjbgiaced20406080100110.81110.89110.90110.92110.98110.98111.01111.03111.09111.11

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Streamabcjhidefg112233445549.3349.1747.1532.0632.0031.9616.1616.1416.1316.07

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Streamabdjfeihgc110220330440550485.72487.36493.60494.01494.22494.26494.50495.22495.60507.48

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Streambachjidgef110220330440550489.45489.12487.05326.93326.90326.78163.56163.23162.93162.90

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Streamdhijbgaefc112233445548.8748.8948.8948.8948.9748.9849.0149.0649.0749.21

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Streambcaihjgefd50100150200250219.53218.52218.15145.65145.48145.3772.6972.6672.5772.46

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Streambcihajgefd20406080100109.23109.58109.74109.79109.80109.86109.90109.97110.00110.11

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Streamacbjhigefd70140210280350322.25321.51321.18216.51216.24216.22109.22109.09109.09108.91

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Streamgfedjhiacb2040608010073.1973.2273.2673.3173.7873.8873.9474.3274.5074.56

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Streambcaijhfdeg153045607568.6668.6368.6047.3547.3347.1324.5224.4824.4724.46

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Streamfgedjihbca80160240320400324.96325.51325.74325.88336.68336.77337.96347.22347.37347.66

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Streamabchjidefg160320480640800718.92717.97716.14488.06487.23486.71240.55240.23240.16239.52

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Streamhjidefagbc81624324032.7532.8132.8433.2233.2633.2833.3433.3733.3833.46

TiDB Community Server

This is a PingCAP TiDB Community Server benchmark facilitated using the sysbench OLTP database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_index - Threads: 16jhifcgdea4K8K12K16K20K169721696516817126921268112627126221256712558

Test: oltp_update_index - Threads: 16

b: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

Neural Magic DeepSparse

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Streamcbaijhdfeg4080120160200164.61159.06158.92109.46109.41109.0355.6155.5455.4655.43

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Streamfdegcijhab306090120150143.69143.76144.10144.11145.26145.83145.90146.12150.59150.61

TiDB Community Server

This is a PingCAP TiDB Community Server benchmark facilitated using the sysbench OLTP database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_read_write - Threads: 32hijbcafgde16K32K48K64K80K75486752547425261520596305897447141469934697746737

Neural Magic DeepSparse

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Streambachjidefg91827364539.4539.4439.4225.7925.7725.7013.1313.1213.0913.06

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Streamacdbefgjhi130260390520650605.76605.88606.58606.67606.76606.79608.72612.52613.16613.64

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPUhijgefd0.480.961.441.922.41.147491.150121.155782.118132.125702.130622.13332MIN: 1.01MIN: 1MIN: 1.03MIN: 1.99MIN: 2.01MIN: 1.97MIN: 21. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

TiDB Community Server

This is a PingCAP TiDB Community Server benchmark facilitated using the sysbench OLTP database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_read_write - Threads: 64hibacdgfe20K40K60K80K100K955799426180183790907846955334553015495653893

Test: oltp_read_write - Threads: 64

j: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPUjhiegdf0.35390.70781.06171.41561.76950.7683140.7785430.7985401.5491101.5511801.5582401.572820MIN: 0.71MIN: 0.71MIN: 0.7MIN: 1.51MIN: 1.52MIN: 1.51MIN: 1.531. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

TiDB Community Server

This is a PingCAP TiDB Community Server benchmark facilitated using the sysbench OLTP database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_non_index - Threads: 1hiegfdcab400800120016002000186118481708170516971693138113281312

Test: oltp_update_non_index - Threads: 1

j: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_non_index - Threads: 32hjibafed8K16K24K32K40K3604135655356502891428735266952628526273

Test: oltp_update_non_index - Threads: 32

c: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

g: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPUjhigdef0.30190.60380.90571.20761.50950.7316180.7344610.7350941.3356401.3378901.3386101.341830MIN: 0.66MIN: 0.66MIN: 0.66MIN: 1.31MIN: 1.31MIN: 1.31MIN: 1.311. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

TiDB Community Server

This is a PingCAP TiDB Community Server benchmark facilitated using the sysbench OLTP database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_point_select - Threads: 128hijbacfed40K80K120K160K200K200327198137197738159728159242149962130389129904129492

Test: oltp_point_select - Threads: 128

g: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPUijhdfge0.86491.72982.59473.45964.32453.659073.680873.722473.815763.818233.823813.84421MIN: 2.81MIN: 2.85MIN: 2.83MIN: 3.26MIN: 3.25MIN: 3.29MIN: 3.271. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPUhijdgfe0.14260.28520.42780.57040.7130.4264260.4275120.4302700.6282360.6291080.6303250.633975MIN: 0.38MIN: 0.39MIN: 0.38MIN: 0.6MIN: 0.6MIN: 0.6MIN: 0.61. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPUhjigfde0.68931.37862.06792.75723.44651.781701.786911.788763.054583.056743.059913.06370MIN: 1.64MIN: 1.66MIN: 1.65MIN: 2.97MIN: 2.97MIN: 2.96MIN: 2.971. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPUhijdfge0.76151.5232.28453.0463.80751.733811.734991.735013.377823.379563.381563.38436MIN: 1.64MIN: 1.65MIN: 1.64MIN: 3.33MIN: 3.33MIN: 3.33MIN: 3.331. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPUhjigedf0.19140.38280.57420.76560.9570.4400060.4401560.4403680.8434920.8444340.8478050.850691MIN: 0.41MIN: 0.41MIN: 0.41MIN: 0.83MIN: 0.83MIN: 0.83MIN: 0.831. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPUhijgdfe0.43150.8631.29451.7262.15751.041001.043121.043331.912741.913741.914221.91781MIN: 0.94MIN: 0.94MIN: 0.94MIN: 1.88MIN: 1.88MIN: 1.88MIN: 1.881. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: IP Shapes 1D - Data Type: f32 - Engine: CPUihjdfge0.57721.15441.73162.30882.8861.644781.742031.754532.494082.497142.514412.56522MIN: 1.42MIN: 1.51MIN: 1.52MIN: 2.3MIN: 2.26MIN: 2.3MIN: 2.321. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPUgdfejhi0.43690.87381.31071.74762.18450.6477000.6522590.6531820.6576100.8800160.8927011.941900MIN: 0.57MIN: 0.57MIN: 0.57MIN: 0.57MIN: 0.78MIN: 0.79MIN: 0.871. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPUfdgeijh0.47220.94441.41661.88882.3611.001361.037491.127231.144321.243081.949412.09880MIN: 0.92MIN: 0.92MIN: 0.93MIN: 1.07MIN: 1.04MIN: 1.26MIN: 1.291. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

TiDB Community Server

This is a PingCAP TiDB Community Server benchmark facilitated using the sysbench OLTP database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_non_index - Threads: 128hjcaegf14K28K42K56K70K65816640665286551105421384169541424

Test: oltp_update_non_index - Threads: 128

b: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

d: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

i: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_read_write - Threads: 1ihjfegabc7001400210028003500348534803479321832093195254025102485

Test: oltp_read_write - Threads: 1

d: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPUihjgfed400800120016002000985.74987.84991.121641.401642.351643.971643.99MIN: 949.93MIN: 952.67MIN: 954.92MIN: 1589.91MIN: 1586.17MIN: 1590.89MIN: 1588.031. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

TiDB Community Server

This is a PingCAP TiDB Community Server benchmark facilitated using the sysbench OLTP database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_read_write - Threads: 16hijacbedfg10K20K30K40K50K47576475014741438331373683695036784364803612536088

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_point_select - Threads: 64jibafegd40K80K120K160K200K180581180179130802127567119092118657118549115675

Test: oltp_point_select - Threads: 64

c: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

h: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_point_select - Threads: 32hijbadfeg30K60K90K120K150K13853813817313761810618010462798149973689690796840

Test: oltp_point_select - Threads: 32

c: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_point_select - Threads: 16jhiefgbc20K40K60K80K100K8741287218864717025070105699236751565406

Test: oltp_point_select - Threads: 16

a: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

d: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_index - Threads: 1hjiefgdac400800120016002000166616601656149014831481147912121189

Test: oltp_update_index - Threads: 1

b: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPUhijdgef2004006008001000564.12566.18569.80838.52848.03849.71851.49MIN: 545.13MIN: 544.56MIN: 548.08MIN: 796.3MIN: 807.34MIN: 805.98MIN: 807.971. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

TiDB Community Server

This is a PingCAP TiDB Community Server benchmark facilitated using the sysbench OLTP database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_index - Threads: 64hjibcedf7K14K21K28K35K3133230638305222437123324212712110821067

Test: oltp_update_index - Threads: 64

a: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

g: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPUihjefdg0.13780.27560.41340.55120.6890.3015350.3024600.3092780.5757940.6008340.6039500.612320MIN: 0.28MIN: 0.27MIN: 0.28MIN: 0.52MIN: 0.53MIN: 0.53MIN: 0.531. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

TiDB Community Server

This is a PingCAP TiDB Community Server benchmark facilitated using the sysbench OLTP database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_index - Threads: 128hjibacfeg8K16K24K32K40K371263664436141274642708726546248302461124574

Test: oltp_update_index - Threads: 128

d: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPUihjdgef0.23880.47760.71640.95521.1940.6442520.7045500.7149701.0287501.0456701.0542501.061440MIN: 0.61MIN: 0.66MIN: 0.67MIN: 0.96MIN: 0.98MIN: 0.97MIN: 0.981. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

TiDB Community Server

This is a PingCAP TiDB Community Server benchmark facilitated using the sysbench OLTP database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_non_index - Threads: 16hjigdeab5K10K15K20K25K2379423543235411873518563185571809518068

Test: oltp_update_non_index - Threads: 16

c: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

f: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPUhjifged400800120016002000986.96988.59991.071636.761637.371641.001641.92MIN: 949.02MIN: 950.96MIN: 953.96MIN: 1585.98MIN: 1584.58MIN: 1595.55MIN: 1584.811. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

TiDB Community Server

This is a PingCAP TiDB Community Server benchmark facilitated using the sysbench OLTP database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_non_index - Threads: 64hijabcfdge11K22K33K44K55K51191503465030441281397593910634470342243410733881

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_read_write - Threads: 128jihbafegd20K40K60K80K100K105802104620104180890998575760310601455994459727

Test: oltp_read_write - Threads: 128

c: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_point_select - Threads: 1ihefdcba1300260039005200650061656125597659545898447144054331

Test: oltp_point_select - Threads: 1

g: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

j: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: IP Shapes 3D - Data Type: f32 - Engine: CPUhijfdge0.28810.57620.86431.15241.44050.9262830.9317930.9360011.2065301.2575801.2791801.280430MIN: 0.85MIN: 0.86MIN: 0.86MIN: 1.18MIN: 1.21MIN: 1.24MIN: 1.241. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

TiDB Community Server

This is a PingCAP TiDB Community Server benchmark facilitated using the sysbench OLTP database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_index - Threads: 32jhiabdcge5K10K15K20K25K243662428623773183611781717612175651713517117

Test: oltp_update_index - Threads: 32

f: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPUihjgfed400800120016002000987.36993.56994.611631.991636.441639.361642.51MIN: 952.16MIN: 955.42MIN: 960.2MIN: 1581.62MIN: 1585.81MIN: 1581.93MIN: 1593.161. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPUjihgdfe2004006008001000563.58564.45568.75837.60849.16849.34851.66MIN: 543.65MIN: 545.57MIN: 546.79MIN: 796.61MIN: 806.44MIN: 805.8MIN: 809.451. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPUijhefdg2004006008001000563.33566.39568.65841.08845.31847.38847.42MIN: 544.04MIN: 542.7MIN: 547.26MIN: 798.46MIN: 803.78MIN: 806.33MIN: 806.721. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection FP16 - Device: CPUbcajihgfed71421283530.4430.4330.4119.8419.8319.8210.4810.4810.4710.471. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection FP16 - Device: CPUbcagfedhij2004006008001000393.23393.37393.60759.92760.57761.16761.59804.58804.75805.38MIN: 360.87 / MAX: 433.13MIN: 362.57 / MAX: 433.51MIN: 363.29 / MAX: 431.61MIN: 737.63 / MAX: 771.07MIN: 741.4 / MAX: 770.88MIN: 741.99 / MAX: 776.56MIN: 738.34 / MAX: 772.36MIN: 772.52 / MAX: 820.63MIN: 776.93 / MAX: 819.19MIN: 783.22 / MAX: 819.231. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Person Detection FP16 - Device: CPUbcahjifegd60120180240300284.22282.67282.55197.94194.82193.80107.39107.27107.04107.021. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Person Detection FP16 - Device: CPUbcafedghji2040608010042.2042.4342.4474.4374.5074.7174.7180.7782.0982.49MIN: 36.84 / MAX: 61.97MIN: 36.31 / MAX: 62.36MIN: 36.14 / MAX: 61.98MIN: 65.68 / MAX: 83.49MIN: 66.5 / MAX: 80.32MIN: 66.12 / MAX: 81.09MIN: 66.29 / MAX: 79.68MIN: 69.54 / MAX: 95.42MIN: 68.73 / MAX: 91.87MIN: 70.77 / MAX: 94.621. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Person Detection FP32 - Device: CPUbcaijhgedf60120180240300284.99284.31283.97197.66196.26196.07107.24107.24106.90106.761. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Person Detection FP32 - Device: CPUbcaegdfijh2040608010042.0942.1942.2474.5474.5874.8174.8780.8881.5081.58MIN: 37.13 / MAX: 58.71MIN: 36.21 / MAX: 65.64MIN: 36.59 / MAX: 61.56MIN: 65.97 / MAX: 82.9MIN: 67.63 / MAX: 78.73MIN: 66.88 / MAX: 80.7MIN: 66.72 / MAX: 80.96MIN: 39.72 / MAX: 92.54MIN: 68.9 / MAX: 92.66MIN: 68.74 / MAX: 95.811. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16 - Device: CPUacbijhdgef4008001200160020002033.172029.792028.011488.041483.251481.71797.64793.90793.75791.741. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16 - Device: CPUacbdegfijh36912155.895.905.9110.0110.0610.0610.0910.7410.7710.78MIN: 4.67 / MAX: 18.4MIN: 4.83 / MAX: 13.4MIN: 4.84 / MAX: 12.9MIN: 5.7 / MAX: 19.52MIN: 5.29 / MAX: 19.07MIN: 5.2 / MAX: 19.38MIN: 5.4 / MAX: 19.17MIN: 5.92 / MAX: 24.44MIN: 6 / MAX: 18.16MIN: 5.59 / MAX: 21.131. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection FP16-INT8 - Device: CPUbcahijgdfe132639526556.0656.0256.0137.8237.5737.4820.0520.0320.0120.001. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection FP16-INT8 - Device: CPUbcagdefhij90180270360450213.62213.79213.94398.13398.52398.91399.24421.80425.68425.88MIN: 197.2 / MAX: 235.23MIN: 197.29 / MAX: 236.32MIN: 201.64 / MAX: 242.71MIN: 379.09 / MAX: 404.71MIN: 382.1 / MAX: 404.98MIN: 386.2 / MAX: 407.29MIN: 387.9 / MAX: 408.93MIN: 269.94 / MAX: 598.22MIN: 402.91 / MAX: 432.03MIN: 404.76 / MAX: 434.061. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16 - Device: CPUacbjihdegf130026003900520065005882.915840.535836.274892.274848.424803.652564.782562.542557.662539.971. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16 - Device: CPUabcdegfjih0.7471.4942.2412.9883.7352.032.052.053.113.113.123.143.263.293.32MIN: 1.66 / MAX: 7.51MIN: 1.6 / MAX: 7MIN: 1.62 / MAX: 6.96MIN: 1.94 / MAX: 11.57MIN: 1.93 / MAX: 9.72MIN: 1.88 / MAX: 11.92MIN: 1.93 / MAX: 11.65MIN: 2.1 / MAX: 14.3MIN: 1.89 / MAX: 12.75MIN: 2.11 / MAX: 12.581. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16 - Device: CPUcbajhidfeg160320480640800757.38750.49748.44648.27643.80642.90344.67343.49342.81341.361. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16 - Device: CPUcbadfegjhi61218243015.8315.9816.0223.2023.2823.3223.4224.6724.8424.87MIN: 12.38 / MAX: 32.97MIN: 12.74 / MAX: 33.34MIN: 12.5 / MAX: 33.94MIN: 15.1 / MAX: 31.6MIN: 15.73 / MAX: 30.77MIN: 19.49 / MAX: 30.99MIN: 20.46 / MAX: 32.43MIN: 20.15 / MAX: 37.89MIN: 16.93 / MAX: 33.96MIN: 17 / MAX: 33.341. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16-INT8 - Device: CPUcbaijhfdge60012001800240030002881.142880.582873.242264.932254.722252.701180.851175.671175.581174.601. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16-INT8 - Device: CPUbcafdgeijh2468104.164.164.176.766.796.796.807.057.087.09MIN: 3.42 / MAX: 11.2MIN: 3.43 / MAX: 10.26MIN: 3.39 / MAX: 10.07MIN: 4.04 / MAX: 15.47MIN: 3.8 / MAX: 15.48MIN: 3.79 / MAX: 15.41MIN: 4.04 / MAX: 15.37MIN: 4.44 / MAX: 16.57MIN: 4.35 / MAX: 16.86MIN: 4.43 / MAX: 16.881. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16 - Device: CPUcbajihedgf60012001800240030002987.332986.462945.261964.711964.611963.901039.821039.611039.371038.471. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16 - Device: CPUdegfbcahij4812162015.3615.3615.3715.3816.0216.0216.2616.2716.2716.27MIN: 8.08 / MAX: 24.34MIN: 8.02 / MAX: 23.81MIN: 7.99 / MAX: 23.98MIN: 7.99 / MAX: 24MIN: 14.41 / MAX: 30.55MIN: 14.63 / MAX: 33.79MIN: 14.71 / MAX: 28.14MIN: 8.92 / MAX: 25.52MIN: 8.5 / MAX: 25.86MIN: 8.44 / MAX: 25.481. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16-INT8 - Device: CPUbcahijfedg2K4K6K8K10K9849.079845.279837.586653.866646.916638.243548.783544.183540.883533.641. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16-INT8 - Device: CPUfdeghijbac1.09352.1873.28054.3745.46754.504.514.514.524.804.814.814.854.864.86MIN: 2.98 / MAX: 13.86MIN: 2.98 / MAX: 13.05MIN: 2.96 / MAX: 16.06MIN: 2.77 / MAX: 13.57MIN: 3.23 / MAX: 14.95MIN: 3.23 / MAX: 15.04MIN: 3.23 / MAX: 14.45MIN: 4.25 / MAX: 12.86MIN: 4.23 / MAX: 12.81MIN: 4.34 / MAX: 12.271. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16-INT8 - Device: CPUbcahjiegdf2004006008001000854.51849.30842.91710.69709.75709.73373.64372.26370.57369.261. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16-INT8 - Device: CPUbcaegdfhij51015202514.0314.1214.2321.4021.4721.5721.6522.5022.5322.53MIN: 11.59 / MAX: 26.04MIN: 11.51 / MAX: 26.04MIN: 11.51 / MAX: 25.86MIN: 19.07 / MAX: 25.3MIN: 17.62 / MAX: 28.13MIN: 19.5 / MAX: 24.76MIN: 19.48 / MAX: 24.27MIN: 13.76 / MAX: 30.22MIN: 19.09 / MAX: 30.15MIN: 18.74 / MAX: 31.081. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Machine Translation EN To DE FP16 - Device: CPUcbahjifdeg70140210280350317.33317.28317.22234.18233.88233.65124.30124.12123.61123.411. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Machine Translation EN To DE FP16 - Device: CPUbcafdeghji153045607537.7937.7937.8064.3164.4164.6864.7768.2768.3568.42MIN: 32.97 / MAX: 53.7MIN: 33.29 / MAX: 54.88MIN: 33.35 / MAX: 56.45MIN: 50.85 / MAX: 70.77MIN: 37.44 / MAX: 73.04MIN: 38.02 / MAX: 72.52MIN: 55.8 / MAX: 69.46MIN: 56.41 / MAX: 79.96MIN: 55.82 / MAX: 74.84MIN: 56.13 / MAX: 75.771. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16-INT8 - Device: CPUcbajhidegf120024003600480060005802.655780.445776.943783.653780.803777.752013.772007.532006.092004.761. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16-INT8 - Device: CPUdegfcbajhi2468107.937.967.967.978.248.278.288.458.468.46MIN: 4.2 / MAX: 16.92MIN: 4.19 / MAX: 16.59MIN: 4.19 / MAX: 14.2MIN: 4.37 / MAX: 16.86MIN: 7.62 / MAX: 23.32MIN: 7.37 / MAX: 25.18MIN: 7.44 / MAX: 23.35MIN: 4.46 / MAX: 17.31MIN: 4.67 / MAX: 18MIN: 4.49 / MAX: 17.81. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Person Vehicle Bike Detection FP16 - Device: CPUcabijhfdge50010001500200025002455.512454.092450.262224.082194.362180.831041.871036.991031.601028.641. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Person Vehicle Bike Detection FP16 - Device: CPUacbijhfdge2468104.884.884.897.187.287.337.677.707.747.77MIN: 3.95 / MAX: 16.05MIN: 3.9 / MAX: 14.94MIN: 3.93 / MAX: 13.44MIN: 4.98 / MAX: 16.11MIN: 5.53 / MAX: 15.78MIN: 5.45 / MAX: 15.94MIN: 5.32 / MAX: 16.6MIN: 5.51 / MAX: 16.06MIN: 6.06 / MAX: 12.66MIN: 5.42 / MAX: 16.351. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16 - Device: CPUacbihjgfde300600900120015001560.031551.631546.021036.111034.351012.98538.01533.74532.59530.991. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16 - Device: CPUgfdeaichbj71421283529.7229.9530.0230.1030.7230.8730.8930.9231.0031.57MIN: 19.46 / MAX: 38.99MIN: 19.01 / MAX: 38.08MIN: 18.78 / MAX: 38.72MIN: 22.61 / MAX: 39.15MIN: 29.51 / MAX: 35.07MIN: 20.13 / MAX: 42.34MIN: 29.48 / MAX: 36.29MIN: 25.94 / MAX: 41.77MIN: 29.59 / MAX: 36.33MIN: 20.39 / MAX: 39.221. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUbacihjegdf20K40K60K80K100K87359.2386884.6486789.8059654.9859615.8859505.7832032.0632008.0332002.6231951.641. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUdefghijabc0.12150.2430.36450.4860.60750.490.490.490.490.530.530.530.540.540.54MIN: 0.3 / MAX: 9.28MIN: 0.3 / MAX: 9.07MIN: 0.3 / MAX: 8.2MIN: 0.3 / MAX: 8.84MIN: 0.31 / MAX: 10.06MIN: 0.31 / MAX: 10.06MIN: 0.31 / MAX: 7.18MIN: 0.45 / MAX: 7.64MIN: 0.45 / MAX: 7.81MIN: 0.45 / MAX: 5.031. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16-INT8 - Device: CPUabcijhegfd300600900120015001244.691239.671237.29815.13812.76810.71432.32432.20431.94395.661. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16-INT8 - Device: CPUegfabcijhd91827364536.9836.9837.0138.5038.6638.7539.2339.3439.4440.40MIN: 32.02 / MAX: 44.78MIN: 32.61 / MAX: 41.91MIN: 32.25 / MAX: 43.6MIN: 36.77 / MAX: 44.23MIN: 37.22 / MAX: 43.52MIN: 37.46 / MAX: 43.52MIN: 34.71 / MAX: 47.63MIN: 25.19 / MAX: 46.89MIN: 33.14 / MAX: 45.28MIN: 26.93 / MAX: 74.831. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUcbaihjgfde30K60K90K120K150K123484.28120728.22120606.3868945.3268931.3568895.5045097.9944968.4344958.0744933.271. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUabcdefghij0.07880.15760.23640.31520.3940.340.340.340.350.350.350.350.350.350.35MIN: 0.29 / MAX: 7.33MIN: 0.29 / MAX: 10.87MIN: 0.29 / MAX: 7.09MIN: 0.23 / MAX: 9.09MIN: 0.23 / MAX: 8.84MIN: 0.23 / MAX: 9.15MIN: 0.23 / MAX: 8.63MIN: 0.21 / MAX: 8.91MIN: 0.22 / MAX: 8.62MIN: 0.22 / MAX: 8.351. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Kripke

Kripke is a simple, scalable, 3D Sn deterministic particle transport code. Its primary purpose is to research how data layout, programming paradigms and architectures effect the implementation and performance of Sn transport. Kripke is developed by LLNL. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgThroughput FoM, More Is BetterKripke 1.2.6hijdgfe80M160M240M320M400M3548080003501512003490198002409945002371757002365910002362439001. (CXX) g++ options: -O3 -fopenmp -ldl

a: The test quit with a non-zero exit status.

b: The test quit with a non-zero exit status.

c: The test quit with a non-zero exit status.

Timed Linux Kernel Compilation

This test times how long it takes to build the Linux kernel in a default configuration (defconfig) for the architecture being tested or alternatively an allmodconfig for building all possible kernel modules for the build. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigbacijhefgd122436486027.2427.3527.4133.8733.9333.9555.0955.1555.1755.17

Build: allmodconfig

a: The test quit with a non-zero exit status.

b: The test quit with a non-zero exit status.

c: The test quit with a non-zero exit status.

d: The test quit with a non-zero exit status.

e: The test quit with a non-zero exit status.

f: The test quit with a non-zero exit status.

g: The test quit with a non-zero exit status.

h: The test quit with a non-zero exit status.

i: The test quit with a non-zero exit status.

j: The test quit with a non-zero exit status.

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 4 - Input: Bosphorus 4Kajbihcgfed1.17072.34143.51214.68285.85355.2035.1605.1495.0795.0755.0494.1434.1384.1144.1071. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 8 - Input: Bosphorus 4Kjhibacgefd2040608010099.3599.1098.5791.3290.8190.4267.8167.7267.3966.991. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 12 - Input: Bosphorus 4Khijbadcefg50100150200250230.03227.87224.41166.38163.46163.19163.06162.61161.85160.321. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 13 - Input: Bosphorus 4Kjihbaedcgf50100150200250228.77227.21223.42166.69163.01162.05161.85161.50161.32160.801. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 4 - Input: Bosphorus 1080pcbaihjgedf369121512.6212.5912.4812.2612.2312.1811.0210.9810.9110.741. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 8 - Input: Bosphorus 1080phjicabedfg306090120150151.44149.45149.05143.55141.22138.34119.31118.95118.49118.481. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 12 - Input: Bosphorus 1080pijhgdefcba130260390520650591.32584.12580.16528.53526.22525.17521.52431.90427.69422.991. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 13 - Input: Bosphorus 1080pihjdegfbca160320480640800728.54726.89726.50604.99597.01586.75585.37542.61516.91510.361. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: BMW27 - Compute: CPU-Onlycabhjiefdg163248648026.1226.2026.2438.4038.5138.5771.4471.9672.0072.01

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Classroom - Compute: CPU-Onlyabcjihfedg408012016020066.4266.6466.7299.2999.3599.54181.70182.56182.99183.29

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Fishy Cat - Compute: CPU-Onlycbaijhdfeg2040608010033.0333.1733.2248.6948.8249.1090.0390.2690.3190.63

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Barbershop - Compute: CPU-Onlycabjihfged140280420560700254.72254.88255.30351.38351.66352.40667.87669.09670.64670.87

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Pabellon Barcelona - Compute: CPU-Onlycabjhifegd5010015020025080.4180.5480.76119.04119.30119.42223.95224.10224.12224.15

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer - Model: Crowncbajihfgde122436486055.4055.3954.9043.3143.2742.8921.5921.5821.4821.44MIN: 53.71 / MAX: 58.99MIN: 54.02 / MAX: 57.64MIN: 53.27 / MAX: 57.28MIN: 42.83 / MAX: 44.44MIN: 42.82 / MAX: 44.23MIN: 42.47 / MAX: 43.88MIN: 21.45 / MAX: 21.84MIN: 21.43 / MAX: 21.89MIN: 21.32 / MAX: 21.8MIN: 21.3 / MAX: 21.78

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer ISPC - Model: Crowncbahijgfde132639526556.8156.4656.0945.4845.4045.3222.7722.6622.5922.57MIN: 55.27 / MAX: 59.91MIN: 54.53 / MAX: 59.89MIN: 54.05 / MAX: 59.82MIN: 44.92 / MAX: 46.64MIN: 44.87 / MAX: 46.45MIN: 44.74 / MAX: 46.66MIN: 22.57 / MAX: 23.16MIN: 22.45 / MAX: 22.99MIN: 22.39 / MAX: 22.98MIN: 22.39 / MAX: 22.93

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer - Model: Asian Dragonabcihjgefd132639526560.1459.9159.7948.1948.1248.1024.8224.7324.7024.69MIN: 58.97 / MAX: 62MIN: 58.66 / MAX: 61.96MIN: 58.46 / MAX: 62.03MIN: 47.96 / MAX: 48.63MIN: 47.91 / MAX: 48.91MIN: 47.86 / MAX: 48.8MIN: 24.74 / MAX: 25MIN: 24.67 / MAX: 24.86MIN: 24.63 / MAX: 24.84MIN: 24.62 / MAX: 24.84

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer - Model: Asian Dragon Objbcaihjdgef122436486053.8153.6953.5743.5743.5143.4222.2622.1922.1622.15MIN: 52.72 / MAX: 55.86MIN: 52.63 / MAX: 55.24MIN: 52.17 / MAX: 55.38MIN: 43.34 / MAX: 44.03MIN: 43.26 / MAX: 44.02MIN: 43.14 / MAX: 43.89MIN: 22.18 / MAX: 22.42MIN: 22.12 / MAX: 22.33MIN: 22.08 / MAX: 22.35MIN: 22.07 / MAX: 22.32

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer ISPC - Model: Asian Dragoncabjihgdfe153045607567.5067.3467.2054.5254.5154.3928.4828.3628.3228.31MIN: 65.64 / MAX: 71.17MIN: 65.61 / MAX: 70.54MIN: 65.48 / MAX: 70.41MIN: 54.24 / MAX: 55.1MIN: 54.22 / MAX: 55.08MIN: 54.12 / MAX: 55.15MIN: 28.37 / MAX: 28.69MIN: 28.26 / MAX: 28.59MIN: 28.23 / MAX: 28.55MIN: 28.21 / MAX: 28.56

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer ISPC - Model: Asian Dragon Objcbajhiefgd132639526556.9356.6956.4946.4346.3846.3623.9423.9423.8823.87MIN: 55.56 / MAX: 59.67MIN: 55.42 / MAX: 58.97MIN: 55.29 / MAX: 58.38MIN: 46.17 / MAX: 47.23MIN: 46.09 / MAX: 47.08MIN: 46.13 / MAX: 46.98MIN: 23.84 / MAX: 24.18MIN: 23.84 / MAX: 24.16MIN: 23.79 / MAX: 24.08MIN: 23.78 / MAX: 24.08

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: Asian Dragonhijgfde112233445548.9148.7248.7124.9624.8924.8524.83MIN: 48.64 / MAX: 49.47MIN: 48.48 / MAX: 49.3MIN: 48.45 / MAX: 49.47MIN: 24.9 / MAX: 25.13MIN: 24.81 / MAX: 25.06MIN: 24.78 / MAX: 25MIN: 24.76 / MAX: 24.96

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: Asian Dragon Objjhidefg102030405043.9043.8443.7722.3522.2922.2722.26MIN: 43.66 / MAX: 44.27MIN: 43.64 / MAX: 44.38MIN: 43.51 / MAX: 44.16MIN: 22.28 / MAX: 22.5MIN: 22.22 / MAX: 22.46MIN: 22.2 / MAX: 22.44MIN: 22.18 / MAX: 22.43

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: Crownjihedgf102030405043.9343.8143.5721.9921.8921.8321.77MIN: 43.46 / MAX: 45.01MIN: 43.36 / MAX: 45.05MIN: 43.11 / MAX: 44.65MIN: 21.84 / MAX: 22.32MIN: 21.74 / MAX: 22.23MIN: 21.69 / MAX: 22.17MIN: 21.63 / MAX: 22.18

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragonhijgefd122436486054.2254.1954.1527.9127.8327.8327.74MIN: 53.93 / MAX: 54.77MIN: 53.91 / MAX: 54.97MIN: 53.87 / MAX: 54.79MIN: 27.81 / MAX: 28.17MIN: 27.72 / MAX: 28.1MIN: 27.73 / MAX: 28.13MIN: 27.64 / MAX: 27.98

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon Objijhgefd102030405046.0946.0245.9223.7123.5323.5023.35MIN: 45.82 / MAX: 46.6MIN: 45.75 / MAX: 46.57MIN: 45.64 / MAX: 46.53MIN: 23.61 / MAX: 23.93MIN: 23.43 / MAX: 23.73MIN: 23.4 / MAX: 23.74MIN: 23.26 / MAX: 23.57

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Crownijhfgde102030405045.7145.4045.1922.4422.4222.3922.34MIN: 45.11 / MAX: 47.49MIN: 44.88 / MAX: 46.68MIN: 44.65 / MAX: 46.39MIN: 22.25 / MAX: 22.78MIN: 22.22 / MAX: 22.85MIN: 22.2 / MAX: 22.85MIN: 22.15 / MAX: 22.75

Intel Open Image Denoise

Open Image Denoise is a denoising library for ray-tracing and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.0Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Onlycbajihgfed0.41180.82361.23541.64722.0591.831.831.831.371.371.370.720.720.720.72

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.0Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Onlybacjihgfed0.4140.8281.2421.6562.071.841.841.821.381.381.380.720.720.720.72

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.0Run: RTLightmap.hdr.4096x4096 - Device: CPU-Onlycbajihgfed0.19580.39160.58740.78320.9790.870.860.860.650.650.650.340.340.340.34

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.1Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Onlyjihgfed0.30830.61660.92491.23321.54151.371.371.370.720.720.720.72

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.1Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Onlyjihgfed0.31050.6210.93151.2421.55251.381.381.380.720.720.720.72

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.1Run: RTLightmap.hdr.4096x4096 - Device: CPU-Onlyjihgfed0.14630.29260.43890.58520.73150.650.650.650.340.340.340.34

OpenVKL

OpenVKL is the Intel Open Volume Kernel Library that offers high-performance volume computation kernels and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU Scalarjihgfde80160240320400363363363191191191190MIN: 24 / MAX: 6613MIN: 24 / MAX: 6577MIN: 24 / MAX: 6610MIN: 13 / MAX: 3483MIN: 13 / MAX: 3484MIN: 13 / MAX: 3471MIN: 13 / MAX: 3484

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPChjigfed2004006008001000926922922489488487487MIN: 67 / MAX: 12416MIN: 67 / MAX: 12356MIN: 67 / MAX: 12374MIN: 36 / MAX: 6969MIN: 36 / MAX: 6952MIN: 36 / MAX: 6956MIN: 36 / MAX: 6949

OSPRay

Intel OSPRay is a portable ray-tracing engine for high-performance, high-fidelity scientific visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/ao/real_timecabhijgdfe4812162015.9872015.9860015.9785010.7988010.7430010.693205.575535.574695.573205.54107

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/scivis/real_timebcaihjdgef4812162015.9888015.9778015.9528010.7904010.7832010.766405.570015.565395.563535.55581

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/pathtracer/real_timeacbjhidfge50100150200250215.10214.14214.07192.70192.65192.40151.91151.78151.68151.51

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/ao/real_timeabcijhgefd4812162014.2369014.1783014.1399010.8829010.8743010.852405.622785.620405.614545.60747

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeacbhijgedf4812162013.8739013.8317013.7666010.5913010.5848010.574005.477255.461535.453295.45227

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timecbahjigfde4812162016.5350016.4365016.3468012.5438012.5104012.498706.600856.595636.587456.58270

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 32abchijefgd8M16M24M32M40M394990003948600039453000371450003714100037120000353150003527100035236000352280001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 57abcijfgedh13M26M39M52M65M594010005929600057519000558410005571500052879000528540005282700052665000514430001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 2 - Buffer Length: 256 - Filter Length: 32abcihjfegd17M34M51M68M85M771810007701900076924000724910007246800072400000688610006884600068678000670540001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 2 - Buffer Length: 256 - Filter Length: 57cabjifdehg30M60M90M120M150M1185500001174900001140100001113700001097000001057400001056500001054800001052800001048000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

easyWave

The easyWave software allows simulating tsunami generation and propagation in the context of early warning systems. EasyWave supports making use of OpenMP for CPU multi-threading and there are also GPU ports available but not currently incorporated as part of this test profile. The easyWave tsunami generation software is run with one of the example/reference input files for measuring the CPU execution time. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BettereasyWave r34Input: e2Asean Grid + BengkuluSept2007 Source - Time: 240jhigedf0.37280.74561.11841.49121.8641.2451.2841.2881.6481.6541.6571.6571. (CXX) g++ options: -O3 -fopenmp

OpenBenchmarking.orgSeconds, Fewer Is BettereasyWave r34Input: e2Asean Grid + BengkuluSept2007 Source - Time: 1200jhigfed91827364525.5626.1126.3937.9538.0238.0738.111. (CXX) g++ options: -O3 -fopenmp

OpenBenchmarking.orgSeconds, Fewer Is BettereasyWave r34Input: e2Asean Grid + BengkuluSept2007 Source - Time: 2400ijhgfde2040608010068.2468.5268.5797.5397.9998.9899.421. (CXX) g++ options: -O3 -fopenmp

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 4 - Buffer Length: 256 - Filter Length: 32abcihjedfg30M60M90M120M150M1538500001536900001536700001459200001458200001457400001386200001386000001385800001384600001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 4 - Buffer Length: 256 - Filter Length: 57hjibacegfd40M80M120M160M200M2009300002001200001986400001965900001962200001945100001912300001907500001898800001889300001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 8 - Buffer Length: 256 - Filter Length: 32acbhjidegf70M140M210M280M350M3075400003067600003051100002926200002924900002924300002780300002777800002774100002763900001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 8 - Buffer Length: 256 - Filter Length: 57jhiacbdegf80M160M240M320M400M3816600003783300003772500003694300003669900003669300003633100003579900003578100003504500001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 512cbaihjdfeg3M6M9M12M15M142250001402100013909000133630001290900012899000126830001268100012366000122560001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 16 - Buffer Length: 256 - Filter Length: 32cbahjidefg130M260M390M520M650M6036500006024700005942300005858500005856700005838700005453600005451400005450200005430500001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 16 - Buffer Length: 256 - Filter Length: 57hjiafebdgc160M320M480M640M800M7414200007371200007358000006997400006933400006929200006927600006891500006820700006749300001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 2 - Buffer Length: 256 - Filter Length: 512cabjihefdg6M12M18M24M30M282270002790100027736000263780002591000025648000252070002519900024627000227270001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 32 - Buffer Length: 256 - Filter Length: 32bcaihjgdef300M600M900M1200M1500M11903000001184800000118350000011729000001172400000116990000010471000001047100000104660000010419000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 32 - Buffer Length: 256 - Filter Length: 57ijhcbadgef300M600M900M1200M1500M13941000001369800000135290000012548000001214200000119210000010350000001033400000103200000010246000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 4 - Buffer Length: 256 - Filter Length: 512bcahiedfjg12M24M36M48M60M555880005516500052911000528900005212900050380000502580004997700049781000495560001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 32bachjidefg500M1000M1500M2000M2500M22121000002207700000220680000020575000002056500000205260000010595000001057500000105710000010562000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 57cbajhigefd400M800M1200M1600M2000M20103000002001900000199440000019223000001916800000189970000010993000001095400000109460000010933000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 8 - Buffer Length: 256 - Filter Length: 512acbihjgdfe20M40M60M80M100M1098700001091400001080800001047800001044400001042200001001700009959400099441000970050001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 96 - Buffer Length: 256 - Filter Length: 32acbjihgfde600M1200M1800M2400M3000M30058000002999800000299540000020710000002069900000206830000010657000001065300000106520000010651000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 96 - Buffer Length: 256 - Filter Length: 57bcajihdfge600M1200M1800M2400M3000M25711000002564900000255980000019995000001997000000199550000011208000001120500000111820000011178000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 16 - Buffer Length: 256 - Filter Length: 512bacijhegfd50M100M150M200M250M2161500002160800002149100002097200002094900002075900001960400001946700001945000001938500001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 32 - Buffer Length: 256 - Filter Length: 512bacjihgdef90M180M270M360M450M4296200004258100004244000003932700003932000003916800002740700002737600002734800002733900001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 512cabihjfdeg130M260M390M520M650M6226300006225600006109500005123100005120200005110700002830300002829200002818300002817300001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 96 - Buffer Length: 256 - Filter Length: 512bcaihjgdfe150M300M450M600M750M7181400007150300007116400005201400005197000005194400002865300002862500002859200002858800001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Apache Hadoop

This is a benchmark of the Apache Hadoop making use of its built-in name-node throughput benchmark (NNThroughputBenchmark). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Open - Threads: 50 - Files: 100000hjifdegbac140K280K420K560K700K645161617284581395578035578035552486546448469484460829401606

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Open - Threads: 100 - Files: 100000idhfgabcje120K240K360K480K600K555556529101526316523560460829420168404858403226370370294985

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Open - Threads: 50 - Files: 1000000jhfabcgdie300K600K900K1200K1500K12515641233046122100111261261020408683995654022278319253678251004

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Create - Threads: 50 - Files: 100000gjihedfcab13K26K39K52K65K60680593475899758720586175861758343439374364941288

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Delete - Threads: 50 - Files: 100000gidehfjacb20K40K60K80K100K1039501022491010101006041004029699395602910759058073801

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Open - Threads: 100 - Files: 1000000fdegihjacb300K600K900K1200K1500K1303781124843912048191107420382995323729289101215332185874173822

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Rename - Threads: 50 - Files: 100000ijhdgefcba20K40K60K80K100K90827892068305682372822378223781633771017304670522

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Create - Threads: 100 - Files: 100000hfigejdabc13K26K39K52K65K60496593825903258928588245800557971407333742535075

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Create - Threads: 50 - Files: 1000000hjgidefacb16K32K48K64K80K73411731537270672464721347089769920536655226052119

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Delete - Threads: 100 - Files: 100000dhgifejbac20K40K60K80K100K105708105263102564102041994049803997371908278756673475

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Delete - Threads: 50 - Files: 1000000jhefdgiabc20K40K60K80K100K113572113404113327111198111012110828110436989329731490147

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Rename - Threads: 100 - Files: 100000ejidghfabc20K40K60K80K100K83822834728237282102803867980879491755296934867159

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Rename - Threads: 50 - Files: 1000000jihgedfcab20K40K60K80K100K88550863118512184810840418392182501746387323971679

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Create - Threads: 100 - Files: 1000000hjidgfeabc16K32K48K64K80K73611727547201071296709227053770057461454443744001

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Delete - Threads: 100 - Files: 1000000igedhfjcab20K40K60K80K100K114692113895113225112613111782110803110693970319011486715

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Rename - Threads: 100 - Files: 1000000jfgiehdabc20K40K60K80K100K87161858158576385215843608431081208730787212966827

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: File Status - Threads: 50 - Files: 100000hibjfcdgae200K400K600K800K1000K925926869565862069751880709220657895632911561798529101389105

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: File Status - Threads: 100 - Files: 100000icjehdagfb200K400K600K800K1000K847458729927684932613497595238591716515464487805478469458716

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: File Status - Threads: 50 - Files: 1000000agjbidfhec500K1000K1500K2000K2500K2173913203666019417481941748193050218181821795332426439320924284252

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: File Status - Threads: 100 - Files: 1000000ihgfcadjeb500K1000K1500K2000K2500K250626623529412049180196463718939391886792600601558036235627161970

Apache Cassandra

This is a benchmark of the Apache Cassandra NoSQL database management system making use of cassandra-stress. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.1.3Test: Writeshijcbadgfe70K140K210K280K350K324575318109316485270480256661248095197866197092196287195798

207 Results Shown

SPECFEM3D:
  Tomographic Model
  Homogeneous Halfspace
  Mount St. Helens
  Layered Halfspace
BRL-CAD
Remhos
QuantLib
SPECFEM3D
QuantLib
nekRS:
  Kershaw
  TurboPipe Periodic
Neural Magic DeepSparse:
  NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  ResNet-50, Baseline - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  ResNet-50, Sparse INT8 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  BERT-Large, NLP Question Answering - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
TiDB Community Server
Neural Magic DeepSparse:
  NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
TiDB Community Server
Neural Magic DeepSparse:
  NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
oneDNN
TiDB Community Server
oneDNN
TiDB Community Server:
  oltp_update_non_index - 1
  oltp_update_non_index - 32
oneDNN
TiDB Community Server
oneDNN:
  Deconvolution Batch shapes_1d - f32 - CPU
  Deconvolution Batch shapes_1d - u8s8f32 - CPU
  Deconvolution Batch shapes_1d - bf16bf16bf16 - CPU
  Deconvolution Batch shapes_3d - f32 - CPU
  Deconvolution Batch shapes_3d - u8s8f32 - CPU
  Deconvolution Batch shapes_3d - bf16bf16bf16 - CPU
  IP Shapes 1D - f32 - CPU
  IP Shapes 1D - u8s8f32 - CPU
  IP Shapes 1D - bf16bf16bf16 - CPU
TiDB Community Server:
  oltp_update_non_index - 128
  oltp_read_write - 1
oneDNN
TiDB Community Server:
  oltp_read_write - 16
  oltp_point_select - 64
  oltp_point_select - 32
  oltp_point_select - 16
  oltp_update_index - 1
oneDNN
TiDB Community Server
oneDNN
TiDB Community Server
oneDNN
TiDB Community Server
oneDNN
TiDB Community Server:
  oltp_update_non_index - 64
  oltp_read_write - 128
  oltp_point_select - 1
oneDNN
TiDB Community Server
oneDNN:
  Recurrent Neural Network Training - u8s8f32 - CPU
  Recurrent Neural Network Inference - u8s8f32 - CPU
  Recurrent Neural Network Inference - bf16bf16bf16 - CPU
OpenVINO:
  Face Detection FP16 - CPU:
    FPS
    ms
  Person Detection FP16 - CPU:
    FPS
    ms
  Person Detection FP32 - CPU:
    FPS
    ms
  Vehicle Detection FP16 - CPU:
    FPS
    ms
  Face Detection FP16-INT8 - CPU:
    FPS
    ms
  Face Detection Retail FP16 - CPU:
    FPS
    ms
  Road Segmentation ADAS FP16 - CPU:
    FPS
    ms
  Vehicle Detection FP16-INT8 - CPU:
    FPS
    ms
  Weld Porosity Detection FP16 - CPU:
    FPS
    ms
  Face Detection Retail FP16-INT8 - CPU:
    FPS
    ms
  Road Segmentation ADAS FP16-INT8 - CPU:
    FPS
    ms
  Machine Translation EN To DE FP16 - CPU:
    FPS
    ms
  Weld Porosity Detection FP16-INT8 - CPU:
    FPS
    ms
  Person Vehicle Bike Detection FP16 - CPU:
    FPS
    ms
  Handwritten English Recognition FP16 - CPU:
    FPS
    ms
  Age Gender Recognition Retail 0013 FP16 - CPU:
    FPS
    ms
  Handwritten English Recognition FP16-INT8 - CPU:
    FPS
    ms
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU:
    FPS
    ms
Kripke
Timed Linux Kernel Compilation
SVT-AV1:
  Preset 4 - Bosphorus 4K
  Preset 8 - Bosphorus 4K
  Preset 12 - Bosphorus 4K
  Preset 13 - Bosphorus 4K
  Preset 4 - Bosphorus 1080p
  Preset 8 - Bosphorus 1080p
  Preset 12 - Bosphorus 1080p
  Preset 13 - Bosphorus 1080p
Blender:
  BMW27 - CPU-Only
  Classroom - CPU-Only
  Fishy Cat - CPU-Only
  Barbershop - CPU-Only
  Pabellon Barcelona - CPU-Only
Embree:
  Pathtracer - Crown
  Pathtracer ISPC - Crown
  Pathtracer - Asian Dragon
  Pathtracer - Asian Dragon Obj
  Pathtracer ISPC - Asian Dragon
  Pathtracer ISPC - Asian Dragon Obj
Embree:
  Pathtracer - Asian Dragon
  Pathtracer - Asian Dragon Obj
  Pathtracer - Crown
  Pathtracer ISPC - Asian Dragon
  Pathtracer ISPC - Asian Dragon Obj
  Pathtracer ISPC - Crown
Intel Open Image Denoise:
  RT.hdr_alb_nrm.3840x2160 - CPU-Only
  RT.ldr_alb_nrm.3840x2160 - CPU-Only
  RTLightmap.hdr.4096x4096 - CPU-Only
Intel Open Image Denoise:
  RT.hdr_alb_nrm.3840x2160 - CPU-Only
  RT.ldr_alb_nrm.3840x2160 - CPU-Only
  RTLightmap.hdr.4096x4096 - CPU-Only
OpenVKL:
  vklBenchmarkCPU Scalar
  vklBenchmarkCPU ISPC
OSPRay:
  particle_volume/ao/real_time
  particle_volume/scivis/real_time
  particle_volume/pathtracer/real_time
  gravity_spheres_volume/dim_512/ao/real_time
  gravity_spheres_volume/dim_512/scivis/real_time
  gravity_spheres_volume/dim_512/pathtracer/real_time
Liquid-DSP:
  1 - 256 - 32
  1 - 256 - 57
  2 - 256 - 32
  2 - 256 - 57
easyWave:
  e2Asean Grid + BengkuluSept2007 Source - 240
  e2Asean Grid + BengkuluSept2007 Source - 1200
  e2Asean Grid + BengkuluSept2007 Source - 2400
Liquid-DSP:
  4 - 256 - 32
  4 - 256 - 57
  8 - 256 - 32
  8 - 256 - 57
  1 - 256 - 512
  16 - 256 - 32
  16 - 256 - 57
  2 - 256 - 512
  32 - 256 - 32
  32 - 256 - 57
  4 - 256 - 512
  64 - 256 - 32
  64 - 256 - 57
  8 - 256 - 512
  96 - 256 - 32
  96 - 256 - 57
  16 - 256 - 512
  32 - 256 - 512
  64 - 256 - 512
  96 - 256 - 512
Apache Hadoop:
  Open - 50 - 100000
  Open - 100 - 100000
  Open - 50 - 1000000
  Create - 50 - 100000
  Delete - 50 - 100000
  Open - 100 - 1000000
  Rename - 50 - 100000
  Create - 100 - 100000
  Create - 50 - 1000000
  Delete - 100 - 100000
  Delete - 50 - 1000000
  Rename - 100 - 100000
  Rename - 50 - 1000000
  Create - 100 - 1000000
  Delete - 100 - 1000000
  Rename - 100 - 1000000
  File Status - 50 - 100000
  File Status - 100 - 100000
  File Status - 50 - 1000000
  File Status - 100 - 1000000
Apache Cassandra