Linux Distros Emerald Rapids

Benchmarks for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2403025-NE-2402297NE31&rdt&grs.

Linux Distros Emerald RapidsProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionDesktopDisplay ServerUbuntu Linux 23.10CentOS Stream 9Fedora Server 392 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads)Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS)Intel Device 1bce1008GB3201GB Micron_7450_MTFDKCB3T2TFSASPEED2 x Intel X710 for 10GBASE-TUbuntu 23.106.5.0-17-generic (x86_64)GCC 13.2.0ext41024x7683201GB Micron_7450_MTFDKCB3T2TFS + 257GB Flash DriveCentOS Stream 95.14.0-419.el9.x86_64 (x86_64)GNOME Shell 40.10X ServerGCC 11.4.1 20231218xfs1920x1200Fedora Linux 396.7.6-200.fc39.x86_64 (x86_64)GCC 13.2.1 202312051024x768OpenBenchmarking.orgKernel Details- Ubuntu Linux 23.10: Transparent Huge Pages: madvise- CentOS Stream 9: Transparent Huge Pages: always- Fedora Server 39: Transparent Huge Pages: madviseCompiler Details- Ubuntu Linux 23.10: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - CentOS Stream 9: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-isl - Fedora Server 39: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,fortran,objc,obj-c++,ada,go,d,m2,lto --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-multilib --enable-offload-defaulted --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=i686 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-libstdcxx-zoneinfo=/usr/share/zoneinfo --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver Processor Details- Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x21000161Python Details- Ubuntu Linux 23.10: Python 3.11.6- CentOS Stream 9: Python 3.9.18- Fedora Server 39: Python 3.12.2Security Details- Ubuntu Linux 23.10: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - CentOS Stream 9: SELinux + gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Fedora Server 39: SELinux + gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Linux Distros Emerald Rapidsgpaw: Carbon Nanotubemt-dgemm: Sustained Floating-Point Ratecompress-7zip: Compression Ratingmemcached: 1:10embree: Pathtracer ISPC - Crowncloverleaf: clover_bm64_shortrocksdb: Read Rand Write Randcloverleaf: clover_bm16graph500: 26graph500: 26oidn: RTLightmap.hdr.4096x4096 - CPU-Onlyy-cruncher: 1Bopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUrocksdb: Read While Writingy-cruncher: 5Bclickhouse: 100M Rows Hits Dataset, First Run / Cold Cacheoidn: RT.hdr_alb_nrm.3840x2160 - CPU-Onlyincompact3d: X3D-benchmarking input.i3drawtherapee: Total Benchmark Timerocksdb: Rand Readopenvino: Weld Porosity Detection FP16-INT8 - CPUoidn: RT.ldr_alb_nrm.3840x2160 - CPU-Onlyopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUospray-studio: 3 - 4K - 32 - Path Tracer - CPUclickhouse: 100M Rows Hits Dataset, Third Runclickhouse: 100M Rows Hits Dataset, Second Runsvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 13 - Bosphorus 4Kopenvino: Weld Porosity Detection FP16-INT8 - CPUquicksilver: CORAL2 P2graph500: 26ospray: gravity_spheres_volume/dim_512/pathtracer/real_timetensorflow: CPU - 512 - ResNet-50speedb: Rand Readquicksilver: CTS2ospray: gravity_spheres_volume/dim_512/ao/real_timeospray: gravity_spheres_volume/dim_512/scivis/real_timegraph500: 26openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUvvenc: Bosphorus 4K - Fasterdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamsvt-av1: Preset 4 - Bosphorus 4Kdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamospray-studio: 1 - 1080p - 32 - Path Tracer - CPUlammps: 20k Atomsrocksdb: Update Randospray-studio: 3 - 4K - 1 - Path Tracer - CPUdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamsvt-av1: Preset 8 - Bosphorus 4Kdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamhpcg: 104 104 104 - 60deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUvvenc: Bosphorus 4K - Fasthpcg: 144 144 144 - 60ospray: particle_volume/pathtracer/real_timeospray: particle_volume/scivis/real_timeospray-studio: 2 - 4K - 1 - Path Tracer - CPUdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamospray-studio: 3 - 1080p - 32 - Path Tracer - CPUdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamospray-studio: 1 - 4K - 1 - Path Tracer - CPUopenvino: Face Detection Retail FP16-INT8 - CPUospray-studio: 2 - 1080p - 16 - Path Tracer - CPUospray: particle_volume/ao/real_timeopenvino: Face Detection Retail FP16-INT8 - CPUospray-studio: 1 - 1080p - 16 - Path Tracer - CPUospray-studio: 1 - 4K - 16 - Path Tracer - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamospray-studio: 3 - 4K - 16 - Path Tracer - CPUdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamospray-studio: 3 - 1080p - 16 - Path Tracer - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUospray-studio: 1 - 1080p - 1 - Path Tracer - CPUospray-studio: 2 - 1080p - 32 - Path Tracer - CPUopenvkl: vklBenchmarkCPU ISPCdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamospray-studio: 2 - 4K - 16 - Path Tracer - CPUdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamospray-studio: 3 - 1080p - 1 - Path Tracer - CPUospray-studio: 2 - 1080p - 1 - Path Tracer - CPUnwchem: C240 Buckyballlczero: Eigenospray-studio: 2 - 4K - 32 - Path Tracer - CPUospray-studio: 1 - 4K - 32 - Path Tracer - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUpgbench: 100 - 1000 - Read Write - Average Latencypgbench: 100 - 1000 - Read Writepgbench: 100 - 1000 - Read Only - Average Latencypgbench: 100 - 1000 - Read Onlygromacs: MPI CPU - water_GMX50_bareredis: SET - 500redis: GET - 500memcached: 1:100compress-7zip: Decompression Ratingembree: Pathtracer ISPC - Asian Dragoneasywave: e2Asean Grid + BengkuluSept2007 Source - 2400lammps: Rhodopsin Proteinnamd: STMV with 1,066,628 Atomsnamd: ATPase with 327,506 Atomsquicksilver: CORAL2 P1lczero: BLASUbuntu Linux 23.10CentOS Stream 9Fedora Server 3938.63737.9710184648133370014.38100.339932.10955461279.21122655000012895800002.187.20785.06375.75977598929.821205.204.53169.178579129.07959982204643516.984.5461020.1637285215.62214.3166.85766.4302.85674477848353400032.321273.12600703384768022228.608828.91626649910000.805.6111866.225934.254534.98841826.04472.307155.8178644856.68312556010794547.539521.317409.008971.137114.05733217.8439.76519.83245.982.78569.336282.970020.7725911176.56912377.9053.791837.1113361.2877732134.760391424570.10369420.65465.2037181208610033.9512.7411099.6440145085.751543538901.6114.372346324282177.0180829.5063132.678912243478.7631477.136274.883852.2774133.20631223.1639853.20792762331750.3380331743227927.931143.2525.616395421.4896793179.6302134872.891541713.803477137.28455056144.9195177.75437.5181.490044.7071159315001563.6358407510703337339.10105.619425.01314.49146412000014996000002.517.91397.34328.3732.850183.625.04184.19233240187.344.9060429.54201.05200.1869.86869.7183.02638100046639800033.293876.68739833329.762629.51046407940000.835.8081810.950835.284634.22621866.51532.358152.567857.8364462.525521.560416.681671.133214.31823196.4740.02528.79241.672.82369.172883.565220.4427173.95152412.5153.021863.3429366.383134.290624295.7120.50215.2510113.4712.6511022.30205.78338908.7414.36281577.1671827.9914132.9101478.0315476.578574.803852.2360133.28181223.6470853.337452.09617.455.9391978937.181821521.392615816.73434200177.7960205.00539.7950.502513.203285800833194.50837.7200764961385054518.76142.167531.631184837255.39119551000012532500002.258.27093.74340.97856700633.734188.714.68168.671819118.22865285412542419.894.7056624.9834698206.83202.1471.51870.8742.86675960049303100031.6999626261826736750028.663728.4306634120000.835.8042.346631457.677123092105821.16172.45753255.1639.30529.14241.702.83470.380582.138020.54198972383.2253.67742490224296.54365520.44425.2536831218710082.9312.691442243778862.0714.432356303282112262276233275242803532.67978.707.1802125843.971838671.438983240.52428601179.5403156.23739.0091.929775.407065835818OpenBenchmarking.org

GPAW

Input: Carbon Nanotube

OpenBenchmarking.orgSeconds, Fewer Is BetterGPAW 23.6Input: Carbon NanotubeUbuntu Linux 23.10Fedora Server 394080120160200SE +/- 0.35, N = 15SE +/- 0.94, N = 338.64194.51-fwrapv -O2-fno-strict-overflow -fcf-protection -fexceptions -fPIC -UNDEBUG -std=c991. (CC) gcc options: -shared -lxc -lblas -lmpi

ACES DGEMM

Sustained Floating-Point Rate

OpenBenchmarking.orgGFLOP/s, More Is BetterACES DGEMM 1.0Sustained Floating-Point RateUbuntu Linux 23.10CentOS Stream 9Fedora Server 391428425670SE +/- 0.09, N = 3SE +/- 0.51, N = 3SE +/- 0.04, N = 337.9763.6437.721. (CC) gcc options: -O3 -march=native -fopenmp

7-Zip Compression

Test: Compression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression RatingUbuntu Linux 23.10CentOS Stream 9Fedora Server 39160K320K480K640K800KSE +/- 4291.24, N = 3SE +/- 5583.39, N = 15SE +/- 4508.27, N = 74648137510704961381. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

Memcached

Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.19Set To Get Ratio: 1:10Ubuntu Linux 23.10CentOS Stream 9Fedora Server 391.1M2.2M3.3M4.4M5.5MSE +/- 36897.17, N = 5SE +/- 43085.73, N = 13SE +/- 65254.44, N = 33370014.383337339.105054518.761. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Embree

Binary: Pathtracer ISPC - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownUbuntu Linux 23.10CentOS Stream 9Fedora Server 39306090120150SE +/- 0.25, N = 3SE +/- 1.24, N = 15SE +/- 1.32, N = 15100.34105.62142.17MIN: 95.92 / MAX: 109.46MIN: 95.01 / MAX: 132.75MIN: 115.81 / MAX: 164.58

CloverLeaf

Input: clover_bm64_short

OpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeaf 1.3Input: clover_bm64_shortUbuntu Linux 23.10CentOS Stream 9Fedora Server 39714212835SE +/- 0.23, N = 11SE +/- 0.12, N = 3SE +/- 0.40, N = 332.1025.0131.631. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp

RocksDB

Test: Read Random Write Random

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 8.0Test: Read Random Write RandomUbuntu Linux 23.10Fedora Server 39300K600K900K1200K1500KSE +/- 5328.60, N = 3SE +/- 13512.70, N = 159554611184837-lpthread1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

CloverLeaf

Input: clover_bm16

OpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeaf 1.3Input: clover_bm16Ubuntu Linux 23.10CentOS Stream 9Fedora Server 3970140210280350SE +/- 3.60, N = 3SE +/- 1.51, N = 3SE +/- 1.01, N = 3279.21314.49255.391. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp

Graph500

Scale: 26

OpenBenchmarking.orgbfs median_TEPS, More Is BetterGraph500 3.0Scale: 26Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39300M600M900M1200M1500M1226550000146412000011955100001. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi

Graph500

Scale: 26

OpenBenchmarking.orgbfs max_TEPS, More Is BetterGraph500 3.0Scale: 26Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39300M600M900M1200M1500M1289580000149960000012532500001. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi

Intel Open Image Denoise

Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RTLightmap.hdr.4096x4096 - Device: CPU-OnlyUbuntu Linux 23.10CentOS Stream 9Fedora Server 390.56481.12961.69442.25922.824SE +/- 0.01, N = 3SE +/- 0.03, N = 4SE +/- 0.01, N = 152.182.512.25

Y-Cruncher

Pi Digits To Calculate: 1B

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 1BUbuntu Linux 23.10CentOS Stream 9Fedora Server 39246810SE +/- 0.037, N = 3SE +/- 0.045, N = 3SE +/- 0.088, N = 57.2077.9138.270

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 3920406080100SE +/- 0.11, N = 3SE +/- 0.81, N = 3SE +/- 0.18, N = 385.0697.3493.74-pie - MIN: 39.38 / MAX: 260.96-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 33.82 / MAX: 325.84-pie - MIN: 34.75 / MAX: 283.241. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 3980160240320400SE +/- 0.48, N = 3SE +/- 2.69, N = 3SE +/- 0.63, N = 3375.75328.37340.97-pie-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

RocksDB

Test: Read While Writing

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 8.0Test: Read While WritingUbuntu Linux 23.10Fedora Server 392M4M6M8M10MSE +/- 81611.31, N = 8SE +/- 133209.05, N = 1497759898567006-lpthread1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

Y-Cruncher

Pi Digits To Calculate: 5B

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 5BUbuntu Linux 23.10CentOS Stream 9Fedora Server 39816243240SE +/- 0.07, N = 3SE +/- 0.17, N = 3SE +/- 0.43, N = 329.8232.8533.73

ClickHouse

100M Rows Hits Dataset, First Run / Cold Cache

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold CacheUbuntu Linux 23.10CentOS Stream 9Fedora Server 3950100150200250SE +/- 2.70, N = 3SE +/- 0.84, N = 3SE +/- 2.54, N = 3205.20183.62188.71MIN: 35.4 / MAX: 1818.18MIN: 34.56 / MAX: 1714.29MIN: 30.08 / MAX: 1428.57

Intel Open Image Denoise

Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-OnlyUbuntu Linux 23.10CentOS Stream 9Fedora Server 391.1342.2683.4024.5365.67SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 34.535.044.68

Xcompact3d Incompact3d

Input: X3D-benchmarking input.i3d

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: X3D-benchmarking input.i3dUbuntu Linux 23.10CentOS Stream 9Fedora Server 394080120160200SE +/- 0.44, N = 3SE +/- 0.56, N = 3SE +/- 0.67, N = 3169.18184.19168.67-lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz1. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi

RawTherapee

Total Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterRawTherapeeTotal Benchmark TimeUbuntu Linux 23.10Fedora Server 39306090120150SE +/- 0.65, N = 3SE +/- 0.45, N = 3129.08118.231. Ubuntu Linux 23.10: RawTherapee, version 5.9, command line.2. Fedora Server 39: RawTherapee, version 5.10, command line.

RocksDB

Test: Random Read

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 8.0Test: Random ReadUbuntu Linux 23.10Fedora Server 39140M280M420M560M700MSE +/- 7527805.83, N = 15SE +/- 3865049.53, N = 3599822046652854125-lpthread1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 399K18K27K36K45KSE +/- 43.54, N = 3SE +/- 347.22, N = 3SE +/- 194.22, N = 343516.9840187.3442419.89-pie-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

Intel Open Image Denoise

Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-OnlyUbuntu Linux 23.10CentOS Stream 9Fedora Server 391.10252.2053.30754.415.5125SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 154.544.904.70

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 3913K26K39K52K65KSE +/- 827.51, N = 15SE +/- 478.67, N = 3SE +/- 271.02, N = 361020.1660429.5456624.98-pie-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 398K16K24K32K40KSE +/- 564.37, N = 15SE +/- 119.27, N = 33728534698

ClickHouse

100M Rows Hits Dataset, Third Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third RunUbuntu Linux 23.10CentOS Stream 9Fedora Server 3950100150200250SE +/- 3.81, N = 3SE +/- 2.16, N = 3SE +/- 3.01, N = 3215.62201.05206.83MIN: 37.43 / MAX: 1714.29MIN: 36.08 / MAX: 1500MIN: 35.91 / MAX: 1935.48

ClickHouse

100M Rows Hits Dataset, Second Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second RunUbuntu Linux 23.10CentOS Stream 9Fedora Server 3950100150200250SE +/- 1.67, N = 3SE +/- 3.30, N = 3SE +/- 1.90, N = 3214.31200.18202.14MIN: 36.39 / MAX: 1764.71MIN: 37.41 / MAX: 2000MIN: 36.41 / MAX: 1463.41

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 12 - Input: Bosphorus 4KUbuntu Linux 23.10CentOS Stream 9Fedora Server 391632486480SE +/- 0.48, N = 15SE +/- 0.39, N = 3SE +/- 0.99, N = 366.8669.8771.521. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 13 - Input: Bosphorus 4KUbuntu Linux 23.10CentOS Stream 9Fedora Server 391632486480SE +/- 0.74, N = 5SE +/- 0.99, N = 3SE +/- 0.53, N = 366.4369.7270.871. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 390.67951.3592.03852.7183.3975SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 32.853.022.86-pie - MIN: 2.08 / MAX: 32.04-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 2.07 / MAX: 29.73-pie - MIN: 1.94 / MAX: 41.91. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

Quicksilver

Input: CORAL2 P2

OpenBenchmarking.orgFigure Of Merit, More Is BetterQuicksilver 20230818Input: CORAL2 P2Ubuntu Linux 23.10CentOS Stream 9Fedora Server 391.4M2.8M4.2M5.6M7MSE +/- 81512.06, N = 9SE +/- 51868.42, N = 3SE +/- 74346.22, N = 56744778638100067596001. (CXX) g++ options: -fopenmp -O3 -march=native

Graph500

Scale: 26

OpenBenchmarking.orgsssp median_TEPS, More Is BetterGraph500 3.0Scale: 26Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39110M220M330M440M550M4835340004663980004930310001. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeUbuntu Linux 23.10CentOS Stream 9Fedora Server 39816243240SE +/- 0.05, N = 3SE +/- 0.48, N = 15SE +/- 0.12, N = 332.3233.2931.70

TensorFlow

Device: CPU - Batch Size: 512 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 512 - Model: ResNet-50Ubuntu Linux 23.10CentOS Stream 920406080100SE +/- 0.84, N = 3SE +/- 0.83, N = 473.1276.68

Speedb

Test: Random Read

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random ReadUbuntu Linux 23.10Fedora Server 39130M260M390M520M650MSE +/- 5282775.06, N = 8SE +/- 8524314.28, N = 3600703384626261826-lpthread1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

Quicksilver

Input: CTS2

OpenBenchmarking.orgFigure Of Merit, More Is BetterQuicksilver 20230818Input: CTS2Ubuntu Linux 23.10CentOS Stream 9Fedora Server 391.6M3.2M4.8M6.4M8MSE +/- 80526.35, N = 9SE +/- 121572.66, N = 6SE +/- 90618.71, N = 47680222739833373675001. (CXX) g++ options: -fopenmp -O3 -march=native

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/ao/real_timeUbuntu Linux 23.10CentOS Stream 9Fedora Server 39714212835SE +/- 0.05, N = 3SE +/- 0.26, N = 15SE +/- 0.10, N = 328.6129.7628.66

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeUbuntu Linux 23.10CentOS Stream 9Fedora Server 39714212835SE +/- 0.11, N = 3SE +/- 0.17, N = 3SE +/- 0.17, N = 328.9229.5128.43

Graph500

Scale: 26

OpenBenchmarking.orgsssp max_TEPS, More Is BetterGraph500 3.0Scale: 26Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39140M280M420M560M700M6649910006407940006634120001. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 390.18680.37360.56040.74720.934SE +/- 0.00, N = 15SE +/- 0.00, N = 3SE +/- 0.00, N = 30.800.830.83-pie - MIN: 0.2 / MAX: 28.24-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 0.21 / MAX: 20.36-pie - MIN: 0.2 / MAX: 31.651. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

VVenC

Video Input: Bosphorus 4K - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FasterUbuntu Linux 23.10CentOS Stream 9Fedora Server 391.30682.61363.92045.22726.534SE +/- 0.061, N = 4SE +/- 0.013, N = 3SE +/- 0.035, N = 35.6115.8085.8041. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9400800120016002000SE +/- 20.52, N = 3SE +/- 16.06, N = 31866.231810.95

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9816243240SE +/- 0.38, N = 3SE +/- 0.32, N = 334.2535.28

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9816243240SE +/- 0.31, N = 3SE +/- 0.07, N = 334.9934.23

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9400800120016002000SE +/- 16.26, N = 3SE +/- 3.56, N = 31826.041866.52

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 4 - Input: Bosphorus 4KUbuntu Linux 23.10CentOS Stream 9Fedora Server 390.53061.06121.59182.12242.653SE +/- 0.007, N = 3SE +/- 0.009, N = 3SE +/- 0.008, N = 32.3072.3582.3461. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9306090120150SE +/- 0.87, N = 3SE +/- 0.32, N = 3155.82152.57

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 3914002800420056007000SE +/- 77.79, N = 4SE +/- 13.35, N = 364486314

LAMMPS Molecular Dynamics Simulator

Model: 20k Atoms

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: 20k AtomsUbuntu Linux 23.10CentOS Stream 9Fedora Server 391326395265SE +/- 0.42, N = 3SE +/- 0.46, N = 3SE +/- 0.40, N = 356.6857.8457.681. (CXX) g++ options: -O3 -lm -ldl

RocksDB

Test: Update Random

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 8.0Test: Update RandomUbuntu Linux 23.10Fedora Server 3930K60K90K120K150KSE +/- 440.29, N = 3SE +/- 1187.74, N = 3125560123092-lpthread1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 392004006008001000SE +/- 2.40, N = 3SE +/- 2.96, N = 310791058

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 910002000300040005000SE +/- 40.60, N = 7SE +/- 40.12, N = 74547.544462.53

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 8 - Input: Bosphorus 4KUbuntu Linux 23.10CentOS Stream 9Fedora Server 39510152025SE +/- 0.19, N = 3SE +/- 0.21, N = 3SE +/- 0.10, N = 321.3221.5621.161. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 990180270360450SE +/- 2.51, N = 3SE +/- 0.86, N = 3409.01416.68

High Performance Conjugate Gradient

X Y Z: 104 104 104 - RT: 60

OpenBenchmarking.orgGFLOP/s, More Is BetterHigh Performance Conjugate Gradient 3.1X Y Z: 104 104 104 - RT: 60Ubuntu Linux 23.10CentOS Stream 9Fedora Server 391632486480SE +/- 0.19, N = 3SE +/- 0.12, N = 3SE +/- 0.14, N = 371.1471.1372.461. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 948121620SE +/- 0.13, N = 7SE +/- 0.13, N = 714.0614.32

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 397001400210028003500SE +/- 1.65, N = 3SE +/- 1.03, N = 3SE +/- 4.78, N = 33217.843196.473255.16-pie-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39918273645SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 339.7640.0239.30-pie - MIN: 37.84 / MAX: 104.98-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 33.6 / MAX: 102.02-pie - MIN: 33.26 / MAX: 101.521. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39110220330440550SE +/- 5.90, N = 4SE +/- 1.20, N = 3SE +/- 6.06, N = 4519.83528.79529.14-pie-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 3950100150200250SE +/- 2.84, N = 4SE +/- 0.55, N = 3SE +/- 2.84, N = 4245.98241.67241.70-pie - MIN: 176.44 / MAX: 390.61-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 160.04 / MAX: 556.9-pie - MIN: 163.92 / MAX: 559.831. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

VVenC

Video Input: Bosphorus 4K - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FastUbuntu Linux 23.10CentOS Stream 9Fedora Server 390.63771.27541.91312.55083.1885SE +/- 0.035, N = 3SE +/- 0.026, N = 3SE +/- 0.017, N = 32.7852.8232.8341. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

High Performance Conjugate Gradient

X Y Z: 144 144 144 - RT: 60

OpenBenchmarking.orgGFLOP/s, More Is BetterHigh Performance Conjugate Gradient 3.1X Y Z: 144 144 144 - RT: 60Ubuntu Linux 23.10CentOS Stream 9Fedora Server 391632486480SE +/- 0.52, N = 3SE +/- 0.83, N = 4SE +/- 0.27, N = 369.3469.1770.381. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi

OSPRay

Benchmark: particle_volume/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/pathtracer/real_timeUbuntu Linux 23.10CentOS Stream 9Fedora Server 3920406080100SE +/- 0.35, N = 3SE +/- 0.23, N = 3SE +/- 0.58, N = 382.9783.5782.14

OSPRay

Benchmark: particle_volume/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/scivis/real_timeUbuntu Linux 23.10CentOS Stream 9Fedora Server 39510152025SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 320.7720.4420.54

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 392004006008001000SE +/- 3.53, N = 3SE +/- 2.03, N = 3911897

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 94080120160200SE +/- 1.16, N = 3SE +/- 0.21, N = 3176.57173.95

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 395001000150020002500SE +/- 15.67, N = 3SE +/- 10.50, N = 3SE +/- 4.46, N = 32377.902412.512383.22-pie-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 391224364860SE +/- 0.36, N = 3SE +/- 0.23, N = 3SE +/- 0.10, N = 353.7953.0253.67-pie - MIN: 44.62 / MAX: 198.12-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 42.98 / MAX: 178.63-pie - MIN: 43.29 / MAX: 161.251. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

Neural Magic DeepSparse

Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9400800120016002000SE +/- 7.36, N = 3SE +/- 4.86, N = 31837.111863.34

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 980160240320400SE +/- 2.37, N = 3SE +/- 0.14, N = 3361.29366.38

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 3916003200480064008000SE +/- 31.90, N = 3SE +/- 91.12, N = 473217424

Neural Magic DeepSparse

Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9816243240SE +/- 0.12, N = 3SE +/- 0.09, N = 334.7634.29

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 392004006008001000SE +/- 3.48, N = 3SE +/- 9.82, N = 4914902

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 395K10K15K20K25KSE +/- 208.25, N = 3SE +/- 36.89, N = 3SE +/- 130.19, N = 324570.1024295.7124296.54-pie-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 398001600240032004000SE +/- 7.45, N = 3SE +/- 43.59, N = 336943655

OSPRay

Benchmark: particle_volume/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/ao/real_timeUbuntu Linux 23.10CentOS Stream 9Fedora Server 39510152025SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 320.6520.5020.44

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 391.18132.36263.54394.72525.9065SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 35.205.255.25-pie - MIN: 4.59 / MAX: 31.78-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 4.69 / MAX: 58.72-pie - MIN: 4.62 / MAX: 31.261. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 398001600240032004000SE +/- 3.21, N = 3SE +/- 16.22, N = 337183683

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 393K6K9K12K15KSE +/- 3.51, N = 3SE +/- 22.15, N = 31208612187

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 392K4K6K8K10KSE +/- 140.94, N = 3SE +/- 104.96, N = 5SE +/- 124.93, N = 410033.9510113.4710082.93-pie-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 393691215SE +/- 0.18, N = 3SE +/- 0.14, N = 5SE +/- 0.16, N = 412.7412.6512.69-pie - MIN: 10.88 / MAX: 73.62-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 10.9 / MAX: 74.36-pie - MIN: 10.9 / MAX: 75.691. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

Neural Magic DeepSparse

Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 92K4K6K8K10KSE +/- 102.73, N = 7SE +/- 43.63, N = 311099.6411022.30

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 393K6K9K12K15KSE +/- 177.62, N = 4SE +/- 37.95, N = 31450814422

Neural Magic DeepSparse

Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 91.30122.60243.90365.20486.506SE +/- 0.0557, N = 7SE +/- 0.0226, N = 35.75155.7833

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 399001800270036004500SE +/- 47.59, N = 4SE +/- 21.55, N = 343534377

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 392K4K6K8K10KSE +/- 20.48, N = 3SE +/- 7.04, N = 3SE +/- 9.74, N = 38901.618908.748862.07-pie-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 3948121620SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 314.3714.3614.43-pie - MIN: 12.05 / MAX: 72.49-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 12.55 / MAX: 76.83-pie - MIN: 12.18 / MAX: 71.661. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 3950100150200250SE +/- 0.33, N = 3SE +/- 0.88, N = 3234235

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 3914002800420056007000SE +/- 60.98, N = 6SE +/- 28.01, N = 363246303

OpenVKL

Benchmark: vklBenchmarkCPU ISPC

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCUbuntu Linux 23.10CentOS Stream 9Fedora Server 396001200180024003000SE +/- 20.99, N = 3SE +/- 33.05, N = 3SE +/- 22.66, N = 3282128152821MIN: 175 / MAX: 34505MIN: 186 / MAX: 35204MIN: 178 / MAX: 36193

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 920406080100SE +/- 0.46, N = 3SE +/- 0.41, N = 377.0277.17

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 92004006008001000SE +/- 5.31, N = 3SE +/- 4.43, N = 3829.51827.99

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9306090120150SE +/- 0.29, N = 3SE +/- 0.30, N = 3132.68132.91

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 393K6K9K12K15KSE +/- 25.12, N = 3SE +/- 36.03, N = 31224312262

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9100200300400500SE +/- 0.91, N = 3SE +/- 0.62, N = 3478.76478.03

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9100200300400500SE +/- 0.78, N = 3SE +/- 0.34, N = 3477.14476.58

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 920406080100SE +/- 0.50, N = 3SE +/- 0.70, N = 374.8874.80

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 91224364860SE +/- 0.63, N = 3SE +/- 0.70, N = 352.2852.24

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9306090120150SE +/- 0.24, N = 3SE +/- 0.09, N = 3133.21133.28

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 930060090012001500SE +/- 14.85, N = 3SE +/- 15.64, N = 31223.161223.65

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 92004006008001000SE +/- 6.05, N = 3SE +/- 8.06, N = 3853.21853.34

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 3960120180240300SE +/- 0.00, N = 3SE +/- 1.45, N = 3276276

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 3950100150200250SE +/- 0.33, N = 3SE +/- 0.33, N = 3233233

NWChem

Input: C240 Buckyball

OpenBenchmarking.orgSeconds, Fewer Is BetterNWChem 7.0.2Input: C240 BuckyballUbuntu Linux 23.104008001200160020001750.31. (F9X) gfortran options: -lnwctask -lccsd -lmcscf -lselci -lmp2 -lmoints -lstepper -ldriver -loptim -lnwdft -lgradients -lcphf -lesp -lddscf -ldangchang -lguess -lhessian -lvib -lnwcutil -lrimp2 -lproperty -lsolvation -lnwints -lprepar -lnwmd -lnwpw -lofpw -lpaw -lpspw -lband -lnwpwlib -lcafe -lspace -lanalyze -lqhop -lpfft -ldplot -ldrdy -lvscf -lqmmm -lqmd -letrans -ltce -lbq -lmm -lcons -lperfm -ldntmc -lccca -ldimqm -lga -larmci -lpeigs -l64to32 -lopenblas -lpthread -lrt -llapack -lnwcblas -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz -lcomex -m64 -ffast-math -std=legacy -fdefault-integer-8 -finline-functions -O2

LeelaChessZero

Backend: Eigen

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.30Backend: EigenUbuntu Linux 23.1080160240320400SE +/- 4.52, N = 43801. (CXX) g++ options: -flto -pthread

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 397K14K21K28K35KSE +/- 600.94, N = 15SE +/- 1255.46, N = 153317427524

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 397K14K21K28K35KSE +/- 481.26, N = 15SE +/- 1257.60, N = 153227928035

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 391224364860SE +/- 0.11, N = 3SE +/- 1.14, N = 15SE +/- 0.27, N = 927.9352.0932.67-pie - MIN: 19.99 / MAX: 261.46-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 17.25 / MAX: 578.83-pie - MIN: 19.33 / MAX: 484.581. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 392004006008001000SE +/- 4.60, N = 3SE +/- 13.25, N = 15SE +/- 8.04, N = 91143.25617.45978.70-pie-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average LatencyUbuntu Linux 23.10612182430SE +/- 0.97, N = 925.621. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read WriteUbuntu Linux 23.108K16K24K32K40KSE +/- 1662.84, N = 9395421. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average LatencyUbuntu Linux 23.100.3350.671.0051.341.675SE +/- 0.047, N = 121.4891. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read OnlyUbuntu Linux 23.10150K300K450K600K750KSE +/- 22056.84, N = 126793171. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2024Implementation: MPI CPU - Input: water_GMX50_bareUbuntu Linux 23.10CentOS Stream 9Fedora Server 393691215SE +/- 1.403, N = 7SE +/- 0.323, N = 12SE +/- 0.850, N = 129.6305.9397.1801. (CXX) g++ options: -O3 -lm

Redis

Test: SET - Parallel Connections: 500

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 7.0.4Test: SET - Parallel Connections: 500Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39500K1000K1500K2000K2500KSE +/- 48178.71, N = 15SE +/- 47416.25, N = 15SE +/- 73166.31, N = 152134872.891978937.182125843.971. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

Redis

Test: GET - Parallel Connections: 500

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 7.0.4Test: GET - Parallel Connections: 500Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39400K800K1200K1600K2000KSE +/- 15103.72, N = 15SE +/- 19161.91, N = 15SE +/- 30474.05, N = 151541713.801821521.391838671.431. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

Memcached

Set To Get Ratio: 1:100

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.19Set To Get Ratio: 1:100Ubuntu Linux 23.10CentOS Stream 9Fedora Server 392M4M6M8M10MSE +/- 20632.12, N = 3SE +/- 20448.57, N = 10SE +/- 380886.14, N = 123477137.282615816.738983240.521. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

7-Zip Compression

Test: Decompression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression RatingUbuntu Linux 23.10CentOS Stream 9Fedora Server 39100K200K300K400K500KSE +/- 39319.74, N = 3SE +/- 2615.74, N = 15SE +/- 14994.49, N = 74550564342004286011. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonUbuntu Linux 23.10CentOS Stream 9Fedora Server 394080120160200SE +/- 0.50, N = 3SE +/- 3.90, N = 15SE +/- 0.73, N = 3144.92177.80179.54MIN: 137.85 / MAX: 155.04MIN: 142.88 / MAX: 210.57MIN: 145.33 / MAX: 207.47

easyWave

Input: e2Asean Grid + BengkuluSept2007 Source - Time: 2400

OpenBenchmarking.orgSeconds, Fewer Is BettereasyWave r34Input: e2Asean Grid + BengkuluSept2007 Source - Time: 2400Ubuntu Linux 23.10CentOS Stream 9Fedora Server 394080120160200SE +/- 8.98, N = 12SE +/- 10.40, N = 12SE +/- 15.88, N = 12177.75205.01156.241. (CXX) g++ options: -O3 -fopenmp

LAMMPS Molecular Dynamics Simulator

Model: Rhodopsin Protein

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: Rhodopsin ProteinUbuntu Linux 23.10CentOS Stream 9Fedora Server 39918273645SE +/- 0.93, N = 15SE +/- 0.76, N = 15SE +/- 0.95, N = 1537.5239.8039.011. (CXX) g++ options: -O3 -lm -ldl

NAMD

Input: STMV with 1,066,628 Atoms

OpenBenchmarking.orgns/day, More Is BetterNAMD 3.0b6Input: STMV with 1,066,628 AtomsUbuntu Linux 23.10CentOS Stream 9Fedora Server 390.43420.86841.30261.73682.171SE +/- 0.14829, N = 15SE +/- 0.04889, N = 12SE +/- 0.05361, N = 151.490040.502511.92977

NAMD

Input: ATPase with 327,506 Atoms

OpenBenchmarking.orgns/day, More Is BetterNAMD 3.0b6Input: ATPase with 327,506 AtomsUbuntu Linux 23.10CentOS Stream 9Fedora Server 391.21662.43323.64984.86646.083SE +/- 0.33618, N = 15SE +/- 0.30866, N = 12SE +/- 0.33952, N = 154.707113.203285.40706

Quicksilver

Input: CORAL2 P1

OpenBenchmarking.orgFigure Of Merit, More Is BetterQuicksilver 20230818Input: CORAL2 P1Ubuntu Linux 23.10CentOS Stream 9Fedora Server 391.3M2.6M3.9M5.2M6.5MSE +/- 65941.38, N = 12SE +/- 105910.76, N = 12SE +/- 42699.12, N = 115931500580083358358181. (CXX) g++ options: -fopenmp -O3 -march=native

LeelaChessZero

Backend: BLAS

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.30Backend: BLASUbuntu Linux 23.1048121620SE +/- 1.18, N = 9151. (CXX) g++ options: -flto -pthread

Phoronix Test Suite v10.8.5