7950X Linux 6.1 Kernel Benchmarks AMD Ryzen 9 7950X 16-Core testing with a ASUS ROG CROSSHAIR X670E HERO (0703 BIOS) and AMD Radeon RX 6800 16GB on Ubuntu 22.10 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2211060-PTS-7950XLIN25&sro&gru .
7950X Linux 6.1 Kernel Benchmarks Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server OpenGL Vulkan Compiler File-System Screen Resolution Linux 6.0 Linux 6.1 Git AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads) ASUS ROG CROSSHAIR X670E HERO (0703 BIOS) AMD Device 14d8 32GB 1000GB Sabrent Rocket 4.0 Plus AMD Radeon RX 6800 16GB (2475/1000MHz) AMD Navi 21/23 ASUS MG28U Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411 Ubuntu 22.10 6.0.0-060000-generic (x86_64) GNOME Shell 43.0 X Server + Wayland 4.6 Mesa 22.2.1 (LLVM 15.0.2 DRM 3.48) 1.3.224 GCC 12.2.0 ext4 3840x2160 6.1.0-060100rc3daily20221103-generic (x86_64) 4.6 Mesa 22.2.1 (LLVM 15.0.2 DRM 3.49) OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: amd-pstate schedutil (Boost: Enabled) - CPU Microcode: 0xa601203 Graphics Details - BAR1 / Visible vRAM Size: 16368 MB - vBIOS Version: 113-D4120900-101 Python Details - Python 3.10.7 Security Details - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
7950X Linux 6.1 Kernel Benchmarks stress-ng: MMAP stress-ng: NUMA stress-ng: Futex stress-ng: MEMFD stress-ng: Mutex stress-ng: Atomic stress-ng: Crypto stress-ng: Malloc stress-ng: Forking stress-ng: IO_uring stress-ng: SENDFILE stress-ng: CPU Cache stress-ng: CPU Stress stress-ng: Semaphores stress-ng: Matrix Math stress-ng: Vector Math stress-ng: Memory Copying stress-ng: Socket Activity stress-ng: Context Switching stress-ng: Glibc C String Functions stress-ng: Glibc Qsort Data Sorting stress-ng: System V Message Passing srsran: 4G PHY_DL_Test 100 PRB MIMO 64-QAM srsran: 4G PHY_DL_Test 100 PRB SISO 64-QAM srsran: 4G PHY_DL_Test 100 PRB MIMO 256-QAM srsran: 4G PHY_DL_Test 100 PRB SISO 256-QAM srsran: 5G PHY_DL_NR Test 52 PRB SISO 64-QAM ffmpeg: libx264 - Live ffmpeg: libx265 - Live ffmpeg: libx264 - Upload ffmpeg: libx265 - Upload ffmpeg: libx264 - Platform ffmpeg: libx265 - Platform ffmpeg: libx264 - Video On Demand ffmpeg: libx265 - Video On Demand openvino: Face Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP32 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU gravitymark: 1920 x 1080 - OpenGL gravitymark: 1920 x 1080 - Vulkan unvanquished: 1920 x 1080 - High unvanquished: 1920 x 1080 - Ultra unvanquished: 1920 x 1080 - Medium xonotic: 1920 x 1080 - Low xonotic: 1920 x 1080 - High xonotic: 1920 x 1080 - Ultra xonotic: 1920 x 1080 - Ultimate yquake2: Vulkan - On - On - 1920 x 1080 yquake2: OpenGL 3.x - On - On - 1920 x 1080 xmrig: Monero - 1M xmrig: Wownero - 1M tensorflow: CPU - 64 - AlexNet tensorflow: CPU - 256 - AlexNet tensorflow: CPU - 64 - GoogLeNet tensorflow: CPU - 64 - ResNet-50 tensorflow: CPU - 256 - GoogLeNet tensorflow: CPU - 256 - ResNet-50 deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream deepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream compress-zstd: 19 - Compression Speed compress-zstd: 19 - Decompression Speed compress-zstd: 19, Long Mode - Compression Speed compress-zstd: 19, Long Mode - Decompression Speed compress-7zip: Compression Rating compress-7zip: Decompression Rating jpegxl: PNG - 90 jpegxl: JPEG - 90 jpegxl: PNG - 100 jpegxl: JPEG - 100 jpegxl-decode: All memtier-benchmark: Redis - 50 - 1:1 memtier-benchmark: Redis - 100 - 1:1 memtier-benchmark: Redis - 50 - 10:1 memtier-benchmark: Redis - 50 - 1:10 memtier-benchmark: Redis - 100 - 10:1 memtier-benchmark: Redis - 100 - 1:10 clickhouse: 100M Rows Web Analytics Dataset, First Run / Cold Cache clickhouse: 100M Rows Web Analytics Dataset, Second Run clickhouse: 100M Rows Web Analytics Dataset, Third Run redis: GET - 50 redis: SET - 50 nginx: 100 nginx: 200 nginx: 500 nginx: 1000 srsran: OFDM_Test srsran: 4G PHY_DL_Test 100 PRB MIMO 64-QAM srsran: 4G PHY_DL_Test 100 PRB SISO 64-QAM srsran: 4G PHY_DL_Test 100 PRB MIMO 256-QAM srsran: 4G PHY_DL_Test 100 PRB SISO 256-QAM srsran: 5G PHY_DL_NR Test 52 PRB SISO 64-QAM brl-cad: VGR Performance Metric ctx-clock: Context Switch Time cloudsuite-ga: cloudsuite-ma: openvino: Face Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP32 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream deepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream openradioss: Bumper Beam openradioss: Cell Phone Drop Test openradioss: Bird Strike on Windshield openradioss: Rubber O-Ring Seal Installation build-gem5: Time To Compile build-linux-kernel: defconfig build-llvm: Ninja build-nodejs: Time To Compile build-wasmer: Time To Compile ffmpeg: libx264 - Live ffmpeg: libx265 - Live ffmpeg: libx264 - Upload ffmpeg: libx265 - Upload ffmpeg: libx264 - Platform ffmpeg: libx265 - Platform ffmpeg: libx264 - Video On Demand ffmpeg: libx265 - Video On Demand hackbench: 16 - Thread hackbench: 16 - Process hackbench: 32 - Process sqlite-speedtest: Timed Time - Size 1,000 darktable: Boat - CPU-only darktable: Masskrug - CPU-only darktable: Server Rack - CPU-only darktable: Server Room - CPU-only gimp: resize gimp: rotate gimp: auto-levels gimp: unsharp-mask rawtherapee: Total Benchmark Time blender: BMW27 - CPU-Only encodec: 3 kbps encodec: 6 kbps encodec: 24 kbps encodec: 1.5 kbps Linux 6.0 Linux 6.1 Git 389.82 620.85 4513526.65 1293.88 13642692.61 212953.36 43244.95 40501146.22 98404.14 10188.88 539956.84 182.34 59804.30 3465310.79 129424.60 143300.47 7713.88 4837.93 9717203.23 4847776.89 373.80 11046939.98 610.1 610.4 663.3 654.6 211.4 304.87 117.40 18.33 22.93 70.32 46.70 70.32 46.81 14.21 7.52 7.37 758.75 28.02 1838.28 1419.09 136.99 2869.70 1678.79 44354.28 63011.01 179.6 179.3 433.3 423.7 409.8 863.4356108 695.9548967 654.2978580 523.2314373 1387 2398.2 12677.7 19952.4 342.20 432.98 141.52 43.90 138.71 44.42 12.4159 97.7093 109.0426 290.5406 182.7330 95.0104 12.3732 76.1 4721.7 48.1 4877.7 179168 183031 12.93 12.50 1.11 0.99 284.21 3435234.18 3550038.77 3205780.38 3739917.20 3318686.52 3767434.05 276.09 294.15 292.96 5431831.2 3691080.00 172626.83 171549.00 165462.13 150107.43 238366667 233.3 248.0 246.5 255.2 143.7 412280 180 11432 12425 560.78 1058.53 1080.94 10.53 285.08 4.35 5.63 58.34 5.57 4.76 0.36 0.25 640.7982 81.8540 73.3504 27.5227 43.7680 84.1890 643.6487 85.24 56.01 161.27 62.29 193.312 40.980 262.404 259.699 32.792 16.56 43.01 137.73 110.138068606 107.721203767 162.19 107.72 161.83 15.611 15.098 32.983 35.602 2.474 2.879 0.186 2.490 13.781 10.423 11.712 14.313 35.866 50.08 24.790 25.146 29.244 24.144 381.28 678.95 4329454.86 1285.22 13815310.32 215387.60 43693.53 36347605.82 91714.84 12962.32 527214.96 180.41 60486.03 3443439.15 129777.48 143624.28 7717.99 4378.58 9288451.36 4900729.54 380.40 29509613.95 626.5 627.3 673.3 670.7 208.4 304.76 118.09 18.32 23.16 70.63 47.04 70.67 46.92 14.34 7.52 7.37 753.57 28.02 1842.14 1427.41 135.03 2890.08 1668.10 44621.22 63398.11 180.5 178.8 404.5 406.0 409.8 862.7283275 693.3119722 653.0427319 522.3233533 1388 2370.5 13556.1 20024.7 342.92 434.46 142.08 43.97 139.04 44.46 12.4594 95.8184 109.4003 293.2148 186.6611 96.0884 12.4105 77.0 4771.2 47.9 4860.0 180502 183471 12.97 12.71 1.06 0.86 308.92 3482262.86 3551129.05 3300830.03 3781036.42 3315970.14 3805057.15 286.55 299.35 296.01 4590364.3 3921247.98 177285.54 178016.25 171914.46 156698.41 241466667 238.1 250.6 250.1 260.3 142.1 417506 180 11591 12781 555.43 1057.38 1080.65 10.61 285.02 4.34 5.60 59.19 5.53 4.79 0.35 0.25 638.1627 83.4925 73.1124 27.2717 42.8472 83.2453 641.4289 85.02 55.21 161.06 62.30 192.611 40.639 261.815 258.498 32.885 16.57 42.77 137.841764653 109.021505892 107.249294960 161.041187128 107.188031298 161.434335265 15.696 15.307 33.133 35.830 2.462 2.768 0.182 2.432 13.297 9.927 11.196 13.622 34.620 49.83 24.904 25.280 29.421 24.249 OpenBenchmarking.org
Stress-NG Test: MMAP OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: MMAP Linux 6.0 Linux 6.1 Git 80 160 240 320 400 SE +/- 0.37, N = 3 SE +/- 4.55, N = 15 389.82 381.28 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: NUMA OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: NUMA Linux 6.0 Linux 6.1 Git 150 300 450 600 750 SE +/- 3.36, N = 3 SE +/- 5.94, N = 3 620.85 678.95 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: Futex OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Futex Linux 6.0 Linux 6.1 Git 1000K 2000K 3000K 4000K 5000K SE +/- 47734.72, N = 3 SE +/- 45227.84, N = 5 4513526.65 4329454.86 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: MEMFD OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: MEMFD Linux 6.0 Linux 6.1 Git 300 600 900 1200 1500 SE +/- 3.13, N = 3 SE +/- 1.25, N = 3 1293.88 1285.22 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: Mutex OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Mutex Linux 6.0 Linux 6.1 Git 3M 6M 9M 12M 15M SE +/- 32046.96, N = 3 SE +/- 27600.03, N = 3 13642692.61 13815310.32 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: Atomic OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Atomic Linux 6.0 Linux 6.1 Git 50K 100K 150K 200K 250K SE +/- 156.13, N = 3 SE +/- 2238.54, N = 5 212953.36 215387.60 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: Crypto OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Crypto Linux 6.0 Linux 6.1 Git 9K 18K 27K 36K 45K SE +/- 406.94, N = 15 SE +/- 475.16, N = 15 43244.95 43693.53 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: Malloc OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Malloc Linux 6.0 Linux 6.1 Git 9M 18M 27M 36M 45M SE +/- 78023.48, N = 3 SE +/- 266556.97, N = 12 40501146.22 36347605.82 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: Forking OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Forking Linux 6.0 Linux 6.1 Git 20K 40K 60K 80K 100K SE +/- 1281.66, N = 15 SE +/- 631.08, N = 13 98404.14 91714.84 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: IO_uring OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: IO_uring Linux 6.0 Linux 6.1 Git 3K 6K 9K 12K 15K SE +/- 1142.09, N = 12 SE +/- 1156.58, N = 12 10188.88 12962.32 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: SENDFILE OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: SENDFILE Linux 6.0 Linux 6.1 Git 120K 240K 360K 480K 600K SE +/- 955.59, N = 3 SE +/- 1107.61, N = 3 539956.84 527214.96 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: CPU Cache OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: CPU Cache Linux 6.0 Linux 6.1 Git 40 80 120 160 200 SE +/- 2.52, N = 15 SE +/- 2.33, N = 15 182.34 180.41 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: CPU Stress OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: CPU Stress Linux 6.0 Linux 6.1 Git 13K 26K 39K 52K 65K SE +/- 282.45, N = 3 SE +/- 540.38, N = 7 59804.30 60486.03 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: Semaphores OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Semaphores Linux 6.0 Linux 6.1 Git 700K 1400K 2100K 2800K 3500K SE +/- 3265.56, N = 3 SE +/- 2188.16, N = 3 3465310.79 3443439.15 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: Matrix Math OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Matrix Math Linux 6.0 Linux 6.1 Git 30K 60K 90K 120K 150K SE +/- 1002.24, N = 15 SE +/- 1053.43, N = 15 129424.60 129777.48 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: Vector Math OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Vector Math Linux 6.0 Linux 6.1 Git 30K 60K 90K 120K 150K SE +/- 28.47, N = 3 SE +/- 29.00, N = 3 143300.47 143624.28 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: Memory Copying OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Memory Copying Linux 6.0 Linux 6.1 Git 1700 3400 5100 6800 8500 SE +/- 11.85, N = 3 SE +/- 4.09, N = 3 7713.88 7717.99 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: Socket Activity OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Socket Activity Linux 6.0 Linux 6.1 Git 1000 2000 3000 4000 5000 SE +/- 1091.99, N = 15 SE +/- 1447.91, N = 15 4837.93 4378.58 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: Context Switching OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Context Switching Linux 6.0 Linux 6.1 Git 2M 4M 6M 8M 10M SE +/- 273238.96, N = 12 SE +/- 28253.02, N = 3 9717203.23 9288451.36 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: Glibc C String Functions OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Glibc C String Functions Linux 6.0 Linux 6.1 Git 1000K 2000K 3000K 4000K 5000K SE +/- 61292.71, N = 3 SE +/- 41852.02, N = 3 4847776.89 4900729.54 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: Glibc Qsort Data Sorting OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Glibc Qsort Data Sorting Linux 6.0 Linux 6.1 Git 80 160 240 320 400 SE +/- 1.22, N = 3 SE +/- 3.76, N = 5 373.80 380.40 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: System V Message Passing OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: System V Message Passing Linux 6.0 Linux 6.1 Git 6M 12M 18M 24M 30M SE +/- 30917.16, N = 3 SE +/- 491177.50, N = 15 11046939.98 29509613.95 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
srsRAN Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAM OpenBenchmarking.org eNb Mb/s, More Is Better srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAM Linux 6.0 Linux 6.1 Git 140 280 420 560 700 SE +/- 4.34, N = 3 SE +/- 3.49, N = 3 610.1 626.5 1. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -ldl -lpthread -lm
srsRAN Test: 4G PHY_DL_Test 100 PRB SISO 64-QAM OpenBenchmarking.org eNb Mb/s, More Is Better srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB SISO 64-QAM Linux 6.0 Linux 6.1 Git 140 280 420 560 700 SE +/- 6.53, N = 3 SE +/- 0.93, N = 3 610.4 627.3 1. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -ldl -lpthread -lm
srsRAN Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAM OpenBenchmarking.org eNb Mb/s, More Is Better srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAM Linux 6.0 Linux 6.1 Git 150 300 450 600 750 SE +/- 1.32, N = 3 SE +/- 2.25, N = 3 663.3 673.3 1. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -ldl -lpthread -lm
srsRAN Test: 4G PHY_DL_Test 100 PRB SISO 256-QAM OpenBenchmarking.org eNb Mb/s, More Is Better srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB SISO 256-QAM Linux 6.0 Linux 6.1 Git 140 280 420 560 700 SE +/- 3.50, N = 3 SE +/- 2.20, N = 3 654.6 670.7 1. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -ldl -lpthread -lm
srsRAN Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAM OpenBenchmarking.org eNb Mb/s, More Is Better srsRAN 22.04.1 Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAM Linux 6.0 Linux 6.1 Git 50 100 150 200 250 SE +/- 1.39, N = 3 SE +/- 1.07, N = 3 211.4 208.4 1. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -ldl -lpthread -lm
FFmpeg Encoder: libx264 - Scenario: Live OpenBenchmarking.org FPS, More Is Better FFmpeg 5.1.2 Encoder: libx264 - Scenario: Live Linux 6.0 Linux 6.1 Git 70 140 210 280 350 SE +/- 0.94, N = 3 SE +/- 0.63, N = 3 304.87 304.76 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
FFmpeg Encoder: libx265 - Scenario: Live OpenBenchmarking.org FPS, More Is Better FFmpeg 5.1.2 Encoder: libx265 - Scenario: Live Linux 6.0 Linux 6.1 Git 30 60 90 120 150 SE +/- 0.29, N = 3 SE +/- 0.71, N = 3 117.40 118.09 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
FFmpeg Encoder: libx264 - Scenario: Upload OpenBenchmarking.org FPS, More Is Better FFmpeg 5.1.2 Encoder: libx264 - Scenario: Upload Linux 6.0 Linux 6.1 Git 5 10 15 20 25 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 18.33 18.32 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
FFmpeg Encoder: libx265 - Scenario: Upload OpenBenchmarking.org FPS, More Is Better FFmpeg 5.1.2 Encoder: libx265 - Scenario: Upload Linux 6.0 Linux 6.1 Git 6 12 18 24 30 SE +/- 0.05, N = 3 SE +/- 0.06, N = 3 22.93 23.16 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
FFmpeg Encoder: libx264 - Scenario: Platform OpenBenchmarking.org FPS, More Is Better FFmpeg 5.1.2 Encoder: libx264 - Scenario: Platform Linux 6.0 Linux 6.1 Git 16 32 48 64 80 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 70.32 70.63 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
FFmpeg Encoder: libx265 - Scenario: Platform OpenBenchmarking.org FPS, More Is Better FFmpeg 5.1.2 Encoder: libx265 - Scenario: Platform Linux 6.0 Linux 6.1 Git 11 22 33 44 55 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 46.70 47.04 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
FFmpeg Encoder: libx264 - Scenario: Video On Demand OpenBenchmarking.org FPS, More Is Better FFmpeg 5.1.2 Encoder: libx264 - Scenario: Video On Demand Linux 6.0 Linux 6.1 Git 16 32 48 64 80 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 70.32 70.67 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
FFmpeg Encoder: libx265 - Scenario: Video On Demand OpenBenchmarking.org FPS, More Is Better FFmpeg 5.1.2 Encoder: libx265 - Scenario: Video On Demand Linux 6.0 Linux 6.1 Git 11 22 33 44 55 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 46.81 46.92 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Face Detection FP16 - Device: CPU Linux 6.0 Linux 6.1 Git 4 8 12 16 20 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 14.21 14.34 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Person Detection FP16 - Device: CPU Linux 6.0 Linux 6.1 Git 2 4 6 8 10 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 7.52 7.52 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Person Detection FP32 - Device: CPU Linux 6.0 Linux 6.1 Git 2 4 6 8 10 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 7.37 7.37 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16 - Device: CPU Linux 6.0 Linux 6.1 Git 160 320 480 640 800 SE +/- 10.02, N = 3 SE +/- 3.51, N = 3 758.75 753.57 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Face Detection FP16-INT8 - Device: CPU Linux 6.0 Linux 6.1 Git 7 14 21 28 35 SE +/- 0.25, N = 3 SE +/- 0.02, N = 3 28.02 28.02 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU Linux 6.0 Linux 6.1 Git 400 800 1200 1600 2000 SE +/- 1.47, N = 3 SE +/- 5.09, N = 3 1838.28 1842.14 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16 - Device: CPU Linux 6.0 Linux 6.1 Git 300 600 900 1200 1500 SE +/- 0.70, N = 3 SE +/- 1.33, N = 3 1419.09 1427.41 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU Linux 6.0 Linux 6.1 Git 30 60 90 120 150 SE +/- 0.16, N = 3 SE +/- 0.75, N = 3 136.99 135.03 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU Linux 6.0 Linux 6.1 Git 600 1200 1800 2400 3000 SE +/- 2.40, N = 3 SE +/- 3.20, N = 3 2869.70 2890.08 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU Linux 6.0 Linux 6.1 Git 400 800 1200 1600 2000 SE +/- 8.09, N = 3 SE +/- 6.81, N = 3 1678.79 1668.10 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU Linux 6.0 Linux 6.1 Git 10K 20K 30K 40K 50K SE +/- 49.84, N = 3 SE +/- 76.26, N = 3 44354.28 44621.22 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU Linux 6.0 Linux 6.1 Git 14K 28K 42K 56K 70K SE +/- 106.57, N = 3 SE +/- 13.52, N = 3 63011.01 63398.11 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
GravityMark Resolution: 1920 x 1080 - Renderer: OpenGL OpenBenchmarking.org Frames Per Second, More Is Better GravityMark 1.72 Resolution: 1920 x 1080 - Renderer: OpenGL Linux 6.0 Linux 6.1 Git 40 80 120 160 200 SE +/- 0.19, N = 3 SE +/- 0.73, N = 3 179.6 180.5
GravityMark Resolution: 1920 x 1080 - Renderer: Vulkan OpenBenchmarking.org Frames Per Second, More Is Better GravityMark 1.72 Resolution: 1920 x 1080 - Renderer: Vulkan Linux 6.0 Linux 6.1 Git 40 80 120 160 200 SE +/- 0.43, N = 3 SE +/- 0.07, N = 3 179.3 178.8
Unvanquished Resolution: 1920 x 1080 - Effects Quality: High OpenBenchmarking.org Frames Per Second, More Is Better Unvanquished 0.53 Resolution: 1920 x 1080 - Effects Quality: High Linux 6.0 Linux 6.1 Git 90 180 270 360 450 SE +/- 8.65, N = 15 SE +/- 4.34, N = 5 433.3 404.5
Unvanquished Resolution: 1920 x 1080 - Effects Quality: Ultra OpenBenchmarking.org Frames Per Second, More Is Better Unvanquished 0.53 Resolution: 1920 x 1080 - Effects Quality: Ultra Linux 6.0 Linux 6.1 Git 90 180 270 360 450 SE +/- 6.01, N = 3 SE +/- 4.77, N = 15 423.7 406.0
Unvanquished Resolution: 1920 x 1080 - Effects Quality: Medium OpenBenchmarking.org Frames Per Second, More Is Better Unvanquished 0.53 Resolution: 1920 x 1080 - Effects Quality: Medium Linux 6.0 Linux 6.1 Git 90 180 270 360 450 SE +/- 5.16, N = 3 SE +/- 5.51, N = 15 409.8 409.8
Xonotic Resolution: 1920 x 1080 - Effects Quality: Low OpenBenchmarking.org Frames Per Second, More Is Better Xonotic 0.8.5 Resolution: 1920 x 1080 - Effects Quality: Low Linux 6.0 Linux 6.1 Git 200 400 600 800 1000 SE +/- 0.91, N = 3 SE +/- 2.38, N = 3 863.44 862.73 MIN: 406 / MAX: 1684 MIN: 452 / MAX: 1708
Xonotic Resolution: 1920 x 1080 - Effects Quality: High OpenBenchmarking.org Frames Per Second, More Is Better Xonotic 0.8.5 Resolution: 1920 x 1080 - Effects Quality: High Linux 6.0 Linux 6.1 Git 150 300 450 600 750 SE +/- 1.17, N = 3 SE +/- 3.83, N = 3 695.95 693.31 MIN: 409 / MAX: 1323 MIN: 416 / MAX: 1303
Xonotic Resolution: 1920 x 1080 - Effects Quality: Ultra OpenBenchmarking.org Frames Per Second, More Is Better Xonotic 0.8.5 Resolution: 1920 x 1080 - Effects Quality: Ultra Linux 6.0 Linux 6.1 Git 140 280 420 560 700 SE +/- 1.72, N = 3 SE +/- 1.68, N = 3 654.30 653.04 MIN: 319 / MAX: 1176 MIN: 401 / MAX: 1165
Xonotic Resolution: 1920 x 1080 - Effects Quality: Ultimate OpenBenchmarking.org Frames Per Second, More Is Better Xonotic 0.8.5 Resolution: 1920 x 1080 - Effects Quality: Ultimate Linux 6.0 Linux 6.1 Git 110 220 330 440 550 SE +/- 0.78, N = 3 SE +/- 2.19, N = 3 523.23 522.32 MIN: 97 / MAX: 1082 MIN: 103 / MAX: 1067
yquake2 Renderer: Vulkan - AF: On - MSAA: On - Resolution: 1920 x 1080 OpenBenchmarking.org Frames Per Second, More Is Better yquake2 8.10 Renderer: Vulkan - AF: On - MSAA: On - Resolution: 1920 x 1080 Linux 6.0 Linux 6.1 Git 300 600 900 1200 1500 SE +/- 1.00, N = 3 SE +/- 1.00, N = 3 1387 1388 1. (CC) gcc options: -shared -lm -ldl -rdynamic -lSDL2 -O2 -pipe -fomit-frame-pointer -std=gnu99 -fno-strict-aliasing -fwrapv -fvisibility=hidden -MMD -mfpmath=sse -fPIC
yquake2 Renderer: OpenGL 3.x - AF: On - MSAA: On - Resolution: 1920 x 1080 OpenBenchmarking.org Frames Per Second, More Is Better yquake2 8.10 Renderer: OpenGL 3.x - AF: On - MSAA: On - Resolution: 1920 x 1080 Linux 6.0 Linux 6.1 Git 500 1000 1500 2000 2500 SE +/- 19.70, N = 9 SE +/- 25.75, N = 3 2398.2 2370.5 1. (CC) gcc options: -shared -lm -ldl -rdynamic -lSDL2 -O2 -pipe -fomit-frame-pointer -std=gnu99 -fno-strict-aliasing -fwrapv -fvisibility=hidden -MMD -mfpmath=sse -fPIC
Xmrig Variant: Monero - Hash Count: 1M OpenBenchmarking.org H/s, More Is Better Xmrig 6.18.1 Variant: Monero - Hash Count: 1M Linux 6.0 Linux 6.1 Git 3K 6K 9K 12K 15K SE +/- 25.00, N = 3 SE +/- 88.20, N = 3 12677.7 13556.1 1. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
Xmrig Variant: Wownero - Hash Count: 1M OpenBenchmarking.org H/s, More Is Better Xmrig 6.18.1 Variant: Wownero - Hash Count: 1M Linux 6.0 Linux 6.1 Git 4K 8K 12K 16K 20K SE +/- 34.83, N = 3 SE +/- 19.75, N = 3 19952.4 20024.7 1. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
TensorFlow Device: CPU - Batch Size: 64 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 64 - Model: AlexNet Linux 6.0 Linux 6.1 Git 70 140 210 280 350 SE +/- 0.72, N = 3 SE +/- 0.22, N = 3 342.20 342.92
TensorFlow Device: CPU - Batch Size: 256 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: AlexNet Linux 6.0 Linux 6.1 Git 90 180 270 360 450 SE +/- 0.26, N = 3 SE +/- 0.21, N = 3 432.98 434.46
TensorFlow Device: CPU - Batch Size: 64 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 64 - Model: GoogLeNet Linux 6.0 Linux 6.1 Git 30 60 90 120 150 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 141.52 142.08
TensorFlow Device: CPU - Batch Size: 64 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 64 - Model: ResNet-50 Linux 6.0 Linux 6.1 Git 10 20 30 40 50 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 43.90 43.97
TensorFlow Device: CPU - Batch Size: 256 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: GoogLeNet Linux 6.0 Linux 6.1 Git 30 60 90 120 150 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 138.71 139.04
TensorFlow Device: CPU - Batch Size: 256 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: ResNet-50 Linux 6.0 Linux 6.1 Git 10 20 30 40 50 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 44.42 44.46
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream Linux 6.0 Linux 6.1 Git 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 12.42 12.46
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream Linux 6.0 Linux 6.1 Git 20 40 60 80 100 SE +/- 0.63, N = 3 SE +/- 0.79, N = 8 97.71 95.82
Neural Magic DeepSparse Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream Linux 6.0 Linux 6.1 Git 20 40 60 80 100 SE +/- 1.01, N = 3 SE +/- 0.55, N = 3 109.04 109.40
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream Linux 6.0 Linux 6.1 Git 60 120 180 240 300 SE +/- 0.14, N = 3 SE +/- 0.44, N = 3 290.54 293.21
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream Linux 6.0 Linux 6.1 Git 40 80 120 160 200 SE +/- 0.60, N = 3 SE +/- 0.71, N = 3 182.73 186.66
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream Linux 6.0 Linux 6.1 Git 20 40 60 80 100 SE +/- 0.25, N = 3 SE +/- 0.34, N = 3 95.01 96.09
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream Linux 6.0 Linux 6.1 Git 3 6 9 12 15 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 12.37 12.41
Zstd Compression Compression Level: 19 - Compression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression Compression Level: 19 - Compression Speed Linux 6.0 Linux 6.1 Git 20 40 60 80 100 SE +/- 0.96, N = 3 SE +/- 0.12, N = 3 76.1 77.0 1. *** zstd command line interface 64-bits v1.5.2, by Yann Collet ***
Zstd Compression Compression Level: 19 - Decompression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression Compression Level: 19 - Decompression Speed Linux 6.0 Linux 6.1 Git 1000 2000 3000 4000 5000 SE +/- 7.12, N = 3 SE +/- 32.30, N = 3 4721.7 4771.2 1. *** zstd command line interface 64-bits v1.5.2, by Yann Collet ***
Zstd Compression Compression Level: 19, Long Mode - Compression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression Compression Level: 19, Long Mode - Compression Speed Linux 6.0 Linux 6.1 Git 11 22 33 44 55 SE +/- 0.07, N = 3 SE +/- 0.19, N = 3 48.1 47.9 1. *** zstd command line interface 64-bits v1.5.2, by Yann Collet ***
Zstd Compression Compression Level: 19, Long Mode - Decompression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression Compression Level: 19, Long Mode - Decompression Speed Linux 6.0 Linux 6.1 Git 1000 2000 3000 4000 5000 SE +/- 57.49, N = 3 SE +/- 80.37, N = 3 4877.7 4860.0 1. *** zstd command line interface 64-bits v1.5.2, by Yann Collet ***
7-Zip Compression Test: Compression Rating OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 22.01 Test: Compression Rating Linux 6.0 Linux 6.1 Git 40K 80K 120K 160K 200K SE +/- 370.80, N = 3 SE +/- 303.67, N = 3 179168 180502 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
7-Zip Compression Test: Decompression Rating OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 22.01 Test: Decompression Rating Linux 6.0 Linux 6.1 Git 40K 80K 120K 160K 200K SE +/- 379.38, N = 3 SE +/- 412.55, N = 3 183031 183471 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
JPEG XL libjxl Input: PNG - Quality: 90 OpenBenchmarking.org MP/s, More Is Better JPEG XL libjxl 0.7 Input: PNG - Quality: 90 Linux 6.0 Linux 6.1 Git 3 6 9 12 15 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 12.93 12.97 1. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic
JPEG XL libjxl Input: JPEG - Quality: 90 OpenBenchmarking.org MP/s, More Is Better JPEG XL libjxl 0.7 Input: JPEG - Quality: 90 Linux 6.0 Linux 6.1 Git 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 12.50 12.71 1. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic
JPEG XL libjxl Input: PNG - Quality: 100 OpenBenchmarking.org MP/s, More Is Better JPEG XL libjxl 0.7 Input: PNG - Quality: 100 Linux 6.0 Linux 6.1 Git 0.2498 0.4996 0.7494 0.9992 1.249 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 1.11 1.06 1. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic
JPEG XL libjxl Input: JPEG - Quality: 100 OpenBenchmarking.org MP/s, More Is Better JPEG XL libjxl 0.7 Input: JPEG - Quality: 100 Linux 6.0 Linux 6.1 Git 0.2228 0.4456 0.6684 0.8912 1.114 SE +/- 0.02, N = 9 SE +/- 0.02, N = 6 0.99 0.86 1. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic
JPEG XL Decoding libjxl CPU Threads: All OpenBenchmarking.org MP/s, More Is Better JPEG XL Decoding libjxl 0.7 CPU Threads: All Linux 6.0 Linux 6.1 Git 70 140 210 280 350 SE +/- 1.19, N = 3 SE +/- 1.63, N = 3 284.21 308.92
memtier_benchmark Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:1 OpenBenchmarking.org Ops/sec, More Is Better memtier_benchmark 1.4 Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:1 Linux 6.0 Linux 6.1 Git 700K 1400K 2100K 2800K 3500K SE +/- 17901.92, N = 3 SE +/- 8233.66, N = 3 3435234.18 3482262.86 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
memtier_benchmark Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:1 OpenBenchmarking.org Ops/sec, More Is Better memtier_benchmark 1.4 Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:1 Linux 6.0 Linux 6.1 Git 800K 1600K 2400K 3200K 4000K SE +/- 25594.55, N = 3 SE +/- 13511.26, N = 3 3550038.77 3551129.05 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
memtier_benchmark Protocol: Redis - Clients: 50 - Set To Get Ratio: 10:1 OpenBenchmarking.org Ops/sec, More Is Better memtier_benchmark 1.4 Protocol: Redis - Clients: 50 - Set To Get Ratio: 10:1 Linux 6.0 Linux 6.1 Git 700K 1400K 2100K 2800K 3500K SE +/- 28208.00, N = 3 SE +/- 18255.93, N = 3 3205780.38 3300830.03 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
memtier_benchmark Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:10 OpenBenchmarking.org Ops/sec, More Is Better memtier_benchmark 1.4 Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:10 Linux 6.0 Linux 6.1 Git 800K 1600K 2400K 3200K 4000K SE +/- 35729.73, N = 3 SE +/- 17262.48, N = 3 3739917.20 3781036.42 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
memtier_benchmark Protocol: Redis - Clients: 100 - Set To Get Ratio: 10:1 OpenBenchmarking.org Ops/sec, More Is Better memtier_benchmark 1.4 Protocol: Redis - Clients: 100 - Set To Get Ratio: 10:1 Linux 6.0 Linux 6.1 Git 700K 1400K 2100K 2800K 3500K SE +/- 29769.39, N = 3 SE +/- 16734.05, N = 3 3318686.52 3315970.14 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
memtier_benchmark Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:10 OpenBenchmarking.org Ops/sec, More Is Better memtier_benchmark 1.4 Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:10 Linux 6.0 Linux 6.1 Git 800K 1600K 2400K 3200K 4000K SE +/- 35629.05, N = 3 SE +/- 12670.11, N = 3 3767434.05 3805057.15 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
ClickHouse 100M Rows Web Analytics Dataset, First Run / Cold Cache OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.5.4.19 100M Rows Web Analytics Dataset, First Run / Cold Cache Linux 6.0 Linux 6.1 Git 60 120 180 240 300 SE +/- 3.00, N = 4 SE +/- 2.57, N = 12 276.09 286.55 MIN: 19.23 / MAX: 20000 MIN: 21.26 / MAX: 30000 1. ClickHouse server version 22.5.4.19 (official build).
ClickHouse 100M Rows Web Analytics Dataset, Second Run OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.5.4.19 100M Rows Web Analytics Dataset, Second Run Linux 6.0 Linux 6.1 Git 70 140 210 280 350 SE +/- 1.90, N = 4 SE +/- 1.94, N = 12 294.15 299.35 MIN: 20.99 / MAX: 20000 MIN: 21.02 / MAX: 30000 1. ClickHouse server version 22.5.4.19 (official build).
ClickHouse 100M Rows Web Analytics Dataset, Third Run OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.5.4.19 100M Rows Web Analytics Dataset, Third Run Linux 6.0 Linux 6.1 Git 60 120 180 240 300 SE +/- 3.70, N = 4 SE +/- 2.48, N = 12 292.96 296.01 MIN: 20.59 / MAX: 30000 MIN: 21.08 / MAX: 30000 1. ClickHouse server version 22.5.4.19 (official build).
Redis Test: GET - Parallel Connections: 50 OpenBenchmarking.org Requests Per Second, More Is Better Redis 7.0.4 Test: GET - Parallel Connections: 50 Linux 6.0 Linux 6.1 Git 1.2M 2.4M 3.6M 4.8M 6M SE +/- 74616.69, N = 3 SE +/- 66626.93, N = 15 5431831.2 4590364.3 1. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3
Redis Test: SET - Parallel Connections: 50 OpenBenchmarking.org Requests Per Second, More Is Better Redis 7.0.4 Test: SET - Parallel Connections: 50 Linux 6.0 Linux 6.1 Git 800K 1600K 2400K 3200K 4000K SE +/- 42978.02, N = 4 SE +/- 67171.58, N = 15 3691080.00 3921247.98 1. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3
nginx Connections: 100 OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.23.2 Connections: 100 Linux 6.0 Linux 6.1 Git 40K 80K 120K 160K 200K SE +/- 105.27, N = 3 SE +/- 335.68, N = 3 172626.83 177285.54 1. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2
nginx Connections: 200 OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.23.2 Connections: 200 Linux 6.0 Linux 6.1 Git 40K 80K 120K 160K 200K SE +/- 165.74, N = 3 SE +/- 595.48, N = 3 171549.00 178016.25 1. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2
nginx Connections: 500 OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.23.2 Connections: 500 Linux 6.0 Linux 6.1 Git 40K 80K 120K 160K 200K SE +/- 754.67, N = 3 SE +/- 393.22, N = 3 165462.13 171914.46 1. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2
nginx Connections: 1000 OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.23.2 Connections: 1000 Linux 6.0 Linux 6.1 Git 30K 60K 90K 120K 150K SE +/- 215.07, N = 3 SE +/- 381.59, N = 3 150107.43 156698.41 1. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2
srsRAN Test: OFDM_Test OpenBenchmarking.org Samples / Second, More Is Better srsRAN 22.04.1 Test: OFDM_Test Linux 6.0 Linux 6.1 Git 50M 100M 150M 200M 250M SE +/- 868587.61, N = 3 SE +/- 584047.18, N = 3 238366667 241466667 1. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -ldl -lpthread -lm
srsRAN Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAM OpenBenchmarking.org UE Mb/s, More Is Better srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAM Linux 6.0 Linux 6.1 Git 50 100 150 200 250 SE +/- 0.81, N = 3 SE +/- 2.34, N = 3 233.3 238.1 1. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -ldl -lpthread -lm
srsRAN Test: 4G PHY_DL_Test 100 PRB SISO 64-QAM OpenBenchmarking.org UE Mb/s, More Is Better srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB SISO 64-QAM Linux 6.0 Linux 6.1 Git 50 100 150 200 250 SE +/- 1.31, N = 3 SE +/- 0.42, N = 3 248.0 250.6 1. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -ldl -lpthread -lm
srsRAN Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAM OpenBenchmarking.org UE Mb/s, More Is Better srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAM Linux 6.0 Linux 6.1 Git 50 100 150 200 250 SE +/- 0.62, N = 3 SE +/- 0.67, N = 3 246.5 250.1 1. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -ldl -lpthread -lm
srsRAN Test: 4G PHY_DL_Test 100 PRB SISO 256-QAM OpenBenchmarking.org UE Mb/s, More Is Better srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB SISO 256-QAM Linux 6.0 Linux 6.1 Git 60 120 180 240 300 SE +/- 0.60, N = 3 SE +/- 0.88, N = 3 255.2 260.3 1. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -ldl -lpthread -lm
srsRAN Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAM OpenBenchmarking.org UE Mb/s, More Is Better srsRAN 22.04.1 Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAM Linux 6.0 Linux 6.1 Git 30 60 90 120 150 SE +/- 1.13, N = 3 SE +/- 0.53, N = 3 143.7 142.1 1. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -ldl -lpthread -lm
BRL-CAD VGR Performance Metric OpenBenchmarking.org VGR Performance Metric, More Is Better BRL-CAD 7.32.6 VGR Performance Metric Linux 6.0 Linux 6.1 Git 90K 180K 270K 360K 450K 412280 417506 1. (CXX) g++ options: -std=c++11 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -pedantic -ldl -lm
ctx_clock Context Switch Time OpenBenchmarking.org Clocks, Fewer Is Better ctx_clock Context Switch Time Linux 6.0 Linux 6.1 Git 40 80 120 160 200 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 180 180
CloudSuite Graph Analytics OpenBenchmarking.org ms, Fewer Is Better CloudSuite Graph Analytics Linux 6.0 Linux 6.1 Git 2K 4K 6K 8K 10K SE +/- 111.04, N = 3 SE +/- 118.11, N = 5 11432 11591
CloudSuite In-Memory Analytics OpenBenchmarking.org ms, Fewer Is Better CloudSuite In-Memory Analytics Linux 6.0 Linux 6.1 Git 3K 6K 9K 12K 15K SE +/- 93.86, N = 3 SE +/- 58.29, N = 3 12425 12781
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Face Detection FP16 - Device: CPU Linux 6.0 Linux 6.1 Git 120 240 360 480 600 SE +/- 0.66, N = 3 SE +/- 1.24, N = 3 560.78 555.43 MIN: 532.9 / MAX: 834.5 MIN: 520.59 / MAX: 601.19 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Person Detection FP16 - Device: CPU Linux 6.0 Linux 6.1 Git 200 400 600 800 1000 SE +/- 3.78, N = 3 SE +/- 2.68, N = 3 1058.53 1057.38 MIN: 671.45 / MAX: 1275.51 MIN: 855.47 / MAX: 1282.01 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Person Detection FP32 - Device: CPU Linux 6.0 Linux 6.1 Git 200 400 600 800 1000 SE +/- 7.51, N = 3 SE +/- 6.06, N = 3 1080.94 1080.65 MIN: 722.65 / MAX: 1313.98 MIN: 738.55 / MAX: 1288.43 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16 - Device: CPU Linux 6.0 Linux 6.1 Git 3 6 9 12 15 SE +/- 0.14, N = 3 SE +/- 0.05, N = 3 10.53 10.61 MIN: 4.61 / MAX: 25.14 MIN: 3.76 / MAX: 23.98 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Face Detection FP16-INT8 - Device: CPU Linux 6.0 Linux 6.1 Git 60 120 180 240 300 SE +/- 2.43, N = 3 SE +/- 0.11, N = 3 285.08 285.02 MIN: 243.83 / MAX: 322.94 MIN: 145.15 / MAX: 327.27 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU Linux 6.0 Linux 6.1 Git 0.9788 1.9576 2.9364 3.9152 4.894 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 4.35 4.34 MIN: 2.73 / MAX: 13.24 MIN: 2.65 / MAX: 13 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16 - Device: CPU Linux 6.0 Linux 6.1 Git 1.2668 2.5336 3.8004 5.0672 6.334 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 5.63 5.60 MIN: 2.85 / MAX: 13.41 MIN: 2.91 / MAX: 17.92 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU Linux 6.0 Linux 6.1 Git 13 26 39 52 65 SE +/- 0.06, N = 3 SE +/- 0.32, N = 3 58.34 59.19 MIN: 27.87 / MAX: 92.7 MIN: 26.99 / MAX: 84.83 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU Linux 6.0 Linux 6.1 Git 1.2533 2.5066 3.7599 5.0132 6.2665 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 5.57 5.53 MIN: 2.96 / MAX: 13.17 MIN: 2.97 / MAX: 13.2 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU Linux 6.0 Linux 6.1 Git 1.0778 2.1556 3.2334 4.3112 5.389 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 4.76 4.79 MIN: 3.73 / MAX: 12.59 MIN: 3.54 / MAX: 22.13 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU Linux 6.0 Linux 6.1 Git 0.081 0.162 0.243 0.324 0.405 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.36 0.35 MIN: 0.22 / MAX: 7.91 MIN: 0.22 / MAX: 7.91 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU Linux 6.0 Linux 6.1 Git 0.0563 0.1126 0.1689 0.2252 0.2815 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.25 0.25 MIN: 0.15 / MAX: 7.84 MIN: 0.15 / MAX: 8.06 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream Linux 6.0 Linux 6.1 Git 140 280 420 560 700 SE +/- 0.73, N = 3 SE +/- 1.32, N = 3 640.80 638.16
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream Linux 6.0 Linux 6.1 Git 20 40 60 80 100 SE +/- 0.53, N = 3 SE +/- 0.69, N = 8 81.85 83.49
Neural Magic DeepSparse Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream Linux 6.0 Linux 6.1 Git 16 32 48 64 80 SE +/- 0.69, N = 3 SE +/- 0.37, N = 3 73.35 73.11
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream Linux 6.0 Linux 6.1 Git 6 12 18 24 30 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 27.52 27.27
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream Linux 6.0 Linux 6.1 Git 10 20 30 40 50 SE +/- 0.14, N = 3 SE +/- 0.16, N = 3 43.77 42.85
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream Linux 6.0 Linux 6.1 Git 20 40 60 80 100 SE +/- 0.22, N = 3 SE +/- 0.29, N = 3 84.19 83.25
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream Linux 6.0 Linux 6.1 Git 140 280 420 560 700 SE +/- 0.14, N = 3 SE +/- 0.96, N = 3 643.65 641.43
OpenRadioss Model: Bumper Beam OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Bumper Beam Linux 6.0 Linux 6.1 Git 20 40 60 80 100 SE +/- 0.21, N = 3 SE +/- 0.30, N = 3 85.24 85.02
OpenRadioss Model: Cell Phone Drop Test OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Cell Phone Drop Test Linux 6.0 Linux 6.1 Git 13 26 39 52 65 SE +/- 0.15, N = 3 SE +/- 0.34, N = 3 56.01 55.21
OpenRadioss Model: Bird Strike on Windshield OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Bird Strike on Windshield Linux 6.0 Linux 6.1 Git 40 80 120 160 200 SE +/- 0.22, N = 3 SE +/- 0.20, N = 3 161.27 161.06
OpenRadioss Model: Rubber O-Ring Seal Installation OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Rubber O-Ring Seal Installation Linux 6.0 Linux 6.1 Git 14 28 42 56 70 SE +/- 0.16, N = 3 SE +/- 0.26, N = 3 62.29 62.30
Timed Gem5 Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Gem5 Compilation 21.2 Time To Compile Linux 6.0 Linux 6.1 Git 40 80 120 160 200 SE +/- 0.46, N = 3 SE +/- 0.33, N = 3 193.31 192.61
Timed Linux Kernel Compilation Build: defconfig OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 5.18 Build: defconfig Linux 6.0 Linux 6.1 Git 9 18 27 36 45 SE +/- 0.34, N = 3 SE +/- 0.29, N = 3 40.98 40.64
Timed LLVM Compilation Build System: Ninja OpenBenchmarking.org Seconds, Fewer Is Better Timed LLVM Compilation 13.0 Build System: Ninja Linux 6.0 Linux 6.1 Git 60 120 180 240 300 SE +/- 0.25, N = 3 SE +/- 0.05, N = 3 262.40 261.82
Timed Node.js Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Node.js Compilation 18.8 Time To Compile Linux 6.0 Linux 6.1 Git 60 120 180 240 300 SE +/- 0.34, N = 3 SE +/- 0.30, N = 3 259.70 258.50
Timed Wasmer Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Wasmer Compilation 2.3 Time To Compile Linux 6.0 Linux 6.1 Git 8 16 24 32 40 SE +/- 0.08, N = 3 SE +/- 0.16, N = 3 32.79 32.89 1. (CC) gcc options: -m64 -ldl -lgcc_s -lutil -lrt -lpthread -lm -lc -pie -nodefaultlibs
FFmpeg Encoder: libx264 - Scenario: Live OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 5.1.2 Encoder: libx264 - Scenario: Live Linux 6.0 Linux 6.1 Git 4 8 12 16 20 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 16.56 16.57 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
FFmpeg Encoder: libx265 - Scenario: Live OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 5.1.2 Encoder: libx265 - Scenario: Live Linux 6.0 Linux 6.1 Git 10 20 30 40 50 SE +/- 0.11, N = 3 SE +/- 0.26, N = 3 43.01 42.77 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
FFmpeg Encoder: libx264 - Scenario: Upload OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 5.1.2 Encoder: libx264 - Scenario: Upload Linux 6.0 Linux 6.1 Git 30 60 90 120 150 SE +/- 0.12, N = 3 SE +/- 0.18, N = 3 137.73 137.84 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
FFmpeg Encoder: libx265 - Scenario: Upload OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 5.1.2 Encoder: libx265 - Scenario: Upload Linux 6.0 Linux 6.1 Git 20 40 60 80 100 SE +/- 0.23, N = 3 SE +/- 0.30, N = 3 110.14 109.02 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
FFmpeg Encoder: libx264 - Scenario: Platform OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 5.1.2 Encoder: libx264 - Scenario: Platform Linux 6.0 Linux 6.1 Git 20 40 60 80 100 SE +/- 0.10, N = 3 SE +/- 0.09, N = 3 107.72 107.25 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
FFmpeg Encoder: libx265 - Scenario: Platform OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 5.1.2 Encoder: libx265 - Scenario: Platform Linux 6.0 Linux 6.1 Git 40 80 120 160 200 SE +/- 0.12, N = 3 SE +/- 0.05, N = 3 162.19 161.04 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
FFmpeg Encoder: libx264 - Scenario: Video On Demand OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 5.1.2 Encoder: libx264 - Scenario: Video On Demand Linux 6.0 Linux 6.1 Git 20 40 60 80 100 SE +/- 0.08, N = 3 SE +/- 0.05, N = 3 107.72 107.19 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
FFmpeg Encoder: libx265 - Scenario: Video On Demand OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 5.1.2 Encoder: libx265 - Scenario: Video On Demand Linux 6.0 Linux 6.1 Git 40 80 120 160 200 SE +/- 0.19, N = 3 SE +/- 0.23, N = 3 161.83 161.43 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
Hackbench Count: 16 - Type: Thread OpenBenchmarking.org Seconds, Fewer Is Better Hackbench Count: 16 - Type: Thread Linux 6.0 Linux 6.1 Git 4 8 12 16 20 SE +/- 0.09, N = 3 SE +/- 0.08, N = 3 15.61 15.70 1. (CC) gcc options: -lpthread
Hackbench Count: 16 - Type: Process OpenBenchmarking.org Seconds, Fewer Is Better Hackbench Count: 16 - Type: Process Linux 6.0 Linux 6.1 Git 4 8 12 16 20 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 15.10 15.31 1. (CC) gcc options: -lpthread
Hackbench Count: 32 - Type: Process OpenBenchmarking.org Seconds, Fewer Is Better Hackbench Count: 32 - Type: Process Linux 6.0 Linux 6.1 Git 8 16 24 32 40 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 32.98 33.13 1. (CC) gcc options: -lpthread
SQLite Speedtest Timed Time - Size 1,000 OpenBenchmarking.org Seconds, Fewer Is Better SQLite Speedtest 3.30 Timed Time - Size 1,000 Linux 6.0 Linux 6.1 Git 8 16 24 32 40 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 35.60 35.83 1. (CC) gcc options: -O2 -lz
Darktable Test: Boat - Acceleration: CPU-only OpenBenchmarking.org Seconds, Fewer Is Better Darktable 4.0.0 Test: Boat - Acceleration: CPU-only Linux 6.0 Linux 6.1 Git 0.5567 1.1134 1.6701 2.2268 2.7835 SE +/- 0.013, N = 3 SE +/- 0.024, N = 5 2.474 2.462
Darktable Test: Masskrug - Acceleration: CPU-only OpenBenchmarking.org Seconds, Fewer Is Better Darktable 4.0.0 Test: Masskrug - Acceleration: CPU-only Linux 6.0 Linux 6.1 Git 0.6478 1.2956 1.9434 2.5912 3.239 SE +/- 0.019, N = 13 SE +/- 0.018, N = 3 2.879 2.768
Darktable Test: Server Rack - Acceleration: CPU-only OpenBenchmarking.org Seconds, Fewer Is Better Darktable 4.0.0 Test: Server Rack - Acceleration: CPU-only Linux 6.0 Linux 6.1 Git 0.0419 0.0838 0.1257 0.1676 0.2095 SE +/- 0.001, N = 3 SE +/- 0.000, N = 3 0.186 0.182
Darktable Test: Server Room - Acceleration: CPU-only OpenBenchmarking.org Seconds, Fewer Is Better Darktable 4.0.0 Test: Server Room - Acceleration: CPU-only Linux 6.0 Linux 6.1 Git 0.5603 1.1206 1.6809 2.2412 2.8015 SE +/- 0.006, N = 3 SE +/- 0.020, N = 3 2.490 2.432
GIMP Test: resize OpenBenchmarking.org Seconds, Fewer Is Better GIMP 2.10.32 Test: resize Linux 6.0 Linux 6.1 Git 4 8 12 16 20 SE +/- 0.13, N = 6 SE +/- 0.10, N = 10 13.78 13.30
GIMP Test: rotate OpenBenchmarking.org Seconds, Fewer Is Better GIMP 2.10.32 Test: rotate Linux 6.0 Linux 6.1 Git 3 6 9 12 15 SE +/- 0.030, N = 3 SE +/- 0.067, N = 3 10.423 9.927
GIMP Test: auto-levels OpenBenchmarking.org Seconds, Fewer Is Better GIMP 2.10.32 Test: auto-levels Linux 6.0 Linux 6.1 Git 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 11.71 11.20
GIMP Test: unsharp-mask OpenBenchmarking.org Seconds, Fewer Is Better GIMP 2.10.32 Test: unsharp-mask Linux 6.0 Linux 6.1 Git 4 8 12 16 20 SE +/- 0.13, N = 3 SE +/- 0.01, N = 3 14.31 13.62
RawTherapee Total Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better RawTherapee Total Benchmark Time Linux 6.0 Linux 6.1 Git 8 16 24 32 40 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 35.87 34.62 1. RawTherapee, version 5.8, command line.
Blender Blend File: BMW27 - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.3 Blend File: BMW27 - Compute: CPU-Only Linux 6.0 Linux 6.1 Git 11 22 33 44 55 SE +/- 0.18, N = 3 SE +/- 0.05, N = 3 50.08 49.83
EnCodec Target Bandwidth: 3 kbps OpenBenchmarking.org Seconds, Fewer Is Better EnCodec 0.1.1 Target Bandwidth: 3 kbps Linux 6.0 Linux 6.1 Git 6 12 18 24 30 SE +/- 0.26, N = 5 SE +/- 0.26, N = 5 24.79 24.90
EnCodec Target Bandwidth: 6 kbps OpenBenchmarking.org Seconds, Fewer Is Better EnCodec 0.1.1 Target Bandwidth: 6 kbps Linux 6.0 Linux 6.1 Git 6 12 18 24 30 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 25.15 25.28
EnCodec Target Bandwidth: 24 kbps OpenBenchmarking.org Seconds, Fewer Is Better EnCodec 0.1.1 Target Bandwidth: 24 kbps Linux 6.0 Linux 6.1 Git 7 14 21 28 35 SE +/- 0.05, N = 3 SE +/- 0.10, N = 3 29.24 29.42
EnCodec Target Bandwidth: 1.5 kbps OpenBenchmarking.org Seconds, Fewer Is Better EnCodec 0.1.1 Target Bandwidth: 1.5 kbps Linux 6.0 Linux 6.1 Git 6 12 18 24 30 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 24.14 24.25
Phoronix Test Suite v10.8.5