Linux 4.19 I/O Scheduler Performance

Linux I/O scheduler benchmarks for a future article on Phoronix.com.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1811264-SK-LINUX419I79
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Limit displaying results to tests within:

Timed Code Compilation 2 Tests
CPU Massive 5 Tests
Database Test Suite 2 Tests
Disk Test Suite 4 Tests
Multi-Core 3 Tests
Programmer / Developer System Benchmarks 2 Tests
Server 3 Tests
Server CPU Tests 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
CFQ
November 24 2018
  3 Hours, 54 Minutes
Deadline
November 25 2018
  2 Hours, 5 Minutes
Noop
November 25 2018
  3 Hours, 52 Minutes
MQ None
November 25 2018
  3 Hours, 55 Minutes
BFQ low_latency
November 25 2018
  4 Hours, 9 Minutes
BFQ
November 26 2018
  2 Hours, 33 Minutes
Kyber
November 26 2018
  3 Hours, 57 Minutes
MQ Deadline
November 26 2018
  4 Hours, 25 Minutes
Invert Hiding All Results Option
  3 Hours, 36 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

CFQ

Processor: 2 x AMD EPYC 7601 32-Core (64 Cores / 128 Threads), Motherboard: Dell 02MJ3T (1.2.5 BIOS), Chipset: AMD Family 17h, Memory: 16 x 32 GB DDR4-2400MT/s 36ASF4G72PZ-2G6D2, Disk: 120GB SSDSCKJB120G7R + 20 x 500GB Samsung SSD 860, Graphics: Matrox G200eW3, Monitor: VE228, Network: Broadcom BCM57416 NetXtreme-E Dual-Media 10G RDMA

OS: Ubuntu 18.10, Kernel: 4.19.0-041900-generic (x86_64), Compiler: GCC 8.2.0 + Clang 7.0.0-3 + LLVM 7.0.0, File-System: ext4, Screen Resolution: 1600x1200

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v
Disk Notes: CFQ / relatime,rw
Python Notes: Python 2.7.15+ + Python 3.6.7
Security Notes: __user pointer sanitization + Full AMD retpoline IBPB + SSB disabled via prctl and seccomp

Deadline

Changed Disk to 20 x 500GB Samsung SSD 860 + 120GB SSDSCKJB120G7R.

Disk Change: DEADLINE / relatime,rw

Noop

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v
Disk Notes: NOOP / relatime,rw
Python Notes: Python 2.7.15+ + Python 3.6.7
Security Notes: __user pointer sanitization + Full AMD retpoline IBPB + SSB disabled via prctl and seccomp

MQ None

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v
Disk Notes: NONE / relatime,rw
Python Notes: Python 2.7.15+ + Python 3.6.7
Security Notes: __user pointer sanitization + Full AMD retpoline IBPB + SSB disabled via prctl and seccomp

BFQ low_latency

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v
Disk Notes: BFQ / relatime,rw
Python Notes: Python 2.7.15+ + Python 3.6.7
Security Notes: __user pointer sanitization + Full AMD retpoline IBPB + SSB disabled via prctl and seccomp

BFQ

Kyber

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v
Disk Notes: KYBER / relatime,rw
Python Notes: Python 2.7.15+ + Python 3.6.7
Security Notes: __user pointer sanitization + Full AMD retpoline IBPB + SSB disabled via prctl and seccomp

MQ Deadline

Changed Disk to 120GB SSDSCKJB120G7R + 20 x 500GB Samsung SSD 860.

Disk Change: MQ-DEADLINE / relatime,rw

Linux 4.19 I/O Scheduler PerformanceOpenBenchmarking.orgPhoronix Test Suite2 x AMD EPYC 7601 32-Core (64 Cores / 128 Threads)Dell 02MJ3T (1.2.5 BIOS)AMD Family 17h16 x 32 GB DDR4-2400MT/s 36ASF4G72PZ-2G6D2120GB SSDSCKJB120G7R + 20 x 500GB Samsung SSD 86020 x 500GB Samsung SSD 860 + 120GB SSDSCKJB120G7RMatrox G200eW3VE228Broadcom BCM57416 NetXtreme-E Dual-Media 10G RDMAUbuntu 18.104.19.0-041900-generic (x86_64)GCC 8.2.0 + Clang 7.0.0-3 + LLVM 7.0.0ext41600x1200ProcessorMotherboardChipsetMemoryDisksGraphicsMonitorNetworkOSKernelCompilerFile-SystemScreen ResolutionLinux 4.19 I/O Scheduler Performance BenchmarksSystem Logs- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - CFQ: CFQ / relatime,rw- Deadline: DEADLINE / relatime,rw- Noop: NOOP / relatime,rw- MQ None: NONE / relatime,rw- BFQ low_latency: BFQ / relatime,rw- BFQ: BFQ / relatime,rw- Kyber: KYBER / relatime,rw- MQ Deadline: MQ-DEADLINE / relatime,rw- Python 2.7.15+ + Python 3.6.7- __user pointer sanitization + Full AMD retpoline IBPB + SSB disabled via prctl and seccomp

CFQDeadlineNoopMQ NoneBFQ low_latencyBFQKyberMQ DeadlineResult OverviewPhoronix Test Suite100%133%167%200%234%SQLitePostgreSQL pgbenchFS-MarkFlexible IO TesterBlogBenchCompile BenchTimed GCC CompilationTimed Linux Kernel Compilation

Linux 4.19 I/O Scheduler Performancefio: Rand Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizefio: Seq Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Write - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Read - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - No - Yes - 4KB - Default Test Directoryblogbench: Readfio: Rand Write - Linux AIO - No - Yes - 4KB - Default Test Directorycompilebench: Read Compiled Treecompilebench: Initial Createfio: Seq Write - Linux AIO - No - Yes - 4KB - Default Test Directorycompilebench: Compilefs-mark: 1000 Files, 1MB Size, No Sync/FSyncbuild-gcc: Time To Compilebuild-linux-kernel: Time To Compilepgbench: Buffer Test - Normal Load - Read Writepgbench: Buffer Test - Normal Load - Read Onlyblogbench: Writefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 1000 Files, 1MB Sizefio: Rand Write - Linux AIO - No - Yes - 2MB - Default Test Directorysqlite: Timed SQLite InsertionsCFQDeadlineNoopMQ NoneBFQ low_latencyBFQKyberMQ Deadline25386.703824053222847483962378813703131554189080626.3836565194382354718117439133.1754284.473824103243137361432379383883151576189680326.3750745524702281717317340334.2054281.802533182532717058472389683913091568189780726.4825545337092148517891.3031077.1054357.202523112522707950752279723963091571192080026.5020895334632732014064.4328068.2954366.932523122532727855412129603943101591191880426.4934065197922251213161.3322375.0554283.833813863292708051482369693873131575189680026.43483754571924163181168.2337957.3254389.172533122532757805362369493903081577190980426.4223034978992749218391.6831169.1154367.382523132522727834462269553893071577189379626.4424535063972634212359.2324377.52OpenBenchmarking.org

Flexible IO Tester

Fio is an advanced disk benchmark that depends upon the kernel's AIO access library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryNoopMQ NoneMQ DeadlineKyberDeadlineCFQBFQ low_latencyBFQ120240360480600SE +/- 0.33, N = 3SE +/- 0.33, N = 35425435435435422535435421. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lgfapi -lglusterfs -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

FS-Mark

FS_Mark is designed to test a system's file-system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeNoopMQ NoneMQ DeadlineKyberDeadlineCFQBFQ low_latencyBFQ20406080100SE +/- 1.50, N = 3SE +/- 1.01, N = 3SE +/- 1.79, N = 12SE +/- 0.07, N = 3SE +/- 0.12, N = 3SE +/- 0.06, N = 3SE +/- 1.76, N = 12SE +/- 0.07, N = 381.8057.2067.3889.1784.4786.7066.9383.831. (CC) gcc options: -static

Flexible IO Tester

Fio is an advanced disk benchmark that depends upon the kernel's AIO access library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryNoopMQ NoneMQ DeadlineKyberDeadlineCFQBFQ low_latencyBFQ801602403204002532522522533823822523811. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lgfapi -lglusterfs -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryNoopMQ NoneMQ DeadlineKyberDeadlineCFQBFQ low_latencyBFQ90180270360450SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 1.86, N = 3SE +/- 0.88, N = 3SE +/- 0.67, N = 3SE +/- 3.84, N = 3SE +/- 0.67, N = 3SE +/- 4.74, N = 73183113133124104053123861. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lgfapi -lglusterfs -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryNoopMQ NoneMQ DeadlineKyberDeadlineCFQBFQ low_latencyBFQ70140210280350SE +/- 0.88, N = 3SE +/- 2.33, N = 32532522522533243222533291. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lgfapi -lglusterfs -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryNoopMQ NoneMQ DeadlineKyberDeadlineCFQBFQ low_latencyBFQ20K40K60K80K100KSE +/- 233.33, N = 3SE +/- 120.19, N = 3SE +/- 33.33, N = 3SE +/- 650.64, N = 364800646006460064700828338256764633843001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lgfapi -lglusterfs -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryNoopMQ NoneMQ DeadlineKyberDeadlineCFQBFQ low_latencyBFQ20K40K60K80K100KSE +/- 33.33, N = 3SE +/- 100.00, N = 3SE +/- 33.33, N = 3SE +/- 33.33, N = 3SE +/- 384.42, N = 369500691336970070467802007266769500687671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lgfapi -lglusterfs -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryNoopMQ NoneMQ DeadlineKyberDeadlineCFQBFQ low_latencyBFQ70140210280350SE +/- 0.33, N = 3SE +/- 0.33, N = 32712702722753132842722701. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lgfapi -lglusterfs -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

BlogBench

BlogBench is designed to replicate the load of a real-world busy file server by stressing the file-system with multiple threads of random reads, writes, and rewrites. The behavior is mimicked of that of a blog by creating blogs with content and pictures, modifying blog posts, adding comments to these blogs, and then reading the content of the blogs. All of these blogs generated are created locally with fake content and pictures. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: ReadNoopMQ NoneMQ DeadlineKyberDeadlineCFQBFQ low_latencyBFQ200K400K600K800K1000KSE +/- 14644.01, N = 9SE +/- 5674.85, N = 3SE +/- 15271.38, N = 3SE +/- 3436.67, N = 3SE +/- 12667.35, N = 4SE +/- 12021.04, N = 3SE +/- 7744.57, N = 3SE +/- 6417.79, N = 37058477950757834467805367361437483967855418051481. (CC) gcc options: -O2 -pthread

Flexible IO Tester

Fio is an advanced disk benchmark that depends upon the kernel's AIO access library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryNoopMQ NoneMQ DeadlineKyberDeadlineCFQBFQ low_latencyBFQ50100150200250SE +/- 1.15, N = 3SE +/- 3.07, N = 6SE +/- 1.20, N = 3SE +/- 2.41, N = 10SE +/- 0.88, N = 32382272262362372372122361. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lgfapi -lglusterfs -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryNoopMQ NoneMQ DeadlineKyberDeadlineCFQBFQ low_latencyBFQ13K26K39K52K65KSE +/- 328.30, N = 3SE +/- 260.34, N = 3SE +/- 771.00, N = 6SE +/- 88.19, N = 3SE +/- 284.80, N = 3SE +/- 632.60, N = 10SE +/- 272.85, N = 360633580675773360533606006076754280603331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lgfapi -lglusterfs -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Compile Bench

Compilebench tries to age a filesystem by simulating some of the disk IO common in creating, compiling, patching, stating and reading kernel trees. It indirectly measures how well filesystems can maintain directory locality as the disk fills up and directories age. This current test is setup to use the makej mode with 10 initial directories Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Read Compiled TreeNoopMQ NoneMQ DeadlineKyberDeadlineCFQBFQ low_latencyBFQ2004006008001000SE +/- 0.51, N = 3SE +/- 0.68, N = 3SE +/- 9.75, N = 3SE +/- 33.71, N = 3SE +/- 16.27, N = 3SE +/- 88.38, N = 3SE +/- 10.55, N = 3SE +/- 13.50, N = 3968972955949938881960969

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateNoopMQ NoneMQ DeadlineKyberDeadlineCFQBFQ low_latencyBFQ90180270360450SE +/- 0.40, N = 3SE +/- 2.34, N = 3SE +/- 4.48, N = 3SE +/- 3.28, N = 3SE +/- 5.24, N = 3SE +/- 14.05, N = 3SE +/- 2.88, N = 3SE +/- 4.71, N = 3391396389390388370394387

Flexible IO Tester

Fio is an advanced disk benchmark that depends upon the kernel's AIO access library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryNoopMQ NoneMQ DeadlineKyberDeadlineCFQBFQ low_latencyBFQ70140210280350SE +/- 0.67, N = 3SE +/- 1.33, N = 3SE +/- 0.67, N = 3SE +/- 1.86, N = 3SE +/- 2.19, N = 3SE +/- 2.52, N = 33093093073083153133103131. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lgfapi -lglusterfs -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryNoopMQ NoneMQ DeadlineKyberDeadlineCFQBFQ low_latencyBFQ20K40K60K80K100KSE +/- 133.33, N = 3SE +/- 366.67, N = 3SE +/- 296.27, N = 3SE +/- 437.16, N = 3SE +/- 584.05, N = 3SE +/- 208.17, N = 3SE +/- 635.96, N = 379100791677876778567805678016779300802331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lgfapi -lglusterfs -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Compile Bench

Compilebench tries to age a filesystem by simulating some of the disk IO common in creating, compiling, patching, stating and reading kernel trees. It indirectly measures how well filesystems can maintain directory locality as the disk fills up and directories age. This current test is setup to use the makej mode with 10 initial directories Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileNoopMQ NoneMQ DeadlineKyberDeadlineCFQBFQ low_latencyBFQ30060090012001500SE +/- 3.60, N = 3SE +/- 10.25, N = 3SE +/- 8.82, N = 3SE +/- 9.90, N = 3SE +/- 18.06, N = 3SE +/- 25.94, N = 12SE +/- 23.01, N = 3SE +/- 27.17, N = 315681571157715771576155415911575

FS-Mark

FS_Mark is designed to test a system's file-system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size, No Sync/FSyncNoopMQ NoneMQ DeadlineKyberDeadlineCFQBFQ low_latencyBFQ400800120016002000SE +/- 5.04, N = 3SE +/- 10.18, N = 3SE +/- 5.34, N = 3SE +/- 8.63, N = 3SE +/- 4.07, N = 3SE +/- 4.42, N = 3SE +/- 13.64, N = 3SE +/- 9.03, N = 3189719201893190918961890191818961. (CC) gcc options: -static

Timed GCC Compilation

This test times how long it takes to build the GNU Compiler Collection (GCC). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed GCC Compilation 8.2Time To CompileNoopMQ NoneMQ DeadlineKyberDeadlineCFQBFQ low_latencyBFQ2004006008001000807800796804803806804800

Timed Linux Kernel Compilation

This test times how long it takes to build the Linux kernel in a default configuration. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 4.18Time To CompileNoopMQ NoneMQ DeadlineKyberDeadlineCFQBFQ low_latencyBFQ612182430SE +/- 0.30, N = 12SE +/- 0.28, N = 12SE +/- 0.29, N = 12SE +/- 0.26, N = 12SE +/- 0.32, N = 12SE +/- 0.30, N = 9SE +/- 0.30, N = 12SE +/- 0.27, N = 1226.4826.5026.4426.4226.3726.3826.4926.43

PostgreSQL pgbench

This is a simple benchmark of PostgreSQL using pgbench. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Buffer Test - Test: Normal Load - Mode: Read WriteNoopMQ NoneMQ DeadlineKyberDeadlineCFQBFQ low_latencyBFQ11002200330044005500SE +/- 178.04, N = 9SE +/- 79.41, N = 9SE +/- 116.16, N = 6SE +/- 328.42, N = 9SE +/- 43.49, N = 3SE +/- 482.90, N = 6SE +/- 274.44, N = 6SE +/- 30.68, N = 3255420892453230350743656340648371. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Buffer Test - Test: Normal Load - Mode: Read OnlyNoopMQ NoneMQ DeadlineKyberDeadlineCFQBFQ low_latencyBFQ120K240K360K480K600KSE +/- 5081.43, N = 3SE +/- 1266.65, N = 3SE +/- 17086.01, N = 9SE +/- 16915.21, N = 9SE +/- 5594.65, N = 3SE +/- 14237.99, N = 9SE +/- 8044.90, N = 9SE +/- 9965.65, N = 35337095334635063974978995524705194385197925457191. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

BlogBench

BlogBench is designed to replicate the load of a real-world busy file server by stressing the file-system with multiple threads of random reads, writes, and rewrites. The behavior is mimicked of that of a blog by creating blogs with content and pictures, modifying blog posts, adding comments to these blogs, and then reading the content of the blogs. All of these blogs generated are created locally with fake content and pictures. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: WriteNoopMQ NoneMQ DeadlineKyberDeadlineCFQBFQ low_latencyBFQ6K12K18K24K30KSE +/- 1540.70, N = 3SE +/- 386.03, N = 3SE +/- 1133.74, N = 3SE +/- 265.64, N = 3SE +/- 1730.49, N = 3SE +/- 1591.21, N = 3SE +/- 2941.93, N = 3SE +/- 2384.58, N = 321485273202634227492228172354722512241631. (CC) gcc options: -O2 -pthread

FS-Mark

FS_Mark is designed to test a system's file-system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsNoopMQ NoneMQ DeadlineKyberDeadlineCFQBFQ low_latencyBFQ4080120160200SE +/- 0.61, N = 3SE +/- 8.57, N = 8SE +/- 12.68, N = 6SE +/- 0.35, N = 3SE +/- 0.13, N = 3SE +/- 5.69, N = 12SE +/- 9.48, N = 6SE +/- 5.19, N = 121781401231831731811311811. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeNoopMQ NoneMQ DeadlineKyberDeadlineCFQBFQ low_latencyBFQ4080120160200SE +/- 6.28, N = 12SE +/- 2.14, N = 12SE +/- 2.40, N = 12SE +/- 2.15, N = 12SE +/- 0.23, N = 3SE +/- 0.09, N = 3SE +/- 2.31, N = 12SE +/- 0.44, N = 391.3064.4359.2391.68173.00174.0061.33168.231. (CC) gcc options: -static

Flexible IO Tester

Fio is an advanced disk benchmark that depends upon the kernel's AIO access library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryNoopMQ NoneMQ DeadlineKyberDeadlineCFQBFQ low_latencyBFQ90180270360450SE +/- 1.53, N = 3SE +/- 7.26, N = 12SE +/- 12.51, N = 12SE +/- 7.51, N = 3SE +/- 4.04, N = 3SE +/- 12.98, N = 12SE +/- 3.71, N = 33102802433114033912233791. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lgfapi -lglusterfs -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

SQLite

This is a simple benchmark of SQLite. At present this test profile just measures the time to perform a pre-defined number of insertions on an indexed database. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite InsertionsNoopMQ NoneMQ DeadlineKyberDeadlineCFQBFQ low_latencyBFQ20406080100SE +/- 10.02, N = 9SE +/- 9.94, N = 9SE +/- 10.09, N = 9SE +/- 9.71, N = 9SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 8.89, N = 9SE +/- 0.64, N = 377.1068.2977.5269.1134.2033.1775.0557.321. (CC) gcc options: -O2 -lz -ldl -lpthread

CFQ

Processor: 2 x AMD EPYC 7601 32-Core (64 Cores / 128 Threads), Motherboard: Dell 02MJ3T (1.2.5 BIOS), Chipset: AMD Family 17h, Memory: 16 x 32 GB DDR4-2400MT/s 36ASF4G72PZ-2G6D2, Disk: 120GB SSDSCKJB120G7R + 20 x 500GB Samsung SSD 860, Graphics: Matrox G200eW3, Monitor: VE228, Network: Broadcom BCM57416 NetXtreme-E Dual-Media 10G RDMA

OS: Ubuntu 18.10, Kernel: 4.19.0-041900-generic (x86_64), Compiler: GCC 8.2.0 + Clang 7.0.0-3 + LLVM 7.0.0, File-System: ext4, Screen Resolution: 1600x1200

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v
Disk Notes: CFQ / relatime,rw
Python Notes: Python 2.7.15+ + Python 3.6.7
Security Notes: __user pointer sanitization + Full AMD retpoline IBPB + SSB disabled via prctl and seccomp

Testing initiated at 24 November 2018 08:47 by user root.

Deadline

Processor: 2 x AMD EPYC 7601 32-Core (64 Cores / 128 Threads), Motherboard: Dell 02MJ3T (1.2.5 BIOS), Chipset: AMD Family 17h, Memory: 16 x 32 GB DDR4-2400MT/s 36ASF4G72PZ-2G6D2, Disk: 20 x 500GB Samsung SSD 860 + 120GB SSDSCKJB120G7R, Graphics: Matrox G200eW3, Monitor: VE228, Network: Broadcom BCM57416 NetXtreme-E Dual-Media 10G RDMA

OS: Ubuntu 18.10, Kernel: 4.19.0-041900-generic (x86_64), Compiler: GCC 8.2.0 + Clang 7.0.0-3 + LLVM 7.0.0, File-System: ext4, Screen Resolution: 1600x1200

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v
Disk Notes: DEADLINE / relatime,rw
Python Notes: Python 2.7.15+ + Python 3.6.7
Security Notes: __user pointer sanitization + Full AMD retpoline IBPB + SSB disabled via prctl and seccomp

Testing initiated at 25 November 2018 01:33 by user root.

Noop

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v
Disk Notes: NOOP / relatime,rw
Python Notes: Python 2.7.15+ + Python 3.6.7
Security Notes: __user pointer sanitization + Full AMD retpoline IBPB + SSB disabled via prctl and seccomp

Testing initiated at 25 November 2018 03:40 by user root.

MQ None

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v
Disk Notes: NONE / relatime,rw
Python Notes: Python 2.7.15+ + Python 3.6.7
Security Notes: __user pointer sanitization + Full AMD retpoline IBPB + SSB disabled via prctl and seccomp

Testing initiated at 25 November 2018 07:51 by user root.

BFQ low_latency

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v
Disk Notes: BFQ / relatime,rw
Python Notes: Python 2.7.15+ + Python 3.6.7
Security Notes: __user pointer sanitization + Full AMD retpoline IBPB + SSB disabled via prctl and seccomp

Testing initiated at 25 November 2018 11:49 by user root.

BFQ

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v
Disk Notes: BFQ / relatime,rw
Python Notes: Python 2.7.15+ + Python 3.6.7
Security Notes: __user pointer sanitization + Full AMD retpoline IBPB + SSB disabled via prctl and seccomp

Testing initiated at 26 November 2018 00:17 by user root.

Kyber

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v
Disk Notes: KYBER / relatime,rw
Python Notes: Python 2.7.15+ + Python 3.6.7
Security Notes: __user pointer sanitization + Full AMD retpoline IBPB + SSB disabled via prctl and seccomp

Testing initiated at 26 November 2018 02:53 by user root.

MQ Deadline

Processor: 2 x AMD EPYC 7601 32-Core (64 Cores / 128 Threads), Motherboard: Dell 02MJ3T (1.2.5 BIOS), Chipset: AMD Family 17h, Memory: 16 x 32 GB DDR4-2400MT/s 36ASF4G72PZ-2G6D2, Disk: 120GB SSDSCKJB120G7R + 20 x 500GB Samsung SSD 860, Graphics: Matrox G200eW3, Monitor: VE228, Network: Broadcom BCM57416 NetXtreme-E Dual-Media 10G RDMA

OS: Ubuntu 18.10, Kernel: 4.19.0-041900-generic (x86_64), Compiler: GCC 8.2.0 + Clang 7.0.0-3 + LLVM 7.0.0, File-System: ext4, Screen Resolution: 1600x1200

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v
Disk Notes: MQ-DEADLINE / relatime,rw
Python Notes: Python 2.7.15+ + Python 3.6.7
Security Notes: __user pointer sanitization + Full AMD retpoline IBPB + SSB disabled via prctl and seccomp

Testing initiated at 26 November 2018 06:54 by user root.