Linux 6.11 File-Systems

Tests for a future article. AMD EPYC 8534P 64-Core testing with a AMD Cinnabar (RCB1009C BIOS) and ASPEED on Ubuntu 23.10 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2408065-NE-LINUX611F18&sro&gru.

Linux 6.11 File-SystemsProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionEXT4F2FSBtrfsXFSBcachefsAMD EPYC 8534P 64-Core @ 2.30GHz (64 Cores / 128 Threads)AMD Cinnabar (RCB1009C BIOS)AMD Device 14a46 x 32GB DRAM-4800MT/s Samsung M321R4GA0BB0-CQKMG1000GB INTEL SSDPE2KX010T8 + 7682GB SOLIDIGM SB5PH27X076TASPEED2 x Broadcom NetXtreme BCM5720 PCIeUbuntu 23.106.11.0-061100rc2-generic (x86_64)GCC 13.2.0ext41920x1200f2fsbtrfsxfsBcacheFSOpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Disk Details- EXT4: NONE / relatime,rw,stripe=256 / Block Size: 4096- F2FS: NONE / acl,active_logs=6,alloc_mode=default,background_gc=on,barrier,checkpoint_merge,discard,discard_unit=block,errors=continue,extent_cache,flush_merge,fsync_mode=posix,inline_data,inline_dentry,inline_xattr,lazytime,memory=normal,mode=adaptive,nogc_merge,relatime,rw,user_xattr / Block Size: 4096 - Btrfs: NONE / discard=async,relatime,rw,space_cache=v2,ssd,subvol=/,subvolid=5 / Block Size: 4096 - XFS: NONE / attr2,inode64,logbsize=32k,logbufs=8,noquota,relatime,rw / Block Size: 4096 - Bcachefs: NONE / relatime,rw / Block Size: 4096Processor Details- Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00212 Java Details- EXT4: OpenJDK Runtime Environment (build 11.0.23+9-post-Ubuntu-1ubuntu123.10.1)Python Details- EXT4: Python 3.11.6Security Details- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Linux 6.11 File-Systemsfio: Rand Read - IO_uring - Yes - 4KB - 32 - Default Test Directoryfio: Rand Write - IO_uring - Yes - 4KB - 32 - Default Test Directoryfio: Seq Read - IO_uring - Yes - 2MB - 32 - Default Test Directoryfio: Seq Write - IO_uring - Yes - 2MB - 32 - Default Test Directoryfio: Rand Read - IO_uring - Yes - 4KB - 32 - Default Test Directoryfio: Rand Write - IO_uring - Yes - 4KB - 32 - Default Test Directoryfio: Seq Write - IO_uring - Yes - 2MB - 32 - Default Test Directorydbench: 12fio: Seq Read - IO_uring - Yes - 2MB - 32 - Default Test Directoryspeedb: Rand Fillspeedb: Read While Writingcockroach: KV, 50% Reads - 256cockroach: KV, 60% Reads - 256mariadb: oltp_update_non_index - 64mysqlslap: 32pgbench: 100 - 1000 - Read Writepgbench: 100 - 1000 - Read Write - Average Latencysqlite: 4EXT4F2FSBtrfsXFSBcachefs2036671360005941403979553280815057.883711311227419297936.8106658.518391315386351115.7462.6062033331470006110404279457480876756.0436880612193430100277.0101341.918656215384654921.48710.441139000608335981136754323727372061.203694701207097588960.799639.74782610152401641.64014.8822050001300006092404280050780865777.2435572112275021100698.8101495.318563015366451915.5002.48817666754600371298469021319713229.7871863675781211078894771.8102296.815812713474155624.0644.537OpenBenchmarking.org

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Direct: Yes - Block Size: 4KB - Job Count: 32 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.36Type: Random Read - Engine: IO_uring - Direct: Yes - Block Size: 4KB - Job Count: 32 - Disk Target: Default Test DirectoryBcachefsBtrfsEXT4F2FSXFS40K80K120K160K200KSE +/- 2185.81, N = 3SE +/- 577.35, N = 3SE +/- 333.33, N = 3SE +/- 333.33, N = 3SE +/- 577.35, N = 31766671390002036672033332050001. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Direct: Yes - Block Size: 4KB - Job Count: 32 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.36Type: Random Write - Engine: IO_uring - Direct: Yes - Block Size: 4KB - Job Count: 32 - Disk Target: Default Test DirectoryBcachefsBtrfsEXT4F2FSXFS30K60K90K120K150KSE +/- 57.74, N = 3SE +/- 578.31, N = 3SE +/- 577.35, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 354600608331360001470001300001. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Direct: Yes - Block Size: 2MB - Job Count: 32 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.36Type: Sequential Read - Engine: IO_uring - Direct: Yes - Block Size: 2MB - Job Count: 32 - Disk Target: Default Test DirectoryBcachefsBtrfsEXT4F2FSXFS13002600390052006500SE +/- 121.50, N = 15SE +/- 13.01, N = 3SE +/- 6.74, N = 3SE +/- 5.24, N = 3SE +/- 5.69, N = 3371259815941611060921. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Direct: Yes - Block Size: 2MB - Job Count: 32 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.36Type: Sequential Write - Engine: IO_uring - Direct: Yes - Block Size: 2MB - Job Count: 32 - Disk Target: Default Test DirectoryBcachefsBtrfsEXT4F2FSXFS9001800270036004500SE +/- 1.20, N = 3SE +/- 1.45, N = 3SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 398413674039404240421. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Direct: Yes - Block Size: 4KB - Job Count: 32 - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.36Type: Random Read - Engine: IO_uring - Direct: Yes - Block Size: 4KB - Job Count: 32 - Disk Target: Default Test DirectoryBcachefsBtrfsEXT4F2FSXFS2004006008001000SE +/- 8.84, N = 3SE +/- 1.67, N = 3SE +/- 1.20, N = 3SE +/- 0.33, N = 3SE +/- 2.52, N = 36905437957948001. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Direct: Yes - Block Size: 4KB - Job Count: 32 - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.36Type: Random Write - Engine: IO_uring - Direct: Yes - Block Size: 4KB - Job Count: 32 - Disk Target: Default Test DirectoryBcachefsBtrfsEXT4F2FSXFS120240360480600SE +/- 0.33, N = 3SE +/- 2.33, N = 3SE +/- 2.19, N = 3SE +/- 0.58, N = 3SE +/- 0.33, N = 32132375325745071. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Direct: Yes - Block Size: 2MB - Job Count: 32 - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.36Type: Sequential Write - Engine: IO_uring - Direct: Yes - Block Size: 2MB - Job Count: 32 - Disk Target: Default Test DirectoryBcachefsBtrfsEXT4F2FSXFS2K4K6K8K10KSE +/- 2.33, N = 3SE +/- 2.91, N = 3SE +/- 1.53, N = 3SE +/- 0.88, N = 3SE +/- 1.33, N = 3197127378081808780861. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Dbench

Client Count: 12

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 12BcachefsBtrfsEXT4F2FSXFS14002800420056007000SE +/- 3.41, N = 3SE +/- 7.42, N = 3SE +/- 5.27, N = 3SE +/- 12.71, N = 3SE +/- 1.83, N = 33229.782061.205057.886756.045777.241. (CC) gcc options: -lpopt -O2

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Direct: Yes - Block Size: 2MB - Job Count: 32 - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.36Type: Sequential Read - Engine: IO_uring - Direct: Yes - Block Size: 2MB - Job Count: 32 - Disk Target: Default Test DirectoryBcachefs15003000450060007500SE +/- 35.33, N = 1471861. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Speedb

Test: Random Fill

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random FillBcachefsBtrfsEXT4F2FSXFS80K160K240K320K400KSE +/- 104.11, N = 3SE +/- 846.81, N = 3SE +/- 1260.12, N = 3SE +/- 207.63, N = 3SE +/- 15517.10, N = 123675783694703711313688063557211. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Speedb

Test: Read While Writing

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Read While WritingBcachefsBtrfsEXT4F2FSXFS3M6M9M12M15MSE +/- 114927.82, N = 15SE +/- 115159.19, N = 6SE +/- 124696.22, N = 15SE +/- 110325.78, N = 15SE +/- 86255.08, N = 312110788120709751227419212193430122750211. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

CockroachDB

Workload: KV, 50% Reads - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 50% Reads - Concurrency: 256BcachefsBtrfsEXT4F2FSXFS20K40K60K80K100KSE +/- 1082.29, N = 15SE +/- 981.48, N = 5SE +/- 1094.28, N = 15SE +/- 1260.51, N = 3SE +/- 327.73, N = 394771.888960.797936.8100277.0100698.8

CockroachDB

Workload: KV, 60% Reads - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 60% Reads - Concurrency: 256BcachefsBtrfsEXT4F2FSXFS20K40K60K80K100KSE +/- 1084.81, N = 15SE +/- 695.82, N = 3SE +/- 291.24, N = 3SE +/- 1635.56, N = 15SE +/- 1480.60, N = 15102296.899639.7106658.5101341.9101495.3

MariaDB

Test: oltp_update_non_index - Threads: 64

OpenBenchmarking.orgQueries Per Second, More Is BetterMariaDB 11.5Test: oltp_update_non_index - Threads: 64BcachefsBtrfsEXT4F2FSXFS40K80K120K160K200KSE +/- 142.43, N = 3SE +/- 352.18, N = 3SE +/- 162.81, N = 3SE +/- 374.96, N = 3SE +/- 224.91, N = 315812747826183913186562185630-shared -lrt -lstdc++-shared -lrt -lstdc++-shared -lrt -lstdc++-lcrypt -laio -lnuma -lssl -lcrypto-shared -lrt -lstdc++1. (CXX) g++ options: -fPIC -pie -fstack-protector -O3 -lpthread -lz -ldl -lm

MariaDB mariadb-slap

Clients: 32

OpenBenchmarking.orgQueries Per Second, More Is BetterMariaDB mariadb-slap 11.5Clients: 32BcachefsBtrfsEXT4F2FSXFS30060090012001500SE +/- 7.10, N = 3SE +/- 14.43, N = 3SE +/- 3.43, N = 3SE +/- 4.18, N = 3SE +/- 7.57, N = 3134710151538153815361. (CXX) g++ options: -fPIC -pie -fstack-protector -O3 -shared -lrt -lpthread -lz -ldl -lm -lstdc++

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read WriteBcachefsBtrfsEXT4F2FSXFS14K28K42K56K70KSE +/- 150.28, N = 3SE +/- 78.26, N = 3SE +/- 307.92, N = 3SE +/- 444.74, N = 3SE +/- 375.90, N = 341556240166351146549645191. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average LatencyBcachefsBtrfsEXT4F2FSXFS1020304050SE +/- 0.09, N = 3SE +/- 0.14, N = 3SE +/- 0.08, N = 3SE +/- 0.20, N = 3SE +/- 0.09, N = 324.0641.6415.7521.4915.501. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

SQLite

Threads / Copies: 4

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.41.2Threads / Copies: 4BcachefsBtrfsEXT4F2FSXFS48121620SE +/- 0.055, N = 15SE +/- 0.321, N = 15SE +/- 0.010, N = 3SE +/- 0.099, N = 3SE +/- 0.009, N = 34.53714.8822.60610.4412.488-lreadline -ltermcap-lreadline -ltermcap-lreadline -ltermcap-lreadline -ltermcap1. (CC) gcc options: -O2 -lz -lm

Phoronix Test Suite v10.8.5