Linux 6.11 File-Systems

Tests for a future article. AMD EPYC 8534P 64-Core testing with a AMD Cinnabar (RCB1009C BIOS) and ASPEED on Ubuntu 23.10 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2408065-NE-LINUX611F18&sor&grr.

Linux 6.11 File-SystemsProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionEXT4F2FSBtrfsXFSBcachefsAMD EPYC 8534P 64-Core @ 2.30GHz (64 Cores / 128 Threads)AMD Cinnabar (RCB1009C BIOS)AMD Device 14a46 x 32GB DRAM-4800MT/s Samsung M321R4GA0BB0-CQKMG1000GB INTEL SSDPE2KX010T8 + 7682GB SOLIDIGM SB5PH27X076TASPEED2 x Broadcom NetXtreme BCM5720 PCIeUbuntu 23.106.11.0-061100rc2-generic (x86_64)GCC 13.2.0ext41920x1200f2fsbtrfsxfsBcacheFSOpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Disk Details- EXT4: NONE / relatime,rw,stripe=256 / Block Size: 4096- F2FS: NONE / acl,active_logs=6,alloc_mode=default,background_gc=on,barrier,checkpoint_merge,discard,discard_unit=block,errors=continue,extent_cache,flush_merge,fsync_mode=posix,inline_data,inline_dentry,inline_xattr,lazytime,memory=normal,mode=adaptive,nogc_merge,relatime,rw,user_xattr / Block Size: 4096 - Btrfs: NONE / discard=async,relatime,rw,space_cache=v2,ssd,subvol=/,subvolid=5 / Block Size: 4096 - XFS: NONE / attr2,inode64,logbsize=32k,logbufs=8,noquota,relatime,rw / Block Size: 4096 - Bcachefs: NONE / relatime,rw / Block Size: 4096Processor Details- Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00212 Java Details- EXT4: OpenJDK Runtime Environment (build 11.0.23+9-post-Ubuntu-1ubuntu123.10.1)Python Details- EXT4: Python 3.11.6Security Details- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Linux 6.11 File-Systemsdbench: 12fio: Seq Read - IO_uring - Yes - 2MB - 32 - Default Test Directorycockroach: KV, 60% Reads - 256mariadb: oltp_update_non_index - 64cockroach: KV, 50% Reads - 256speedb: Read While Writingfio: Seq Read - IO_uring - Yes - 2MB - 32 - Default Test Directorypgbench: 100 - 1000 - Read Write - Average Latencypgbench: 100 - 1000 - Read Writespeedb: Rand Fillfio: Rand Read - IO_uring - Yes - 4KB - 32 - Default Test Directoryfio: Rand Read - IO_uring - Yes - 4KB - 32 - Default Test Directoryfio: Seq Write - IO_uring - Yes - 2MB - 32 - Default Test Directoryfio: Seq Write - IO_uring - Yes - 2MB - 32 - Default Test Directoryfio: Rand Write - IO_uring - Yes - 4KB - 32 - Default Test Directoryfio: Rand Write - IO_uring - Yes - 4KB - 32 - Default Test Directorymysqlslap: 32sqlite: 4EXT4F2FSBtrfsXFSBcachefs5057.88106658.518391397936.812274192594115.746635113711312036677954039808113600053215382.6066756.04101341.9186562100277.012193430611021.4874654936880620333379440428087147000574153810.4412061.2099639.74782688960.712070975598141.640240163694701390005431367273760833237101514.8825777.24101495.3185630100698.812275021609215.500645193557212050008004042808613000050715362.4883229.787186102296.815812794771.812110788371224.0644155636757817666769098419715460021313474.537OpenBenchmarking.org

Dbench

Client Count: 12

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 12F2FSXFSEXT4BcachefsBtrfs14002800420056007000SE +/- 12.71, N = 3SE +/- 1.83, N = 3SE +/- 5.27, N = 3SE +/- 3.41, N = 3SE +/- 7.42, N = 36756.045777.245057.883229.782061.201. (CC) gcc options: -lpopt -O2

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Direct: Yes - Block Size: 2MB - Job Count: 32 - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.36Type: Sequential Read - Engine: IO_uring - Direct: Yes - Block Size: 2MB - Job Count: 32 - Disk Target: Default Test DirectoryBcachefs15003000450060007500SE +/- 35.33, N = 1471861. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

CockroachDB

Workload: KV, 60% Reads - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 60% Reads - Concurrency: 256EXT4BcachefsXFSF2FSBtrfs20K40K60K80K100KSE +/- 291.24, N = 3SE +/- 1084.81, N = 15SE +/- 1480.60, N = 15SE +/- 1635.56, N = 15SE +/- 695.82, N = 3106658.5102296.8101495.3101341.999639.7

MariaDB

Test: oltp_update_non_index - Threads: 64

OpenBenchmarking.orgQueries Per Second, More Is BetterMariaDB 11.5Test: oltp_update_non_index - Threads: 64F2FSXFSEXT4BcachefsBtrfs40K80K120K160K200KSE +/- 374.96, N = 3SE +/- 224.91, N = 3SE +/- 162.81, N = 3SE +/- 142.43, N = 3SE +/- 352.18, N = 318656218563018391315812747826-lcrypt -laio -lnuma -lssl -lcrypto-shared -lrt -lstdc++-shared -lrt -lstdc++-shared -lrt -lstdc++-shared -lrt -lstdc++1. (CXX) g++ options: -pie -fPIC -fstack-protector -O3 -lz -lm -lpthread -ldl

CockroachDB

Workload: KV, 50% Reads - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 50% Reads - Concurrency: 256XFSF2FSEXT4BcachefsBtrfs20K40K60K80K100KSE +/- 327.73, N = 3SE +/- 1260.51, N = 3SE +/- 1094.28, N = 15SE +/- 1082.29, N = 15SE +/- 981.48, N = 5100698.8100277.097936.894771.888960.7

Speedb

Test: Read While Writing

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Read While WritingXFSEXT4F2FSBcachefsBtrfs3M6M9M12M15MSE +/- 86255.08, N = 3SE +/- 124696.22, N = 15SE +/- 110325.78, N = 15SE +/- 114927.82, N = 15SE +/- 115159.19, N = 612275021122741921219343012110788120709751. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Direct: Yes - Block Size: 2MB - Job Count: 32 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.36Type: Sequential Read - Engine: IO_uring - Direct: Yes - Block Size: 2MB - Job Count: 32 - Disk Target: Default Test DirectoryF2FSXFSBtrfsEXT4Bcachefs13002600390052006500SE +/- 5.24, N = 3SE +/- 5.69, N = 3SE +/- 13.01, N = 3SE +/- 6.74, N = 3SE +/- 121.50, N = 15611060925981594137121. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average LatencyXFSEXT4F2FSBcachefsBtrfs1020304050SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.20, N = 3SE +/- 0.09, N = 3SE +/- 0.14, N = 315.5015.7521.4924.0641.641. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read WriteXFSEXT4F2FSBcachefsBtrfs14K28K42K56K70KSE +/- 375.90, N = 3SE +/- 307.92, N = 3SE +/- 444.74, N = 3SE +/- 150.28, N = 3SE +/- 78.26, N = 364519635114654941556240161. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

Speedb

Test: Random Fill

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random FillEXT4BtrfsF2FSBcachefsXFS80K160K240K320K400KSE +/- 1260.12, N = 3SE +/- 846.81, N = 3SE +/- 207.63, N = 3SE +/- 104.11, N = 3SE +/- 15517.10, N = 123711313694703688063675783557211. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Direct: Yes - Block Size: 4KB - Job Count: 32 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.36Type: Random Read - Engine: IO_uring - Direct: Yes - Block Size: 4KB - Job Count: 32 - Disk Target: Default Test DirectoryXFSEXT4F2FSBcachefsBtrfs40K80K120K160K200KSE +/- 577.35, N = 3SE +/- 333.33, N = 3SE +/- 333.33, N = 3SE +/- 2185.81, N = 3SE +/- 577.35, N = 32050002036672033331766671390001. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Direct: Yes - Block Size: 4KB - Job Count: 32 - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.36Type: Random Read - Engine: IO_uring - Direct: Yes - Block Size: 4KB - Job Count: 32 - Disk Target: Default Test DirectoryXFSEXT4F2FSBcachefsBtrfs2004006008001000SE +/- 2.52, N = 3SE +/- 1.20, N = 3SE +/- 0.33, N = 3SE +/- 8.84, N = 3SE +/- 1.67, N = 38007957946905431. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Direct: Yes - Block Size: 2MB - Job Count: 32 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.36Type: Sequential Write - Engine: IO_uring - Direct: Yes - Block Size: 2MB - Job Count: 32 - Disk Target: Default Test DirectoryXFSF2FSEXT4BtrfsBcachefs9001800270036004500SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 0.58, N = 3SE +/- 1.45, N = 3SE +/- 1.20, N = 340424042403913679841. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Direct: Yes - Block Size: 2MB - Job Count: 32 - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.36Type: Sequential Write - Engine: IO_uring - Direct: Yes - Block Size: 2MB - Job Count: 32 - Disk Target: Default Test DirectoryF2FSXFSEXT4BtrfsBcachefs2K4K6K8K10KSE +/- 0.88, N = 3SE +/- 1.33, N = 3SE +/- 1.53, N = 3SE +/- 2.91, N = 3SE +/- 2.33, N = 3808780868081273719711. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Direct: Yes - Block Size: 4KB - Job Count: 32 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.36Type: Random Write - Engine: IO_uring - Direct: Yes - Block Size: 4KB - Job Count: 32 - Disk Target: Default Test DirectoryF2FSEXT4XFSBtrfsBcachefs30K60K90K120K150KSE +/- 0.00, N = 3SE +/- 577.35, N = 3SE +/- 0.00, N = 3SE +/- 578.31, N = 3SE +/- 57.74, N = 314700013600013000060833546001. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Direct: Yes - Block Size: 4KB - Job Count: 32 - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.36Type: Random Write - Engine: IO_uring - Direct: Yes - Block Size: 4KB - Job Count: 32 - Disk Target: Default Test DirectoryF2FSEXT4XFSBtrfsBcachefs120240360480600SE +/- 0.58, N = 3SE +/- 2.19, N = 3SE +/- 0.33, N = 3SE +/- 2.33, N = 3SE +/- 0.33, N = 35745325072372131. (CC) gcc options: -rdynamic -ll -lnuma -lz -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

MariaDB mariadb-slap

Clients: 32

OpenBenchmarking.orgQueries Per Second, More Is BetterMariaDB mariadb-slap 11.5Clients: 32F2FSEXT4XFSBcachefsBtrfs30060090012001500SE +/- 4.18, N = 3SE +/- 3.43, N = 3SE +/- 7.57, N = 3SE +/- 7.10, N = 3SE +/- 14.43, N = 3153815381536134710151. (CXX) g++ options: -fPIC -pie -fstack-protector -O3 -shared -lrt -lpthread -lz -ldl -lm -lstdc++

SQLite

Threads / Copies: 4

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.41.2Threads / Copies: 4XFSEXT4BcachefsF2FSBtrfs48121620SE +/- 0.009, N = 3SE +/- 0.010, N = 3SE +/- 0.055, N = 15SE +/- 0.099, N = 3SE +/- 0.321, N = 152.4882.6064.53710.44114.882-lreadline -ltermcap-lreadline -ltermcap-lreadline -ltermcap-lreadline -ltermcap1. (CC) gcc options: -O2 -lz -lm

Phoronix Test Suite v10.8.5