proxmox-disk

qemu testing on Debian 9.4 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/1805227-FO-MERGE604593&gru&sro.

proxmox-diskProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionSystem Layerproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebacktau-ceph-raw-nonetau-ceph-raw-writebacktau-nfs-qcow2-nonetau-nfs-raw-writebacktau-nfs-qcow2-writebacktau-nfs-qcow2-writeback-512MBtau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-writeback-8GBtau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-2x4corestau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-writeback-swappiness0uranus-nfs-qcow2-writebackuranus-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-qcow2-writeback-4cores-2uranus-ceph-raw-writebackCommon KVM @ 2.90GHz (2 Cores)QEMU Standard PC (i440FX + PIIX 1996) (rel-1.9.3-0-ge2fc41e-prebuilt.qemu-project.org BIOS)Intel 440FX- 82441FX PMC1 x 2048 MB RAM QEMU30GBbochsdrmfbRed Hat Virtio deviceDebian 9.44.9.0-6-amd64 (x86_64)GCC 6.3.0 20170516ext41024x768qemuCommon KVM @ 2.20GHz (2 Cores)QEMU Standard PC (i440FX + PIIX 1996) (rel-1.11.0-0-g63451fca13-prebuilt.qemu-project.org BIOS)1 x 512 MB RAM QEMU1 x 4096 MB RAM QEMU1 x 8192 MB RAM QEMUCommon KVM @ 2.20GHz (4 Cores)1 x 2048 MB RAM QEMU2 x Common KVM @ 2.20GHz (8 Cores)Common KVM @ 2.20GHz (8 Cores)Common KVM @ 2.20GHz (4 Cores)Common KVM @ 2.20GHz (2 Cores)Common KVM @ 2.60GHz (2 Cores)Common KVM @ 2.60GHz (4 Cores)Common KVM @ 2.20GHz (2 Cores)1 x 512 MB RAM QEMUCommon KVM @ 2.20GHz (4 Cores)1 x 2048 MB RAM QEMUCommon KVM @ 2.60GHz (2 Cores)OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -vDisk Details- none / data=ordered,errors=remount-ro,relatime,rwPython Details- Python 2.7.13 + Python 3.5.3Security Details- KPTI + __user pointer sanitization + Full generic retpoline Protection

proxmox-diskfs-mark: 1000 Files, 1MB Sizeaio-stress: Rand Writedbench: 12 Clientsdbench: 48 Clientsdbench: 128 Clientsdbench: 1 Clientstiobench: 64MB Rand Read - 32 Threadstiobench: 64MB Rand Write - 32 Threadscompilebench: Compilecompilebench: Initial Createcompilebench: Read Compiled Treeapache: Static Web Page Servingpostmark: Disk Transaction Performancesqlite: Timed SQLite Insertionsunpack-linux: linux-4.15.tar.xzcompress-gzip: Linux Source Tree Archiving To .tar.gzproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebacktau-ceph-raw-nonetau-ceph-raw-writebacktau-nfs-qcow2-nonetau-nfs-raw-writebacktau-nfs-qcow2-writebacktau-nfs-qcow2-writeback-512MBtau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-writeback-8GBtau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-2x4corestau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-writeback-swappiness0uranus-nfs-qcow2-writebackuranus-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-qcow2-writeback-4cores-2uranus-ceph-raw-writeback35.73360.30271.40496.30311.1366.9410835.30236.49549.5478.17228.212257.49176950.1417.6864.7351.47400.16105.99210.38209.3324.509167.5229.5687.0142.72224.872290.98611233.8026.2264.859.9378.4527.4759.4868.827.75437.839.4584.9558.77270.298133.751029634.3615.14293.4210.4390.8227.4559.1379.8711.65486.607.4773.2756.04291.3210051.441158571.0113.70224.78359.65240.11793.33811.21735.00317.3114397.922193.97256.29143.00350.629514.15225613.579.2157.33192.33314.22736.88811.43579.78237.2110509.831454.69479.50126.12381.078489.36215511.439.6951.53365.03254.34834.32882.50853.23304.1515152.772655.82432.45131.96317.479564.74237317.899.2451.30404.52278.30863.80839.71693.32295.077312.682560.59295.29163.97129.8410785.49165916.1910.4352.33385.82371.39871.29877.11753.05304.4025844.391173.98378.29138.23355.849651.52285116.549.0047.84401.20669.641355.371444.361385.40317.7329557.982642.97454.94170.16439.5514513.27259516.308.5648.87294.07253.681455.091874.731723.91257.6426506.211868.61374.37116.37361.4011010.71205518.409.4351.26308.77335.191464.161904.751792.13273.0423408.941385.75392.86132.61362.3010701.30218017.579.3450.73340.90294.961148.901276.551186.16270.1622338.172234.12359.59137.37357.3010774.98216117.709.5251.06317.40324.89870.20904.05886.91298.4516701.011592.47410.96139.69320.7010212.68229316.969.1651.21101.68124.82368.99527.81502.4180.4411393.61552.26143.6160.85173.522866.0991741.5319.7574.51114.87209.16441.27834.581032.5096.1919855.48394.22176.6862.29195.608567.6898838.0118.8162.58385.47311.09790.26773.05613.28285.487714.922375.65473.25131.30133.618612.01132714.7510.0655.64340.93343.321201.331274.621229.43283.0620854.761975.72460.95127.86368.8713008.62211916.609.4051.2510.3375.3730.4053.1174.0212.80539.844.9269.4547.67129.152883.65709436.5423.00305.63OpenBenchmarking.org

FS-Mark

1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.31000 Files, 1MB Sizeproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebacktau-ceph-raw-nonetau-ceph-raw-writebacktau-nfs-qcow2-nonetau-nfs-qcow2-writebacktau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-2x4corestau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-4cores-2tau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-writeback-512MBtau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-qcow2-writeback-swappiness0tau-nfs-raw-writebackuranus-ceph-raw-writebackuranus-nfs-qcow2-writebackuranus-nfs-qcow2-writeback-4cores90180270360450SE +/- 0.12, N = 3SE +/- 1.19, N = 6SE +/- 0.36, N = 6SE +/- 0.15, N = 3SE +/- 26.35, N = 6SE +/- 22.63, N = 6SE +/- 2.74, N = 3SE +/- 24.26, N = 6SE +/- 14.31, N = 6SE +/- 16.66, N = 6SE +/- 13.57, N = 6SE +/- 34.41, N = 6SE +/- 15.16, N = 6SE +/- 14.81, N = 6SE +/- 10.22, N = 6SE +/- 6.75, N = 6SE +/- 1.02, N = 6SE +/- 8.10, N = 6SE +/- 9.78, N = 635.7351.479.9310.43359.65365.03308.77294.07385.82401.20340.93340.90404.52385.47317.40192.3310.33101.68114.871. (CC) gcc options: -static

AIO-Stress

Random Write

OpenBenchmarking.orgMB/s, More Is BetterAIO-Stress 0.21Random Writeproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebacktau-ceph-raw-nonetau-ceph-raw-writebacktau-nfs-qcow2-nonetau-nfs-qcow2-writebacktau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-2x4corestau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-4cores-2tau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-writeback-512MBtau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-qcow2-writeback-swappiness0tau-nfs-raw-writebackuranus-ceph-raw-writebackuranus-nfs-qcow2-writebackuranus-nfs-qcow2-writeback-4cores140280420560700SE +/- 27.84, N = 6SE +/- 22.46, N = 6SE +/- 1.35, N = 6SE +/- 2.47, N = 6SE +/- 37.62, N = 6SE +/- 81.52, N = 6SE +/- 131.41, N = 6SE +/- 92.54, N = 6SE +/- 111.52, N = 6SE +/- 158.74, N = 6SE +/- 100.94, N = 6SE +/- 119.83, N = 6SE +/- 97.35, N = 6SE +/- 82.15, N = 6SE +/- 116.61, N = 6SE +/- 102.50, N = 6SE +/- 4.34, N = 6SE +/- 7.91, N = 6SE +/- 88.79, N = 6360.30400.1678.4590.82240.11254.34335.19253.68371.39669.64343.32294.96278.30311.09324.89314.2275.37124.82209.161. (CC) gcc options: -pthread -laio

Dbench

12 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.012 Clientsproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebacktau-ceph-raw-nonetau-ceph-raw-writebacktau-nfs-qcow2-nonetau-nfs-qcow2-writebacktau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-2x4corestau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-4cores-2tau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-writeback-512MBtau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-qcow2-writeback-swappiness0tau-nfs-raw-writebackuranus-ceph-raw-writebackuranus-nfs-qcow2-writebackuranus-nfs-qcow2-writeback-4cores30060090012001500SE +/- 0.36, N = 3SE +/- 0.62, N = 3SE +/- 1.69, N = 6SE +/- 2.16, N = 6SE +/- 8.70, N = 3SE +/- 8.73, N = 3SE +/- 14.52, N = 3SE +/- 11.57, N = 3SE +/- 5.31, N = 3SE +/- 7.39, N = 3SE +/- 5.99, N = 3SE +/- 16.43, N = 3SE +/- 1.96, N = 3SE +/- 2.11, N = 3SE +/- 5.26, N = 3SE +/- 56.22, N = 6SE +/- 1.21, N = 6SE +/- 6.95, N = 3SE +/- 8.59, N = 3271.40105.9927.4727.45793.33834.321464.161455.09871.291355.371201.331148.90863.80790.26870.20736.8830.40368.99441.271. (CC) gcc options: -lpopt -O2

Dbench

48 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.048 Clientsproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebacktau-ceph-raw-nonetau-ceph-raw-writebacktau-nfs-qcow2-nonetau-nfs-qcow2-writebacktau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-2x4corestau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-4cores-2tau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-writeback-512MBtau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-qcow2-writeback-swappiness0tau-nfs-raw-writebackuranus-ceph-raw-writebackuranus-nfs-qcow2-writebackuranus-nfs-qcow2-writeback-4cores400800120016002000SE +/- 1.11, N = 3SE +/- 4.34, N = 6SE +/- 5.21, N = 6SE +/- 2.48, N = 6SE +/- 5.87, N = 3SE +/- 3.66, N = 3SE +/- 27.38, N = 3SE +/- 5.73, N = 3SE +/- 7.40, N = 3SE +/- 5.34, N = 3SE +/- 7.67, N = 3SE +/- 4.41, N = 3SE +/- 8.16, N = 3SE +/- 3.65, N = 3SE +/- 7.13, N = 3SE +/- 7.72, N = 3SE +/- 2.55, N = 6SE +/- 19.16, N = 6SE +/- 24.83, N = 6496.30210.3859.4859.13811.21882.501904.751874.73877.111444.361274.621276.55839.71773.05904.05811.4353.11527.81834.581. (CC) gcc options: -lpopt -O2

Dbench

128 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0128 Clientsproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebacktau-ceph-raw-nonetau-ceph-raw-writebacktau-nfs-qcow2-nonetau-nfs-qcow2-writebacktau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-2x4corestau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-4cores-2tau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-writeback-512MBtau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-qcow2-writeback-swappiness0tau-nfs-raw-writebackuranus-ceph-raw-writebackuranus-nfs-qcow2-writebackuranus-nfs-qcow2-writeback-4cores400800120016002000SE +/- 2.17, N = 3SE +/- 3.26, N = 6SE +/- 5.25, N = 6SE +/- 3.83, N = 6SE +/- 13.98, N = 3SE +/- 2.08, N = 3SE +/- 26.38, N = 3SE +/- 11.25, N = 3SE +/- 5.88, N = 3SE +/- 5.30, N = 3SE +/- 1.63, N = 3SE +/- 9.30, N = 3SE +/- 10.58, N = 6SE +/- 3.39, N = 3SE +/- 1.95, N = 3SE +/- 42.22, N = 6SE +/- 1.24, N = 3SE +/- 19.34, N = 6SE +/- 32.29, N = 6311.13209.3368.8279.87735.00853.231792.131723.91753.051385.401229.431186.16693.32613.28886.91579.7874.02502.411032.501. (CC) gcc options: -lpopt -O2

Dbench

1 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.01 Clientsproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebacktau-ceph-raw-nonetau-ceph-raw-writebacktau-nfs-qcow2-nonetau-nfs-qcow2-writebacktau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-2x4corestau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-4cores-2tau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-writeback-512MBtau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-qcow2-writeback-swappiness0tau-nfs-raw-writebackuranus-ceph-raw-writebackuranus-nfs-qcow2-writebackuranus-nfs-qcow2-writeback-4cores70140210280350SE +/- 0.18, N = 3SE +/- 0.09, N = 3SE +/- 0.30, N = 6SE +/- 0.50, N = 6SE +/- 2.51, N = 3SE +/- 1.61, N = 3SE +/- 1.04, N = 3SE +/- 0.73, N = 3SE +/- 0.85, N = 3SE +/- 0.75, N = 3SE +/- 1.16, N = 3SE +/- 1.13, N = 3SE +/- 4.50, N = 3SE +/- 0.63, N = 3SE +/- 1.21, N = 3SE +/- 1.08, N = 3SE +/- 0.38, N = 6SE +/- 1.07, N = 6SE +/- 0.81, N = 366.9424.507.7511.65317.31304.15273.04257.64304.40317.73283.06270.16295.07285.48298.45237.2112.8080.4496.191. (CC) gcc options: -lpopt -O2

Threaded I/O Tester

64MB Random Read - 32 Threads

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 2017050364MB Random Read - 32 Threadsproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebacktau-ceph-raw-nonetau-ceph-raw-writebacktau-nfs-qcow2-nonetau-nfs-qcow2-writebacktau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-2x4corestau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-4cores-2tau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-writeback-512MBtau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-qcow2-writeback-swappiness0tau-nfs-raw-writebackuranus-ceph-raw-writebackuranus-nfs-qcow2-writebackuranus-nfs-qcow2-writeback-4cores6K12K18K24K30KSE +/- 160.41, N = 3SE +/- 280.82, N = 6SE +/- 53.46, N = 5SE +/- 47.98, N = 6SE +/- 947.64, N = 6SE +/- 714.51, N = 6SE +/- 538.07, N = 6SE +/- 1314.96, N = 6SE +/- 391.33, N = 3SE +/- 1964.16, N = 6SE +/- 1396.84, N = 6SE +/- 1332.13, N = 6SE +/- 1298.31, N = 6SE +/- 317.29, N = 6SE +/- 318.12, N = 3SE +/- 1608.65, N = 6SE +/- 37.91, N = 6SE +/- 387.45, N = 6SE +/- 1301.43, N = 610835.309167.52437.83486.6014397.9215152.7723408.9426506.2125844.3929557.9820854.7622338.177312.687714.9216701.0110509.83539.8411393.6119855.481. (CC) gcc options: -O2

Threaded I/O Tester

64MB Random Write - 32 Threads

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 2017050364MB Random Write - 32 Threadsproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebacktau-ceph-raw-nonetau-ceph-raw-writebacktau-nfs-qcow2-nonetau-nfs-qcow2-writebacktau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-2x4corestau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-4cores-2tau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-writeback-512MBtau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-qcow2-writeback-swappiness0tau-nfs-raw-writebackuranus-ceph-raw-writebackuranus-nfs-qcow2-writebackuranus-nfs-qcow2-writeback-4cores6001200180024003000SE +/- 4.51, N = 3SE +/- 2.56, N = 6SE +/- 0.20, N = 3SE +/- 0.79, N = 3SE +/- 697.63, N = 6SE +/- 402.73, N = 6SE +/- 218.60, N = 6SE +/- 361.45, N = 6SE +/- 171.06, N = 6SE +/- 587.82, N = 6SE +/- 366.85, N = 6SE +/- 471.96, N = 6SE +/- 534.57, N = 6SE +/- 458.33, N = 6SE +/- 254.19, N = 6SE +/- 28.09, N = 3SE +/- 0.59, N = 3SE +/- 128.09, N = 6SE +/- 1.03, N = 3236.4929.569.457.472193.972655.821385.751868.611173.982642.971975.722234.122560.592375.651592.471454.694.92552.26394.221. (CC) gcc options: -O2

Compile Bench

Test: Compile

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Compileproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebacktau-ceph-raw-nonetau-ceph-raw-writebacktau-nfs-qcow2-nonetau-nfs-qcow2-writebacktau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-2x4corestau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-4cores-2tau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-writeback-512MBtau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-qcow2-writeback-swappiness0tau-nfs-raw-writebackuranus-ceph-raw-writebackuranus-nfs-qcow2-writebackuranus-nfs-qcow2-writeback-4cores120240360480600SE +/- 20.59, N = 6SE +/- 40.64, N = 6SE +/- 2.46, N = 6SE +/- 1.10, N = 3SE +/- 17.75, N = 6SE +/- 23.12, N = 6SE +/- 24.96, N = 6SE +/- 11.22, N = 6SE +/- 26.64, N = 6SE +/- 31.36, N = 6SE +/- 15.07, N = 6SE +/- 25.53, N = 6SE +/- 22.76, N = 6SE +/- 10.22, N = 6SE +/- 14.65, N = 6SE +/- 32.65, N = 6SE +/- 0.83, N = 3SE +/- 11.81, N = 6SE +/- 29.17, N = 6549.5487.0184.9573.27256.29432.45392.86374.37378.29454.94460.95359.59295.29473.25410.96479.5069.45143.61176.68

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial Createproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebacktau-ceph-raw-nonetau-ceph-raw-writebacktau-nfs-qcow2-nonetau-nfs-qcow2-writebacktau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-2x4corestau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-4cores-2tau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-writeback-512MBtau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-qcow2-writeback-swappiness0tau-nfs-raw-writebackuranus-ceph-raw-writebackuranus-nfs-qcow2-writebackuranus-nfs-qcow2-writeback-4cores4080120160200SE +/- 5.34, N = 3SE +/- 8.10, N = 3SE +/- 2.91, N = 3SE +/- 0.88, N = 3SE +/- 3.24, N = 3SE +/- 5.03, N = 3SE +/- 4.41, N = 3SE +/- 7.52, N = 3SE +/- 3.97, N = 3SE +/- 4.40, N = 3SE +/- 2.15, N = 3SE +/- 7.46, N = 3SE +/- 5.34, N = 3SE +/- 2.41, N = 3SE +/- 6.72, N = 3SE +/- 3.13, N = 3SE +/- 2.75, N = 3SE +/- 6.77, N = 3SE +/- 3.64, N = 378.1742.7258.7756.04143.00131.96132.61116.37138.23170.16127.86137.37163.97131.30139.69126.1247.6760.8562.29

Compile Bench

Test: Read Compiled Tree

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Read Compiled Treeproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebacktau-ceph-raw-nonetau-ceph-raw-writebacktau-nfs-qcow2-nonetau-nfs-qcow2-writebacktau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-2x4corestau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-4cores-2tau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-writeback-512MBtau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-qcow2-writeback-swappiness0tau-nfs-raw-writebackuranus-ceph-raw-writebackuranus-nfs-qcow2-writebackuranus-nfs-qcow2-writeback-4cores100200300400500SE +/- 8.47, N = 3SE +/- 23.85, N = 3SE +/- 2.43, N = 3SE +/- 16.55, N = 3SE +/- 43.62, N = 3SE +/- 11.31, N = 3SE +/- 28.05, N = 3SE +/- 38.10, N = 3SE +/- 10.33, N = 3SE +/- 4.62, N = 3SE +/- 29.15, N = 3SE +/- 11.95, N = 3SE +/- 7.24, N = 3SE +/- 3.34, N = 3SE +/- 9.06, N = 3SE +/- 18.45, N = 3SE +/- 5.71, N = 3SE +/- 4.29, N = 3SE +/- 14.43, N = 3228.21224.87270.29291.32350.62317.47362.30361.40355.84439.55368.87357.30129.84133.61320.70381.07129.15173.52195.60

Apache Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.4.29Static Web Page Servingproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebacktau-ceph-raw-nonetau-ceph-raw-writebacktau-nfs-qcow2-nonetau-nfs-qcow2-writebacktau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-2x4corestau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-4cores-2tau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-writeback-512MBtau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-qcow2-writeback-swappiness0tau-nfs-raw-writebackuranus-ceph-raw-writebackuranus-nfs-qcow2-writebackuranus-nfs-qcow2-writeback-4cores3K6K9K12K15KSE +/- 23.92, N = 3SE +/- 23.09, N = 3SE +/- 28.92, N = 3SE +/- 22.41, N = 3SE +/- 44.44, N = 3SE +/- 36.16, N = 3SE +/- 34.29, N = 3SE +/- 20.33, N = 3SE +/- 44.51, N = 3SE +/- 601.93, N = 6SE +/- 471.43, N = 6SE +/- 97.03, N = 3SE +/- 20.81, N = 3SE +/- 31.17, N = 3SE +/- 34.13, N = 3SE +/- 33.10, N = 3SE +/- 59.51, N = 6SE +/- 22.74, N = 3SE +/- 385.83, N = 62257.492290.988133.7510051.449514.159564.7410701.3011010.719651.5214513.2713008.6210774.9810785.498612.0110212.688489.362883.652866.098567.681. (CC) gcc options: -shared -fPIC -O2 -pthread

PostMark

Disk Transaction Performance

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction Performanceproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebacktau-ceph-raw-nonetau-ceph-raw-writebacktau-nfs-qcow2-nonetau-nfs-qcow2-writebacktau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-2x4corestau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-4cores-2tau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-writeback-512MBtau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-qcow2-writeback-swappiness0tau-nfs-raw-writebackuranus-ceph-raw-writebackuranus-nfs-qcow2-writebackuranus-nfs-qcow2-writeback-4cores6001200180024003000SE +/- 15.07, N = 3SE +/- 16.41, N = 6SE +/- 16.90, N = 6SE +/- 16.15, N = 3SE +/- 43.53, N = 6SE +/- 7.33, N = 3SE +/- 16.82, N = 3SE +/- 5.67, N = 3SE +/- 28.85, N = 3SE +/- 9.00, N = 3SE +/- 20.79, N = 3SE +/- 16.44, N = 3SE +/- 9.70, N = 3SE +/- 31.33, N = 6SE +/- 21.33, N = 3SE +/- 10.68, N = 3SE +/- 4.37, N = 3SE +/- 17.78, N = 3SE +/- 15.88, N = 31769611102911582256237321802055285125952119216116591327229321557099179881. (CC) gcc options: -O3

SQLite

Timed SQLite Insertions

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite Insertionsproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebacktau-ceph-raw-nonetau-ceph-raw-writebacktau-nfs-qcow2-nonetau-nfs-qcow2-writebacktau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-2x4corestau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-4cores-2tau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-writeback-512MBtau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-qcow2-writeback-swappiness0tau-nfs-raw-writebackuranus-ceph-raw-writebackuranus-nfs-qcow2-writebackuranus-nfs-qcow2-writeback-4cores140280420560700SE +/- 0.42, N = 3SE +/- 1.97, N = 3SE +/- 40.98, N = 6SE +/- 48.37, N = 6SE +/- 0.05, N = 3SE +/- 1.21, N = 6SE +/- 0.89, N = 6SE +/- 0.79, N = 6SE +/- 0.70, N = 6SE +/- 0.83, N = 6SE +/- 0.51, N = 6SE +/- 0.53, N = 6SE +/- 0.30, N = 3SE +/- 1.05, N = 6SE +/- 0.73, N = 6SE +/- 0.19, N = 3SE +/- 33.08, N = 6SE +/- 2.97, N = 6SE +/- 2.12, N = 650.14233.80634.36571.0113.5717.8917.5718.4016.5416.3016.6017.7016.1914.7516.9611.43436.5441.5338.011. (CC) gcc options: -O2 -ldl -lpthread

Unpacking The Linux Kernel

linux-4.15.tar.xz

OpenBenchmarking.orgSeconds, Fewer Is BetterUnpacking The Linux Kernellinux-4.15.tar.xzproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebacktau-ceph-raw-nonetau-ceph-raw-writebacktau-nfs-qcow2-nonetau-nfs-qcow2-writebacktau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-2x4corestau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-4cores-2tau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-writeback-512MBtau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-qcow2-writeback-swappiness0tau-nfs-raw-writebackuranus-ceph-raw-writebackuranus-nfs-qcow2-writebackuranus-nfs-qcow2-writeback-4cores612182430SE +/- 0.42, N = 8SE +/- 3.21, N = 8SE +/- 0.85, N = 8SE +/- 0.79, N = 8SE +/- 0.14, N = 8SE +/- 0.17, N = 8SE +/- 0.21, N = 8SE +/- 0.14, N = 5SE +/- 0.07, N = 4SE +/- 0.13, N = 4SE +/- 0.16, N = 8SE +/- 0.12, N = 4SE +/- 0.33, N = 8SE +/- 0.12, N = 4SE +/- 0.11, N = 4SE +/- 0.14, N = 4SE +/- 1.73, N = 8SE +/- 1.00, N = 8SE +/- 0.83, N = 817.6826.2215.1413.709.219.249.349.439.008.569.409.5210.4310.069.169.6923.0019.7518.81

Gzip Compression

Linux Source Tree Archiving To .tar.gz

OpenBenchmarking.orgSeconds, Fewer Is BetterGzip CompressionLinux Source Tree Archiving To .tar.gzproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebacktau-ceph-raw-nonetau-ceph-raw-writebacktau-nfs-qcow2-nonetau-nfs-qcow2-writebacktau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-2x4corestau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-4cores-2tau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-writeback-512MBtau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-qcow2-writeback-swappiness0tau-nfs-raw-writebackuranus-ceph-raw-writebackuranus-nfs-qcow2-writebackuranus-nfs-qcow2-writeback-4cores70140210280350SE +/- 1.68, N = 6SE +/- 2.18, N = 6SE +/- 17.09, N = 6SE +/- 18.11, N = 6SE +/- 0.70, N = 3SE +/- 0.93, N = 3SE +/- 0.08, N = 3SE +/- 0.84, N = 3SE +/- 0.40, N = 3SE +/- 0.40, N = 3SE +/- 0.06, N = 3SE +/- 0.76, N = 3SE +/- 0.79, N = 5SE +/- 0.70, N = 3SE +/- 0.49, N = 3SE +/- 0.29, N = 3SE +/- 11.87, N = 6SE +/- 1.71, N = 6SE +/- 1.81, N = 664.7364.85293.42224.7857.3351.3050.7351.2647.8448.8751.2551.0652.3355.6451.2151.53305.6374.5162.58

Phoronix Test Suite v10.8.5