machine learning

AMD Ryzen 9 3900X 12-Core testing with a MSI X570-A PRO (MS-7C37) v3.0 (H.70 BIOS) and NVIDIA GeForce RTX 3060 12GB on Ubuntu 23.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2404287-VPA1-DESKTOP70
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Limit displaying results to tests within:

CPU Massive 2 Tests
HPC - High Performance Computing 4 Tests
Machine Learning 3 Tests
Programmer / Developer System Benchmarks 2 Tests
Python 5 Tests
Server CPU Tests 3 Tests
Single-Threaded 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
mantic
February 23
  15 Hours, 54 Minutes
mantic-no-omit-framepointer
February 24
  19 Hours, 11 Minutes
Invert Hiding All Results Option
  17 Hours, 32 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


machine learningOpenBenchmarking.orgPhoronix Test SuiteAMD Ryzen 9 3900X 12-Core @ 3.80GHz (12 Cores / 24 Threads)MSI X570-A PRO (MS-7C37) v3.0 (H.70 BIOS)AMD Starship/Matisse2 x 16GB DDR4-3200MT/s F4-3200C16-16GVK2000GB Seagate ST2000DM006-2DM1 + 2000GB Western Digital WD20EZAZ-00G + 500GB Samsung SSD 860 + 8002GB Seagate ST8000DM004-2CX1 + 1000GB CT1000BX500SSD1 + 512GB TS512GESD310CNVIDIA GeForce RTX 3060 12GBNVIDIA GeForce RTX 3060NVIDIA GA104 HD AudioDELL P2314HRealtek RTL8111/8168/8411Ubuntu 23.106.5.0-9-generic (x86_64)X Server 1.21.1.7NVIDIAOpenCL 3.0 CUDA 12.2.146GCC 13.2.0 + CUDA 12.2ext41920x1080ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDisplay ServerDisplay DriverOpenCLCompilerFile-SystemScreen ResolutionMachine Learning BenchmarksSystem Logs- Transparent Huge Pages: madvise- mantic: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - mantic-no-omit-framepointer: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-b9QCDx/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-b9QCDx/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0x8701013- Python 3.11.6- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT enabled with STIBP protection + spec_rstack_overflow: Mitigation of safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - mantic-no-omit-framepointer: CXXFLAGS=-fno-omit-frame-pointer QMAKE_CFLAGS=-fno-omit-frame-pointer CFLAGS=-fno-omit-frame-pointer CFLAGS_OVERRIDE=-fno-omit-frame-pointer QMAKE_CXXFLAGS=-fno-omit-frame-pointer FFLAGS=-fno-omit-frame-pointer

mantic vs. mantic-no-omit-framepointer ComparisonPhoronix Test SuiteBaseline+12.5%+12.5%+25%+25%+37.5%+37.5%50%12.5%12.5%6.9%5.2%3.7%2.6%2.3%2.3%2%GPU - Numpy - 16384 - Equation of StateIsolation Forest16.2%CPU - Numpy - 16384 - Isoneutral MixingGPU - Numpy - 16384 - Isoneutral MixingTree9.6%NVIDIA CUDA GPU - 16 - Efficientnet_v2_l7.9%GPU - Numpy - 262144 - Equation of Statejson_loads6.7%LocalOutlierFactor6.2%NVIDIA CUDA GPU - 1 - Efficientnet_v2_l5.5%CPU - Numpy - 262144 - Equation of StateText Vectorizers5%raytrace4.6%Plot Neighborsdjango_template3.5%regex_compile3.4%S.R.P.1.I2.9%NVIDIA CUDA GPU - 64 - ResNet-152pathlib2.5%GPU - Numpy - 262144 - Isoneutral Mixingcrypto_pyaes2.3%NVIDIA CUDA GPU - 1 - ResNet-1522.3%NVIDIA CUDA GPU - 64 - ResNet-50I.P.L2.2%H.G.B.A2.1%NVIDIA CUDA GPU - 256 - Efficientnet_v2_l2.1%T.F.A.T.T2.1%S.W.R2%NVIDIA CUDA GPU - 512 - ResNet-152PyHPC BenchmarksScikit-LearnPyHPC BenchmarksPyHPC BenchmarksScikit-LearnPyTorchPyHPC BenchmarksPyPerformanceScikit-LearnPyTorchPyHPC BenchmarksScikit-LearnPyPerformanceScikit-LearnPyPerformancePyPerformanceScikit-LearnPyTorchPyPerformancePyHPC BenchmarksPyPerformancePyTorchPyTorchScikit-LearnScikit-LearnPyTorchPyBenchScikit-LearnPyTorchmanticmantic-no-omit-framepointer

machine learningnumpy: pytorch: CPU - 1 - ResNet-50pytorch: CPU - 1 - ResNet-152pytorch: CPU - 16 - ResNet-50pytorch: CPU - 32 - ResNet-50pytorch: CPU - 64 - ResNet-50pytorch: CPU - 16 - ResNet-152pytorch: CPU - 256 - ResNet-50pytorch: CPU - 32 - ResNet-152pytorch: CPU - 512 - ResNet-50pytorch: CPU - 64 - ResNet-152pytorch: CPU - 256 - ResNet-152pytorch: CPU - 512 - ResNet-152pytorch: CPU - 1 - Efficientnet_v2_lpytorch: CPU - 16 - Efficientnet_v2_lpytorch: CPU - 32 - Efficientnet_v2_lpytorch: CPU - 64 - Efficientnet_v2_lpytorch: CPU - 256 - Efficientnet_v2_lpytorch: CPU - 512 - Efficientnet_v2_lpytorch: NVIDIA CUDA GPU - 1 - ResNet-50pytorch: NVIDIA CUDA GPU - 1 - ResNet-152pytorch: NVIDIA CUDA GPU - 16 - ResNet-50pytorch: NVIDIA CUDA GPU - 32 - ResNet-50pytorch: NVIDIA CUDA GPU - 64 - ResNet-50pytorch: NVIDIA CUDA GPU - 16 - ResNet-152pytorch: NVIDIA CUDA GPU - 256 - ResNet-50pytorch: NVIDIA CUDA GPU - 32 - ResNet-152pytorch: NVIDIA CUDA GPU - 512 - ResNet-50pytorch: NVIDIA CUDA GPU - 64 - ResNet-152pytorch: NVIDIA CUDA GPU - 256 - ResNet-152pytorch: NVIDIA CUDA GPU - 512 - ResNet-152pytorch: NVIDIA CUDA GPU - 1 - Efficientnet_v2_lpytorch: NVIDIA CUDA GPU - 16 - Efficientnet_v2_lpytorch: NVIDIA CUDA GPU - 32 - Efficientnet_v2_lpytorch: NVIDIA CUDA GPU - 64 - Efficientnet_v2_lpytorch: NVIDIA CUDA GPU - 256 - Efficientnet_v2_lpytorch: NVIDIA CUDA GPU - 512 - Efficientnet_v2_lpybench: Total For Average Test Timespyperformance: gopyperformance: 2to3pyperformance: chaospyperformance: floatpyperformance: nbodypyperformance: pathlibpyperformance: raytracepyperformance: json_loadspyperformance: crypto_pyaespyperformance: regex_compilepyperformance: python_startuppyperformance: django_templatepyperformance: pickle_pure_pythonpyhpc: CPU - Numpy - 16384 - Equation of Statepyhpc: CPU - Numpy - 16384 - Isoneutral Mixingpyhpc: CPU - Numpy - 65536 - Equation of Statepyhpc: CPU - Numpy - 65536 - Isoneutral Mixingpyhpc: GPU - Numpy - 16384 - Equation of Statepyhpc: GPU - Numpy - 16384 - Isoneutral Mixingpyhpc: GPU - Numpy - 65536 - Equation of Statepyhpc: GPU - Numpy - 65536 - Isoneutral Mixingpyhpc: CPU - Numpy - 262144 - Equation of Statepyhpc: CPU - Numpy - 262144 - Isoneutral Mixingpyhpc: GPU - Numpy - 262144 - Equation of Statepyhpc: GPU - Numpy - 262144 - Isoneutral Mixingpyhpc: CPU - Numpy - 1048576 - Equation of Statepyhpc: CPU - Numpy - 1048576 - Isoneutral Mixingpyhpc: CPU - Numpy - 4194304 - Equation of Statepyhpc: CPU - Numpy - 4194304 - Isoneutral Mixingpyhpc: GPU - Numpy - 1048576 - Equation of Statepyhpc: GPU - Numpy - 1048576 - Isoneutral Mixingpyhpc: GPU - Numpy - 4194304 - Equation of Statepyhpc: GPU - Numpy - 4194304 - Isoneutral Mixingscikit-learn: GLMscikit-learn: SAGAscikit-learn: Treescikit-learn: Lassoscikit-learn: Sparsifyscikit-learn: Plot Wardscikit-learn: MNIST Datasetscikit-learn: Plot Neighborsscikit-learn: SGD Regressionscikit-learn: SGDOneClassSVMscikit-learn: Isolation Forestscikit-learn: Text Vectorizersscikit-learn: Plot Hierarchicalscikit-learn: Plot OMP vs. LARSscikit-learn: Feature Expansionsscikit-learn: LocalOutlierFactorscikit-learn: TSNE MNIST Datasetscikit-learn: Isotonic / Logisticscikit-learn: Plot Incremental PCAscikit-learn: Hist Gradient Boostingscikit-learn: Sample Without Replacementscikit-learn: Covertype Dataset Benchmarkscikit-learn: Hist Gradient Boosting Adultscikit-learn: Isotonic / Perturbed Logarithmscikit-learn: Hist Gradient Boosting Threadingscikit-learn: 20 Newsgroups / Logistic Regressionscikit-learn: Plot Polynomial Kernel Approximationscikit-learn: Hist Gradient Boosting Categorical Onlyscikit-learn: Kernel PCA Solvers / Time vs. N Samplesscikit-learn: Kernel PCA Solvers / Time vs. N Componentsscikit-learn: Sparse Rand Projections / 100 Iterationsscikit-learn: Plot Singular Value Decompositionmanticmantic-no-omit-framepointer426.2832.3612.7224.2824.2924.249.8824.429.8424.139.889.779.877.315.635.635.625.615.61210.8873.91200.30199.46201.4173.01202.7274.15203.1871.8171.7472.3139.3538.9537.7137.8837.3637.4377412922162.867.476.219.726219.565.11167.6128.52590.0030.0090.0150.0320.0030.0090.0150.0330.0610.1310.0620.1310.2630.6191.4022.6700.2630.6311.4222.662293.598868.01848.338511.848127.28257.82465.763147.752106.315379.739289.37160.814211.28691.499131.27753.464236.8651470.80631.006109.984158.262376.145103.4971788.259110.21541.519150.73218.57972.54137.242613.547428.6132.5412.7824.3824.3524.409.9324.3710.0024.289.919.919.807.325.645.645.655.645.65211.4672.27200.17202.68205.9572.24203.2273.36201.1473.6572.9173.7537.2936.1037.1637.2436.6037.2279013122463.666.977.120.227420.866.61207.6429.52630.0030.0080.0150.0320.0020.0080.0150.0330.0580.1320.0580.1280.2620.6181.4052.6260.2600.6221.4112.620295.096873.82252.969509.537125.44257.54565.877142.451107.527382.611336.37263.875208.39192.582133.09256.754236.7861471.83431.057111.255161.460370.694105.6471828.300110.37441.728150.37618.86572.90937.889631.071OpenBenchmarking.org

Numpy Benchmark

This is a test to obtain the general Numpy performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgScore, More Is BetterNumpy Benchmarkmantic-no-omit-framepointermantic90180270360450SE +/- 0.90, N = 3SE +/- 1.20, N = 3428.61426.28

PyTorch

This is a benchmark of PyTorch making use of pytorch-benchmark [https://github.com/LukasHedegaard/pytorch-benchmark]. Currently this test profile is catered to CPU-based testing. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: ResNet-50mantic-no-omit-framepointermantic816243240SE +/- 0.16, N = 3SE +/- 0.11, N = 332.5432.36MIN: 31.64 / MAX: 32.94MIN: 31.89 / MAX: 32.7

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: ResNet-152mantic-no-omit-framepointermantic3691215SE +/- 0.04, N = 3SE +/- 0.03, N = 312.7812.72MIN: 11.9 / MAX: 12.9MIN: 11.99 / MAX: 12.8

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 16 - Model: ResNet-50mantic-no-omit-framepointermantic612182430SE +/- 0.16, N = 3SE +/- 0.05, N = 324.3824.28MIN: 22.2 / MAX: 24.87MIN: 20.22 / MAX: 24.56

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 32 - Model: ResNet-50mantic-no-omit-framepointermantic612182430SE +/- 0.16, N = 3SE +/- 0.10, N = 324.3524.29MIN: 23.67 / MAX: 24.87MIN: 22.24 / MAX: 24.66

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: ResNet-50mantic-no-omit-framepointermantic612182430SE +/- 0.15, N = 3SE +/- 0.04, N = 324.4024.24MIN: 21.6 / MAX: 24.8MIN: 23.59 / MAX: 24.49

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 16 - Model: ResNet-152mantic-no-omit-framepointermantic3691215SE +/- 0.01, N = 3SE +/- 0.04, N = 39.939.88MIN: 9.39 / MAX: 10.01MIN: 9.31 / MAX: 10.01

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 256 - Model: ResNet-50mantic-no-omit-framepointermantic612182430SE +/- 0.11, N = 3SE +/- 0.03, N = 324.3724.42MIN: 23.76 / MAX: 24.81MIN: 20.15 / MAX: 24.74

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 32 - Model: ResNet-152mantic-no-omit-framepointermantic3691215SE +/- 0.09, N = 3SE +/- 0.05, N = 310.009.84MIN: 8.09 / MAX: 10.27MIN: 9.6 / MAX: 9.98

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 512 - Model: ResNet-50mantic-no-omit-framepointermantic612182430SE +/- 0.08, N = 3SE +/- 0.02, N = 324.2824.13MIN: 22.31 / MAX: 24.53MIN: 23.58 / MAX: 24.41

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: ResNet-152mantic-no-omit-framepointermantic3691215SE +/- 0.02, N = 3SE +/- 0.03, N = 39.919.88MIN: 8.69 / MAX: 10.08MIN: 8.8 / MAX: 9.98

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 256 - Model: ResNet-152mantic-no-omit-framepointermantic3691215SE +/- 0.04, N = 3SE +/- 0.07, N = 39.919.77MIN: 9.19 / MAX: 10.05MIN: 9.17 / MAX: 10

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 512 - Model: ResNet-152mantic-no-omit-framepointermantic3691215SE +/- 0.07, N = 3SE +/- 0.02, N = 39.809.87MIN: 9.12 / MAX: 9.98MIN: 9.09 / MAX: 9.96

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_lmantic-no-omit-framepointermantic246810SE +/- 0.02, N = 3SE +/- 0.00, N = 37.327.31MIN: 7.23 / MAX: 7.38MIN: 7.16 / MAX: 7.34

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 16 - Model: Efficientnet_v2_lmantic-no-omit-framepointermantic1.2692.5383.8075.0766.345SE +/- 0.01, N = 3SE +/- 0.02, N = 35.645.63MIN: 5.45 / MAX: 5.68MIN: 5.39 / MAX: 5.71

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 32 - Model: Efficientnet_v2_lmantic-no-omit-framepointermantic1.2692.5383.8075.0766.345SE +/- 0.01, N = 3SE +/- 0.01, N = 35.645.63MIN: 5.52 / MAX: 5.69MIN: 5.31 / MAX: 5.68

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_lmantic-no-omit-framepointermantic1.27132.54263.81395.08526.3565SE +/- 0.01, N = 3SE +/- 0.01, N = 35.655.62MIN: 5.45 / MAX: 5.7MIN: 5.35 / MAX: 5.66

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 256 - Model: Efficientnet_v2_lmantic-no-omit-framepointermantic1.2692.5383.8075.0766.345SE +/- 0.01, N = 3SE +/- 0.02, N = 35.645.61MIN: 5.29 / MAX: 5.68MIN: 5.44 / MAX: 5.65

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 512 - Model: Efficientnet_v2_lmantic-no-omit-framepointermantic1.27132.54263.81395.08526.3565SE +/- 0.02, N = 3SE +/- 0.01, N = 35.655.61MIN: 5.36 / MAX: 5.93MIN: 5.45 / MAX: 5.66

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-50mantic-no-omit-framepointermantic50100150200250SE +/- 1.46, N = 15SE +/- 2.67, N = 3211.46210.88MIN: 192.13 / MAX: 223.01MIN: 195.21 / MAX: 218.16

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-152mantic-no-omit-framepointermantic1632486480SE +/- 0.96, N = 3SE +/- 0.56, N = 372.2773.91MIN: 68.86 / MAX: 76.62MIN: 68.9 / MAX: 75.9

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: ResNet-50mantic-no-omit-framepointermantic4080120160200SE +/- 0.96, N = 3SE +/- 0.25, N = 3200.17200.30MIN: 183.43 / MAX: 203.55MIN: 182.88 / MAX: 202.36

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: ResNet-50mantic-no-omit-framepointermantic4080120160200SE +/- 2.52, N = 4SE +/- 1.06, N = 3202.68199.46MIN: 182.69 / MAX: 211.53MIN: 182.77 / MAX: 206.03

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: ResNet-50mantic-no-omit-framepointermantic50100150200250SE +/- 1.98, N = 3SE +/- 0.58, N = 3205.95201.41MIN: 186.96 / MAX: 210.21MIN: 184.02 / MAX: 203.68

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: ResNet-152mantic-no-omit-framepointermantic1632486480SE +/- 0.20, N = 3SE +/- 0.96, N = 372.2473.01MIN: 68.36 / MAX: 73.14MIN: 68.06 / MAX: 75.3

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: ResNet-50mantic-no-omit-framepointermantic4080120160200SE +/- 1.21, N = 3SE +/- 1.76, N = 3203.22202.72MIN: 185.88 / MAX: 206.71MIN: 183.1 / MAX: 207.93

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: ResNet-152mantic-no-omit-framepointermantic1632486480SE +/- 0.74, N = 3SE +/- 0.96, N = 373.3674.15MIN: 68.19 / MAX: 74.63MIN: 68.27 / MAX: 75.61

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-50mantic-no-omit-framepointermantic4080120160200SE +/- 0.33, N = 3SE +/- 1.69, N = 3201.14203.18MIN: 183.61 / MAX: 202.73MIN: 183.76 / MAX: 207.98

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: ResNet-152mantic-no-omit-framepointermantic1632486480SE +/- 0.66, N = 3SE +/- 0.44, N = 373.6571.81MIN: 68.88 / MAX: 75.03MIN: 67.31 / MAX: 72.89

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: ResNet-152mantic-no-omit-framepointermantic1632486480SE +/- 0.83, N = 3SE +/- 0.24, N = 372.9171.74MIN: 68 / MAX: 75.45MIN: 67.87 / MAX: 72.6

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-152mantic-no-omit-framepointermantic1632486480SE +/- 0.50, N = 3SE +/- 0.94, N = 373.7572.31MIN: 68.91 / MAX: 75.15MIN: 67.38 / MAX: 74.62

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: Efficientnet_v2_lmantic-no-omit-framepointermantic918273645SE +/- 0.26, N = 3SE +/- 0.47, N = 337.2939.35MIN: 35.83 / MAX: 39.17MIN: 36.65 / MAX: 40.42

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: Efficientnet_v2_lmantic-no-omit-framepointermantic918273645SE +/- 0.02, N = 3SE +/- 0.08, N = 336.1038.95MIN: 34.25 / MAX: 38.01MIN: 37.12 / MAX: 39.27

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: Efficientnet_v2_lmantic-no-omit-framepointermantic918273645SE +/- 0.30, N = 15SE +/- 0.24, N = 337.1637.71MIN: 34.12 / MAX: 39.48MIN: 35.52 / MAX: 38.25

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: Efficientnet_v2_lmantic-no-omit-framepointermantic918273645SE +/- 0.31, N = 15SE +/- 0.30, N = 937.2437.88MIN: 33.97 / MAX: 39.43MIN: 35.67 / MAX: 39.63

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: Efficientnet_v2_lmantic-no-omit-framepointermantic918273645SE +/- 0.30, N = 15SE +/- 0.15, N = 336.6037.36MIN: 33.07 / MAX: 39.53MIN: 35.47 / MAX: 37.85

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: Efficientnet_v2_lmantic-no-omit-framepointermantic918273645SE +/- 0.33, N = 8SE +/- 0.03, N = 337.2237.43MIN: 34.99 / MAX: 39.08MIN: 35.81 / MAX: 38.02

PyBench

This test profile reports the total time of the different average timed test results from PyBench. PyBench reports average test times for different functions such as BuiltinFunctionCalls and NestedForLoops, with this total result providing a rough estimate as to Python's average performance on a given system. This test profile runs PyBench each time for 20 rounds. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyBench 2018-02-16Total For Average Test Timesmantic-no-omit-framepointermantic2004006008001000SE +/- 1.20, N = 3SE +/- 1.00, N = 3790774

PyPerformance

PyPerformance is the reference Python performance benchmark suite. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.0.0Benchmark: gomantic-no-omit-framepointermantic306090120150SE +/- 0.33, N = 3SE +/- 0.00, N = 3131129

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.0.0Benchmark: 2to3mantic-no-omit-framepointermantic50100150200250SE +/- 0.33, N = 3SE +/- 0.00, N = 3224221

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.0.0Benchmark: chaosmantic-no-omit-framepointermantic1428425670SE +/- 0.20, N = 3SE +/- 0.03, N = 363.662.8

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.0.0Benchmark: floatmantic-no-omit-framepointermantic1530456075SE +/- 0.10, N = 3SE +/- 0.03, N = 366.967.4

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.0.0Benchmark: nbodymantic-no-omit-framepointermantic20406080100SE +/- 0.07, N = 3SE +/- 0.06, N = 377.176.2

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.0.0Benchmark: pathlibmantic-no-omit-framepointermantic510152025SE +/- 0.00, N = 3SE +/- 0.00, N = 320.219.7

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.0.0Benchmark: raytracemantic-no-omit-framepointermantic60120180240300SE +/- 0.33, N = 3SE +/- 0.33, N = 3274262

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.0.0Benchmark: json_loadsmantic-no-omit-framepointermantic510152025SE +/- 0.03, N = 3SE +/- 0.06, N = 320.819.5

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.0.0Benchmark: crypto_pyaesmantic-no-omit-framepointermantic1530456075SE +/- 0.00, N = 3SE +/- 0.06, N = 366.665.1

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.0.0Benchmark: regex_compilemantic-no-omit-framepointermantic306090120150SE +/- 0.33, N = 3SE +/- 0.00, N = 3120116

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.0.0Benchmark: python_startupmantic-no-omit-framepointermantic246810SE +/- 0.01, N = 3SE +/- 0.01, N = 37.647.61

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.0.0Benchmark: django_templatemantic-no-omit-framepointermantic714212835SE +/- 0.06, N = 3SE +/- 0.03, N = 329.528.5

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.0.0Benchmark: pickle_pure_pythonmantic-no-omit-framepointermantic60120180240300SE +/- 0.58, N = 3SE +/- 0.33, N = 3263259

PyHPC Benchmarks

PyHPC-Benchmarks is a suite of Python high performance computing benchmarks for execution on CPUs and GPUs using various popular Python HPC libraries. The PyHPC CPU-based benchmarks focus on sequential CPU performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numpy - Project Size: 16384 - Benchmark: Equation of Statemantic-no-omit-framepointermantic0.00070.00140.00210.00280.0035SE +/- 0.000, N = 3SE +/- 0.000, N = 30.0030.003

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numpy - Project Size: 16384 - Benchmark: Isoneutral Mixingmantic-no-omit-framepointermantic0.0020.0040.0060.0080.01SE +/- 0.000, N = 3SE +/- 0.000, N = 30.0080.009

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numpy - Project Size: 65536 - Benchmark: Equation of Statemantic-no-omit-framepointermantic0.00340.00680.01020.01360.017SE +/- 0.000, N = 3SE +/- 0.000, N = 30.0150.015

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numpy - Project Size: 65536 - Benchmark: Isoneutral Mixingmantic-no-omit-framepointermantic0.00720.01440.02160.02880.036SE +/- 0.000, N = 3SE +/- 0.000, N = 30.0320.032

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: GPU - Backend: Numpy - Project Size: 16384 - Benchmark: Equation of Statemantic-no-omit-framepointermantic0.00070.00140.00210.00280.0035SE +/- 0.000, N = 15SE +/- 0.000, N = 30.0020.003

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: GPU - Backend: Numpy - Project Size: 16384 - Benchmark: Isoneutral Mixingmantic-no-omit-framepointermantic0.0020.0040.0060.0080.01SE +/- 0.000, N = 3SE +/- 0.000, N = 30.0080.009

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: GPU - Backend: Numpy - Project Size: 65536 - Benchmark: Equation of Statemantic-no-omit-framepointermantic0.00340.00680.01020.01360.017SE +/- 0.000, N = 3SE +/- 0.000, N = 30.0150.015

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: GPU - Backend: Numpy - Project Size: 65536 - Benchmark: Isoneutral Mixingmantic-no-omit-framepointermantic0.00740.01480.02220.02960.037SE +/- 0.000, N = 3SE +/- 0.000, N = 30.0330.033

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numpy - Project Size: 262144 - Benchmark: Equation of Statemantic-no-omit-framepointermantic0.01370.02740.04110.05480.0685SE +/- 0.000, N = 3SE +/- 0.001, N = 30.0580.061

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numpy - Project Size: 262144 - Benchmark: Isoneutral Mixingmantic-no-omit-framepointermantic0.02970.05940.08910.11880.1485SE +/- 0.000, N = 3SE +/- 0.001, N = 30.1320.131

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: GPU - Backend: Numpy - Project Size: 262144 - Benchmark: Equation of Statemantic-no-omit-framepointermantic0.0140.0280.0420.0560.07SE +/- 0.000, N = 3SE +/- 0.001, N = 30.0580.062

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: GPU - Backend: Numpy - Project Size: 262144 - Benchmark: Isoneutral Mixingmantic-no-omit-framepointermantic0.02950.0590.08850.1180.1475SE +/- 0.001, N = 3SE +/- 0.000, N = 30.1280.131

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numpy - Project Size: 1048576 - Benchmark: Equation of Statemantic-no-omit-framepointermantic0.05920.11840.17760.23680.296SE +/- 0.000, N = 3SE +/- 0.002, N = 30.2620.263

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numpy - Project Size: 1048576 - Benchmark: Isoneutral Mixingmantic-no-omit-framepointermantic0.13930.27860.41790.55720.6965SE +/- 0.000, N = 3SE +/- 0.001, N = 30.6180.619

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numpy - Project Size: 4194304 - Benchmark: Equation of Statemantic-no-omit-framepointermantic0.31610.63220.94831.26441.5805SE +/- 0.004, N = 3SE +/- 0.003, N = 31.4051.402

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numpy - Project Size: 4194304 - Benchmark: Isoneutral Mixingmantic-no-omit-framepointermantic0.60081.20161.80242.40323.004SE +/- 0.002, N = 3SE +/- 0.010, N = 32.6262.670

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: GPU - Backend: Numpy - Project Size: 1048576 - Benchmark: Equation of Statemantic-no-omit-framepointermantic0.05920.11840.17760.23680.296SE +/- 0.001, N = 3SE +/- 0.002, N = 30.2600.263

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: GPU - Backend: Numpy - Project Size: 1048576 - Benchmark: Isoneutral Mixingmantic-no-omit-framepointermantic0.1420.2840.4260.5680.71SE +/- 0.007, N = 3SE +/- 0.002, N = 30.6220.631

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: GPU - Backend: Numpy - Project Size: 4194304 - Benchmark: Equation of Statemantic-no-omit-framepointermantic0.320.640.961.281.6SE +/- 0.001, N = 3SE +/- 0.004, N = 31.4111.422

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: GPU - Backend: Numpy - Project Size: 4194304 - Benchmark: Isoneutral Mixingmantic-no-omit-framepointermantic0.5991.1981.7972.3962.995SE +/- 0.006, N = 3SE +/- 0.006, N = 32.6202.662

Scikit-Learn

Scikit-learn is a Python module for machine learning built on NumPy, SciPy, and is BSD-licensed. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: GLMmantic-no-omit-framepointermantic60120180240300SE +/- 1.07, N = 3SE +/- 1.06, N = 3295.10293.601. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: SAGAmantic-no-omit-framepointermantic2004006008001000SE +/- 5.60, N = 3SE +/- 8.69, N = 6873.82868.021. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Treemantic-no-omit-framepointermantic1224364860SE +/- 0.48, N = 15SE +/- 0.59, N = 452.9748.341. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Lassomantic-no-omit-framepointermantic110220330440550SE +/- 3.50, N = 3SE +/- 3.22, N = 3509.54511.851. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Sparsifymantic-no-omit-framepointermantic306090120150SE +/- 1.28, N = 5SE +/- 1.36, N = 5125.44127.281. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Plot Wardmantic-no-omit-framepointermantic1326395265SE +/- 0.22, N = 3SE +/- 0.21, N = 357.5557.821. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: MNIST Datasetmantic-no-omit-framepointermantic1530456075SE +/- 0.47, N = 3SE +/- 0.82, N = 465.8865.761. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Plot Neighborsmantic-no-omit-framepointermantic306090120150SE +/- 0.59, N = 3SE +/- 1.34, N = 7142.45147.751. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: SGD Regressionmantic-no-omit-framepointermantic20406080100SE +/- 0.49, N = 3SE +/- 1.06, N = 6107.53106.321. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: SGDOneClassSVMmantic-no-omit-framepointermantic80160240320400SE +/- 3.48, N = 7SE +/- 4.18, N = 3382.61379.741. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Isolation Forestmantic-no-omit-framepointermantic70140210280350SE +/- 51.04, N = 9SE +/- 1.30, N = 3336.37289.371. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Text Vectorizersmantic-no-omit-framepointermantic1428425670SE +/- 0.08, N = 3SE +/- 0.19, N = 363.8860.811. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Plot Hierarchicalmantic-no-omit-framepointermantic50100150200250SE +/- 0.42, N = 3SE +/- 0.75, N = 3208.39211.291. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Plot OMP vs. LARSmantic-no-omit-framepointermantic20406080100SE +/- 0.44, N = 3SE +/- 0.08, N = 392.5891.501. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Feature Expansionsmantic-no-omit-framepointermantic306090120150SE +/- 1.22, N = 3SE +/- 0.86, N = 3133.09131.281. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: LocalOutlierFactormantic-no-omit-framepointermantic1326395265SE +/- 0.74, N = 15SE +/- 0.18, N = 356.7553.461. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: TSNE MNIST Datasetmantic-no-omit-framepointermantic50100150200250SE +/- 0.54, N = 3SE +/- 0.44, N = 3236.79236.871. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Isotonic / Logisticmantic-no-omit-framepointermantic30060090012001500SE +/- 14.46, N = 3SE +/- 12.29, N = 31471.831470.811. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Plot Incremental PCAmantic-no-omit-framepointermantic714212835SE +/- 0.07, N = 3SE +/- 0.03, N = 331.0631.011. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Hist Gradient Boostingmantic-no-omit-framepointermantic20406080100SE +/- 0.25, N = 3SE +/- 0.22, N = 3111.26109.981. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Sample Without Replacementmantic-no-omit-framepointermantic4080120160200SE +/- 0.62, N = 3SE +/- 0.60, N = 3161.46158.261. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Covertype Dataset Benchmarkmantic-no-omit-framepointermantic80160240320400SE +/- 3.40, N = 3SE +/- 4.88, N = 3370.69376.151. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Hist Gradient Boosting Adultmantic-no-omit-framepointermantic20406080100SE +/- 0.59, N = 3SE +/- 0.70, N = 3105.65103.501. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Isotonic / Perturbed Logarithmmantic-no-omit-framepointermantic400800120016002000SE +/- 16.46, N = 3SE +/- 24.41, N = 31828.301788.261. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Hist Gradient Boosting Threadingmantic-no-omit-framepointermantic20406080100SE +/- 0.15, N = 3SE +/- 0.13, N = 3110.37110.221. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: 20 Newsgroups / Logistic Regressionmantic-no-omit-framepointermantic1020304050SE +/- 0.24, N = 3SE +/- 0.19, N = 341.7341.521. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Plot Polynomial Kernel Approximationmantic-no-omit-framepointermantic306090120150SE +/- 1.20, N = 3SE +/- 1.22, N = 3150.38150.731. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Hist Gradient Boosting Categorical Onlymantic-no-omit-framepointermantic510152025SE +/- 0.12, N = 3SE +/- 0.06, N = 318.8718.581. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Kernel PCA Solvers / Time vs. N Samplesmantic-no-omit-framepointermantic1632486480SE +/- 0.16, N = 3SE +/- 0.05, N = 372.9172.541. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Kernel PCA Solvers / Time vs. N Componentsmantic-no-omit-framepointermantic918273645SE +/- 0.36, N = 3SE +/- 0.21, N = 337.8937.241. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Sparse Random Projections / 100 Iterationsmantic-no-omit-framepointermantic140280420560700SE +/- 7.06, N = 4SE +/- 3.80, N = 3631.07613.551. (F9X) gfortran options: -O0

PyHPC Benchmarks

PyHPC-Benchmarks is a suite of Python high performance computing benchmarks for execution on CPUs and GPUs using various popular Python HPC libraries. The PyHPC CPU-based benchmarks focus on sequential CPU performance. Learn more via the OpenBenchmarking.org test page.

Device: CPU - Backend: JAX - Project Size: 16384 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: JAX - Project Size: 16384 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: JAX - Project Size: 65536 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: JAX - Project Size: 65536 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: JAX - Project Size: 16384 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: JAX - Project Size: 16384 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: JAX - Project Size: 65536 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: JAX - Project Size: 65536 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: JAX - Project Size: 262144 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: JAX - Project Size: 262144 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: JAX - Project Size: 262144 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: JAX - Project Size: 262144 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: JAX - Project Size: 1048576 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: JAX - Project Size: 1048576 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: JAX - Project Size: 4194304 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: JAX - Project Size: 4194304 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Numba - Project Size: 16384 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Numba - Project Size: 16384 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Numba - Project Size: 65536 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Numba - Project Size: 65536 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: JAX - Project Size: 1048576 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: JAX - Project Size: 1048576 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: JAX - Project Size: 4194304 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: JAX - Project Size: 4194304 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Numba - Project Size: 16384 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Numba - Project Size: 16384 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Numba - Project Size: 65536 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Numba - Project Size: 65536 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Aesara - Project Size: 16384 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Aesara - Project Size: 16384 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Aesara - Project Size: 65536 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Aesara - Project Size: 65536 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Numba - Project Size: 262144 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Numba - Project Size: 262144 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Aesara - Project Size: 16384 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Aesara - Project Size: 16384 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Aesara - Project Size: 65536 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Aesara - Project Size: 65536 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Numba - Project Size: 262144 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Numba - Project Size: 262144 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Aesara - Project Size: 262144 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Aesara - Project Size: 262144 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Numba - Project Size: 1048576 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Numba - Project Size: 1048576 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Numba - Project Size: 4194304 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Numba - Project Size: 4194304 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: PyTorch - Project Size: 16384 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: PyTorch - Project Size: 16384 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: PyTorch - Project Size: 65536 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: PyTorch - Project Size: 65536 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Aesara - Project Size: 262144 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Aesara - Project Size: 262144 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Numba - Project Size: 1048576 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Numba - Project Size: 1048576 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Numba - Project Size: 4194304 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Numba - Project Size: 4194304 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: PyTorch - Project Size: 16384 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: PyTorch - Project Size: 16384 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: PyTorch - Project Size: 65536 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: PyTorch - Project Size: 65536 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Aesara - Project Size: 1048576 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Aesara - Project Size: 1048576 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Aesara - Project Size: 4194304 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Aesara - Project Size: 4194304 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: PyTorch - Project Size: 262144 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: PyTorch - Project Size: 262144 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Aesara - Project Size: 1048576 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Aesara - Project Size: 1048576 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Aesara - Project Size: 4194304 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Aesara - Project Size: 4194304 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: PyTorch - Project Size: 262144 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: PyTorch - Project Size: 262144 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: PyTorch - Project Size: 1048576 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: PyTorch - Project Size: 1048576 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: PyTorch - Project Size: 4194304 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: PyTorch - Project Size: 4194304 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: PyTorch - Project Size: 1048576 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: PyTorch - Project Size: 1048576 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: PyTorch - Project Size: 4194304 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: PyTorch - Project Size: 4194304 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: TensorFlow - Project Size: 16384 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: TensorFlow - Project Size: 16384 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: TensorFlow - Project Size: 65536 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: TensorFlow - Project Size: 65536 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: TensorFlow - Project Size: 16384 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: TensorFlow - Project Size: 16384 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: TensorFlow - Project Size: 65536 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: TensorFlow - Project Size: 65536 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: TensorFlow - Project Size: 262144 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: TensorFlow - Project Size: 262144 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: TensorFlow - Project Size: 262144 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: TensorFlow - Project Size: 262144 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: TensorFlow - Project Size: 1048576 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: TensorFlow - Project Size: 1048576 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: TensorFlow - Project Size: 4194304 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: TensorFlow - Project Size: 4194304 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: TensorFlow - Project Size: 1048576 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: TensorFlow - Project Size: 1048576 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: TensorFlow - Project Size: 4194304 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: TensorFlow - Project Size: 4194304 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Scikit-Learn

Scikit-learn is a Python module for machine learning built on NumPy, SciPy, and is BSD-licensed. Learn more via the OpenBenchmarking.org test page.

Benchmark: Glmnet

mantic-no-omit-framepointer: The test quit with a non-zero exit status. E: ModuleNotFoundError: No module named 'glmnet'

Benchmark: Plot Lasso Path

mantic-no-omit-framepointer: The test quit with a non-zero exit status. E: AttributeError: type object 'Axis' has no attribute '_set_ticklabels'. Did you mean: 'set_ticklabels'?

Benchmark: Plot Fast KMeans

mantic-no-omit-framepointer: The test quit with a non-zero exit status. E: AttributeError: type object 'Axis' has no attribute '_set_ticklabels'. Did you mean: 'set_ticklabels'?

Benchmark: Plot Parallel Pairwise

mantic-no-omit-framepointer: The test quit with a non-zero exit status. E: numpy.core._exceptions._ArrayMemoryError: Unable to allocate 74.5 GiB for an array with shape (100000, 100000) and data type float64

Benchmark: Isotonic / Pathological

mantic-no-omit-framepointer: The test quit with a non-zero exit status.

Benchmark: RCV1 Logreg Convergencet

mantic-no-omit-framepointer: The test quit with a non-zero exit status. E: IndexError: list index out of range

Benchmark: Plot Singular Value Decomposition

mantic-no-omit-framepointer: The test quit with a non-zero exit status. E: AttributeError: type object 'Axis' has no attribute '_set_ticklabels'. Did you mean: 'set_ticklabels'?

102 Results Shown

Numpy Benchmark
PyTorch:
  CPU - 1 - ResNet-50
  CPU - 1 - ResNet-152
  CPU - 16 - ResNet-50
  CPU - 32 - ResNet-50
  CPU - 64 - ResNet-50
  CPU - 16 - ResNet-152
  CPU - 256 - ResNet-50
  CPU - 32 - ResNet-152
  CPU - 512 - ResNet-50
  CPU - 64 - ResNet-152
  CPU - 256 - ResNet-152
  CPU - 512 - ResNet-152
  CPU - 1 - Efficientnet_v2_l
  CPU - 16 - Efficientnet_v2_l
  CPU - 32 - Efficientnet_v2_l
  CPU - 64 - Efficientnet_v2_l
  CPU - 256 - Efficientnet_v2_l
  CPU - 512 - Efficientnet_v2_l
  NVIDIA CUDA GPU - 1 - ResNet-50
  NVIDIA CUDA GPU - 1 - ResNet-152
  NVIDIA CUDA GPU - 16 - ResNet-50
  NVIDIA CUDA GPU - 32 - ResNet-50
  NVIDIA CUDA GPU - 64 - ResNet-50
  NVIDIA CUDA GPU - 16 - ResNet-152
  NVIDIA CUDA GPU - 256 - ResNet-50
  NVIDIA CUDA GPU - 32 - ResNet-152
  NVIDIA CUDA GPU - 512 - ResNet-50
  NVIDIA CUDA GPU - 64 - ResNet-152
  NVIDIA CUDA GPU - 256 - ResNet-152
  NVIDIA CUDA GPU - 512 - ResNet-152
  NVIDIA CUDA GPU - 1 - Efficientnet_v2_l
  NVIDIA CUDA GPU - 16 - Efficientnet_v2_l
  NVIDIA CUDA GPU - 32 - Efficientnet_v2_l
  NVIDIA CUDA GPU - 64 - Efficientnet_v2_l
  NVIDIA CUDA GPU - 256 - Efficientnet_v2_l
  NVIDIA CUDA GPU - 512 - Efficientnet_v2_l
PyBench
PyPerformance:
  go
  2to3
  chaos
  float
  nbody
  pathlib
  raytrace
  json_loads
  crypto_pyaes
  regex_compile
  python_startup
  django_template
  pickle_pure_python
PyHPC Benchmarks:
  CPU - Numpy - 16384 - Equation of State
  CPU - Numpy - 16384 - Isoneutral Mixing
  CPU - Numpy - 65536 - Equation of State
  CPU - Numpy - 65536 - Isoneutral Mixing
  GPU - Numpy - 16384 - Equation of State
  GPU - Numpy - 16384 - Isoneutral Mixing
  GPU - Numpy - 65536 - Equation of State
  GPU - Numpy - 65536 - Isoneutral Mixing
  CPU - Numpy - 262144 - Equation of State
  CPU - Numpy - 262144 - Isoneutral Mixing
  GPU - Numpy - 262144 - Equation of State
  GPU - Numpy - 262144 - Isoneutral Mixing
  CPU - Numpy - 1048576 - Equation of State
  CPU - Numpy - 1048576 - Isoneutral Mixing
  CPU - Numpy - 4194304 - Equation of State
  CPU - Numpy - 4194304 - Isoneutral Mixing
  GPU - Numpy - 1048576 - Equation of State
  GPU - Numpy - 1048576 - Isoneutral Mixing
  GPU - Numpy - 4194304 - Equation of State
  GPU - Numpy - 4194304 - Isoneutral Mixing
Scikit-Learn:
  GLM
  SAGA
  Tree
  Lasso
  Sparsify
  Plot Ward
  MNIST Dataset
  Plot Neighbors
  SGD Regression
  SGDOneClassSVM
  Isolation Forest
  Text Vectorizers
  Plot Hierarchical
  Plot OMP vs. LARS
  Feature Expansions
  LocalOutlierFactor
  TSNE MNIST Dataset
  Isotonic / Logistic
  Plot Incremental PCA
  Hist Gradient Boosting
  Sample Without Replacement
  Covertype Dataset Benchmark
  Hist Gradient Boosting Adult
  Isotonic / Perturbed Logarithm
  Hist Gradient Boosting Threading
  20 Newsgroups / Logistic Regression
  Plot Polynomial Kernel Approximation
  Hist Gradient Boosting Categorical Only
  Kernel PCA Solvers / Time vs. N Samples
  Kernel PCA Solvers / Time vs. N Components
  Sparse Rand Projections / 100 Iterations