PyBench

This test profile reports the total time of the different average timed test results from PyBench. PyBench reports average test times for different functions such as BuiltinFunctionCalls and NestedForLoops, with this total result providing a rough estimate as to Python's average performance on a given system. This test profile runs PyBench each time for 20 rounds.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark pybench.

Project Site

svn.python.org

Test Created

6 December 2010

Last Updated

17 January 2019

Test Maintainer

Michael Larabel 

Test Type

System

Average Install Time

2 Seconds

Average Run Time

2 Minutes, 52 Seconds

Test Dependencies

Python

Accolades

200k+ Downloads + 10k+ Public Benchmark Results

Supported Platforms


Public Result Uploads *Reported Test Completions **Reported Installs **Test Profile Page Views ***OpenBenchmarking.orgEventsPyBench Popularity Statisticspts/pybench2010.122011.052011.102012.032012.082013.012013.062013.112014.042014.092015.022015.072015.122016.052016.102017.032017.082018.012018.062018.112019.042019.092020.022020.072020.122021.052021.102022.032022.082023.012023.062023.112024.042024.0940K80K120K160K200K
* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
*** Test profile page view reporting began March 2021.
Data updated weekly as of 20 November 2024.

Revision History

pts/pybench-1.1.3   [View Source]   Thu, 17 Jan 2019 10:20:52 GMT
Windows test profile update for latest Python.

pts/pybench-1.1.2   [View Source]   Wed, 07 Mar 2018 11:49:45 GMT
Explicitly use the default Python 3 path on Windows to avoid python2 being picked up which no longer works with this test code.

pts/pybench-1.1.1   [View Source]   Fri, 02 Mar 2018 15:28:39 GMT
Windows support was refreshingly easy...

pts/pybench-1.1.0   [View Source]   Sun, 18 Feb 2018 15:46:36 GMT
Update PyBench to a Python3 port

pts/pybench-1.0.1   [View Source]   Thu, 15 Feb 2018 15:07:12 GMT
Be explicit about python2, don't use generic python call as this test will break when python is python3.

pts/pybench-1.0.0   [View Source]   Mon, 06 Dec 2010 15:19:25 GMT
Initial import into OpenBenchmarking.org

Suites Using This Test

Server CPU Tests

Python

Programmer / Developer System Benchmarks

Single-Threaded


Performance Metrics

Analyze Test Configuration:

PyBench 2018-02-16

Total For Average Test Times

OpenBenchmarking.org metrics for this test profile configuration based on 8,796 public results since 18 February 2018 with the latest data as of 13 November 2024.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Compatible Public Results
Milliseconds (Average)
100th
34
387 +/- 16
100th
10
402 +/- 1
100th
9
402 +/- 17
99th
5
428 +/- 30
99th
16
432 +/- 6
99th
45
444 +/- 35
99th
6
457 +/- 1
99th
11
457 +/- 4
98th
11
488 +/- 5
98th
8
492 +/- 1
98th
5
495 +/- 4
97th
18
504 +/- 27
96th
28
535 +/- 8
95th
7
545 +/- 40
95th
17
550 +/- 4
95th
4
551 +/- 3
94th
30
556 +/- 28
94th
4
560 +/- 22
94th
18
561 +/- 23
94th
38
564 +/- 37
94th
24
570 +/- 32
93rd
9
577 +/- 50
93rd
25
583 +/- 36
93rd
18
584 +/- 40
92nd
18
589 +/- 9
91st
14
602 +/- 29
91st
11
602 +/- 47
91st
13
605 +/- 64
91st
22
609 +/- 74
91st
5
615 +/- 21
91st
15
618 +/- 49
89th
10
659 +/- 1
88th
13
682 +/- 21
88th
38
689 +/- 71
88th
10
697 +/- 15
88th
5
701 +/- 56
87th
11
705 +/- 58
87th
9
707 +/- 3
87th
5
707 +/- 91
87th
4
721 +/- 5
86th
16
734 +/- 47
86th
13
738 +/- 65
85th
25
739 +/- 76
84th
77
754 +/- 58
84th
32
755 +/- 64
84th
74
759 +/- 102
83rd
18
770 +/- 41
83rd
120
773 +/- 112
82nd
15
797 +/- 56
82nd
14
798 +/- 39
81st
12
817 +/- 30
80th
4
830 +/- 41
80th
10
833 +/- 105
80th
11
840 +/- 3
78th
11
852 +/- 17
78th
10
855 +/- 21
78th
6
859 +/- 18
78th
18
865 +/- 99
77th
10
870 +/- 84
76th
71
890 +/- 125
Mid-Tier
75th
> 898
75th
30
899 +/- 112
75th
51
899 +/- 134
73rd
8
927 +/- 7
73rd
5
929 +/- 26
73rd
8
937 +/- 114
73rd
35
937 +/- 108
72nd
9
940 +/- 122
72nd
14
940 +/- 37
72nd
4
944 +/- 124
71st
13
958 +/- 38
71st
24
959 +/- 132
70th
5
962 +/- 11
69th
92
973 +/- 124
69th
21
976 +/- 61
69th
35
977 +/- 132
68th
10
985 +/- 11
67th
6
990 +/- 14
67th
6
991 +/- 28
67th
14
994 +/- 94
67th
20
998 +/- 22
66th
6
1008 +/- 9
66th
27
1010 +/- 86
65th
29
1013 +/- 58
65th
10
1014 +/- 67
65th
9
1014 +/- 83
65th
7
1014 +/- 119
65th
14
1014 +/- 13
65th
64
1017 +/- 115
64th
9
1019 +/- 22
64th
57
1021 +/- 141
64th
18
1023 +/- 4
63rd
7
1028 +/- 148
63rd
10
1036 +/- 35
63rd
6
1037 +/- 59
63rd
24
1039 +/- 28
62nd
4
1049 +/- 72
62nd
27
1050 +/- 154
62nd
6
1060 +/- 7
61st
13
1070 +/- 13
61st
5
1070 +/- 159
59th
4
1094 +/- 12
58th
4
1097 +/- 97
58th
5
1097 +/- 116
58th
11
1111 +/- 24
57th
4
1115 +/- 85
57th
9
1118 +/- 10
57th
5
1123 +/- 9
56th
6
1134 +/- 24
56th
28
1139 +/- 2
55th
13
1146 +/- 74
54th
6
1154 +/- 23
54th
5
1163 +/- 26
54th
30
1164 +/- 99
53rd
9
1166 +/- 146
52nd
5
1179 +/- 13
52nd
23
1179 +/- 11
52nd
12
1179 +/- 14
52nd
7
1181 +/- 18
52nd
12
1182 +/- 21
51st
13
1190 +/- 176
51st
10
1194 +/- 15
51st
4
1194 +/- 105
51st
10
1197 +/- 16
Median
50th
1197
50th
10
1198 +/- 47
50th
10
1199 +/- 13
50th
19
1206 +/- 2
49th
8
1208 +/- 14
49th
4
1214 +/- 18
49th
6
1216 +/- 12
48th
21
1225 +/- 35
48th
8
1225 +/- 20
48th
17
1229 +/- 28
47th
11
1231 +/- 15
47th
20
1235 +/- 142
47th
10
1236 +/- 21
47th
5
1241 +/- 141
47th
36
1243 +/- 153
47th
9
1247 +/- 66
46th
12
1256 +/- 125
46th
7
1257 +/- 84
46th
6
1261 +/- 5
44th
10
1295 +/- 178
44th
5
1299 +/- 42
43rd
5
1306 +/- 191
43rd
8
1310 +/- 174
43rd
8
1317 +/- 13
43rd
16
1322 +/- 125
43rd
8
1322 +/- 72
42nd
9
1328 +/- 43
42nd
21
1330 +/- 7
41st
29
1348 +/- 33
41st
7
1354 +/- 179
41st
13
1367 +/- 84
40th
5
1381 +/- 3
39th
20
1404 +/- 36
39th
10
1411 +/- 189
38th
20
1423 +/- 132
38th
17
1440 +/- 174
38th
10
1442 +/- 186
37th
9
1449 +/- 144
37th
5
1461 +/- 166
36th
18
1471 +/- 4
36th
7
1476 +/- 102
36th
13
1477 +/- 167
35th
5
1494 +/- 16
35th
4
1494 +/- 3
35th
4
1501 +/- 22
35th
7
1503 +/- 58
34th
6
1520 +/- 120
34th
9
1529 +/- 77
34th
35
1535 +/- 178
34th
8
1544 +/- 194
32nd
47
1589 +/- 214
32nd
6
1613 +/- 187
31st
5
1622 +/- 58
31st
20
1634 +/- 200
30th
24
1658 +/- 179
30th
14
1665 +/- 196
30th
7
1674 +/- 209
29th
7
1715 +/- 173
29th
5
1719 +/- 30
28th
6
1729 +/- 214
28th
5
1743 +/- 124
27th
5
1773 +/- 167
27th
5
1774 +/- 70
26th
6
1813 +/- 78
26th
5
1830 +/- 78
Low-Tier
25th
> 1849
25th
5
1861 +/- 215
25th
8
1909 +/- 145
23rd
13
2054 +/- 244
22nd
5
2058 +/- 142
22nd
5
2129 +/- 11
21st
4
2149 +/- 4
21st
12
2211 +/- 5
21st
6
2223 +/- 201
20th
8
2293 +/- 236
19th
4
2364 +/- 302
19th
4
2369 +/- 312
19th
5
2402 +/- 183
19th
4
2445 +/- 353
19th
4
2472 +/- 44
18th
4
2519 +/- 349
18th
21
2600 +/- 63
18th
5
2605 +/- 214
17th
7
2620 +/- 5
17th
10
2620 +/- 335
16th
8
2834 +/- 26
14th
6
3497 +/- 426
14th
4
3515 +/- 231
14th
9
3534 +/- 11
13th
14
3918 +/- 355
13th
19
3995 +/- 483
12th
5
4143 +/- 427
12th
8
4348 +/- 461
11th
5
4566 +/- 30
10th
5
4798 +/- 140
10th
92
4808 +/- 638
10th
7
4859 +/- 515
10th
4
4953 +/- 40
9th
38
5088 +/- 416
9th
16
5107 +/- 293
9th
6
5185 +/- 262
7th
4
6280 +/- 12
6th
6
6614 +/- 747
6th
9
6748 +/- 285
6th
8
6749 +/- 158
6th
20
6862 +/- 301
6th
13
7000 +/- 700
6th
4
7026 +/- 608
4th
31
9157 +/- 1325
2nd
59
20726 +/- 2999
1st
6
21459 +/- 2343
OpenBenchmarking.orgDistribution Of Public Results - Total For Average Test Times8796 Results Range From 233 To 1733771 Milliseconds233349046957510424613891717358820825924293027760131227234694338161441628545095648562752029855496958964062431165898269365372832476299579766683233786700890167993635097102110056921040363107503411097051144376117904712137181248389128306013177311352402138707314217441456415149108615257571560428159509916297701664441169911217337832K4K6K8K10K

Based on OpenBenchmarking.org data, the selected test / test configuration (PyBench 2018-02-16 - Total For Average Test Times) has an average run-time of 3 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkTotal For Average Test TimesRun-Time1122334455Min: 1 / Avg: 2.91 / Max: 54

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.2%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsTotal For Average Test TimesDeviation246810Min: 0 / Avg: 0.24 / Max: 5

Does It Scale Well With Increasing Cores?

Yes, based on the automated analysis of the collected public benchmark data, this test / test settings does generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

AMDIntelOpenBenchmarking.orgRelative Core Scaling To BasePyBench CPU Core ScalingTotal For Average Test Times24681012141624324856641281.08962.17923.26884.35845.448

Tested CPU Architectures

This benchmark has been successfully tested on the below mentioned architectures. The CPU architectures listed is where successful OpenBenchmarking.org result uploads occurred, namely for helping to determine if a given test is compatible with various alternative CPU architectures.

CPU Architecture
Kernel Identifier
Verified On
Intel / AMD x86 64-bit
x86_64
(Many Processors)
RISC-V 64-bit
riscv64
SiFive RISC-V, SiFive U740, Spacemit X60, rv64imafdc, rv64imafdcsu, rv64imafdcvsu
IBM POWER (PowerPC) 64-bit
ppc64le
POWER8, POWER9 16-Core, POWER9 22-Core, POWER9 4-Core, POWER9 44-Core, POWER9 8-Core, POWER9 80-Core, POWER9 altivec supported 144-Core, POWER9 altivec supported 160-Core, POWER9 altivec supported 176-Core, POWER9 altivec supported 32-Core, POWER9 altivec supported 44-Core, POWER9 altivec supported 64-Core, POWER9 altivec supported 88-Core, POWER9 altivec supported 96-Core
IBM POWER (PowerPC) 64-bit
ppc64
POWER7, POWER9 4-Core, PPC970MP
IBM POWER (PowerPC)
ppc
7447A altivec supported
MIPS 64-bit
mips64
Loongson-2K V0.3 FPU V0.1, Loongson-3A R4, Loongson-3A3000 V0.9 FPU V0.1
MIPS
mips
Baikal-T1 1.2 GHz MIPS P5600 V3.0 FPU V2.0, MIPS P5600 V3.0 FPU V2.0
Loongson LoongArch 64-bit
loongarch64
Loongson-3A5000, Loongson-3A5000-HV, Loongson-3A5000-HV-7A2000-1w-EVB-V1.0, Loongson-3A5000LL, Loongson-3A5000M, Loongson-3A6000, Loongson-3A6000-HV
Intel / AMD x86 32-bit
i686
(Many Processors)
ARMv7 32-bit
armv7l
ARMv7 4-Core, ARMv7 Cortex-A15 8-Core, ARMv7 Cortex-A53 4-Core, ARMv7 Cortex-A7 4-Core, ARMv7 Cortex-A72, ARMv7 Cortex-A72 4-Core, ARMv7 rev 0 2-Core, ARMv7 rev 0 4-Core, ARMv7 rev 1 4-Core, ARMv7 rev 10 2-Core, ARMv7 rev 10 4-Core, ARMv7 rev 2, ARMv7 rev 2 4-Core, ARMv7 rev 3 3-Core, ARMv7 rev 3 4-Core, ARMv7 rev 3 8-Core, ARMv7 rev 4 4-Core, ARMv7 rev 5 3-Core, ARMv7 rev 5 4-Core, ARMv7 rev 5 8-Core
ARMv6 32-bit
armv6l
ARMv6-compatible rev 7, ARMv7
ARMv8 64-bit
arm64
Apple, Apple M1, Apple M1 Max, Apple M1 Pro, Apple M2, Apple M2 Max, Apple M2 Pro, Apple M3, Apple M4
Arm
arm
ARM Cortex-A7 r0p5
ARMv8 64-bit
aarch64
AArch64 rev 1, AArch64 rev 12, AArch64 rev 14, AArch64 rev 2, AArch64 rev 4, ARMVv8 Cortex-A53 4-Core, ARMVv8 Cortex-A73 6-Core, ARMv8, ARMv8 8-Core, ARMv8 Cortex-A53 2-Core, ARMv8 Cortex-A53 24-Core, ARMv8 Cortex-A53 3-Core, ARMv8 Cortex-A53 4-Core, ARMv8 Cortex-A53 8-Core, ARMv8 Cortex-A55 4-Core, ARMv8 Cortex-A57, ARMv8 Cortex-A57 4-Core, ARMv8 Cortex-A57 6-Core, ARMv8 Cortex-A57 8-Core, ARMv8 Cortex-A72, ARMv8 Cortex-A72 16-Core, ARMv8 Cortex-A72 2-Core, ARMv8 Cortex-A72 4-Core, ARMv8 Cortex-A72 6-Core, ARMv8 Cortex-A72 8-Core, ARMv8 Cortex-A73, ARMv8 Cortex-A73 2-Core, ARMv8 Cortex-A73 4-Core, ARMv8 Cortex-A73 6-Core, ARMv8 Cortex-A73 8-Core, ARMv8 Cortex-A75 8-Core, ARMv8 Cortex-A76 4-Core, ARMv8 Cortex-A77 6-Core, ARMv8 Cortex-A78 4-Core, ARMv8 Cortex-A78E 12-Core, ARMv8 Cortex-A78E 6-Core, ARMv8 Neoverse-N1, ARMv8 Neoverse-N1 128-Core, ARMv8 Neoverse-N1 16-Core, ARMv8 Neoverse-N1 2-Core, ARMv8 Neoverse-N1 4-Core, ARMv8 Neoverse-N1 64-Core, ARMv8 Neoverse-N1 80-Core, ARMv8 Neoverse-V1, ARMv8 Neoverse-V1 4-Core, ARMv8 Neoverse-V1 64-Core, ARMv8 Neoverse-V2, ARMv8 Neoverse-V2 72-Core, ARMv8 rev 0 6-Core, ARMv8 rev 0 8-Core, ARMv8 rev 1 4-Core, ARMv8 rev 3 4-Core, ARMv8 rev 3 6-Core, ARMv8 rev 4 8-Core, Amlogic, Amlogic ARMv8 Cortex-A53 4-Core, Ampere ARMv8 Neoverse-N1 128-Core, Ampere ARMv8 Neoverse-N1 160-Core, Ampere ARMv8 Neoverse-N1 256-Core, Ampere Altra ARMv8 Neoverse-N1 160-Core, Ampere eMAG ARMv8 16-Core, Ampere eMAG ARMv8 32-Core, Ampere eMAG ARMv8 4-Core, Ampere eMAG ARMv8 8-Core, AmpereOne, AmpereOne 192-Core, Apple, Apple M1, Apple M1 Pro, Apple M2, Cavium ThunderX, FT2000AHK, HUAWEI Kunpeng 920, Phytium D2000, Phytium FT-2000, Phytium FT1500A, Phytium FT2000A 4-Core, Phytium FT2000PLUS, Qualcomm, Rockchip, Rockchip ARMVv8 Cortex-A72 6-Core, Rockchip ARMv8 4-Core, Rockchip ARMv8 Cortex-A53 4-Core, Rockchip ARMv8 Cortex-A55 4-Core, Rockchip ARMv8 Cortex-A72 6-Core, Rockchip ARMv8 Cortex-A76 4-Core, Rockchip ARMv8 Cortex-A76 6-Core, Rockchip ARMv8 Cortex-A76 8-Core, SiFive RISC-V, Snapdragon

Recent Test Results

OpenBenchmarking.org Results Compare

4 Systems - 237 Benchmark Results

Apple M1 - Apple Mac mini - 8GB

macOS 15.1 - 24.1.0 - OpenCL 1.2

1 System - 1 Benchmark Result

2 x Intel Core i7-7700HQ - Intel 440BX - 4096 + 256 + 32 + 4 4800MHz

Microsoft Windows Server 2019 Datacenter Evaluation Build 17763 - 10.0.17763.3650 - 10.0.17763.1

2 Systems - 3 Benchmark Results

2 x Intel Core i7-7700HQ - Intel 440BX - 4096 + 256 + 32 + 4 4800MHz

Microsoft Windows Server 2019 Datacenter Evaluation Build 17763 - 10.0.17763.3650 - 10.0.17763.1

10 Systems - 237 Benchmark Results

8 Systems - 235 Benchmark Results

Apple M1 - Apple Mac mini - 8GB

macOS 15.1 - 24.1.0 - OpenCL 1.2

1 System - 1 Benchmark Result

Apple M3 - Apple MacBook Air - 16GB

macOS 15.1 - 24.1.0 - GCC 16.0.0 + Clang 16.0.0

Most Popular Test Results

OpenBenchmarking.org Results Compare

3 Systems - 14 Benchmark Results

AMD Ryzen 9 5900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.10 - 5.8.0-38-generic - GNOME Shell 3.38.1

2 Systems - 29 Benchmark Results

Intel Core i7-5820K - ASUS X99-A - Intel Xeon E7 v3

Pop 20.10 - 5.8.0-7630-generic - GNOME Shell 3.38.1

16 Systems - 119 Benchmark Results

2 x Intel Xeon Gold 5220R - GIGABYTE MD61-SC2-00 v01000100 - Intel Sky Lake-E DMI3 Registers

Ubuntu 20.04 - 5.4.0-18-generic - GNOME Shell 3.36.0

2 Systems - 29 Benchmark Results

AMD Ryzen 5 3600 6-Core - ASUS PRIME X570-P - AMD Starship

ManjaroLinux 18.1.1 - 5.4.0-1-MANJARO - GNOME Shell 3.34.1

7 Systems - 28 Benchmark Results

ARMv8 Cortex-A53 - Libre Board ALL-H3-CC H5 - 2048MB

Raspbian 9.6 - 4.18.0-rc3-gfc36def997cf-dirty - X Server 1.19.2

4 Systems - 14 Benchmark Results

AMD Ryzen 9 5950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 22.04 - 5.18.0-051800-generic - GNOME Shell 42.0

4 Systems - 55 Benchmark Results

AMD Ryzen 3 3200U - MOTILE PF4PU1F - AMD Raven

Fedora 31 - 5.4.15-200.fc31.x86_64 - GNOME Shell 3.34.3

2 Systems - 535 Benchmark Results

AMD Ryzen 5 4500U - LENOVO LNVNB161216 - AMD Renoir Root Complex

Ubuntu 20.04 - 5.9.0-050900rc7daily20201002-generic - GNOME Shell 3.36.4

5 Systems - 25 Benchmark Results

Intel Xeon E3-1280 v5 - MSI MS-7998 1.0 - Intel Xeon E3-1200 v5

FreeBSD - 13.0-CURRENT - Clang 7.0.1

20 Systems - 43 Benchmark Results

AArch64 rev 4 - sun50iw1p1 - 1024MB

Ubuntu 16.04 - 3.10.104 - X Server 1.18.4

14 Systems - 36 Benchmark Results

ARMv8 Cortex-A72 - Amazon EC2 a1.large - Amazon Device 0200

Ubuntu 18.04 - 4.15.0-1028-aws - GCC 7.3.0

2 Systems - 601 Benchmark Results

2 x Intel Xeon E5-2690 v4 - Intel S2600WTT v.......... - Intel Xeon E7 v4

Debian 9.4 - 4.9.0-6-amd64 - GCC 6.3.0 20170516 + Clang 3.8.1-24

8 Systems - 28 Benchmark Results

Rockchip ARMv8 Cortex-A53 - Firefly ROC-RK3328-CC - 2048MB

Ubuntu 18.04 - 4.4.114 - X Server 1.18.4

3 Systems - 30 Benchmark Results

Intel Core i9-9900KS - ASUS PRIME Z390-A - Intel Cannon Lake PCH

Clear Linux OS 31950 - 5.4.4-880.native - GNOME Shell 3.34.2

Find More Test Results