This is a benchmark of PyTorch making use of pytorch-benchmark [https://github.com/LukasHedegaard/pytorch-benchmark].
Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.
Component
Details
Percentile Rank
# Compatible Public Results
batches/sec (Average)
Zen 5 [16 Cores / 32 Threads]
97th
16
85.2 +/- 1.1
Emerald Rapids [64 Cores / 128 Threads]
93rd
6
78.5 +/- 0.7
Zen 4 [16 Cores / 32 Threads]
88th
8
70.2 +/- 4.5
Zen 4 [16 Cores / 32 Threads]
88th
4
68.8
Zen 4 [8 Cores / 16 Threads]
87th
3
68.7
Zen 4 [8 Cores / 16 Threads]
85th
4
67.7 +/- 0.4
Zen 4 [16 Cores / 32 Threads]
83rd
5
65.9 +/- 0.4
Zen 4 [12 Cores / 24 Threads]
77th
4
61.3
Raptor Lake [24 Cores / 32 Threads]
76th
6
61.1 +/- 5.8
Zen 4 [64 Cores / 128 Threads]
74th
4
60.0 +/- 0.3
Zen 5 [96 Cores / 192 Threads]
73rd
3
59.6 +/- 1.0
Zen 4 [12 Cores / 24 Threads]
73rd
3
58.8 +/- 0.1
Zen 4 [6 Cores / 12 Threads]
72nd
3
58.5
Zen 4 [12 Cores / 24 Threads]
69th
3
57.0
Zen 4 [6 Cores / 12 Threads]
68th
3
56.5 +/- 0.8
Zen 4 [8 Cores / 16 Threads]
66th
3
53.9 +/- 0.7
Zen 4 [6 Cores / 12 Threads]
66th
3
52.6
Zen 5 [128 Cores / 256 Threads]
59th
11
51.0 +/- 2.0
Sapphire Rapids [48 Cores / 96 Threads]
59th
3
49.7 +/- 1.1
Sapphire Rapids [60 Cores / 120 Threads]
57th
5
48.4 +/- 2.8
Sapphire Rapids [56 Cores / 112 Threads]
56th
3
46.5 +/- 1.8
Sapphire Rapids [96 Cores / 192 Threads]
55th
3
46.4 +/- 0.1
Emerald Rapids [128 Cores / 256 Threads]
55th
10
46.3 +/- 2.5
Granite Rapids [128 Cores / 256 Threads]
49th
4
43.3 +/- 0.6
Zen 4 [4 Cores / 8 Threads]
46th
4
41.1
Zen 4 [64 Cores / 128 Threads]
44th
4
40.9 +/- 0.2
Zen 4 [96 Cores / 192 Threads]
43rd
4
40.7 +/- 0.2
Zen 4 [96 Cores / 192 Threads]
42nd
4
40.7 +/- 0.7
Zen 3 [24 Cores / 48 Threads]
41st
4
40.1 +/- 0.1
Sapphire Rapids [120 Cores / 240 Threads]
38th
5
37.3 +/- 1.6
Zen 2 [32 Cores / 64 Threads]
36th
3
35.4 +/- 0.6
Zen 3 [8 Cores / 16 Threads]
34th
4
33.4 +/- 0.4
Raptor Lake [10 Cores / 16 Threads]
32nd
3
32.2
Zen 4 [128 Cores / 256 Threads]
30th
3
32.0 +/- 0.3
Meteor Lake [16 Cores / 22 Threads]
28th
4
28.9 +/- 0.7
Zen 3 [8 Cores / 16 Threads]
24th
4
26.0 +/- 1.0
Alder Lake [14 Cores / 20 Threads]
24th
4
25.4 +/- 2.5
Zen 4 [192 Cores / 384 Threads]
17th
10
22.3 +/- 1.4
Zen 2 [6 Cores / 12 Threads]
17th
4
21.2 +/- 0.2
Zen 2 [8 Cores / 8 Threads]
14th
3
20.9 +/- 0.5
Zen 4 [192 Cores / 384 Threads]
13th
4
20.3 +/- 0.7
Ice Lake [4 Cores / 8 Threads]
11th
4
18.9 +/- 2.5
Granite Rapids [256 Cores / 512 Threads]
7th
7
15.5 +/- 1.9
Zen 4 [256 Cores / 512 Threads]
6th
6
14.9 +/- 0.1
