This is a benchmark of the Caffe deep learning framework and currently supports the AlexNet and Googlenet model and execution on both CPUs and NVIDIA GPUs.
Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.
Component
Details
Percentile Rank
# Compatible Public Results
Milli-Seconds (Average)
Zen 3 [8 Cores / 16 Threads]
97th
5
61026 +/- 486
Kaby/Coffee/Whiskey Lake [6 Cores / 6 Threads]
97th
3
62602 +/- 247
Kaby/Coffee/Whiskey Lake [6 Cores / 6 Threads]
95th
3
64228 +/- 734
Rocket Lake [8 Cores / 16 Threads]
95th
7
64307 +/- 2674
Alder Lake [6 Cores / 12 Threads]
95th
3
64710 +/- 67
Zen 3 [64 Cores / 128 Threads]
93rd
4
67800 +/- 662
Kaby/Coffee/Whiskey Lake [4 Cores / 4 Threads]
92nd
3
69547 +/- 56
Zen 3 [8 Cores / 16 Threads]
91st
9
70178 +/- 1779
Zen 3 [6 Cores / 12 Threads]
88th
8
73630 +/- 669
Kaby/Coffee/Whiskey Lake [4 Cores / 4 Threads]
87th
3
74271 +/- 70
Zen 3 [16 Cores / 32 Threads]
85th
24
75620 +/- 5949
Zen 2 [4 Cores / 8 Threads]
85th
3
75950 +/- 410
Zen 3 [12 Cores / 24 Threads]
85th
16
76348 +/- 3287
Zen 3 [16 Cores / 32 Threads]
82nd
5
79773 +/- 399
Kaby/Coffee/Whiskey Lake [8 Cores / 16 Threads]
82nd
6
79908 +/- 403
Haswell [4 Cores / 4 Threads]
81st
3
80617 +/- 1285
Cascade Lake [18 Cores / 36 Threads]
79th
7
81625 +/- 11296
Kaby/Coffee/Whiskey Lake [8 Cores / 16 Threads]
78th
3
81752 +/- 84
Kaby/Coffee/Whiskey Lake [4 Cores / 4 Threads]
75th
4
88529 +/- 1791
Zen 3 [32 Cores / 64 Threads]
75th
7
89252 +/- 3692
Kaby/Coffee/Whiskey Lake [8 Cores / 16 Threads]
74th
3
89443 +/- 1333
Comet Lake [6 Cores / 12 Threads]
74th
6
89564 +/- 81
Zen 3 [64 Cores / 128 Threads]
73rd
15
90389 +/- 8876
Zen [4 Cores / 4 Threads]
72nd
3
93847 +/- 217
Cascade Lake [20 Cores / 20 Threads]
71st
3
96087 +/- 128
Cascade Lake [8 Cores / 16 Threads]
70th
4
97335
Zen 2 [8 Cores / 16 Threads]
69th
6
100406 +/- 5139
Zen 2 [6 Cores / 12 Threads]
69th
3
101069 +/- 677
Cascade Lake [8 Cores / 16 Threads]
68th
3
101598
Zen 2 [8 Cores / 16 Threads]
67th
4
103831 +/- 1771
Zen 2 [16 Cores / 32 Threads]
66th
6
104489 +/- 1237
Kaby/Coffee/Whiskey Lake [8 Cores / 8 Threads]
66th
3
105259 +/- 2634
Zen 2 [8 Cores / 8 Threads]
66th
3
105463
Zen 3 [128 Cores / 256 Threads]
64th
6
106754 +/- 3969
Cascade Lake [16 Cores / 32 Threads]
64th
4
107095
Zen 2 [12 Cores / 24 Threads]
63rd
8
107223 +/- 4085
Kaby/Coffee/Whiskey Lake [6 Cores / 12 Threads]
62nd
3
107769 +/- 480
Zen 2 [12 Cores / 24 Threads]
62nd
6
108091 +/- 813
Zen 3 [128 Cores / 256 Threads]
61st
5
108205 +/- 787
Kaby/Coffee/Whiskey Lake [6 Cores / 12 Threads]
61st
3
108482 +/- 201
Zen 2 [64 Cores / 128 Threads]
58th
3
112044 +/- 301
Cascade Lake [12 Cores / 24 Threads]
58th
3
112281
Zen 2 [6 Cores / 6 Threads]
57th
6
112603 +/- 604
Cascade Lake [28 Cores / 56 Threads]
56th
4
114228 +/- 1992
Haswell [8 Cores / 8 Threads]
56th
3
114458 +/- 524
Cascade Lake [28 Cores / 56 Threads]
56th
3
114831 +/- 794
Cascade Lake [16 Cores / 32 Threads]
55th
6
116644 +/- 8097
Cascade Lake [18 Cores / 36 Threads]
55th
3
116913 +/- 876
Kaby/Coffee/Whiskey Lake [4 Cores / 8 Threads]
54th
3
117435 +/- 102
Zen [8 Cores / 16 Threads]
54th
3
117632 +/- 405
Haswell [16 Cores / 16 Threads]
53rd
3
118247 +/- 227
Broadwell [8 Cores / 8 Threads]
51st
4
119687 +/- 404
Zen+ [8 Cores / 16 Threads]
51st
3
120153 +/- 202
Zen 3 [32 Cores / 64 Threads]
51st
6
120202 +/- 1993
Cascade Lake [18 Cores / 36 Threads]
50th
3
120562 +/- 155
Kaby/Coffee/Whiskey Lake [8 Cores / 8 Threads]
48th
3
121645 +/- 146
Comet Lake [4 Cores / 8 Threads]
46th
4
122846 +/- 5556
Zen+ [8 Cores / 16 Threads]
46th
3
122885 +/- 956
Zen 2 [64 Cores / 128 Threads]
46th
6
123132 +/- 2195
Zen 2 [64 Cores / 128 Threads]
44th
10
125387 +/- 2866
Zen 2 [64 Cores / 128 Threads]
44th
10
126334 +/- 2828
Cascade Lake [16 Cores / 32 Threads]
44th
7
126960 +/- 8050
Zen 2 [24 Cores / 48 Threads]
44th
3
127408 +/- 173
Ivy Bridge [4 Cores / 4 Threads]
42nd
3
128586 +/- 802
Ice Lake [4 Cores / 8 Threads]
40th
7
129971 +/- 285
Cascade Lake [48 Cores / 96 Threads]
39th
6
130377 +/- 1800
Skylake [8 Cores / 8 Threads]
39th
3
130901 +/- 185
Zen 2 [32 Cores / 64 Threads]
38th
3
132553 +/- 514
Skylake [8 Cores / 8 Threads]
37th
3
133822 +/- 48
Haswell [20 Cores / 20 Threads]
36th
3
134387 +/- 694
Skylake [4 Cores / 8 Threads]
35th
3
137302 +/- 134
Zen 2 [8 Cores / 16 Threads]
33rd
14
139688 +/- 1120
Zen 2 [16 Cores / 32 Threads]
32nd
13
142703 +/- 4586
Kaby/Coffee/Whiskey Lake [6 Cores / 12 Threads]
32nd
3
142973 +/- 424
Ivy Bridge [12 Cores / 12 Threads]
31st
3
143622 +/- 167
Zen 2 [8 Cores / 16 Threads]
30th
3
148683
Zen 2 [16 Cores / 32 Threads]
28th
10
149988 +/- 3124
Zen+ [16 Cores / 32 Threads]
27th
3
150575 +/- 162
Zen 2 [24 Cores / 48 Threads]
26th
9
151039 +/- 1095
Zen 2 [8 Cores / 16 Threads]
24th
10
151623 +/- 299
Zen 2 [24 Cores / 48 Threads]
23rd
10
152268 +/- 2920
Zen 2 [8 Cores / 16 Threads]
23rd
3
152406
Zen 2 [48 Cores / 96 Threads]
23rd
10
152465 +/- 20877
Zen 2 [16 Cores / 32 Threads]
22nd
10
153144 +/- 3125
Zen 2 [12 Cores / 24 Threads]
19th
8
157338 +/- 3321
Skylake [8 Cores / 8 Threads]
17th
3
158865 +/- 409
Zen 2 [32 Cores / 64 Threads]
17th
8
160293 +/- 3276
Tiger Lake [4 Cores / 8 Threads]
17th
7
161676 +/- 9590
Zen 2 [48 Cores / 96 Threads]
17th
10
162384 +/- 12424
Zen 2 [32 Cores / 64 Threads]
16th
3
163216
Zen 2 [128 Cores / 256 Threads]
15th
9
165029 +/- 8986
Zen 2 [32 Cores / 64 Threads]
15th
10
166472 +/- 3205
Zen 2 [24 Cores / 48 Threads]
14th
5
169060
Zen 2 [32 Cores / 64 Threads]
13th
5
170209
Zen+ [24 Cores / 48 Threads]
10th
3
173691 +/- 242
Zen 2 [32 Cores / 64 Threads]
9th
10
177498 +/- 5017
Steamroller [2 Cores / 4 Threads]
8th
3
193058 +/- 6247
Zen [2 Cores / 4 Threads]
7th
3
203286 +/- 3004
Zen 2 [48 Cores / 96 Threads]
7th
4
204085 +/- 1020
Kaby/Coffee/Whiskey Lake [2 Cores / 8 Threads]
6th
4
209788 +/- 545
Zen [32 Cores / 64 Threads]
5th
3
213239
Zen [64 Cores / 128 Threads]
4th
4
214117 +/- 1527
Zen 2 [32 Cores / 64 Threads]
3rd
3
224315 +/- 647
Sandy Bridge [4 Cores / 8 Threads]
2nd
3
244159 +/- 8571
Zen [32 Cores / 64 Threads]
2nd
3
248715 +/- 4600
