TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics.


TensorFlow 2.16.1

Device: CPU - Batch Size: 64 - Model: ResNet-50

OpenBenchmarking.org metrics for this test profile configuration based on 450 public results since 26 March 2024 with the latest data as of 15 December 2024.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Details
Percentile Rank
# Compatible Public Results
images/sec (Average)
Zen 5 [96 Cores / 192 Threads]
100th
3
152 +/- 4
Zen 5 [128 Cores / 256 Threads]
100th
8
140 +/- 6
Emerald Rapids [128 Cores / 256 Threads]
95th
6
93 +/- 1
Zen 4 [64 Cores / 128 Threads]
92nd
5
89 +/- 1
Zen 4 [192 Cores / 384 Threads]
91st
8
88 +/- 1
Zen 4 [64 Cores / 128 Threads]
88th
4
81
Sapphire Rapids [24 Cores / 48 Threads]
86th
3
63 +/- 4
Zen 5 [16 Cores / 32 Threads]
84th
30
53 +/- 1
Zen 5 [12 Cores / 24 Threads]
77th
7
50
Zen 5 [8 Cores / 16 Threads]
76th
6
49
Mid-Tier
75th
< 48
Zen 5 [8 Cores / 16 Threads]
73rd
10
43 +/- 1
Zen 4 [16 Cores / 32 Threads]
71st
5
42
Cascade Lake [18 Cores / 36 Threads]
68th
4
42
Arrow Lake [24 Cores / 24 Threads]
67th
8
42 +/- 1
Zen 4 [16 Cores / 32 Threads]
66th
4
40
Zen 4 [16 Cores / 32 Threads]
64th
5
40 +/- 1
Zen 5 [6 Cores / 12 Threads]
64th
10
39 +/- 1
Zen 4 [12 Cores / 24 Threads]
62nd
5
39
Zen 4 [12 Cores / 24 Threads]
61st
5
38
Granite Rapids [256 Cores / 512 Threads]
58th
3
37
Raptor Lake [24 Cores / 32 Threads]
58th
10
37 +/- 1
Zen 4 [12 Cores / 24 Threads]
56th
8
36 +/- 1
Raptor Lake [24 Cores / 32 Threads]
55th
3
36
Zen 4 [12 Cores / 24 Threads]
54th
4
35
Zen 4 [12 Cores / 24 Threads]
53rd
3
35
Zen 4 [8 Cores / 16 Threads]
53rd
4
33
Zen 4 [8 Cores / 16 Threads]
51st
5
32
Median
50th
32
Arrow Lake [14 Cores / 14 Threads]
50th
5
32
Zen 4 [8 Cores / 16 Threads]
49th
4
32
Zen 4 [8 Cores / 16 Threads]
48th
3
31
Zen 4 [8 Cores / 16 Threads]
47th
4
30
Zen 4 [8 Cores / 16 Threads]
47th
5
29
Raptor Lake [14 Cores / 20 Threads]
46th
3
28
Raptor Lake [14 Cores / 20 Threads]
45th
5
28
Zen 4 [6 Cores / 12 Threads]
41st
7
26 +/- 1
Zen 4 [6 Cores / 12 Threads]
41st
5
26 +/- 1
Cascade Lake [16 Cores / 32 Threads]
41st
4
26
Zen 4 [6 Cores / 12 Threads]
39th
3
26
Zen 4 [6 Cores / 12 Threads]
38th
7
25
Zen 5 [12 Cores / 24 Threads]
37th
6
25 +/- 1
Zen 4 [6 Cores / 12 Threads]
36th
4
24
Raptor Lake [8 Cores / 16 Threads]
34th
9
23
Raptor Lake [14 Cores / 20 Threads]
33rd
5
22 +/- 2
Zen 5 [10 Cores / 20 Threads]
31st
6
22 +/- 1
Raptor Lake [10 Cores / 16 Threads]
30th
3
21
Raptor Lake [10 Cores / 16 Threads]
28th
8
20 +/- 1
Zen 3 [24 Cores / 48 Threads]
27th
4
20
Low-Tier
25th
< 19
Zen 4 [4 Cores / 8 Threads]
25th
4
19
Raptor Lake [4 Cores / 8 Threads]
25th
5
17
Meteor Lake [16 Cores / 22 Threads]
23rd
10
15
Zen 2 [32 Cores / 64 Threads]
20th
3
14
Alder Lake [14 Cores / 20 Threads]
18th
8
13 +/- 1
Zen 3 [8 Cores / 16 Threads]
17th
5
13
Tiger Lake [4 Cores / 8 Threads]
16th
4
12
Zen 2 [8 Cores / 16 Threads]
15th
4
11 +/- 1
Zen 3 [12 Cores / 24 Threads]
15th
6
11
Zen 3 [8 Cores / 16 Threads]
15th
5
11
Zen 3 [16 Cores / 32 Threads]
11th
5
10
Zen 3 [6 Cores / 12 Threads]
10th
4
10
Zen 3 [6 Cores / 12 Threads]
9th
5
9
Zen 2 [8 Cores / 16 Threads]
7th
4
9
Ice Lake [4 Cores / 8 Threads]
6th
4
8
Zen 3 [8 Cores / 16 Threads]
5th
5
8
Zen 3 [8 Cores / 16 Threads]
4th
4
7
Zen 2 [6 Cores / 12 Threads]
3rd
4
6