LiteRT
This is a benchmark of LiteRT (formerly known as TensorFlow Lite) focused on TensorFlow machine learning for mobile, IoT, edge, and other cases. The current Linux support is limited to running on CPUs. This LiteRT benchmark test profile is measuring the average inference time.
LiteRT 2024-10-15
Model: Mobilenet Float
OpenBenchmarking.org metrics for this test profile configuration based on 257 public results since 15 October 2024 with the latest data as of 18 January 2025.
Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.
Component
Details
Percentile Rank
# Compatible Public Results
Microseconds (Average)
Zen 5 [8 Cores / 16 Threads]
97th
4
724 +/- 2
Arrow Lake [24 Cores / 24 Threads]
92nd
17
873 +/- 21
Raptor Lake [24 Cores / 32 Threads]
88th
4
989 +/- 4
Zen 5 [16 Cores / 32 Threads]
86th
4
1019 +/- 28
Zen 4 [8 Cores / 16 Threads]
85th
3
1045 +/- 1
Arrow Lake [14 Cores / 14 Threads]
83rd
5
1083 +/- 5
Zen 4 [16 Cores / 32 Threads]
81st
7
1173 +/- 6
Zen 4 [16 Cores / 32 Threads]
77th
7
1226 +/- 54
Zen 4 [12 Cores / 24 Threads]
76th
7
1244 +/- 3
Zen 4 [12 Cores / 24 Threads]
74th
5
1247 +/- 4
Cascade Lake [18 Cores / 36 Threads]
71st
3
1331 +/- 15
Zen 4 [8 Cores / 16 Threads]
69th
3
1547 +/- 68
Alder Lake [10 Cores / 16 Threads]
64th
3
1820 +/- 10
Zen 2 [32 Cores / 64 Threads]
62nd
4
1843 +/- 32
Zen 4 [32 Cores / 64 Threads]
60th
4
2039 +/- 22
Zen 4 [64 Cores / 128 Threads]
58th
7
2125 +/- 13
Cascade Lake [16 Cores / 32 Threads]
55th
5
2184 +/- 20
Zen 4 [4 Cores / 8 Threads]
54th
5
2193 +/- 2
Zen 2 [12 Cores / 24 Threads]
51st
3
2261 +/- 22
Zen 5 [12 Cores / 24 Threads]
51st
4
2264 +/- 4
Zen 5 [10 Cores / 20 Threads]
49th
3
2286 +/- 124
Zen 5 [64 Cores / 128 Threads]
48th
4
2427 +/- 2
Zen 4 [8 Cores / 16 Threads]
44th
4
3050 +/- 146
Alder Lake [14 Cores / 20 Threads]
42nd
4
3242 +/- 30
Zen 3 [8 Cores / 16 Threads]
41st
3
3295 +/- 104
Lunar Lake [8 Cores / 8 Threads]
40th
4
3381 +/- 28
Zen 3 [8 Cores / 16 Threads]
38th
4
3707 +/- 58
Tiger Lake [4 Cores / 8 Threads]
36th
3
3819 +/- 83
Meteor Lake [16 Cores / 22 Threads]
36th
4
3887 +/- 115
Zen 2 [64 Cores / 128 Threads]
34th
3
4202 +/- 37
Zen 5 [96 Cores / 192 Threads]
30th
22
4415 +/- 29
Zen 5 [128 Cores / 256 Threads]
23rd
6
5921 +/- 270
Granite Rapids [128 Cores / 256 Threads]
19th
3
8182 +/- 434
