SecureMark

SecureMark is an objective, standardized benchmarking framework for measuring the efficiency of cryptographic processing solutions developed by EEMBC. SecureMark-TLS is benchmarking Transport Layer Security performance with a focus on IoT/edge computing.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark securemark.

Project Site

github.com

Test Created

10 April 2021

Test Maintainer

Michael Larabel 

Test Type

Processor

Average Install Time

4 Seconds

Average Run Time

15 Minutes, 25 Seconds

Test Dependencies

C/C++ Compiler Toolchain + CMake

Accolades

5k+ Downloads

Supported Platforms


Public Result Uploads *Reported Installs **Reported Test Completions **Test Profile Page ViewsOpenBenchmarking.orgEventsSecureMark Popularity Statisticspts/securemark2021.042021.052021.062021.072021.082021.092021.102021.112021.122022.012022.022022.032022.042022.052022.062022.072022.082022.092022.102022.112022.122023.012023.022023.032023.042023.052023.062023.072023.082023.092023.102023.112023.122024.012024.022024.032024.042024.052024.062024.072024.082024.092024.102024.112K4K6K8K10K
* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data updated weekly as of 19 November 2024.

Revision History

pts/securemark-1.0.0   [View Source]   Sat, 10 Apr 2021 17:21:13 GMT
Initial commit of SecureMark-TLS.

Suites Using This Test

Cryptography


Performance Metrics

Analyze Test Configuration:

SecureMark 1.0.4

Benchmark: SecureMark-TLS

OpenBenchmarking.org metrics for this test profile configuration based on 1,543 public results since 10 April 2021 with the latest data as of 28 October 2024.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Compatible Public Results
marks (Average)
100th
11
468619 +/- 8098
100th
4
449996 +/- 247
99th
5
443431 +/- 3392
98th
4
441116 +/- 1143
97th
18
435091 +/- 17291
97th
15
432673 +/- 5111
96th
21
430879 +/- 10394
96th
8
430615 +/- 16497
95th
21
427410 +/- 10522
95th
11
426479 +/- 9529
94th
17
425821 +/- 13370
92nd
4
422134 +/- 6708
92nd
5
418970 +/- 7751
90th
5
413417 +/- 9789
89th
14
410132 +/- 16435
89th
7
409588 +/- 3959
89th
10
405859 +/- 722
86th
5
395864 +/- 5091
85th
6
393088 +/- 1753
85th
12
391983 +/- 7608
85th
11
390646 +/- 16157
84th
20
388828 +/- 3844
84th
11
387354 +/- 30001
83rd
9
386056 +/- 3164
82nd
10
380023 +/- 12298
81st
5
371939 +/- 5563
80th
22
369146 +/- 4567
79th
5
364321 +/- 34692
78th
14
362300 +/- 52041
77th
12
353242 +/- 18801
77th
4
347149 +/- 101
77th
17
345938 +/- 5736
Mid-Tier
75th
< 339228
75th
22
337663 +/- 20256
75th
3
334704 +/- 2818
74th
9
329326 +/- 1250
71st
6
322166 +/- 9880
71st
45
321819 +/- 5880
70th
5
321185 +/- 489
70th
21
320139 +/- 6049
69th
16
318457 +/- 6861
67th
10
317728 +/- 837
66th
6
316723 +/- 310
65th
3
316272 +/- 13261
65th
3
316076 +/- 13058
65th
7
315766 +/- 3589
64th
23
315321 +/- 23988
64th
11
312519 +/- 5594
63rd
15
310541 +/- 7061
62nd
3
308853 +/- 12974
62nd
3
308771 +/- 13340
60th
18
307457 +/- 1964
59th
22
306471 +/- 6577
59th
7
306007 +/- 8660
59th
7
305579 +/- 8184
59th
6
305495 +/- 3259
58th
8
301809 +/- 2437
55th
5
296662 +/- 5045
55th
10
296579 +/- 6585
55th
15
296168 +/- 4210
55th
3
295910 +/- 1409
53rd
3
293398 +/- 12830
52nd
4
289979 +/- 12316
52nd
10
289094 +/- 12866
51st
3
287000 +/- 135
51st
3
286425 +/- 468
51st
12
285520 +/- 12542
51st
9
285051 +/- 3621
Median
50th
284432
50th
5
281599 +/- 1282
49th
3
278277 +/- 11600
48th
4
277121 +/- 161
47th
5
275765 +/- 3604
45th
8
271362 +/- 1893
45th
9
271161 +/- 2105
45th
4
271115 +/- 3149
45th
8
271089 +/- 9273
45th
3
270542 +/- 12730
45th
7
270495 +/- 2566
45th
7
270333 +/- 8550
45th
13
269816 +/- 8052
45th
9
269588 +/- 9633
44th
3
269310 +/- 186
44th
6
269027 +/- 9447
43rd
14
267231 +/- 7277
43rd
4
266593 +/- 773
41st
15
258748 +/- 11728
41st
3
257924 +/- 48
40th
14
255059 +/- 1995
39th
8
254169 +/- 5725
38th
5
251548 +/- 2514
36th
3
248954 +/- 1589
36th
8
248550 +/- 3815
36th
7
248042 +/- 3172
35th
4
246188 +/- 3119
35th
4
245899 +/- 5073
34th
21
243231 +/- 9166
34th
3
243099 +/- 1076
34th
3
242075 +/- 4883
32nd
4
238879 +/- 594
32nd
3
238845 +/- 1652
31st
4
237985 +/- 8236
31st
3
237793 +/- 372
31st
4
237355 +/- 807
30th
9
237012 +/- 12765
30th
4
236319 +/- 7363
29th
5
235252 +/- 3820
29th
3
234184 +/- 1034
29th
12
233437 +/- 9689
29th
5
233365 +/- 1250
29th
3
233132 +/- 1012
29th
11
233045 +/- 7238
28th
4
231712 +/- 3392
27th
3
230269 +/- 1081
26th
3
229559 +/- 2112
Low-Tier
25th
< 228714
25th
43
228275 +/- 4445
25th
7
227495 +/- 4916
24th
4
227009 +/- 281
24th
3
226995 +/- 3796
23rd
6
224449 +/- 3818
22nd
9
222628 +/- 3326
22nd
3
222166 +/- 1051
21st
4
221916 +/- 379
21st
4
220323 +/- 2662
19th
5
216555 +/- 1503
19th
3
215843 +/- 37
19th
3
214496 +/- 1001
19th
3
214112 +/- 814
19th
4
214041 +/- 1618
18th
3
211996 +/- 254
18th
5
211198 +/- 233
17th
11
211112 +/- 1881
17th
7
210360 +/- 2138
16th
4
206096 +/- 1045
15th
5
205322 +/- 2680
15th
3
205108 +/- 242
15th
6
204044 +/- 622
15th
3
203892 +/- 3711
14th
3
202261 +/- 239
13th
3
194997 +/- 240
13th
7
191809 +/- 934
12th
3
191139 +/- 28
12th
3
188073 +/- 1615
12th
4
188027 +/- 1419
11th
4
179986 +/- 880
11th
6
179766 +/- 2005
11th
6
178700 +/- 314
10th
3
175689 +/- 620
10th
3
173198 +/- 1201
10th
4
172974 +/- 956
9th
3
170816 +/- 559
9th
3
170794 +/- 61
9th
3
164783 +/- 4205
7th
5
143986 +/- 1189
5th
3
93211 +/- 862
5th
4
82471 +/- 197
4th
8
51972 +/- 6763
3rd
7
45517 +/- 2692
2nd
3
14964 +/- 2105
OpenBenchmarking.orgDistribution Of Public Results - Benchmark: SecureMark-TLS1543 Results Range From 13588 To 497771 marks135882327232956426405232462008716928137691060100744110428120112129796139480149164158848168532178216187900197584207268216952226636236320246004255688265372275056284740294424304108313792323476333160342844352528362212371896381580391264400948410632420316430000439684449368459052468736478420488104497788306090120150

Based on OpenBenchmarking.org data, the selected test / test configuration (SecureMark 1.0.4 - Benchmark: SecureMark-TLS) has an average run-time of 15 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkBenchmark: SecureMark-TLSRun-Time612182430Min: 14 / Avg: 14.27 / Max: 29

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.2%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsBenchmark: SecureMark-TLSDeviation246810Min: 0 / Avg: 0.23 / Max: 3

Does It Scale Well With Increasing Cores?

No, based on the automated analysis of the collected public benchmark data, this test / test settings does not generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

IntelAMDOpenBenchmarking.orgRelative Core Scaling To BaseSecureMark CPU Core ScalingBenchmark: SecureMark-TLS24681012141624324864961281920.68961.37922.06882.75843.448

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set
Support
Instructions Detected
SSE2 (SSE2)
Used by default on supported hardware.
 
CVTSS2SD MOVDQA MOVDQU PSRLDQ MOVD PSHUFD
Last automated analysis: 18 January 2022

This test profile binary relies on the shared libraries libc.so.6.

Tested CPU Architectures

This benchmark has been successfully tested on the below mentioned architectures. The CPU architectures listed is where successful OpenBenchmarking.org result uploads occurred, namely for helping to determine if a given test is compatible with various alternative CPU architectures.

CPU Architecture
Kernel Identifier
Verified On
Intel / AMD x86 64-bit
x86_64
(Many Processors)
IBM Z
s390x
(Many Processors)
RISC-V 64-bit
riscv64
SiFive RISC-V, SiFive U740, rv64imafdc, rv64imafdcsu
Loongson LoongArch 64-bit
loongarch64
Loongson-3A6000
ARMv7 32-bit
armv7l
ARMv7 Cortex-A53 4-Core, ARMv7 Cortex-A72 4-Core
ARMv8 64-bit
aarch64
ARMv8 Cortex-A53 4-Core, ARMv8 Cortex-A57 4-Core, ARMv8 Cortex-A72, ARMv8 Cortex-A72 16-Core, ARMv8 Cortex-A72 4-Core, ARMv8 Neoverse-N1, ARMv8 Neoverse-V1, ARMv8 Neoverse-V2 72-Core, Ampere ARMv8 Neoverse-N1 128-Core, Ampere ARMv8 Neoverse-N1 160-Core, Ampere ARMv8 Neoverse-N1 256-Core, Ampere Altra ARMv8 Neoverse-N1 160-Core, Ampere eMAG ARMv8 32-Core, AmpereOne 192-Core, Apple M1, Apple M2, HiSilicon, Rockchip ARMv8 Cortex-A76 4-Core, Rockchip ARMv8 Cortex-A76 8-Core