Memcached

Memcached is a high performance, distributed memory object caching system. This Memcached test profiles makes use of memtier_benchmark for excuting this CPU/memory-focused server benchmark.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark memcached.

Project Site

memcached.org

Source Repository

github.com

Test Created

19 August 2022

Last Updated

25 March 2023

Test Maintainer

Michael Larabel 

Test Type

System

Average Install Time

32 Seconds

Average Run Time

3 Minutes, 54 Seconds

Test Dependencies

C/C++ Compiler Toolchain + Libevent + Perl Compatible Regular Expressions + Zlib + OpenSSL + Libtool

Accolades

40k+ Downloads

Supported Platforms


Public Result Uploads *Reported Installs **Reported Test Completions **Test Profile Page ViewsOpenBenchmarking.orgEventsMemcached Popularity Statisticspts/memcached2022.082022.092022.102022.112022.122023.012023.022023.032023.042023.052023.062023.072023.082023.092023.102023.112023.122024.012024.022024.032024.042024.052024.062024.072024.082024.092024.102024.112024.125K10K15K20K25K
* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data updated weekly as of 25 December 2024.
1:1038.4%1:10045.5%1:516.0%Set To Get Ratio Option PopularityOpenBenchmarking.org

Revision History

pts/memcached-1.2.0   [View Source]   Sat, 25 Mar 2023 11:45:35 GMT
Update against memcached 1.6.19 for GCC 13 build fix.

pts/memcached-1.1.0   [View Source]   Wed, 01 Feb 2023 15:16:10 GMT
Pull in fixes from https://github.com/phoronix-test-suite/test-profiles/pull/266 Closes: https://github.com/phoronix-test-suite/test-profiles/pull/266

pts/memcached-1.0.0   [View Source]   Fri, 19 Aug 2022 14:43:00 GMT
Add memcached benchmark using memtier_benchmark.

Suites Using This Test

Database Test Suite

Server


Performance Metrics

Analyze Test Configuration:

Memcached 1.6.19

Set To Get Ratio: 1:100

OpenBenchmarking.org metrics for this test profile configuration based on 1,191 public results since 25 March 2023 with the latest data as of 22 December 2024.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Compatible Public Results
Ops/sec (Average)
100th
5
13986050 +/- 256546
99th
6
13488609 +/- 441078
99th
14
13404486 +/- 119180
98th
8
13060939 +/- 584940
98th
14
12954309 +/- 933041
96th
20
11762877 +/- 636848
90th
4
8117068 +/- 16923
90th
14
8032027 +/- 471467
87th
22
7685094 +/- 338465
85th
13
7543304 +/- 226983
83rd
16
6806345 +/- 141446
81st
11
6057566 +/- 471874
80th
7
5970200 +/- 33271
79th
8
5942859 +/- 563168
78th
25
5524136 +/- 444699
Mid-Tier
75th
< 5112118
75th
6
4932304 +/- 9109
73rd
5
4755670 +/- 4386
72nd
9
4638795 +/- 133717
71st
14
4420532 +/- 69538
70th
10
4391681 +/- 246968
69th
5
4341354 +/- 79064
66th
13
4085022 +/- 87947
66th
9
4012628 +/- 210663
65th
7
3911788 +/- 52973
64th
5
3845228 +/- 2676
61st
3
3686165 +/- 117954
61st
5
3675715 +/- 235282
60th
5
3630098 +/- 326221
60th
3
3576914 +/- 14716
59th
10
3532254 +/- 69376
59th
23
3525553 +/- 172333
51st
7
3187641 +/- 147910
Median
50th
3179845
50th
4
3160052 +/- 424682
50th
4
3103295 +/- 64371
50th
20
3102931 +/- 295599
49th
19
3101292 +/- 358831
48th
4
3037917 +/- 24782
47th
5
3008230 +/- 90836
47th
4
2990660 +/- 28926
45th
14
2944057 +/- 122741
45th
19
2939347 +/- 208371
43rd
4
2777089 +/- 125506
43rd
13
2762699 +/- 331409
42nd
8
2752909 +/- 257144
38th
4
2577950 +/- 265911
37th
7
2554610 +/- 38343
34th
6
2415724 +/- 85367
31st
7
2205326 +/- 10378
31st
7
2184150 +/- 235765
30th
10
2174126 +/- 138955
30th
4
2109416 +/- 9851
30th
3
2098107 +/- 91622
27th
10
1941871 +/- 12074
Low-Tier
25th
< 1926837
24th
7
1807869 +/- 27989
23rd
3
1782540
22nd
3
1624580 +/- 50856
21st
4
1594146 +/- 4626
20th
5
1553303 +/- 10896
20th
3
1524842
19th
8
1521484 +/- 96348
19th
8
1499652 +/- 30332
18th
6
1476404 +/- 144673
16th
9
1412890 +/- 29044
15th
5
1383679 +/- 9286
15th
5
1377100 +/- 15500
14th
4
1326875 +/- 44628
14th
4
1306616 +/- 173039
12th
5
1142347 +/- 157846
12th
4
1066940 +/- 3859
11th
3
1048826 +/- 8308
11th
3
1013278 +/- 26207
10th
3
929855 +/- 6646
10th
8
922486 +/- 83240
8th
3
763349 +/- 48030
7th
22
738777 +/- 40788
6th
5
703140 +/- 12253
6th
3
696557 +/- 2298
5th
3
641807 +/- 17117
4th
4
491116 +/- 5997
Detailed Performance Overview
OpenBenchmarking.orgDistribution Of Public Results - Set To Get Ratio: 1:1001189 Results Range From 122842 To 15868472 Ops/sec122842437755752668106758113824941697407201232023272332642146295705932719723586885390179842167114531624484653751614505476363579127661061896421102673601570509287365841768075479956678310580862549389404069255319957023298851451020005810514971108298841114479711459710117746231208953612404449127193621303427513349188136641011397901414293927146088401492375315238666155535791586849220406080100

Based on OpenBenchmarking.org data, the selected test / test configuration (Memcached 1.6.19 - Set To Get Ratio: 1:100) has an average run-time of 6 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkSet To Get Ratio: 1:100Run-Time48121620Min: 4 / Avg: 5.84 / Max: 17

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.6%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsSet To Get Ratio: 1:100Deviation246810Min: 0 / Avg: 0.64 / Max: 6

Does It Scale Well With Increasing Cores?

Yes, based on the automated analysis of the collected public benchmark data, this test / test settings does generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

IntelAMDOpenBenchmarking.orgRelative Core Scaling To BaseMemcached CPU Core ScalingSet To Get Ratio: 1:100468101214163264961282.034.066.098.1210.15

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set
Support
Instructions Detected
SSE2 (SSE2)
Used by default on supported hardware.
 
CVTSI2SD COMISD UCOMISD MOVAPD DIVSD MULSD CVTTSD2SI ADDSD CVTSS2SD SUBSD MOVDQU MOVDQA MAXSD MINSD CVTSD2SS SQRTSD ANDPD ANDNPD CMPNLESD ORPD
Requires passing a supported compiler/build flag (verified with targets: sandybridge, skylake, tigerlake, cascadelake, sapphirerapids, alderlake, znver2, znver3).
Found on Intel processors since Sandy Bridge (2011).
Found on AMD processors since Bulldozer (2011).

 
VINSERTF128 VEXTRACTF128 VZEROUPPER
Requires passing a supported compiler/build flag (verified with targets: skylake, tigerlake, cascadelake, sapphirerapids, alderlake, znver2, znver3).
Found on Intel processors since Haswell (2013).
Found on AMD processors since Excavator (2016).

 
VEXTRACTI128 VINSERTI128
FMA (FMA)
Requires passing a supported compiler/build flag (verified with targets: skylake, tigerlake, cascadelake, sapphirerapids, alderlake, znver2, znver3).
Found on Intel processors since Haswell (2013).
Found on AMD processors since Bulldozer (2011).

 
VFMADD213SD VFMADD231SD
Advanced Vector Extensions 512 (AVX512)
Requires passing a supported compiler/build flag (verified with targets: cascadelake, sapphirerapids).
 
(ZMM REGISTER USE)
The test / benchmark does honor compiler flag changes.
Last automated analysis: 30 March 2023

This test profile binary relies on the shared libraries libevent-2.1.so.7, libcrypto.so.3, libssl.so.3, libz.so.1, libm.so.6, libc.so.6.

Tested CPU Architectures

This benchmark has been successfully tested on the below mentioned architectures. The CPU architectures listed is where successful OpenBenchmarking.org result uploads occurred, namely for helping to determine if a given test is compatible with various alternative CPU architectures.

CPU Architecture
Kernel Identifier
Verified On
Intel / AMD x86 64-bit
x86_64
(Many Processors)
ARMv8 64-bit
aarch64
ARMv8, ARMv8 Neoverse-N1, ARMv8 Neoverse-N1 128-Core, ARMv8 Neoverse-V2, ARMv8 Neoverse-V2 72-Core, ARMv8 rev 0, AmpereOne, AmpereOne 192-Core, AmpereOne 72-Core, Apple M2, Rockchip ARMv8 Cortex-A76 4-Core

Recent Test Results

OpenBenchmarking.org Results Compare

33 Systems - 367 Benchmark Results

2 Systems - 84 Benchmark Results

Intel Core Ultra 9 285K - ASUS ROG MAXIMUS Z890 HERO - Intel Device ae7f

Ubuntu 24.10 - 6.11.0-9-generic - GNOME Shell 47.0

4 Systems - 856 Benchmark Results

1 System - 113 Benchmark Results

2 x AMD EPYC 9755 128-Core - AMD VOLCANO - AMD Device 153a

Ubuntu 24.04 - 6.8.0-45-generic - GCC 13.2.0 + Clang 18.1.3

Most Popular Test Results

OpenBenchmarking.org Results Compare

3 Systems - 413 Benchmark Results

Intel Core Ultra 7 155H - MTL Swift SFG14-72T Coral_MTH - Intel Device 7e7f

Ubuntu 24.04 - 6.10.0-061000rc4daily20240621-generic - GNOME Shell 46.0

18 Systems - 442 Benchmark Results

AMD Ryzen 9 7900X3D 12-Core - ASUS ROG STRIX X670E-E GAMING WIFI - AMD Device 14d8

Ubuntu 24.04 - 6.10.0-061000rc2-generic - GNOME Shell 46.0

3 Systems - 131 Benchmark Results

AMD Ryzen 7 5800X3D 8-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 22.04 - 5.17.0-1019-oem - GNOME Shell 42.2

5 Systems - 203 Benchmark Results

2 x AMD EPYC 9654 96-Core - AMD Titanite_4G - AMD Device 14a4

Ubuntu 23.04 - 5.19.0-21-generic - GNOME Shell 43.1

4 Systems - 215 Benchmark Results

Intel Xeon Gold 6346 - Supermicro X12SPO-NTF v2.00 - 8 x 64 GB DDR4-3200MT

AlmaLinux 9.1 - 5.14.0-162.12.1.el9_1.x86_64 - GCC 11.3.1 20220421

3 Systems - 237 Benchmark Results

AMD Ryzen 7 4800U - ASRock 4X4-4000 - AMD Renoir

Ubuntu 22.04 - 5.19.0-rc6-phx-retbleed - GNOME Shell 42.2

2 Systems - 84 Benchmark Results

Intel Core i9-13900K - ASUS PRIME Z790-P WIFI - Intel Device 7a27

Ubuntu 23.04 - 6.2.0-20-generic - GNOME Shell 44.0

8 Systems - 271 Benchmark Results

AMD Ryzen 7 5800X 8-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 22.04 - 5.19.0-46-generic - GNOME Shell 42.5

4 Systems - 132 Benchmark Results

2 x AMD EPYC 7773X 64-Core - AMD DAYTONA_X - AMD Starship

Ubuntu 22.04 - 6.2.0-phx - GNOME Shell 42.5

Find More Test Results