auggy

AMD Ryzen 5 4500U testing with a LENOVO LNVNB161216 (EECN20WW BIOS) and AMD Renoir 512MB on Pop 22.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2308051-NE-AUGGY363552&grr&rdt.

auggyProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen ResolutionabAMD Renoir - AMD Ryzen 5 4500UAMD Ryzen 5 4500U @ 2.38GHz (6 Cores)LENOVO LNVNB161216 (EECN20WW BIOS)AMD Renoir/Cezanne16GB256GB SK hynix HFM256GDHTNI-87A0BAMD Renoir 512MB (1500/400MHz)AMD Renoir Radeon HD AudioRealtek RTL8822CE 802.11ac PCIePop 22.045.17.5-76051705-generic (x86_64)GNOME Shell 42.1X Server 1.21.1.34.6 Mesa 22.0.1 (LLVM 13.0.1 DRM 3.44)1.2.204GCC 11.2.0ext41920x1080AMD Renoir 512MB (1500MHz)AMD Renoir 512MB (1500/400MHz)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-gBFGDP/gcc-11-11.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-gBFGDP/gcc-11-11.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - Platform Profile: balanced - CPU Microcode: 0x8600102 - ACPI Profile: balanced Graphics Details- GLAMOR - BAR1 / Visible vRAM Size: 512 MB - vBIOS Version: 113-RENOIR-025Java Details- OpenJDK Runtime Environment (build 11.0.15+10-Ubuntu-0ubuntu0.22.04.1)Python Details- Python 3.10.6Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Not affected + tsx_async_abort: Not affected

auggybuild-gcc: Time To Compilecouchdb: 500 - 3000 - 30brl-cad: VGR Performance Metriccouchdb: 300 - 3000 - 30apache-iotdb: 500 - 100 - 500apache-iotdb: 500 - 100 - 500couchdb: 100 - 3000 - 30couchdb: 500 - 1000 - 30vkpeak: int16-vec4vkpeak: int16-scalarvkpeak: int32-vec4vkpeak: int32-scalarvkpeak: fp64-vec4vkpeak: fp64-scalarvkpeak: fp16-vec4vkpeak: fp16-scalarvkpeak: fp32-vec4vkpeak: fp32-scalarvvenc: Bosphorus 4K - Fastcouchdb: 300 - 1000 - 30deepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamncnn: CPU - FastestDetncnn: CPU - vision_transformerncnn: CPU - regnety_400mncnn: CPU - squeezenet_ssdncnn: CPU - yolov4-tinyncnn: CPU - resnet50ncnn: CPU - alexnetncnn: CPU - resnet18ncnn: CPU - vgg16ncnn: CPU - googlenetncnn: CPU - blazefacencnn: CPU - efficientnet-b0ncnn: CPU - mnasnetncnn: CPU - shufflenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU - mobilenetncnn: Vulkan GPU - FastestDetncnn: Vulkan GPU - vision_transformerncnn: Vulkan GPU - regnety_400mncnn: Vulkan GPU - squeezenet_ssdncnn: Vulkan GPU - yolov4-tinyncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - googlenetncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU - mobilenetdeepsparse: BERT-Large, NLP Question Answering - Synchronous Single-Streamdeepsparse: BERT-Large, NLP Question Answering - Synchronous Single-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Synchronous Single-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Synchronous Single-Streamvvenc: Bosphorus 4K - Fastercouchdb: 100 - 1000 - 30apache-iotdb: 500 - 100 - 200apache-iotdb: 500 - 100 - 200apache-iotdb: 200 - 100 - 500apache-iotdb: 200 - 100 - 500deepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamcassandra: Writesvvenc: Bosphorus 1080p - Fastdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamapache-iotdb: 500 - 1 - 500apache-iotdb: 500 - 1 - 500deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdragonflydb: 60 - 1:5dragonflydb: 60 - 1:100dragonflydb: 50 - 1:10dragonflydb: 50 - 1:5dragonflydb: 50 - 1:100dragonflydb: 60 - 1:10dragonflydb: 20 - 1:10dragonflydb: 20 - 1:100dragonflydb: 10 - 1:10dragonflydb: 10 - 1:100dragonflydb: 20 - 1:5dragonflydb: 10 - 1:5apache-iotdb: 100 - 100 - 500apache-iotdb: 100 - 100 - 500deepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Synchronous Single-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Streamapache-iotdb: 200 - 100 - 200apache-iotdb: 200 - 100 - 200deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamvvenc: Bosphorus 1080p - Fasterdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Synchronous Single-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Synchronous Single-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection, YOLOv5s COCO - Synchronous Single-Streamdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamdeepsparse: ResNet-50, Baseline - Synchronous Single-Streamdeepsparse: ResNet-50, Baseline - Synchronous Single-Streamdeepsparse: ResNet-50, Sparse INT8 - Synchronous Single-Streamdeepsparse: ResNet-50, Sparse INT8 - Synchronous Single-Streamapache-iotdb: 500 - 1 - 200apache-iotdb: 500 - 1 - 200apache-iotdb: 100 - 100 - 200apache-iotdb: 100 - 100 - 200apache-iotdb: 200 - 1 - 500apache-iotdb: 200 - 1 - 500apache-iotdb: 200 - 1 - 200apache-iotdb: 100 - 1 - 500apache-iotdb: 200 - 1 - 200apache-iotdb: 100 - 1 - 500apache-iotdb: 100 - 1 - 200apache-iotdb: 100 - 1 - 200vkresample: 2x - SingleabAMD Renoir - AMD Ryzen 5 4500U2725.0041252.59953415878.652720.446656162.13493.651401.313229.3889.32163.1970.9280.6059.694.014.21177.2862.211.561277.677628.08124.75615.14242.259.5818.5040.6835.4510.8215.3593.4320.661.4511.645.885.006.407.6726.925.11241.979.8818.3141.0035.5010.7315.1993.5720.331.3411.305.514.435.957.4126.95253.17013.949835.895127.85113.482155.070156.1911896529.96354.1213117829.3168.410843.8114232365.16415.445564.6993809.26933.682571.38640326.81196.054915.3557279.968210.701435.495184.3727851.96013.501298.693130.3778639312.80672849.08634736.01602213.78603815.39638619.97619544.49521281.07517164.96538437.76555633.33560321.90288.8715836698.969.994114.3163110.57989.0426723.98874.132139.012025.6329280.41983.5660302.45583.3080237.28074.2141107.7116236661.9794.036031.929032.651230.618313.3654.534618.3337146.857020.4003143.255020.903052.240219.137010.4265286.904174.221440.392825.746338.829868.181243.957824.704440.46026.3938155.9575870872.7319.34104.6515789875.81982415.9342.3221.11818281.01686458.8945.12446723.6228.5355.6022604.3861261.9862517896.375517.787404.386218.4384.22156.566.7874.456.033.884.21176.3962.251.802280.539814.77133.65585.13241.229.9418.440.6635.7110.7915.3693.6921.271.3611.876.315.196.418.0227.025.23245.89.9617.8740.2335.1710.7116.1992.9821.011.2511.445.915.216.397.626.98250.61653.9934.959428.59393.97160.43268.427443.7597235355.82815.196965.7528815.38353.6482195.838715.3016284.329910.541535.399584.5974842.47563.5558100.017529.9723620626.04624768.18649063.96600771.43710309636341.63587558.64549095.84515883.69515626.76595869.89511381.8467.149114.89112.78238.8655718.16584.149541.013124.3744285.36753.5041296.56873.3718237.67544.207190.479433.124832.839230.442514.53154.18418.452148.865820.1215141.298521.211253.228518.781710.4703285.740970.296242.641125.255339.576867.847344.177824.641540.56296.7742147.224755.7262409.2401254.97662248891.191706.956836941.96512.397407.845228.8989.15163.1370.8779.7059.634.004.21176.8362.21.817284.352625.28244.76975.05237.129.8318.040.6435.6310.7415.4793.7220.951.2611.415.934.816.347.8926.795.09240.259.6518.4240.3835.2410.6715.1793.5020.461.4211.435.814.526.377.4326.80239.35454.177737.602326.58894.108157.985155.1411298528.21375.2311981302.9268.143143.9816231806.08115.567164.1923816.05333.639770.26637397.9225.731813.3056275.035510.891535.859583.5418865.63883.4493101.344329.5718673078.78692262.13576996.27618630.54652808.07632802.22602510.4635238.89536437.47517858.51587975.21514823.83337.1613387890.267.784514.752097.713510.2327717.17584.156540.655324.5894285.86943.4981336.98402.9676236.44344.2291118.2414164673.0390.258733.211532.152131.092914.67352.619619.0010144.779820.6990141.308021.192751.530819.400210.3851288.079573.589940.718925.134839.766467.665044.284724.529140.74864.7072211.8067855795.4119.64113.8714130374.99994052.2541.3821813547.71684869.0445.06465319.7528.3655.249OpenBenchmarking.org

Timed GCC Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed GCC Compilation 13.2Time To CompileabAMD Renoir - AMD Ryzen 5 4500U6001200180024003000SE +/- 9.38, N = 2SE +/- 46.09, N = 22725.002604.392409.24

Apache CouchDB

Bulk Size: 500 - Inserts: 3000 - Rounds: 30

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Bulk Size: 500 - Inserts: 3000 - Rounds: 30abAMD Renoir - AMD Ryzen 5 4500U30060090012001500SE +/- 5.65, N = 2SE +/- 3.01, N = 21252.601261.981254.981. (CXX) g++ options: -std=c++17 -lmozjs-91 -lm -lei -fPIC -MMD

BRL-CAD

VGR Performance Metric

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.36VGR Performance MetricabAMD Renoir - AMD Ryzen 5 4500U13K26K39K52K65KSE +/- 2174.50, N = 2SE +/- 83.00, N = 25341562517622481. (CXX) g++ options: -std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6

Apache CouchDB

Bulk Size: 300 - Inserts: 3000 - Rounds: 30

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Bulk Size: 300 - Inserts: 3000 - Rounds: 30abAMD Renoir - AMD Ryzen 5 4500U2004006008001000SE +/- 4.72, N = 2SE +/- 1.01, N = 2878.65896.38891.191. (CXX) g++ options: -std=c++17 -lmozjs-91 -lm -lei -fPIC -MMD

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500

OpenBenchmarking.orgAverage Latency, More Is BetterApache IoTDB 1.1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500aAMD Renoir - AMD Ryzen 5 4500U160320480640800720.44706.95MAX: 4246.32MAX: 4244.39

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500aAMD Renoir - AMD Ryzen 5 4500U1.5M3M4.5M6M7.5M6656162.136836941.96

Apache CouchDB

Bulk Size: 100 - Inserts: 3000 - Rounds: 30

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Bulk Size: 100 - Inserts: 3000 - Rounds: 30abAMD Renoir - AMD Ryzen 5 4500U110220330440550SE +/- 2.87, N = 2SE +/- 0.56, N = 2493.65517.79512.401. (CXX) g++ options: -std=c++17 -lmozjs-91 -lm -lei -fPIC -MMD

Apache CouchDB

Bulk Size: 500 - Inserts: 1000 - Rounds: 30

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Bulk Size: 500 - Inserts: 1000 - Rounds: 30abAMD Renoir - AMD Ryzen 5 4500U90180270360450SE +/- 7.43, N = 2SE +/- 3.34, N = 2401.31404.39407.851. (CXX) g++ options: -std=c++17 -lmozjs-91 -lm -lei -fPIC -MMD

vkpeak

int16-vec4

OpenBenchmarking.orgGIOPS, More Is Bettervkpeak 20230730int16-vec4abAMD Renoir - AMD Ryzen 5 4500U50100150200250SE +/- 3.00, N = 2SE +/- 3.57, N = 2229.38218.43228.89

vkpeak

int16-scalar

OpenBenchmarking.orgGIOPS, More Is Bettervkpeak 20230730int16-scalarabAMD Renoir - AMD Ryzen 5 4500U20406080100SE +/- 1.47, N = 2SE +/- 1.63, N = 289.3284.2289.15

vkpeak

int32-vec4

OpenBenchmarking.orgGIOPS, More Is Bettervkpeak 20230730int32-vec4abAMD Renoir - AMD Ryzen 5 4500U4080120160200SE +/- 2.63, N = 2SE +/- 3.49, N = 2163.19156.50163.13

vkpeak

int32-scalar

OpenBenchmarking.orgGIOPS, More Is Bettervkpeak 20230730int32-scalarabAMD Renoir - AMD Ryzen 5 4500U1632486480SE +/- 1.69, N = 2SE +/- 2.27, N = 270.9266.7870.87

vkpeak

fp64-vec4

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20230730fp64-vec4abAMD Renoir - AMD Ryzen 5 4500U20406080100SE +/- 3.81, N = 2SE +/- 3.03, N = 280.6074.4079.70

vkpeak

fp64-scalar

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20230730fp64-scalarabAMD Renoir - AMD Ryzen 5 4500U1326395265SE +/- 2.11, N = 2SE +/- 2.16, N = 259.6956.0359.63

vkpeak

fp16-vec4

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20230730fp16-vec4abAMD Renoir - AMD Ryzen 5 4500U0.90231.80462.70693.60924.5115SE +/- 0.06, N = 2SE +/- 0.07, N = 24.013.884.00

vkpeak

fp16-scalar

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20230730fp16-scalarabAMD Renoir - AMD Ryzen 5 4500U0.94731.89462.84193.78924.7365SE +/- 0.01, N = 2SE +/- 0.01, N = 24.214.214.21

vkpeak

fp32-vec4

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20230730fp32-vec4abAMD Renoir - AMD Ryzen 5 4500U4080120160200SE +/- 2.40, N = 2SE +/- 2.79, N = 2177.28176.39176.83

vkpeak

fp32-scalar

OpenBenchmarking.orgGFLOPS, More Is Bettervkpeak 20230730fp32-scalarabAMD Renoir - AMD Ryzen 5 4500U1428425670SE +/- 0.05, N = 2SE +/- 0.00, N = 262.2162.2562.20

VVenC

Video Input: Bosphorus 4K - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 4K - Video Preset: FastabAMD Renoir - AMD Ryzen 5 4500U0.40880.81761.22641.63522.044SE +/- 0.056, N = 2SE +/- 0.031, N = 21.5611.8021.8171. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

Apache CouchDB

Bulk Size: 300 - Inserts: 1000 - Rounds: 30

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Bulk Size: 300 - Inserts: 1000 - Rounds: 30abAMD Renoir - AMD Ryzen 5 4500U60120180240300SE +/- 5.40, N = 2SE +/- 1.56, N = 2277.68280.54284.351. (CXX) g++ options: -std=c++17 -lmozjs-91 -lm -lei -fPIC -MMD

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-StreamabAMD Renoir - AMD Ryzen 5 4500U2004006008001000SE +/- 0.37, N = 2SE +/- 0.89, N = 2628.08814.77625.28

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-StreamabAMD Renoir - AMD Ryzen 5 4500U1.07322.14643.21964.29285.366SE +/- 0.0029, N = 2SE +/- 0.0053, N = 24.75613.65584.7697

NCNN

Target: CPU - Model: FastestDet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: FastestDetabAMD Renoir - AMD Ryzen 5 4500U1.15652.3133.46954.6265.7825SE +/- 0.04, N = 2SE +/- 0.01, N = 25.145.135.05MIN: 5.03 / MAX: 9.54MIN: 4.94 / MAX: 16.65MIN: 4.94 / MAX: 9.131. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: vision_transformer

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: vision_transformerabAMD Renoir - AMD Ryzen 5 4500U50100150200250SE +/- 1.68, N = 2SE +/- 0.75, N = 2242.25241.22237.12MIN: 238.66 / MAX: 266.75MIN: 238.33 / MAX: 292.19MIN: 234.17 / MAX: 277.131. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: regnety_400mabAMD Renoir - AMD Ryzen 5 4500U3691215SE +/- 0.07, N = 2SE +/- 0.24, N = 29.589.949.83MIN: 9.2 / MAX: 14.22MIN: 9.16 / MAX: 28.5MIN: 9.12 / MAX: 28.661. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: squeezenet_ssdabAMD Renoir - AMD Ryzen 5 4500U510152025SE +/- 0.03, N = 2SE +/- 0.10, N = 218.5018.4018.00MIN: 17.94 / MAX: 33.27MIN: 17.89 / MAX: 32.97MIN: 17.57 / MAX: 23.861. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: yolov4-tinyabAMD Renoir - AMD Ryzen 5 4500U918273645SE +/- 0.11, N = 2SE +/- 0.30, N = 240.6840.6640.64MIN: 39.56 / MAX: 80.12MIN: 39.41 / MAX: 82.29MIN: 39.51 / MAX: 87.11. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: resnet50abAMD Renoir - AMD Ryzen 5 4500U816243240SE +/- 0.08, N = 2SE +/- 0.25, N = 235.4535.7135.63MIN: 34.36 / MAX: 53MIN: 34.37 / MAX: 52.21MIN: 34.42 / MAX: 98.871. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: alexnetabAMD Renoir - AMD Ryzen 5 4500U3691215SE +/- 0.03, N = 2SE +/- 0.01, N = 210.8210.7910.74MIN: 10.44 / MAX: 22.89MIN: 10.5 / MAX: 13.68MIN: 10.36 / MAX: 20.551. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: resnet18abAMD Renoir - AMD Ryzen 5 4500U48121620SE +/- 0.22, N = 2SE +/- 0.28, N = 215.3515.3615.47MIN: 14.65 / MAX: 35.35MIN: 14.62 / MAX: 31.58MIN: 14.36 / MAX: 32.251. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: vgg16abAMD Renoir - AMD Ryzen 5 4500U20406080100SE +/- 0.16, N = 2SE +/- 0.09, N = 293.4393.6993.72MIN: 91.03 / MAX: 140.17MIN: 91.65 / MAX: 138.85MIN: 91.26 / MAX: 109.981. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: googlenetabAMD Renoir - AMD Ryzen 5 4500U510152025SE +/- 0.04, N = 2SE +/- 0.66, N = 220.6621.2720.95MIN: 19.67 / MAX: 46.35MIN: 19.64 / MAX: 48.18MIN: 19.48 / MAX: 65.771. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: blazefaceabAMD Renoir - AMD Ryzen 5 4500U0.32630.65260.97891.30521.6315SE +/- 0.06, N = 2SE +/- 0.01, N = 21.451.361.26MIN: 1.27 / MAX: 7.7MIN: 1.24 / MAX: 7.56MIN: 1.19 / MAX: 5.911. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: efficientnet-b0abAMD Renoir - AMD Ryzen 5 4500U3691215SE +/- 0.19, N = 2SE +/- 0.15, N = 211.6411.8711.41MIN: 10.62 / MAX: 33.04MIN: 10.56 / MAX: 29.61MIN: 10.41 / MAX: 63.481. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: mnasnetabAMD Renoir - AMD Ryzen 5 4500U246810SE +/- 0.25, N = 2SE +/- 0.36, N = 25.886.315.93MIN: 5.21 / MAX: 22.5MIN: 5.18 / MAX: 18.06MIN: 5.06 / MAX: 22.981. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: shufflenet-v2abAMD Renoir - AMD Ryzen 5 4500U1.16782.33563.50344.67125.839SE +/- 0.11, N = 2SE +/- 0.08, N = 25.005.194.81MIN: 3.96 / MAX: 21.02MIN: 4.05 / MAX: 19.52MIN: 3.93 / MAX: 21.181. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU-v3-v3 - Model: mobilenet-v3abAMD Renoir - AMD Ryzen 5 4500U246810SE +/- 0.15, N = 2SE +/- 0.11, N = 26.406.416.34MIN: 5.23 / MAX: 21.11MIN: 5.28 / MAX: 22.1MIN: 5.17 / MAX: 24.251. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU-v2-v2 - Model: mobilenet-v2abAMD Renoir - AMD Ryzen 5 4500U246810SE +/- 0.19, N = 2SE +/- 0.16, N = 27.678.027.89MIN: 7.1 / MAX: 21.52MIN: 7.08 / MAX: 22.24MIN: 6.89 / MAX: 23.061. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: mobilenetabAMD Renoir - AMD Ryzen 5 4500U612182430SE +/- 0.15, N = 2SE +/- 0.05, N = 226.9227.0226.79MIN: 26.1 / MAX: 45.94MIN: 26.45 / MAX: 32.06MIN: 25.89 / MAX: 86.671. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: FastestDet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: FastestDetabAMD Renoir - AMD Ryzen 5 4500U1.17682.35363.53044.70725.884SE +/- 0.03, N = 2SE +/- 0.04, N = 25.115.235.09MIN: 5 / MAX: 10.03MIN: 4.92 / MAX: 16.39MIN: 4.9 / MAX: 16.221. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: vision_transformer

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: vision_transformerabAMD Renoir - AMD Ryzen 5 4500U50100150200250SE +/- 4.64, N = 2SE +/- 1.62, N = 2241.97245.80240.25MIN: 235.91 / MAX: 304.26MIN: 243.93 / MAX: 280.56MIN: 236.95 / MAX: 294.821. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: regnety_400mabAMD Renoir - AMD Ryzen 5 4500U3691215SE +/- 0.12, N = 2SE +/- 0.08, N = 29.889.969.65MIN: 9.26 / MAX: 64.49MIN: 9.13 / MAX: 28.6MIN: 9.16 / MAX: 29.121. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: squeezenet_ssdabAMD Renoir - AMD Ryzen 5 4500U510152025SE +/- 0.08, N = 2SE +/- 0.10, N = 218.3117.8718.42MIN: 17.85 / MAX: 33.97MIN: 17.59 / MAX: 22.8MIN: 17.92 / MAX: 32.61. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: yolov4-tinyabAMD Renoir - AMD Ryzen 5 4500U918273645SE +/- 0.07, N = 2SE +/- 0.02, N = 241.0040.2340.38MIN: 39.84 / MAX: 94.71MIN: 39.46 / MAX: 45.74MIN: 39.42 / MAX: 56.161. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: resnet50abAMD Renoir - AMD Ryzen 5 4500U816243240SE +/- 0.25, N = 2SE +/- 0.15, N = 235.5035.1735.24MIN: 34.39 / MAX: 63.28MIN: 34.08 / MAX: 63.6MIN: 34.4 / MAX: 51.031. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: alexnetabAMD Renoir - AMD Ryzen 5 4500U3691215SE +/- 0.03, N = 2SE +/- 0.00, N = 210.7310.7110.67MIN: 10.47 / MAX: 16.09MIN: 10.41 / MAX: 19.42MIN: 10.37 / MAX: 21.611. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: resnet18abAMD Renoir - AMD Ryzen 5 4500U48121620SE +/- 0.09, N = 2SE +/- 0.02, N = 215.1916.1915.17MIN: 14.46 / MAX: 30.44MIN: 14.7 / MAX: 65.71MIN: 14.49 / MAX: 32.361. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: vgg16abAMD Renoir - AMD Ryzen 5 4500U20406080100SE +/- 0.06, N = 2SE +/- 0.02, N = 293.5792.9893.50MIN: 91.4 / MAX: 112.49MIN: 90.89 / MAX: 125.87MIN: 91.41 / MAX: 107.451. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: googlenetabAMD Renoir - AMD Ryzen 5 4500U510152025SE +/- 0.12, N = 2SE +/- 0.21, N = 220.3321.0120.46MIN: 19.72 / MAX: 47.75MIN: 19.64 / MAX: 46.59MIN: 19.54 / MAX: 43.691. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: blazefaceabAMD Renoir - AMD Ryzen 5 4500U0.31950.6390.95851.2781.5975SE +/- 0.03, N = 2SE +/- 0.17, N = 21.341.251.42MIN: 1.25 / MAX: 5.84MIN: 1.22 / MAX: 1.35MIN: 1.21 / MAX: 42.231. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: efficientnet-b0abAMD Renoir - AMD Ryzen 5 4500U3691215SE +/- 0.01, N = 2SE +/- 0.12, N = 211.3011.4411.43MIN: 10.52 / MAX: 28.17MIN: 10.56 / MAX: 28.99MIN: 10.5 / MAX: 29.381. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: mnasnetabAMD Renoir - AMD Ryzen 5 4500U1.32982.65963.98945.31926.649SE +/- 0.14, N = 2SE +/- 0.30, N = 25.515.915.81MIN: 5.23 / MAX: 42.79MIN: 5.25 / MAX: 22.88MIN: 5 / MAX: 22.141. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: shufflenet-v2abAMD Renoir - AMD Ryzen 5 4500U1.17232.34463.51694.68925.8615SE +/- 0.27, N = 2SE +/- 0.10, N = 24.435.214.52MIN: 3.95 / MAX: 19.63MIN: 4.05 / MAX: 23.72MIN: 3.96 / MAX: 20.361. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3abAMD Renoir - AMD Ryzen 5 4500U246810SE +/- 0.36, N = 2SE +/- 0.17, N = 25.956.396.37MIN: 5.17 / MAX: 18.42MIN: 5.27 / MAX: 18.54MIN: 5.15 / MAX: 27.131. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2abAMD Renoir - AMD Ryzen 5 4500U246810SE +/- 0.07, N = 2SE +/- 0.01, N = 27.417.607.43MIN: 7.11 / MAX: 22.18MIN: 6.99 / MAX: 21.57MIN: 6.93 / MAX: 45.861. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: mobilenetabAMD Renoir - AMD Ryzen 5 4500U612182430SE +/- 0.12, N = 2SE +/- 0.08, N = 226.9526.9826.80MIN: 26 / MAX: 45.37MIN: 25.99 / MAX: 42.84MIN: 25.92 / MAX: 84.561. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-StreamabAMD Renoir - AMD Ryzen 5 4500U60120180240300SE +/- 1.06, N = 2SE +/- 0.21, N = 2253.17250.62239.35

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-StreamabAMD Renoir - AMD Ryzen 5 4500U0.941.882.823.764.7SE +/- 0.0165, N = 2SE +/- 0.0037, N = 23.94983.99004.1777

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-StreamabAMD Renoir - AMD Ryzen 5 4500U918273645SE +/- 0.34, N = 2SE +/- 0.48, N = 235.9034.9637.60

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-StreamabAMD Renoir - AMD Ryzen 5 4500U714212835SE +/- 0.26, N = 2SE +/- 0.34, N = 227.8528.5926.59

VVenC

Video Input: Bosphorus 4K - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 4K - Video Preset: FasterabAMD Renoir - AMD Ryzen 5 4500U0.92431.84862.77293.69724.6215SE +/- 0.066, N = 2SE +/- 0.045, N = 23.4823.9704.1081. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

Apache CouchDB

Bulk Size: 100 - Inserts: 1000 - Rounds: 30

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.3.2Bulk Size: 100 - Inserts: 1000 - Rounds: 30abAMD Renoir - AMD Ryzen 5 4500U4080120160200SE +/- 0.49, N = 2SE +/- 0.87, N = 2155.07160.43157.991. (CXX) g++ options: -std=c++17 -lmozjs-91 -lm -lei -fPIC -MMD

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200

OpenBenchmarking.orgAverage Latency, More Is BetterApache IoTDB 1.1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200aAMD Renoir - AMD Ryzen 5 4500U306090120150156.19155.14MAX: 2583.42MAX: 4202.36

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200aAMD Renoir - AMD Ryzen 5 4500U3M6M9M12M15M11896529.9611298528.21

Apache IoTDB

Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 500

OpenBenchmarking.orgAverage Latency, More Is BetterApache IoTDB 1.1.2Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 500aAMD Renoir - AMD Ryzen 5 4500U80160240320400354.12375.23MAX: 2940.05MAX: 4161.26

Apache IoTDB

Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 500

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 500aAMD Renoir - AMD Ryzen 5 4500U3M6M9M12M15M13117829.3111981302.92

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-StreamabAMD Renoir - AMD Ryzen 5 4500U1530456075SE +/- 0.12, N = 2SE +/- 0.06, N = 268.4168.4368.14

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-StreamabAMD Renoir - AMD Ryzen 5 4500U1020304050SE +/- 0.07, N = 2SE +/- 0.03, N = 243.8143.7643.98

Apache Cassandra

Test: Writes

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.1.3Test: WritesabAMD Renoir - AMD Ryzen 5 4500U5K10K15K20K25KSE +/- 234.00, N = 2SE +/- 212.50, N = 2232362353523180

VVenC

Video Input: Bosphorus 1080p - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 1080p - Video Preset: FastabAMD Renoir - AMD Ryzen 5 4500U246810SE +/- 0.105, N = 2SE +/- 0.061, N = 25.1645.8286.0811. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-StreamabAMD Renoir - AMD Ryzen 5 4500U48121620SE +/- 0.12, N = 2SE +/- 0.08, N = 215.4515.2015.57

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-StreamabAMD Renoir - AMD Ryzen 5 4500U1530456075SE +/- 0.51, N = 2SE +/- 0.34, N = 264.7065.7564.19

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamabAMD Renoir - AMD Ryzen 5 4500U2004006008001000SE +/- 5.58, N = 2SE +/- 0.10, N = 2809.27815.38816.05

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamabAMD Renoir - AMD Ryzen 5 4500U0.82861.65722.48583.31444.143SE +/- 0.0254, N = 2SE +/- 0.0051, N = 23.68253.64823.6397

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 500

OpenBenchmarking.orgAverage Latency, More Is BetterApache IoTDB 1.1.2Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 500aAMD Renoir - AMD Ryzen 5 4500U163248648071.3870.26MAX: 1486.72MAX: 1642.8

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 500

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 500aAMD Renoir - AMD Ryzen 5 4500U140K280K420K560K700K640326.81637397.90

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamabAMD Renoir - AMD Ryzen 5 4500U50100150200250SE +/- 13.53, N = 2SE +/- 11.53, N = 2196.05195.84225.73

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamabAMD Renoir - AMD Ryzen 5 4500U48121620SE +/- 1.07, N = 2SE +/- 0.68, N = 215.3615.3013.31

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamabAMD Renoir - AMD Ryzen 5 4500U60120180240300SE +/- 1.57, N = 2SE +/- 0.31, N = 2279.97284.33275.04

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamabAMD Renoir - AMD Ryzen 5 4500U3691215SE +/- 0.06, N = 2SE +/- 0.01, N = 210.7010.5410.89

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-StreamabAMD Renoir - AMD Ryzen 5 4500U816243240SE +/- 0.17, N = 2SE +/- 0.29, N = 235.5035.4035.86

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-StreamabAMD Renoir - AMD Ryzen 5 4500U20406080100SE +/- 0.40, N = 2SE +/- 0.67, N = 284.3784.6083.54

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamabAMD Renoir - AMD Ryzen 5 4500U2004006008001000SE +/- 1.82, N = 2SE +/- 2.42, N = 2851.96842.48865.64

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamabAMD Renoir - AMD Ryzen 5 4500U0.80011.60022.40033.20044.0005SE +/- 0.0136, N = 2SE +/- 0.0062, N = 23.50123.55583.4493

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-StreamabAMD Renoir - AMD Ryzen 5 4500U20406080100SE +/- 0.17, N = 2SE +/- 0.60, N = 298.69100.02101.34

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-StreamabAMD Renoir - AMD Ryzen 5 4500U714212835SE +/- 0.06, N = 2SE +/- 0.17, N = 230.3829.9729.57

Dragonflydb

Clients Per Thread: 60 - Set To Get Ratio: 1:5

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 1.6.2Clients Per Thread: 60 - Set To Get Ratio: 1:5abAMD Renoir - AMD Ryzen 5 4500U140K280K420K560K700KSE +/- 5949.45, N = 2SE +/- 2499.83, N = 2639312.80620626.04673078.781. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients Per Thread: 60 - Set To Get Ratio: 1:100

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 1.6.2Clients Per Thread: 60 - Set To Get Ratio: 1:100abAMD Renoir - AMD Ryzen 5 4500U150K300K450K600K750KSE +/- 33803.70, N = 2SE +/- 81324.68, N = 2672849.08624768.18692262.131. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients Per Thread: 50 - Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 1.6.2Clients Per Thread: 50 - Set To Get Ratio: 1:10abAMD Renoir - AMD Ryzen 5 4500U140K280K420K560K700KSE +/- 23316.32, N = 2SE +/- 20222.31, N = 2634736.01649063.96576996.271. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients Per Thread: 50 - Set To Get Ratio: 1:5

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 1.6.2Clients Per Thread: 50 - Set To Get Ratio: 1:5abAMD Renoir - AMD Ryzen 5 4500U130K260K390K520K650KSE +/- 6829.92, N = 2SE +/- 24601.03, N = 2602213.78600771.43618630.541. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients Per Thread: 50 - Set To Get Ratio: 1:100

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 1.6.2Clients Per Thread: 50 - Set To Get Ratio: 1:100abAMD Renoir - AMD Ryzen 5 4500U150K300K450K600K750KSE +/- 10719.53, N = 2SE +/- 25536.45, N = 2603815.39710309.00652808.071. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients Per Thread: 60 - Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 1.6.2Clients Per Thread: 60 - Set To Get Ratio: 1:10abAMD Renoir - AMD Ryzen 5 4500U140K280K420K560K700KSE +/- 66150.22, N = 2SE +/- 8371.13, N = 2638619.97636341.63632802.221. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients Per Thread: 20 - Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 1.6.2Clients Per Thread: 20 - Set To Get Ratio: 1:10abAMD Renoir - AMD Ryzen 5 4500U130K260K390K520K650KSE +/- 3012.94, N = 2SE +/- 3797.00, N = 2619544.49587558.64602510.401. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients Per Thread: 20 - Set To Get Ratio: 1:100

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 1.6.2Clients Per Thread: 20 - Set To Get Ratio: 1:100abAMD Renoir - AMD Ryzen 5 4500U140K280K420K560K700KSE +/- 24782.09, N = 2SE +/- 16580.85, N = 2521281.07549095.84635238.891. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients Per Thread: 10 - Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 1.6.2Clients Per Thread: 10 - Set To Get Ratio: 1:10abAMD Renoir - AMD Ryzen 5 4500U110K220K330K440K550KSE +/- 5831.39, N = 2SE +/- 11755.01, N = 2517164.96515883.69536437.471. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients Per Thread: 10 - Set To Get Ratio: 1:100

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 1.6.2Clients Per Thread: 10 - Set To Get Ratio: 1:100abAMD Renoir - AMD Ryzen 5 4500U120K240K360K480K600KSE +/- 587.74, N = 2SE +/- 427.13, N = 2538437.76515626.76517858.511. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients Per Thread: 20 - Set To Get Ratio: 1:5

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 1.6.2Clients Per Thread: 20 - Set To Get Ratio: 1:5abAMD Renoir - AMD Ryzen 5 4500U130K260K390K520K650KSE +/- 13564.23, N = 2SE +/- 15736.96, N = 2555633.33595869.89587975.211. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients Per Thread: 10 - Set To Get Ratio: 1:5

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 1.6.2Clients Per Thread: 10 - Set To Get Ratio: 1:5abAMD Renoir - AMD Ryzen 5 4500U120K240K360K480K600KSE +/- 4625.99, N = 2SE +/- 7066.41, N = 2560321.90511381.84514823.831. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Apache IoTDB

Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 500

OpenBenchmarking.orgAverage Latency, More Is BetterApache IoTDB 1.1.2Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 500aAMD Renoir - AMD Ryzen 5 4500U70140210280350288.87337.16MAX: 3332.52MAX: 5976.26

Apache IoTDB

Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 500

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 500aAMD Renoir - AMD Ryzen 5 4500U3M6M9M12M15M15836698.913387890.2

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamabAMD Renoir - AMD Ryzen 5 4500U1632486480SE +/- 3.28, N = 2SE +/- 0.74, N = 269.9967.1567.78

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamabAMD Renoir - AMD Ryzen 5 4500U48121620SE +/- 0.67, N = 2SE +/- 0.16, N = 214.3214.8914.75

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamabAMD Renoir - AMD Ryzen 5 4500U306090120150SE +/- 0.85, N = 2SE +/- 0.17, N = 2110.58112.7897.71

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamabAMD Renoir - AMD Ryzen 5 4500U3691215SE +/- 0.0693, N = 2SE +/- 0.0180, N = 29.04268.865510.2327

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamabAMD Renoir - AMD Ryzen 5 4500U160320480640800SE +/- 0.36, N = 2SE +/- 1.73, N = 2723.99718.17717.18

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamabAMD Renoir - AMD Ryzen 5 4500U0.93521.87042.80563.74084.676SE +/- 0.0054, N = 2SE +/- 0.0284, N = 24.13214.14954.1565

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-StreamabAMD Renoir - AMD Ryzen 5 4500U918273645SE +/- 0.70, N = 2SE +/- 0.10, N = 239.0141.0140.66

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-StreamabAMD Renoir - AMD Ryzen 5 4500U612182430SE +/- 0.46, N = 2SE +/- 0.06, N = 225.6324.3724.59

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamabAMD Renoir - AMD Ryzen 5 4500U60120180240300SE +/- 0.95, N = 2SE +/- 1.62, N = 2280.42285.37285.87

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamabAMD Renoir - AMD Ryzen 5 4500U0.80241.60482.40723.20964.012SE +/- 0.0120, N = 2SE +/- 0.0199, N = 23.56603.50413.4981

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamabAMD Renoir - AMD Ryzen 5 4500U70140210280350SE +/- 7.05, N = 2SE +/- 2.66, N = 2302.46296.57336.98

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamabAMD Renoir - AMD Ryzen 5 4500U0.75871.51742.27613.03483.7935SE +/- 0.0772, N = 2SE +/- 0.0234, N = 23.30803.37182.9676

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-StreamabAMD Renoir - AMD Ryzen 5 4500U50100150200250SE +/- 0.45, N = 2SE +/- 0.35, N = 2237.28237.68236.44

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-StreamabAMD Renoir - AMD Ryzen 5 4500U0.95151.9032.85453.8064.7575SE +/- 0.0081, N = 2SE +/- 0.0064, N = 24.21414.20714.2291

Apache IoTDB

Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 200

OpenBenchmarking.orgAverage Latency, More Is BetterApache IoTDB 1.1.2Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 200aAMD Renoir - AMD Ryzen 5 4500U306090120150107.71118.24MAX: 2081.88MAX: 4097.41

Apache IoTDB

Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 200

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 200aAMD Renoir - AMD Ryzen 5 4500U3M6M9M12M15M16236661.9714164673.03

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamabAMD Renoir - AMD Ryzen 5 4500U20406080100SE +/- 3.95, N = 2SE +/- 0.04, N = 294.0490.4890.26

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamabAMD Renoir - AMD Ryzen 5 4500U816243240SE +/- 1.33, N = 2SE +/- 0.02, N = 231.9333.1233.21

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamabAMD Renoir - AMD Ryzen 5 4500U816243240SE +/- 0.16, N = 2SE +/- 0.08, N = 232.6532.8432.15

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamabAMD Renoir - AMD Ryzen 5 4500U714212835SE +/- 0.15, N = 2SE +/- 0.07, N = 230.6230.4431.09

VVenC

Video Input: Bosphorus 1080p - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 1080p - Video Preset: FasterabAMD Renoir - AMD Ryzen 5 4500U48121620SE +/- 0.39, N = 2SE +/- 0.11, N = 213.3614.5314.671. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-StreamabAMD Renoir - AMD Ryzen 5 4500U1224364860SE +/- 0.32, N = 2SE +/- 0.32, N = 254.5354.1852.62

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-StreamabAMD Renoir - AMD Ryzen 5 4500U510152025SE +/- 0.11, N = 2SE +/- 0.12, N = 218.3318.4519.00

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-StreamabAMD Renoir - AMD Ryzen 5 4500U306090120150SE +/- 0.34, N = 2SE +/- 0.21, N = 2146.86148.87144.78

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-StreamabAMD Renoir - AMD Ryzen 5 4500U510152025SE +/- 0.05, N = 2SE +/- 0.02, N = 220.4020.1220.70

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamabAMD Renoir - AMD Ryzen 5 4500U306090120150SE +/- 0.80, N = 2SE +/- 0.03, N = 2143.26141.30141.31

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamabAMD Renoir - AMD Ryzen 5 4500U510152025SE +/- 0.12, N = 2SE +/- 0.00, N = 220.9021.2121.19

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-StreamabAMD Renoir - AMD Ryzen 5 4500U1224364860SE +/- 0.12, N = 2SE +/- 0.07, N = 252.2453.2351.53

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-StreamabAMD Renoir - AMD Ryzen 5 4500U510152025SE +/- 0.04, N = 2SE +/- 0.03, N = 219.1418.7819.40

Neural Magic DeepSparse

Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-StreamabAMD Renoir - AMD Ryzen 5 4500U3691215SE +/- 0.02, N = 2SE +/- 0.02, N = 210.4310.4710.39

Neural Magic DeepSparse

Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-StreamabAMD Renoir - AMD Ryzen 5 4500U60120180240300SE +/- 0.47, N = 2SE +/- 0.44, N = 2286.90285.74288.08

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamabAMD Renoir - AMD Ryzen 5 4500U1632486480SE +/- 1.57, N = 2SE +/- 0.58, N = 274.2270.3073.59

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamabAMD Renoir - AMD Ryzen 5 4500U1020304050SE +/- 0.86, N = 2SE +/- 0.34, N = 240.3942.6440.72

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamabAMD Renoir - AMD Ryzen 5 4500U612182430SE +/- 0.33, N = 2SE +/- 0.00, N = 225.7525.2625.13

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamabAMD Renoir - AMD Ryzen 5 4500U918273645SE +/- 0.50, N = 2SE +/- 0.00, N = 238.8339.5839.77

Neural Magic DeepSparse

Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-StreamabAMD Renoir - AMD Ryzen 5 4500U1530456075SE +/- 0.15, N = 2SE +/- 0.26, N = 268.1867.8567.67

Neural Magic DeepSparse

Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-StreamabAMD Renoir - AMD Ryzen 5 4500U1020304050SE +/- 0.09, N = 2SE +/- 0.17, N = 243.9644.1844.28

Neural Magic DeepSparse

Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Baseline - Scenario: Synchronous Single-StreamabAMD Renoir - AMD Ryzen 5 4500U612182430SE +/- 0.08, N = 2SE +/- 0.06, N = 224.7024.6424.53

Neural Magic DeepSparse

Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Baseline - Scenario: Synchronous Single-StreamabAMD Renoir - AMD Ryzen 5 4500U918273645SE +/- 0.13, N = 2SE +/- 0.10, N = 240.4640.5640.75

Neural Magic DeepSparse

Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-StreamabAMD Renoir - AMD Ryzen 5 4500U246810SE +/- 0.0017, N = 2SE +/- 0.0029, N = 26.39386.77424.7072

Neural Magic DeepSparse

Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-StreamabAMD Renoir - AMD Ryzen 5 4500U50100150200250SE +/- 0.03, N = 2SE +/- 0.14, N = 2155.96147.22211.81

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 200

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 200aAMD Renoir - AMD Ryzen 5 4500U200K400K600K800K1000K870872.73855795.41

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 200

OpenBenchmarking.orgAverage Latency, More Is BetterApache IoTDB 1.1.2Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 200aAMD Renoir - AMD Ryzen 5 4500U51015202519.3419.64MAX: 1470.64MAX: 1530.17

Apache IoTDB

Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 200

OpenBenchmarking.orgAverage Latency, More Is BetterApache IoTDB 1.1.2Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 200aAMD Renoir - AMD Ryzen 5 4500U306090120150104.65113.87MAX: 2607.58MAX: 5638.35

Apache IoTDB

Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 200

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 200aAMD Renoir - AMD Ryzen 5 4500U3M6M9M12M15M15789875.8114130374.99

Apache IoTDB

Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 500

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 500aAMD Renoir - AMD Ryzen 5 4500U200K400K600K800K1000K982415.93994052.25

Apache IoTDB

Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 500

OpenBenchmarking.orgAverage Latency, More Is BetterApache IoTDB 1.1.2Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 500aAMD Renoir - AMD Ryzen 5 4500U102030405042.3241.38MAX: 1338.68MAX: 1478.21

Apache IoTDB

Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 200

OpenBenchmarking.orgAverage Latency, More Is BetterApache IoTDB 1.1.2Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 200aAMD Renoir - AMD Ryzen 5 4500U51015202521.1121.00MAX: 1265.96MAX: 1320.28

Apache IoTDB

Device Count: 100 - Batch Size Per Write: 1 - Sensor Count: 500

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 100 - Batch Size Per Write: 1 - Sensor Count: 500aAMD Renoir - AMD Ryzen 5 4500U200K400K600K800K1000K818281.01813547.71

Apache IoTDB

Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 200

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 200aAMD Renoir - AMD Ryzen 5 4500U150K300K450K600K750K686458.89684869.04

Apache IoTDB

Device Count: 100 - Batch Size Per Write: 1 - Sensor Count: 500

OpenBenchmarking.orgAverage Latency, More Is BetterApache IoTDB 1.1.2Device Count: 100 - Batch Size Per Write: 1 - Sensor Count: 500aAMD Renoir - AMD Ryzen 5 4500U102030405045.1245.06MAX: 1423.03MAX: 1511.68

Apache IoTDB

Device Count: 100 - Batch Size Per Write: 1 - Sensor Count: 200

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 100 - Batch Size Per Write: 1 - Sensor Count: 200aAMD Renoir - AMD Ryzen 5 4500U100K200K300K400K500K446723.62465319.75

Apache IoTDB

Device Count: 100 - Batch Size Per Write: 1 - Sensor Count: 200

OpenBenchmarking.orgAverage Latency, More Is BetterApache IoTDB 1.1.2Device Count: 100 - Batch Size Per Write: 1 - Sensor Count: 200aAMD Renoir - AMD Ryzen 5 4500U71421283528.5328.36MAX: 1820.94MAX: 1210

VkResample

Upscale: 2x - Precision: Single

OpenBenchmarking.orgms, Fewer Is BetterVkResample 1.0Upscale: 2x - Precision: SingleabAMD Renoir - AMD Ryzen 5 4500U1326395265SE +/- 0.09, N = 2SE +/- 0.02, N = 255.6055.7355.251. (CXX) g++ options: -O3

Phoronix Test Suite v10.8.5