kubuntu-2404-nvme ARMv8 Cortex-A76 testing with a Raspberry Pi 5 Model B Rev 1.0 and V3D 7.1.7 8GB on Ubuntu 24.04 via the Phoronix Test Suite. ARMv8 Cortex-A76: Processor: ARMv8 Cortex-A76 @ 2.40GHz (4 Cores), Motherboard: Raspberry Pi 5 Model B Rev 1.0, Chipset: Broadcom BCM2712, Memory: 8GB, Disk: 500GB KINGSTON SNV2S500G, Graphics: V3D 7.1.7 8GB, Monitor: PA247CV, Network: Raspberry Pi RP1 PCIe 2.0 South Bridge OS: Ubuntu 24.04, Kernel: 6.8.0-1012-raspi (aarch64), Desktop: KDE Plasma 5.27.11, Display Server: X Server 1.21.1.11, OpenGL: 3.1 Mesa 24.0.9-0ubuntu0.1, File-System: ext4, Screen Resolution: 1920x1080 V3D 7.1.7: Processor: ARMv8 Cortex-A76 @ 2.40GHz (4 Cores), Motherboard: Raspberry Pi 5 Model B Rev 1.0, Chipset: Broadcom BCM2712, Memory: 8GB, Disk: 500GB KINGSTON SNV2S500G + 62GB DataTraveler 3.0, Graphics: V3D 7.1.7 8GB, Monitor: PA247CV, Network: Raspberry Pi RP1 PCIe 2.0 South Bridge OS: Ubuntu 24.04, Kernel: 6.8.0-1013-raspi (aarch64), Desktop: KDE Plasma 5.27.11, Display Server: X Server 1.21.1.11, OpenGL: 3.1 Mesa 24.0.9-0ubuntu0.2, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1080 Timed Apache Compilation 2.4.41 Time To Compile Seconds < Lower Is Better ARMv8 Cortex-A76 . 104.93 |==================================================== Timed Apache Compilation 2.4.41 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 1 AVG: 3359 MAX: 3457 Timed Apache Compilation 2.4.41 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2285 MAX: 2400 Timed Apache Compilation 2.4.41 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 42.5 AVG: 51.4 MAX: 57.3 Timed Apache Compilation 2.4.41 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 5 AVG: 62 MAX: 100 Timed Apache Compilation 2.4.41 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 1607 AVG: 1700 MAX: 1793 Timed Apache Compilation 2.4.41 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 1 AVG: 3359 MAX: 3457 Timed Apache Compilation 2.4.41 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 42.5 AVG: 51.4 MAX: 56.8 Timed FFmpeg Compilation 7.0 Time To Compile Seconds < Lower Is Better ARMv8 Cortex-A76 . 462.73 |==================================================== Timed FFmpeg Compilation 7.0 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 2716 AVG: 5390 MAX: 5965 Timed FFmpeg Compilation 7.0 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2386 MAX: 2400 Timed FFmpeg Compilation 7.0 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 45.8 AVG: 58.8 MAX: 62.3 Timed FFmpeg Compilation 7.0 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 3 AVG: 96 MAX: 100 Timed FFmpeg Compilation 7.0 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 1537 AVG: 1750 MAX: 2201 Timed FFmpeg Compilation 7.0 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 2716 AVG: 5390 MAX: 5965 Timed FFmpeg Compilation 7.0 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 45.2 AVG: 58.9 MAX: 62.3 Mobile Neural Network 2.9.b11b7037d Model: nasnet ms < Lower Is Better ARMv8 Cortex-A76 . 28.91 |===================================================== Mobile Neural Network 2.9.b11b7037d Model: mobilenetV3 ms < Lower Is Better ARMv8 Cortex-A76 . 3.975 |===================================================== Mobile Neural Network 2.9.b11b7037d Model: squeezenetv1.1 ms < Lower Is Better ARMv8 Cortex-A76 . 14.31 |===================================================== Mobile Neural Network 2.9.b11b7037d Model: resnet-v2-50 ms < Lower Is Better ARMv8 Cortex-A76 . 122.56 |==================================================== Mobile Neural Network 2.9.b11b7037d Model: SqueezeNetV1.0 ms < Lower Is Better ARMv8 Cortex-A76 . 30.07 |===================================================== Mobile Neural Network 2.9.b11b7037d Model: MobileNetV2_224 ms < Lower Is Better ARMv8 Cortex-A76 . 14.96 |===================================================== Mobile Neural Network 2.9.b11b7037d Model: mobilenet-v1-1.0 ms < Lower Is Better ARMv8 Cortex-A76 . 21.55 |===================================================== Mobile Neural Network 2.9.b11b7037d Model: inception-v3 ms < Lower Is Better ARMv8 Cortex-A76 . 150.38 |==================================================== Mobile Neural Network 2.9.b11b7037d CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 2993 AVG: 5878 MAX: 5982 Mobile Neural Network 2.9.b11b7037d CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2392 MAX: 2400 Mobile Neural Network 2.9.b11b7037d CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 47.4 AVG: 61.3 MAX: 64.5 Mobile Neural Network 2.9.b11b7037d CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 2 AVG: 99 MAX: 100 Mobile Neural Network 2.9.b11b7037d Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 621 AVG: 769 MAX: 912 Mobile Neural Network 2.9.b11b7037d System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 2993 AVG: 5878 MAX: 5982 Mobile Neural Network 2.9.b11b7037d System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 45.8 AVG: 61.4 MAX: 63.9 NCNN 20230517 Target: CPU - Model: mobilenet ms < Lower Is Better ARMv8 Cortex-A76 . 48.66 |===================================================== NCNN 20230517 Target: CPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better ARMv8 Cortex-A76 . 13.94 |===================================================== NCNN 20230517 Target: CPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better ARMv8 Cortex-A76 . 10.08 |===================================================== NCNN 20230517 Target: CPU - Model: shufflenet-v2 ms < Lower Is Better ARMv8 Cortex-A76 . 3.83 |====================================================== NCNN 20230517 Target: CPU - Model: mnasnet ms < Lower Is Better ARMv8 Cortex-A76 . 9.16 |====================================================== NCNN 20230517 Target: CPU - Model: efficientnet-b0 ms < Lower Is Better ARMv8 Cortex-A76 . 15.99 |===================================================== NCNN 20230517 Target: CPU - Model: blazeface ms < Lower Is Better ARMv8 Cortex-A76 . 1.57 |====================================================== NCNN 20230517 Target: CPU - Model: googlenet ms < Lower Is Better ARMv8 Cortex-A76 . 34.79 |===================================================== NCNN 20230517 Target: CPU - Model: vgg16 ms < Lower Is Better ARMv8 Cortex-A76 . 163.14 |==================================================== NCNN 20230517 Target: CPU - Model: resnet18 ms < Lower Is Better ARMv8 Cortex-A76 . 24.95 |===================================================== NCNN 20230517 Target: CPU - Model: alexnet ms < Lower Is Better ARMv8 Cortex-A76 . 25.69 |===================================================== NCNN 20230517 Target: CPU - Model: resnet50 ms < Lower Is Better ARMv8 Cortex-A76 . 57.94 |===================================================== NCNN 20230517 Target: CPUv2-yolov3v2-yolov3 - Model: mobilenetv2-yolov3 ms < Lower Is Better ARMv8 Cortex-A76 . 48.66 |===================================================== NCNN 20230517 Target: CPU - Model: yolov4-tiny ms < Lower Is Better ARMv8 Cortex-A76 . 57.21 |===================================================== NCNN 20230517 Target: CPU - Model: squeezenet_ssd ms < Lower Is Better ARMv8 Cortex-A76 . 43.11 |===================================================== NCNN 20230517 Target: CPU - Model: regnety_400m ms < Lower Is Better ARMv8 Cortex-A76 . 12.82 |===================================================== NCNN 20230517 Target: CPU - Model: vision_transformer ms < Lower Is Better ARMv8 Cortex-A76 . 627.86 |==================================================== NCNN 20230517 Target: CPU - Model: FastestDet ms < Lower Is Better ARMv8 Cortex-A76 . 6.32 |====================================================== NCNN 20230517 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3628 AVG: 6248 MAX: 8027 NCNN 20230517 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2369 MAX: 2400 NCNN 20230517 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 50.2 AVG: 62.2 MAX: 68.3 NCNN 20230517 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 3 AVG: 93 MAX: 100 NCNN 20230517 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 626 AVG: 870 MAX: 1186 NCNN 20230517 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3628 AVG: 6248 MAX: 8027 NCNN 20230517 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 50.2 AVG: 62.1 MAX: 67.8 NCNN 20230517 Target: Vulkan GPU - Model: mobilenet ms < Lower Is Better ARMv8 Cortex-A76 . 48.83 |===================================================== NCNN 20230517 Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better ARMv8 Cortex-A76 . 14.12 |===================================================== NCNN 20230517 Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better ARMv8 Cortex-A76 . 9.76 |====================================================== NCNN 20230517 Target: Vulkan GPU - Model: shufflenet-v2 ms < Lower Is Better ARMv8 Cortex-A76 . 3.97 |====================================================== NCNN 20230517 Target: Vulkan GPU - Model: mnasnet ms < Lower Is Better ARMv8 Cortex-A76 . 9.13 |====================================================== NCNN 20230517 Target: Vulkan GPU - Model: efficientnet-b0 ms < Lower Is Better ARMv8 Cortex-A76 . 16.06 |===================================================== NCNN 20230517 Target: Vulkan GPU - Model: blazeface ms < Lower Is Better ARMv8 Cortex-A76 . 1.9 |======================================================= NCNN 20230517 Target: Vulkan GPU - Model: googlenet ms < Lower Is Better ARMv8 Cortex-A76 . 34.49 |===================================================== NCNN 20230517 Target: Vulkan GPU - Model: vgg16 ms < Lower Is Better ARMv8 Cortex-A76 . 163.32 |==================================================== NCNN 20230517 Target: Vulkan GPU - Model: resnet18 ms < Lower Is Better ARMv8 Cortex-A76 . 25.01 |===================================================== NCNN 20230517 Target: Vulkan GPU - Model: alexnet ms < Lower Is Better ARMv8 Cortex-A76 . 25.89 |===================================================== NCNN 20230517 Target: Vulkan GPU - Model: resnet50 ms < Lower Is Better ARMv8 Cortex-A76 . 58.31 |===================================================== NCNN 20230517 Target: Vulkan GPUv2-yolov3v2-yolov3 - Model: mobilenetv2-yolov3 ms < Lower Is Better ARMv8 Cortex-A76 . 48.83 |===================================================== NCNN 20230517 Target: Vulkan GPU - Model: yolov4-tiny ms < Lower Is Better ARMv8 Cortex-A76 . 57.05 |===================================================== NCNN 20230517 Target: Vulkan GPU - Model: squeezenet_ssd ms < Lower Is Better ARMv8 Cortex-A76 . 42.51 |===================================================== NCNN 20230517 Target: Vulkan GPU - Model: regnety_400m ms < Lower Is Better ARMv8 Cortex-A76 . 12.86 |===================================================== NCNN 20230517 Target: Vulkan GPU - Model: vision_transformer ms < Lower Is Better ARMv8 Cortex-A76 . 629.58 |==================================================== NCNN 20230517 Target: Vulkan GPU - Model: FastestDet ms < Lower Is Better ARMv8 Cortex-A76 . 6.13 |====================================================== NCNN 20230517 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3700 AVG: 6423 MAX: 8040 NCNN 20230517 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2370 MAX: 2400 NCNN 20230517 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 51.3 AVG: 62.3 MAX: 67.8 NCNN 20230517 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 1 AVG: 94 MAX: 100 NCNN 20230517 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 625 AVG: 870 MAX: 1172 NCNN 20230517 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3700 AVG: 6423 MAX: 8040 NCNN 20230517 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 51.3 AVG: 62.4 MAX: 67.8 OpenCV 4.7 Test: DNN - Deep Neural Network ms < Lower Is Better ARMv8 Cortex-A76 . 472235 |==================================================== OpenCV 4.7 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3733 AVG: 6899 MAX: 8073 OpenCV 4.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2392 MAX: 2400 OpenCV 4.7 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 50.7 AVG: 64.4 MAX: 71.6 OpenCV 4.7 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 0 AVG: 92 MAX: 100 OpenCV 4.7 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 626 AVG: 800 MAX: 1237 OpenCV 4.7 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3733 AVG: 6899 MAX: 8073 OpenCV 4.7 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 50.7 AVG: 64.3 MAX: 71.6 OpenCV 4.7 Test: Features 2D ms < Lower Is Better ARMv8 Cortex-A76 . 240888 |==================================================== OpenCV 4.7 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3590 AVG: 5016 MAX: 5946 OpenCV 4.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2381 MAX: 2400 OpenCV 4.7 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 49.1 AVG: 57.7 MAX: 63.9 OpenCV 4.7 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 1 AVG: 63 MAX: 100 OpenCV 4.7 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 644 AVG: 957 MAX: 1265 OpenCV 4.7 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3590 AVG: 5016 MAX: 5946 OpenCV 4.7 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 50.2 AVG: 57.7 MAX: 65.0 OpenCV 4.7 Test: Object Detection ms < Lower Is Better ARMv8 Cortex-A76 . 61443 |===================================================== OpenCV 4.7 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3571 AVG: 3980 MAX: 5869 OpenCV 4.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2337 MAX: 2400 OpenCV 4.7 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 49.6 AVG: 55.5 MAX: 61.2 OpenCV 4.7 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 3.0 AVG: 39.6 MAX: 95.0 OpenCV 4.7 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 646 AVG: 736 MAX: 765 OpenCV 4.7 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3571 AVG: 3980 MAX: 5869 OpenCV 4.7 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 50.7 AVG: 55.5 MAX: 61.2 OpenCV 4.7 Test: Core ms < Lower Is Better ARMv8 Cortex-A76 . 281470 |==================================================== OpenCV 4.7 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3530 AVG: 3607 MAX: 5810 OpenCV 4.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2384 MAX: 2400 OpenCV 4.7 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 49.1 AVG: 54.2 MAX: 62.3 OpenCV 4.7 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 0 AVG: 31 MAX: 100 OpenCV 4.7 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 637 AVG: 704 MAX: 776 OpenCV 4.7 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3530 AVG: 3607 MAX: 5810 OpenCV 4.7 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 49.1 AVG: 54.3 MAX: 61.2 OpenCV 4.7 Test: Graph API ms < Lower Is Better OpenCV 4.7 Test: Image Processing ms < Lower Is Better ARMv8 Cortex-A76 . 628264 |==================================================== OpenCV 4.7 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3512 AVG: 4423 MAX: 5948 OpenCV 4.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2392 MAX: 2400 OpenCV 4.7 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 48.0 AVG: 56.8 MAX: 63.9 OpenCV 4.7 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 0 AVG: 56 MAX: 100 OpenCV 4.7 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 653 AVG: 804 MAX: 1212 OpenCV 4.7 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3512 AVG: 4423 MAX: 5948 OpenCV 4.7 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 50.2 AVG: 56.8 MAX: 65.6 OpenCV 4.7 Test: Stitching ms < Lower Is Better ARMv8 Cortex-A76 . 439495 |==================================================== OpenCV 4.7 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3524 AVG: 3693 MAX: 5882 OpenCV 4.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2390 MAX: 2400 OpenCV 4.7 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 51.3 AVG: 56.2 MAX: 60.6 OpenCV 4.7 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 5 AVG: 49 MAX: 100 OpenCV 4.7 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 648 AVG: 797 MAX: 1468 OpenCV 4.7 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3524 AVG: 3693 MAX: 5882 OpenCV 4.7 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 49.6 AVG: 56.2 MAX: 60.1 OpenCV 4.7 Test: Video ms < Lower Is Better ARMv8 Cortex-A76 . 161859 |==================================================== OpenCV 4.7 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3557 AVG: 4895 MAX: 5927 OpenCV 4.7 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2372 MAX: 2400 OpenCV 4.7 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 49.6 AVG: 58.3 MAX: 61.2 OpenCV 4.7 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 3 AVG: 86 MAX: 100 OpenCV 4.7 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 653 AVG: 827 MAX: 1051 OpenCV 4.7 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3557 AVG: 4895 MAX: 5927 OpenCV 4.7 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 49.6 AVG: 58.4 MAX: 61.7 R Benchmark Seconds < Lower Is Better ARMv8 Cortex-A76 . 0.6038 |==================================================== R Benchmark CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3560 AVG: 3842 MAX: 5854 R Benchmark CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2358 MAX: 2400 R Benchmark CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 49.6 AVG: 54.4 MAX: 61.7 R Benchmark CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 0 AVG: 34 MAX: 100 R Benchmark Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 654 AVG: 947 MAX: 1269 R Benchmark System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3560 AVG: 3842 MAX: 5854 R Benchmark System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 49.6 AVG: 54.4 MAX: 61.2 Numpy Benchmark Score > Higher Is Better ARMv8 Cortex-A76 . 136.85 |==================================================== Numpy Benchmark CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3521 AVG: 3540 MAX: 3557 Numpy Benchmark CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2387 MAX: 2400 Numpy Benchmark CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 48.0 AVG: 53.3 MAX: 56.8 Numpy Benchmark CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 3.0 AVG: 27.2 MAX: 52.8 Numpy Benchmark Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 651 AVG: 672 MAX: 775 Numpy Benchmark System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3521 AVG: 3540 MAX: 3557 Numpy Benchmark System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 48.5 AVG: 53.3 MAX: 56.8 AI Benchmark Alpha 0.1.2 Score > Higher Is Better Mlpack Benchmark Benchmark: scikit_svm Seconds < Lower Is Better Mlpack Benchmark Benchmark: scikit_linearridgeregression Seconds < Lower Is Better Mlpack Benchmark Benchmark: scikit_qda Seconds < Lower Is Better Mlpack Benchmark Benchmark: scikit_ica Seconds < Lower Is Better Numenta Anomaly Benchmark 1.1 Detector: Bayesian Changepoint Seconds < Lower Is Better Numenta Anomaly Benchmark 1.1 Detector: Windowed Gaussian Seconds < Lower Is Better Numenta Anomaly Benchmark 1.1 Detector: Relative Entropy Seconds < Lower Is Better Numenta Anomaly Benchmark 1.1 Detector: Earthgecko Skyline Seconds < Lower Is Better Numenta Anomaly Benchmark 1.1 Detector: KNN CAD Seconds < Lower Is Better Numenta Anomaly Benchmark 1.1 Detector: Contextual Anomaly Detector OSE Seconds < Lower Is Better TensorFlow Lite 2022-05-18 Model: Mobilenet Float Microseconds < Lower Is Better ARMv8 Cortex-A76 . 18684.6 |=================================================== TensorFlow Lite 2022-05-18 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 11 AVG: 5325 MAX: 5838 TensorFlow Lite 2022-05-18 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2331 MAX: 2400 TensorFlow Lite 2022-05-18 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 46.3 AVG: 61.5 MAX: 65.6 TensorFlow Lite 2022-05-18 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 4 AVG: 95 MAX: 100 TensorFlow Lite 2022-05-18 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 655 AVG: 680 MAX: 682 TensorFlow Lite 2022-05-18 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 11 AVG: 5325 MAX: 5838 TensorFlow Lite 2022-05-18 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 45.8 AVG: 61.7 MAX: 65.6 TensorFlow Lite 2022-05-18 Model: Mobilenet Quant Microseconds < Lower Is Better ARMv8 Cortex-A76 . 5774.24 |=================================================== TensorFlow Lite 2022-05-18 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3556 AVG: 5503 MAX: 5896 TensorFlow Lite 2022-05-18 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2343 MAX: 2400 TensorFlow Lite 2022-05-18 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 49.6 AVG: 61.7 MAX: 64.5 TensorFlow Lite 2022-05-18 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 1 AVG: 91 MAX: 100 TensorFlow Lite 2022-05-18 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 652 AVG: 654 MAX: 655 TensorFlow Lite 2022-05-18 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3556 AVG: 5503 MAX: 5896 TensorFlow Lite 2022-05-18 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 49.6 AVG: 61.4 MAX: 64.5 TensorFlow Lite 2022-05-18 Model: NASNet Mobile Microseconds < Lower Is Better ARMv8 Cortex-A76 . 52846.6 |=================================================== TensorFlow Lite 2022-05-18 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3583 AVG: 5538 MAX: 5909 TensorFlow Lite 2022-05-18 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2330 MAX: 2400 TensorFlow Lite 2022-05-18 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 51.3 AVG: 60.5 MAX: 63.4 TensorFlow Lite 2022-05-18 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 2.0 AVG: 86.6 MAX: 94.5 TensorFlow Lite 2022-05-18 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 650 AVG: 701 MAX: 709 TensorFlow Lite 2022-05-18 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3583 AVG: 5538 MAX: 5909 TensorFlow Lite 2022-05-18 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 50.7 AVG: 60.7 MAX: 63.9 TensorFlow Lite 2022-05-18 Model: SqueezeNet Microseconds < Lower Is Better ARMv8 Cortex-A76 . 26872.6 |=================================================== TensorFlow Lite 2022-05-18 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3601 AVG: 5720 MAX: 7784 TensorFlow Lite 2022-05-18 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2344 MAX: 2400 TensorFlow Lite 2022-05-18 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 49.6 AVG: 64.0 MAX: 67.8 TensorFlow Lite 2022-05-18 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 3 AVG: 92 MAX: 100 TensorFlow Lite 2022-05-18 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 654 AVG: 672 MAX: 676 TensorFlow Lite 2022-05-18 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3601 AVG: 5720 MAX: 7784 TensorFlow Lite 2022-05-18 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 50.2 AVG: 64.0 MAX: 67.8 TensorFlow Lite 2022-05-18 Model: Inception ResNet V2 Microseconds < Lower Is Better ARMv8 Cortex-A76 . 215253 |==================================================== TensorFlow Lite 2022-05-18 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3621 AVG: 7403 MAX: 7982 TensorFlow Lite 2022-05-18 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2331 MAX: 2400 TensorFlow Lite 2022-05-18 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 51.3 AVG: 69.5 MAX: 74.4 TensorFlow Lite 2022-05-18 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 1 AVG: 91 MAX: 100 TensorFlow Lite 2022-05-18 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 655 AVG: 794 MAX: 812 TensorFlow Lite 2022-05-18 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3621 AVG: 7403 MAX: 7982 TensorFlow Lite 2022-05-18 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 51.3 AVG: 69.2 MAX: 73.8 TensorFlow Lite 2022-05-18 Model: Inception V4 Microseconds < Lower Is Better ARMv8 Cortex-A76 . 246550 |==================================================== TensorFlow Lite 2022-05-18 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3738 AVG: 7470 MAX: 8027 TensorFlow Lite 2022-05-18 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2333 MAX: 2400 TensorFlow Lite 2022-05-18 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 52.4 AVG: 69.6 MAX: 74.4 TensorFlow Lite 2022-05-18 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 1 AVG: 91 MAX: 100 TensorFlow Lite 2022-05-18 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 656 AVG: 822 MAX: 839 TensorFlow Lite 2022-05-18 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3738 AVG: 7470 MAX: 8027 TensorFlow Lite 2022-05-18 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 52.9 AVG: 69.6 MAX: 73.8 oneDNN 3.4 Harness: Convolution Batch Shapes Auto - Engine: CPU ms < Lower Is Better ARMv8 Cortex-A76 . 264.11 |==================================================== oneDNN 3.4 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3759 AVG: 4018 MAX: 5897 oneDNN 3.4 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2082 MAX: 2400 oneDNN 3.4 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 53.5 AVG: 56.9 MAX: 59.5 oneDNN 3.4 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 1 AVG: 52 MAX: 99 oneDNN 3.4 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 661 AVG: 777 MAX: 976 oneDNN 3.4 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3759 AVG: 4018 MAX: 5897 oneDNN 3.4 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 53.5 AVG: 57.2 MAX: 60.1 oneDNN 3.4 Harness: Deconvolution Batch shapes_1d - Engine: CPU ms < Lower Is Better ARMv8 Cortex-A76 . 560.13 |==================================================== oneDNN 3.4 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3704 AVG: 5246 MAX: 6007 oneDNN 3.4 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2230 MAX: 2400 oneDNN 3.4 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 50.7 AVG: 60.6 MAX: 66.1 oneDNN 3.4 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 1 AVG: 78 MAX: 100 oneDNN 3.4 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 664 AVG: 673 MAX: 681 oneDNN 3.4 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3704 AVG: 5246 MAX: 6007 oneDNN 3.4 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 50.2 AVG: 60.6 MAX: 65.6 oneDNN 3.4 Harness: Deconvolution Batch shapes_3d - Engine: CPU ms < Lower Is Better ARMv8 Cortex-A76 . 103.12 |==================================================== oneDNN 3.4 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3665 AVG: 3985 MAX: 5742 oneDNN 3.4 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2043 MAX: 2400 oneDNN 3.4 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 50.7 AVG: 55.3 MAX: 62.3 oneDNN 3.4 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 658 AVG: 680 MAX: 706 oneDNN 3.4 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3665 AVG: 3985 MAX: 5742 oneDNN 3.4 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 51.3 AVG: 55.2 MAX: 61.2 oneDNN 3.4 Harness: IP Shapes 1D - Engine: CPU ms < Lower Is Better ARMv8 Cortex-A76 . 58.65 |===================================================== oneDNN 3.4 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3633 AVG: 4995 MAX: 5918 oneDNN 3.4 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2225 MAX: 2400 oneDNN 3.4 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 49.1 AVG: 59.0 MAX: 65.6 oneDNN 3.4 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 0 AVG: 74 MAX: 100 oneDNN 3.4 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 663 AVG: 702 MAX: 782 oneDNN 3.4 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3633 AVG: 4995 MAX: 5918 oneDNN 3.4 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 49.6 AVG: 58.6 MAX: 64.5 oneDNN 3.4 Harness: IP Shapes 3D - Engine: CPU ms < Lower Is Better ARMv8 Cortex-A76 . 62.98 |===================================================== oneDNN 3.4 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3608 AVG: 4083 MAX: 5888 oneDNN 3.4 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2100 MAX: 2400 oneDNN 3.4 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 49.6 AVG: 56.7 MAX: 62.8 oneDNN 3.4 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 0 AVG: 64 MAX: 100 oneDNN 3.4 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 654 AVG: 775 MAX: 1155 oneDNN 3.4 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3608 AVG: 4083 MAX: 5888 oneDNN 3.4 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 49.6 AVG: 56.4 MAX: 62.3 oneDNN 3.4 Harness: Recurrent Neural Network Training - Engine: CPU ms < Lower Is Better ARMv8 Cortex-A76 . 65557.7 |=================================================== oneDNN 3.4 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3595 AVG: 6811 MAX: 8071 oneDNN 3.4 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2386 MAX: 2400 oneDNN 3.4 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 49.1 AVG: 64.5 MAX: 67.2 oneDNN 3.4 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 0 AVG: 96 MAX: 100 oneDNN 3.4 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 658 AVG: 952 MAX: 1256 oneDNN 3.4 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3595 AVG: 6811 MAX: 8071 oneDNN 3.4 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 49.1 AVG: 64.4 MAX: 67.2 oneDNN 3.4 Harness: Recurrent Neural Network Inference - Engine: CPU ms < Lower Is Better ARMv8 Cortex-A76 . 35072.3 |=================================================== oneDNN 3.4 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3764 AVG: 5946 MAX: 6069 oneDNN 3.4 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2384 MAX: 2400 oneDNN 3.4 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 50.2 AVG: 64.5 MAX: 66.7 oneDNN 3.4 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 1 AVG: 95 MAX: 100 oneDNN 3.4 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 654 AVG: 830 MAX: 1004 oneDNN 3.4 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3764 AVG: 5946 MAX: 6069 oneDNN 3.4 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 50.7 AVG: 64.3 MAX: 66.7 ONNX Runtime 1.19 Model: yolov4 - Device: CPU - Executor: Parallel Inferences Per Second > Higher Is Better ARMv8 Cortex-A76 . 0.533576 |================================================== ONNX Runtime 1.19 Model: yolov4 - Device: CPU - Executor: Parallel Inference Time Cost (ms) < Lower Is Better ARMv8 Cortex-A76 . 1874.14 |=================================================== ONNX Runtime 1.19 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3680 AVG: 5712 MAX: 6003 ONNX Runtime 1.19 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2332 MAX: 2400 ONNX Runtime 1.19 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 52.9 AVG: 63.0 MAX: 66.1 ONNX Runtime 1.19 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 4 AVG: 90 MAX: 100 ONNX Runtime 1.19 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 657 AVG: 1181 MAX: 1245 ONNX Runtime 1.19 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3680 AVG: 5712 MAX: 6003 ONNX Runtime 1.19 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 51.8 AVG: 62.8 MAX: 67.2 ONNX Runtime 1.19 Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel Inferences Per Second > Higher Is Better ARMv8 Cortex-A76 . 0.100419 |================================================== ONNX Runtime 1.19 Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel Inference Time Cost (ms) < Lower Is Better ARMv8 Cortex-A76 . 9958.27 |=================================================== ONNX Runtime 1.19 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3668 AVG: 5728 MAX: 5994 ONNX Runtime 1.19 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2337 MAX: 2400 ONNX Runtime 1.19 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 51.3 AVG: 63.8 MAX: 67.8 ONNX Runtime 1.19 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 1 AVG: 90 MAX: 100 ONNX Runtime 1.19 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 648 AVG: 1172 MAX: 1238 ONNX Runtime 1.19 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3668 AVG: 5728 MAX: 5994 ONNX Runtime 1.19 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 51.3 AVG: 63.7 MAX: 67.2 ONNX Runtime 1.19 Model: super-resolution-10 - Device: CPU - Executor: Parallel Inferences Per Second > Higher Is Better ARMv8 Cortex-A76 . 8.69434 |=================================================== ONNX Runtime 1.19 Model: super-resolution-10 - Device: CPU - Executor: Parallel Inference Time Cost (ms) < Lower Is Better ARMv8 Cortex-A76 . 115.01 |==================================================== ONNX Runtime 1.19 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3665 AVG: 6561 MAX: 7955 ONNX Runtime 1.19 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2317 MAX: 2400 ONNX Runtime 1.19 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 51.3 AVG: 64.3 MAX: 68.3 ONNX Runtime 1.19 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 1 AVG: 89 MAX: 100 ONNX Runtime 1.19 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 645 AVG: 684 MAX: 689 ONNX Runtime 1.19 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3665 AVG: 6561 MAX: 7955 ONNX Runtime 1.19 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 52.4 AVG: 64.4 MAX: 68.3 ONNX Runtime 1.19 Model: bertsquad-12 - Device: CPU - Executor: Parallel Inferences Per Second > Higher Is Better ONNX Runtime 1.19 Model: GPT-2 - Device: CPU - Executor: Parallel Inferences Per Second > Higher Is Better ONNX Runtime 1.19 Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel Inferences Per Second > Higher Is Better ONNX Runtime 1.19 Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel Inferences Per Second > Higher Is Better ARMv8 Cortex-A76 . 12.50 |===================================================== ONNX Runtime 1.19 Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel Inference Time Cost (ms) < Lower Is Better ARMv8 Cortex-A76 . 80.01 |===================================================== ONNX Runtime 1.19 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3582 AVG: 5206 MAX: 5920 ONNX Runtime 1.19 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2305 MAX: 2400 ONNX Runtime 1.19 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 48.5 AVG: 59.4 MAX: 63.4 ONNX Runtime 1.19 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 0 AVG: 89 MAX: 100 ONNX Runtime 1.19 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 647 AVG: 713 MAX: 722 ONNX Runtime 1.19 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3582 AVG: 5206 MAX: 5920 ONNX Runtime 1.19 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 48.5 AVG: 59.3 MAX: 62.3 ONNX Runtime 1.19 Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel Inferences Per Second > Higher Is Better ARMv8 Cortex-A76 . 45.17 |===================================================== ONNX Runtime 1.19 Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel Inference Time Cost (ms) < Lower Is Better ARMv8 Cortex-A76 . 22.13 |===================================================== ONNX Runtime 1.19 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3597 AVG: 5467 MAX: 5930 ONNX Runtime 1.19 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2331 MAX: 2400 ONNX Runtime 1.19 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 49.1 AVG: 60.0 MAX: 63.4 ONNX Runtime 1.19 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 0 AVG: 91 MAX: 100 ONNX Runtime 1.19 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 653 AVG: 780 MAX: 816 ONNX Runtime 1.19 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3597 AVG: 5467 MAX: 5927 ONNX Runtime 1.19 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 49.6 AVG: 60.0 MAX: 62.8 ONNX Runtime 1.19 Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel Inferences Per Second > Higher Is Better ONNX Runtime 1.19 Model: T5 Encoder - Device: CPU - Executor: Parallel Inferences Per Second > Higher Is Better ARMv8 Cortex-A76 . 16.91 |===================================================== ONNX Runtime 1.19 Model: T5 Encoder - Device: CPU - Executor: Parallel Inference Time Cost (ms) < Lower Is Better ARMv8 Cortex-A76 . 59.14 |===================================================== ONNX Runtime 1.19 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3573 AVG: 5032 MAX: 5907 ONNX Runtime 1.19 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2316 MAX: 2400 ONNX Runtime 1.19 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 49.1 AVG: 58.2 MAX: 61.2 ONNX Runtime 1.19 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 1 AVG: 90 MAX: 100 ONNX Runtime 1.19 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 646 AVG: 1339 MAX: 1434 ONNX Runtime 1.19 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3573 AVG: 5032 MAX: 5907 ONNX Runtime 1.19 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 49.1 AVG: 58.3 MAX: 61.2 ONNX Runtime 1.19 Model: ZFNet-512 - Device: CPU - Executor: Parallel Inferences Per Second > Higher Is Better ARMv8 Cortex-A76 . 9.59958 |=================================================== ONNX Runtime 1.19 Model: ZFNet-512 - Device: CPU - Executor: Parallel Inference Time Cost (ms) < Lower Is Better ARMv8 Cortex-A76 . 104.17 |==================================================== ONNX Runtime 1.19 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3590 AVG: 5480 MAX: 5931 ONNX Runtime 1.19 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2318 MAX: 2400 ONNX Runtime 1.19 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 50.2 AVG: 60.6 MAX: 65.0 ONNX Runtime 1.19 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 1 AVG: 87 MAX: 100 ONNX Runtime 1.19 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 643 AVG: 1259 MAX: 1347 ONNX Runtime 1.19 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3590 AVG: 5480 MAX: 5931 ONNX Runtime 1.19 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 49.1 AVG: 60.4 MAX: 65.0 ONNX Runtime 1.19 Model: ResNet101_DUC_HDC-12 - Device: CPU - Executor: Parallel Inferences Per Second > Higher Is Better ARMv8 Cortex-A76 . 0.0432072 |================================================= ONNX Runtime 1.19 Model: ResNet101_DUC_HDC-12 - Device: CPU - Executor: Parallel Inference Time Cost (ms) < Lower Is Better ARMv8 Cortex-A76 . 23144.3 |=================================================== ONNX Runtime 1.19 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3612 AVG: 5708 MAX: 5955 ONNX Runtime 1.19 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2341 MAX: 2400 ONNX Runtime 1.19 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 49.1 AVG: 61.8 MAX: 65.6 ONNX Runtime 1.19 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 1 AVG: 89 MAX: 100 ONNX Runtime 1.19 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 645 AVG: 1506 MAX: 1596 ONNX Runtime 1.19 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3612 AVG: 5708 MAX: 5955 ONNX Runtime 1.19 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 50.2 AVG: 61.7 MAX: 65.0 LeelaChessZero 0.31.1 Backend: BLAS Nodes Per Second > Higher Is Better LeelaChessZero 0.31.1 Backend: Eigen Nodes Per Second > Higher Is Better Whisper.cpp 1.6.2 Model: ggml-base.en - Input: 2016 State of the Union Seconds < Lower Is Better ARMv8 Cortex-A76 . 646.23 |==================================================== Whisper.cpp 1.6.2 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3576 AVG: 7715 MAX: 8294 Whisper.cpp 1.6.2 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2384 MAX: 2400 Whisper.cpp 1.6.2 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 48.5 AVG: 65.2 MAX: 68.9 Whisper.cpp 1.6.2 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 1 AVG: 96 MAX: 100 Whisper.cpp 1.6.2 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 648 AVG: 1470 MAX: 2037 Whisper.cpp 1.6.2 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3576 AVG: 7715 MAX: 8294 Whisper.cpp 1.6.2 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 48.5 AVG: 65.2 MAX: 68.9 Whisper.cpp 1.6.2 Model: ggml-small.en - Input: 2016 State of the Union Seconds < Lower Is Better ARMv8 Cortex-A76 . 1928.49 |=================================================== Whisper.cpp 1.6.2 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3751 AVG: 8038 MAX: 8121 Whisper.cpp 1.6.2 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2395 MAX: 2400 Whisper.cpp 1.6.2 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 50.7 AVG: 68.8 MAX: 72.7 Whisper.cpp 1.6.2 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 1 AVG: 98 MAX: 100 Whisper.cpp 1.6.2 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 642 AVG: 2017 MAX: 2445 Whisper.cpp 1.6.2 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3751 AVG: 8038 MAX: 8121 Whisper.cpp 1.6.2 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 51.8 AVG: 68.8 MAX: 72.2 Whisper.cpp 1.6.2 Model: ggml-medium.en - Input: 2016 State of the Union Seconds < Lower Is Better ARMv8 Cortex-A76 . 5899.94 |=================================================== Whisper.cpp 1.6.2 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3796 AVG: 8088 MAX: 8136 Whisper.cpp 1.6.2 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2398 MAX: 2400 Whisper.cpp 1.6.2 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 53.5 AVG: 70.5 MAX: 74.4 Whisper.cpp 1.6.2 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 1 AVG: 99 MAX: 100 Whisper.cpp 1.6.2 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 637 AVG: 3571 MAX: 3616 Whisper.cpp 1.6.2 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3796 AVG: 8088 MAX: 8136 Whisper.cpp 1.6.2 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 53.5 AVG: 70.5 MAX: 73.8 Whisperfile 20Aug24 Model Size: Tiny Seconds < Lower Is Better ARMv8 Cortex-A76 . 332.12 |==================================================== Whisperfile 20Aug24 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3789 AVG: 5936 MAX: 6107 Whisperfile 20Aug24 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2366 MAX: 2400 Whisperfile 20Aug24 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 54.0 AVG: 63.6 MAX: 67.2 Whisperfile 20Aug24 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 3 AVG: 91 MAX: 100 Whisperfile 20Aug24 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 666 AVG: 1307 MAX: 1975 Whisperfile 20Aug24 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3789 AVG: 5936 MAX: 6107 Whisperfile 20Aug24 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 54.6 AVG: 63.5 MAX: 67.8 Whisperfile 20Aug24 Model Size: Small Seconds < Lower Is Better ARMv8 Cortex-A76 . 1779.12 |=================================================== Whisperfile 20Aug24 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3669 AVG: 7104 MAX: 8060 Whisperfile 20Aug24 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2393 MAX: 2400 Whisperfile 20Aug24 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 50.7 AVG: 64.7 MAX: 69.4 Whisperfile 20Aug24 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 1 AVG: 98 MAX: 100 Whisperfile 20Aug24 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 663 AVG: 2026 MAX: 2456 Whisperfile 20Aug24 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3669 AVG: 7104 MAX: 8060 Whisperfile 20Aug24 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 51.8 AVG: 64.7 MAX: 68.9 Whisperfile 20Aug24 Model Size: Medium Seconds < Lower Is Better ARMv8 Cortex-A76 . 5162.45 |=================================================== Whisperfile 20Aug24 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3697 AVG: 7073 MAX: 8253 Whisperfile 20Aug24 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2398 MAX: 2400 Whisperfile 20Aug24 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 51.8 AVG: 65.1 MAX: 70.5 Whisperfile 20Aug24 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 1 AVG: 99 MAX: 100 Whisperfile 20Aug24 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 644 AVG: 3566 MAX: 3629 Whisperfile 20Aug24 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3697 AVG: 7073 MAX: 8253 Whisperfile 20Aug24 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 51.3 AVG: 65.0 MAX: 70.5 PyTorch 2.2.1 Device: CPU - Batch Size: 1 - Model: ResNet-50 batches/sec > Higher Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 1 - Model: ResNet-152 batches/sec > Higher Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_l batches/sec > Higher Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 16 - Model: ResNet-50 batches/sec > Higher Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 16 - Model: ResNet-152 batches/sec > Higher Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 16 - Model: Efficientnet_v2_l batches/sec > Higher Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 32 - Model: ResNet-50 batches/sec > Higher Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 32 - Model: ResNet-152 batches/sec > Higher Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 32 - Model: Efficientnet_v2_l batches/sec > Higher Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 64 - Model: ResNet-50 batches/sec > Higher Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 64 - Model: ResNet-152 batches/sec > Higher Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_l batches/sec > Higher Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 256 - Model: ResNet-50 batches/sec > Higher Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 256 - Model: ResNet-152 batches/sec > Higher Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 256 - Model: Efficientnet_v2_l batches/sec > Higher Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 512 - Model: ResNet-50 batches/sec > Higher Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 512 - Model: ResNet-152 batches/sec > Higher Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 512 - Model: Efficientnet_v2_l batches/sec > Higher Is Better Llama.cpp b3067 Model: Meta-Llama-3-8B-Instruct-Q8_0.gguf Tokens Per Second > Higher Is Better ARMv8 Cortex-A76 . 0.12 |====================================================== Llama.cpp b3067 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 2773 AVG: 3530 MAX: 3554 Llama.cpp b3067 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2033 MAX: 2400 Llama.cpp b3067 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 45.2 AVG: 52.6 MAX: 56.8 Llama.cpp b3067 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 0 AVG: 94 MAX: 100 Llama.cpp b3067 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 248 AVG: 335 MAX: 738 Llama.cpp b3067 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 2773 AVG: 3530 MAX: 3554 Llama.cpp b3067 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 45.2 AVG: 52.5 MAX: 56.8 Llamafile 0.8.6 Test: mistral-7b-instruct-v0.2.Q5_K_M - Acceleration: CPU Tokens Per Second > Higher Is Better ARMv8 Cortex-A76 . 1.89 |====================================================== Llamafile 0.8.6 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3537 AVG: 7633 MAX: 8090 Llamafile 0.8.6 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2377 MAX: 2400 Llamafile 0.8.6 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 48.5 AVG: 68.5 MAX: 72.2 Llamafile 0.8.6 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 0 AVG: 98 MAX: 100 Llamafile 0.8.6 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 253 AVG: 568 MAX: 585 Llamafile 0.8.6 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3537 AVG: 7633 MAX: 8090 Llamafile 0.8.6 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 48.5 AVG: 68.4 MAX: 71.6 Llamafile 0.8.6 Test: mistral-7b-instruct-v0.2.Q5_K_M - Acceleration: GPU AUTO Tokens Per Second > Higher Is Better ARMv8 Cortex-A76 . 1.88 |====================================================== Llamafile 0.8.6 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3806 AVG: 8012 MAX: 8103 Llamafile 0.8.6 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2392 MAX: 2400 Llamafile 0.8.6 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 53.5 AVG: 70.3 MAX: 72.7 Llamafile 0.8.6 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 3 AVG: 99 MAX: 100 Llamafile 0.8.6 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 300 AVG: 579 MAX: 590 Llamafile 0.8.6 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3806 AVG: 8012 MAX: 8103 Llamafile 0.8.6 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 53.5 AVG: 70.2 MAX: 72.7 Llamafile 0.8.6 Test: Meta-Llama-3-8B-Instruct.F16 - Acceleration: CPU Tokens Per Second > Higher Is Better Llamafile 0.8.6 Test: Meta-Llama-3-8B-Instruct.F16 - Acceleration: GPU AUTO Tokens Per Second > Higher Is Better Llamafile 0.8.6 Test: TinyLlama-1.1B-Chat-v1.0.BF16 - Acceleration: CPU Tokens Per Second > Higher Is Better ARMv8 Cortex-A76 . 15 |======================================================== Llamafile 0.8.6 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3538 AVG: 3541 MAX: 3544 Llamafile 0.8.6 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 1750 MAX: 2400 Llamafile 0.8.6 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 47.4 AVG: 49.2 MAX: 55.1 Llamafile 0.8.6 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 2 AVG: 55 MAX: 99 Llamafile 0.8.6 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 328 AVG: 350 MAX: 381 Llamafile 0.8.6 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3538 AVG: 3541 MAX: 3544 Llamafile 0.8.6 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 47.4 AVG: 49.7 MAX: 56.2 Llamafile 0.8.6 Test: TinyLlama-1.1B-Chat-v1.0.BF16 - Acceleration: GPU AUTO Tokens Per Second > Higher Is Better ARMv8 Cortex-A76 . 4.38 |====================================================== Llamafile 0.8.6 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3538 AVG: 3541 MAX: 3544 Llamafile 0.8.6 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1600 AVG: 2055 MAX: 2400 Llamafile 0.8.6 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 46.9 AVG: 52.2 MAX: 57.3 Llamafile 0.8.6 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 3 AVG: 45 MAX: 100 Llamafile 0.8.6 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 331 AVG: 364 MAX: 386 Llamafile 0.8.6 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3538 AVG: 3541 MAX: 3544 Llamafile 0.8.6 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 48.0 AVG: 52.1 MAX: 57.3 Llamafile 0.8.6 Test: llava-v1.6-mistral-7b.Q8_0 - Acceleration: CPU Tokens Per Second > Higher Is Better ARMv8 Cortex-A76 . 1.96 |====================================================== Llamafile 0.8.6 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3537 AVG: 7486 MAX: 8112 Llamafile 0.8.6 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2384 MAX: 2400 Llamafile 0.8.6 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 48.0 AVG: 67.2 MAX: 71.6 Llamafile 0.8.6 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 4 AVG: 97 MAX: 100 Llamafile 0.8.6 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 346 AVG: 1647 MAX: 1707 Llamafile 0.8.6 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3537 AVG: 7486 MAX: 8112 Llamafile 0.8.6 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 47.4 AVG: 67.2 MAX: 71.6 Llamafile 0.8.6 Test: llava-v1.6-mistral-7b.Q8_0 - Acceleration: GPU AUTO Tokens Per Second > Higher Is Better ARMv8 Cortex-A76 . 1.95 |====================================================== Llamafile 0.8.6 CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3823 AVG: 7894 MAX: 8130 Llamafile 0.8.6 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2380 MAX: 2400 Llamafile 0.8.6 CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 54.0 AVG: 70.3 MAX: 73.8 Llamafile 0.8.6 CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 1 AVG: 97 MAX: 100 Llamafile 0.8.6 Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 350 AVG: 1652 MAX: 1707 Llamafile 0.8.6 System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3823 AVG: 7894 MAX: 8130 Llamafile 0.8.6 System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 53.5 AVG: 70.2 MAX: 73.3 Llamafile 0.8.6 Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU Tokens Per Second > Higher Is Better Llamafile 0.8.6 Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: GPU AUTO Tokens Per Second > Higher Is Better XNNPACK 2cd86b Model: FP32MobileNetV2 us < Lower Is Better ARMv8 Cortex-A76 . 20522 |===================================================== XNNPACK 2cd86b Model: FP32MobileNetV3Large us < Lower Is Better ARMv8 Cortex-A76 . 20354 |===================================================== XNNPACK 2cd86b Model: FP32MobileNetV3Small us < Lower Is Better ARMv8 Cortex-A76 . 7492 |====================================================== XNNPACK 2cd86b Model: FP16MobileNetV2 us < Lower Is Better ARMv8 Cortex-A76 . 10166 |===================================================== XNNPACK 2cd86b Model: FP16MobileNetV3Large us < Lower Is Better ARMv8 Cortex-A76 . 10478 |===================================================== XNNPACK 2cd86b Model: FP16MobileNetV3Small us < Lower Is Better ARMv8 Cortex-A76 . 4046 |====================================================== XNNPACK 2cd86b Model: QU8MobileNetV2 us < Lower Is Better ARMv8 Cortex-A76 . 11904 |===================================================== XNNPACK 2cd86b Model: QU8MobileNetV3Large us < Lower Is Better ARMv8 Cortex-A76 . 10338 |===================================================== XNNPACK 2cd86b Model: QU8MobileNetV3Small us < Lower Is Better ARMv8 Cortex-A76 . 3337 |====================================================== XNNPACK 2cd86b CPU Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3545 AVG: 6422 MAX: 8060 XNNPACK 2cd86b CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better ARMv8 Cortex-A76 . MIN: 1500 AVG: 2383 MAX: 2400 XNNPACK 2cd86b CPU Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 47.4 AVG: 62.9 MAX: 67.8 XNNPACK 2cd86b CPU Usage (Summary) Monitor Percent < Lower Is Better ARMv8 Cortex-A76 . MIN: 0 AVG: 94 MAX: 100 XNNPACK 2cd86b Memory Usage Monitor Megabytes < Lower Is Better ARMv8 Cortex-A76 . MIN: 346 AVG: 709 MAX: 886 XNNPACK 2cd86b System Fan Speed Monitor RPM < Lower Is Better ARMv8 Cortex-A76 . MIN: 3545 AVG: 6422 MAX: 8060 XNNPACK 2cd86b System Temperature Monitor Celsius < Lower Is Better ARMv8 Cortex-A76 . MIN: 47.4 AVG: 63.0 MAX: 68.3 CPU Fan Speed Monitor Phoronix Test Suite System Monitoring RPM ARMv8 Cortex-A76 . MIN: 11 AVG: 4822 MAX: 8294 V3D 7.1.7 ........ MIN: 1730 AVG: 3391 MAX: 3465 CPU Peak Freq (Highest CPU Core Frequency) Monitor Phoronix Test Suite System Monitoring Megahertz ARMv8 Cortex-A76 . MIN: 1500 AVG: 2086 MAX: 2400 V3D 7.1.7 ........ MIN: 1500 AVG: 1570 MAX: 2400 CPU Temperature Monitor Phoronix Test Suite System Monitoring Celsius ARMv8 Cortex-A76 . MIN: 44.7 AVG: 55.9 MAX: 74.4 V3D 7.1.7 ........ MIN: 43.6 AVG: 47.2 MAX: 50.2 CPU Usage (Summary) Monitor Phoronix Test Suite System Monitoring Percent ARMv8 Cortex-A76 . MIN: 0 AVG: 88 MAX: 100 V3D 7.1.7 ........ MIN: 0 AVG: 5 MAX: 47 Memory Usage Monitor Phoronix Test Suite System Monitoring Megabytes ARMv8 Cortex-A76 . MIN: 247 AVG: 1954 MAX: 3664 V3D 7.1.7 ........ MIN: 915 AVG: 975 MAX: 1075 System Fan Speed Monitor Phoronix Test Suite System Monitoring RPM ARMv8 Cortex-A76 . MIN: 11 AVG: 4822 MAX: 8294 V3D 7.1.7 ........ MIN: 1730 AVG: 3391 MAX: 3465 System Temperature Monitor Phoronix Test Suite System Monitoring Celsius ARMv8 Cortex-A76 . MIN: 44.7 AVG: 55.9 MAX: 73.8 V3D 7.1.7 ........ MIN: 44.1 AVG: 47.2 MAX: 50.7 VKMark 2022-05-16 Resolution: 800 x 600 - Present Mode: Mailbox VKMark Score > Higher Is Better V3D 7.1.7 . 467 |============================================================== VKMark 2022-05-16 CPU Fan Speed Monitor RPM < Lower Is Better V3D 7.1.7 . MIN: 1730 AVG: 3428 MAX: 3465 VKMark 2022-05-16 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better V3D 7.1.7 . MIN: 1500 AVG: 1596 MAX: 2400 VKMark 2022-05-16 CPU Temperature Monitor Celsius < Lower Is Better V3D 7.1.7 . MIN: 46.3 AVG: 48.5 MAX: 50.2 VKMark 2022-05-16 CPU Usage (Summary) Monitor Percent < Lower Is Better V3D 7.1.7 . MIN: 1.0 AVG: 6.6 MAX: 17.3 VKMark 2022-05-16 Memory Usage Monitor Megabytes < Lower Is Better V3D 7.1.7 . MIN: 929 AVG: 956 MAX: 981 VKMark 2022-05-16 System Fan Speed Monitor RPM < Lower Is Better V3D 7.1.7 . MIN: 1730 AVG: 3428 MAX: 3465 VKMark 2022-05-16 System Temperature Monitor Celsius < Lower Is Better V3D 7.1.7 . MIN: 46.9 AVG: 48.6 MAX: 50.7 VKMark 2022-05-16 Resolution: 1024 x 768 - Present Mode: Mailbox VKMark Score > Higher Is Better V3D 7.1.7 . 302 |============================================================== VKMark 2022-05-16 CPU Fan Speed Monitor RPM < Lower Is Better V3D 7.1.7 . MIN: 3345 AVG: 3383 MAX: 3432 VKMark 2022-05-16 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better V3D 7.1.7 . MIN: 1500 AVG: 1568 MAX: 2400 VKMark 2022-05-16 CPU Temperature Monitor Celsius < Lower Is Better V3D 7.1.7 . MIN: 45.2 AVG: 46.7 MAX: 49.6 VKMark 2022-05-16 CPU Usage (Summary) Monitor Percent < Lower Is Better V3D 7.1.7 . MIN: 0.0 AVG: 5.1 MAX: 19.2 VKMark 2022-05-16 Memory Usage Monitor Megabytes < Lower Is Better V3D 7.1.7 . MIN: 930 AVG: 967 MAX: 986 VKMark 2022-05-16 System Fan Speed Monitor RPM < Lower Is Better V3D 7.1.7 . MIN: 3345 AVG: 3383 MAX: 3432 VKMark 2022-05-16 System Temperature Monitor Celsius < Lower Is Better V3D 7.1.7 . MIN: 45.2 AVG: 46.7 MAX: 49.6 VKMark 2022-05-16 Resolution: 1280 x 1024 - Present Mode: Mailbox VKMark Score > Higher Is Better V3D 7.1.7 . 192 |============================================================== VKMark 2022-05-16 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better V3D 7.1.7 . MIN: 1500 AVG: 1611 MAX: 2400 VKMark 2022-05-16 CPU Temperature Monitor Celsius < Lower Is Better V3D 7.1.7 . MIN: 43.6 AVG: 46.8 MAX: 48.5 VKMark 2022-05-16 CPU Usage (Summary) Monitor Percent < Lower Is Better V3D 7.1.7 . MIN: 0.5 AVG: 3.9 MAX: 18.7 VKMark 2022-05-16 Memory Usage Monitor Megabytes < Lower Is Better V3D 7.1.7 . MIN: 929 AVG: 982 MAX: 1023 VKMark 2022-05-16 System Temperature Monitor Celsius < Lower Is Better V3D 7.1.7 . MIN: 44.1 AVG: 46.9 MAX: 49.1 VKMark 2022-05-16 Resolution: 1920 x 1080 - Present Mode: Mailbox VKMark Score > Higher Is Better V3D 7.1.7 . 131 |============================================================== VKMark 2022-05-16 CPU Fan Speed Monitor RPM < Lower Is Better V3D 7.1.7 . MIN: 2275 AVG: 3366 MAX: 3396 VKMark 2022-05-16 CPU Peak Freq (Highest CPU Core Frequency) Monitor Megahertz > Higher Is Better V3D 7.1.7 . MIN: 1500 AVG: 1517 MAX: 2400 VKMark 2022-05-16 CPU Temperature Monitor Celsius < Lower Is Better V3D 7.1.7 . MIN: 45.2 AVG: 46.8 MAX: 48.5 VKMark 2022-05-16 CPU Usage (Summary) Monitor Percent < Lower Is Better V3D 7.1.7 . MIN: 0.0 AVG: 3.7 MAX: 47.5 VKMark 2022-05-16 Memory Usage Monitor Megabytes < Lower Is Better V3D 7.1.7 . MIN: 926 AVG: 1010 MAX: 1075 VKMark 2022-05-16 System Fan Speed Monitor RPM < Lower Is Better V3D 7.1.7 . MIN: 2275 AVG: 3366 MAX: 3396 VKMark 2022-05-16 System Temperature Monitor Celsius < Lower Is Better V3D 7.1.7 . MIN: 45.2 AVG: 46.9 MAX: 48.5