Jetson Orin

ARMv8 Cortex-A78E testing with a NVIDIA Jetson (36.3.0-gcid-36191598 BIOS) and NVIDIA Tegra Orin on Ubuntu 22.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2409114-NE-JETSONORI27&sor.

Jetson OrinProcessorMotherboardMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLVulkanCompilerFile-SystemScreen ResolutionJetson OrinNvidia Jetson Orin CUDA Mini-NbodyJetson Orin Julia GPUJetson Orin Mandel GPUJetson Orin Cuda Mini NbodyJetson Orin NCNNARMv8 Cortex-A78E @ 2.20GHz (12 Cores)NVIDIA Jetson (36.3.0-gcid-36191598 BIOS)62GBFanxiang S500 256GB + 64GB G1M15MOrinG72Realtek RTL8822CE 802.11ac PCIeUbuntu 22.045.15.136-tegra (aarch64)GNOME Shell 42.9X Server 1.21.1.4NVIDIA 540.3.04.6.01.3.251GCC 11.4.0 + CUDA 12.2ext41920x1080NVIDIA Tegra OrinOpenBenchmarking.orgKernel Details- Transparent Huge Pages: alwaysCompiler Details- --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v Processor Details- Scaling Governor: tegra194 schedutilSecurity Details- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 but not BHB + srbds: Not affected + tsx_async_abort: Not affected Graphics Details- Nvidia Jetson Orin CUDA Mini-Nbody, Jetson Orin Cuda Mini Nbody: BAR1 / Visible vRAM Size: N/A

Jetson Orinfinancebench: Bonds OpenMPvkfft: FFT + iFFT R2C / C2Rncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - googlenetncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - yolov4-tinyncnn: Vulkan GPU - squeezenet_ssdncnn: Vulkan GPU - regnety_400mncnn: Vulkan GPU - vision_transformerncnn: Vulkan GPU - FastestDetncnn: Vulkan GPU - shufflenet-v2Jetson OrinNvidia Jetson Orin CUDA Mini-NbodyJetson Orin Julia GPUJetson Orin Mandel GPUJetson Orin Cuda Mini NbodyJetson Orin NCNN71545.7864581148227.935.325.446.518.621.7714.0634.829.678.0324.6927.3015.6716.13273.104.904.30OpenBenchmarking.org

FinanceBench

Benchmark: Bonds OpenMP

OpenBenchmarking.orgms, Fewer Is BetterFinanceBench 2016-07-25Benchmark: Bonds OpenMPJetson Orin15K30K45K60K75KSE +/- 179.12, N = 371545.791. (CXX) g++ options: -O3 -march=native -fopenmp

VkFFT

Test: FFT + iFFT R2C / C2R

OpenBenchmarking.orgBenchmark Score, More Is BetterVkFFT 1.3.4Test: FFT + iFFT R2C / C2RJetson Orin2K4K6K8K10KSE +/- 73.34, N = 3114821. (CXX) g++ options: -O3

NCNN

Target: Vulkan GPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: mobilenetJetson Orin NCNN714212835SE +/- 0.19, N = 327.93MIN: 10.69 / MAX: 89.281. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2Jetson Orin NCNN1.1972.3943.5914.7885.985SE +/- 0.18, N = 35.32MIN: 3.14 / MAX: 60.941. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3Jetson Orin NCNN1.2242.4483.6724.8966.12SE +/- 0.06, N = 35.44MIN: 2.96 / MAX: 64.71. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: mnasnetJetson Orin NCNN246810SE +/- 1.20, N = 36.51MIN: 2.88 / MAX: 60.211. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: efficientnet-b0Jetson Orin NCNN246810SE +/- 0.36, N = 38.62MIN: 4.84 / MAX: 96.991. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: blazefaceJetson Orin NCNN0.39830.79661.19491.59321.9915SE +/- 0.11, N = 31.77MIN: 1.25 / MAX: 41.691. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: googlenetJetson Orin NCNN48121620SE +/- 0.84, N = 314.06MIN: 8.4 / MAX: 99.661. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: vgg16Jetson Orin NCNN816243240SE +/- 0.35, N = 334.82MIN: 27.53 / MAX: 67.41. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: resnet18Jetson Orin NCNN3691215SE +/- 0.49, N = 39.67MIN: 5.91 / MAX: 52.81. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: alexnetJetson Orin NCNN246810SE +/- 0.23, N = 38.03MIN: 5.9 / MAX: 34.081. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: resnet50Jetson Orin NCNN612182430SE +/- 1.69, N = 324.69MIN: 14.35 / MAX: 97.31. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: yolov4-tinyJetson Orin NCNN612182430SE +/- 0.82, N = 327.30MIN: 18.35 / MAX: 58.631. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: squeezenet_ssdJetson Orin NCNN48121620SE +/- 0.84, N = 315.67MIN: 9.41 / MAX: 106.851. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: regnety_400mJetson Orin NCNN48121620SE +/- 0.43, N = 316.13MIN: 9.46 / MAX: 191.571. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: vision_transformer

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: vision_transformerJetson Orin NCNN60120180240300SE +/- 0.66, N = 3273.10MIN: 244.91 / MAX: 407.131. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: FastestDet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: FastestDetJetson Orin NCNN1.10252.2053.30754.415.5125SE +/- 0.64, N = 34.90MIN: 3.3 / MAX: 80.531. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: shufflenet-v2Jetson Orin NCNN0.96751.9352.90253.874.8375SE +/- 0.48, N = 24.30MIN: 2.65 / MAX: 61.581. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Phoronix Test Suite v10.8.5