Jetson Orin

ARMv8 Cortex-A78E testing with a NVIDIA Jetson (36.3.0-gcid-36191598 BIOS) and NVIDIA Tegra Orin on Ubuntu 22.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2409114-NE-JETSONORI27
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Limit displaying results to tests within:

NVIDIA GPU Compute 3 Tests
Vulkan Compute 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
Jetson Orin
September 10
  8 Minutes
Nvidia Jetson Orin CUDA Mini-Nbody
September 10
  1 Minute
Jetson Orin Julia GPU
September 10
 
Jetson Orin Mandel GPU
September 10
 
Jetson Orin Cuda Mini Nbody
September 11
  1 Minute
Jetson Orin NCNN
September 11
  2 Hours, 12 Minutes
Invert Hiding All Results Option
  24 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


Jetson OrinOpenBenchmarking.orgPhoronix Test SuiteARMv8 Cortex-A78E @ 2.20GHz (12 Cores)NVIDIA Jetson (36.3.0-gcid-36191598 BIOS)62GBFanxiang S500 256GB + 64GB G1M15MOrinNVIDIA Tegra OrinG72Realtek RTL8822CE 802.11ac PCIeUbuntu 22.045.15.136-tegra (aarch64)GNOME Shell 42.9X Server 1.21.1.4NVIDIA 540.3.04.6.01.3.251GCC 11.4.0 + CUDA 12.2ext41920x1080ProcessorMotherboardMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLVulkanCompilerFile-SystemScreen ResolutionJetson Orin BenchmarksSystem Logs- Transparent Huge Pages: always- --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - Scaling Governor: tegra194 schedutil- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 but not BHB + srbds: Not affected + tsx_async_abort: Not affected - Nvidia Jetson Orin CUDA Mini-Nbody, Jetson Orin Cuda Mini Nbody: BAR1 / Visible vRAM Size: N/A

Jetson Orinncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - googlenetncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - yolov4-tinyncnn: Vulkan GPU - squeezenet_ssdncnn: Vulkan GPU - regnety_400mncnn: Vulkan GPU - vision_transformerncnn: Vulkan GPU - FastestDetncnn: Vulkan GPU - shufflenet-v2financebench: Bonds OpenMPvkfft: FFT + iFFT R2C / C2RJetson OrinNvidia Jetson Orin CUDA Mini-NbodyJetson Orin Julia GPUJetson Orin Mandel GPUJetson Orin Cuda Mini NbodyJetson Orin NCNN71545.7864581148227.935.325.446.518.621.7714.0634.829.678.0324.6927.3015.6716.13273.104.904.30OpenBenchmarking.org

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: mobilenetJetson Orin NCNN714212835SE +/- 0.19, N = 327.93MIN: 10.69 / MAX: 89.281. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2Jetson Orin NCNN1.1972.3943.5914.7885.985SE +/- 0.18, N = 35.32MIN: 3.14 / MAX: 60.941. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3Jetson Orin NCNN1.2242.4483.6724.8966.12SE +/- 0.06, N = 35.44MIN: 2.96 / MAX: 64.71. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: mnasnetJetson Orin NCNN246810SE +/- 1.20, N = 36.51MIN: 2.88 / MAX: 60.211. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: efficientnet-b0Jetson Orin NCNN246810SE +/- 0.36, N = 38.62MIN: 4.84 / MAX: 96.991. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

CUDA Mini-Nbody

The CUDA version of Harrism's mini-nbody tests. Learn more via the OpenBenchmarking.org test page.

Test: Original

Nvidia Jetson Orin CUDA Mini-Nbody: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

Jetson Orin Cuda Mini Nbody: The test run did not produce a result. The test run did not produce a result. The test run did not produce a result.

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: blazefaceJetson Orin NCNN0.39830.79661.19491.59321.9915SE +/- 0.11, N = 31.77MIN: 1.25 / MAX: 41.691. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: googlenetJetson Orin NCNN48121620SE +/- 0.84, N = 314.06MIN: 8.4 / MAX: 99.661. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: vgg16Jetson Orin NCNN816243240SE +/- 0.35, N = 334.82MIN: 27.53 / MAX: 67.41. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: resnet18Jetson Orin NCNN3691215SE +/- 0.49, N = 39.67MIN: 5.91 / MAX: 52.81. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: alexnetJetson Orin NCNN246810SE +/- 0.23, N = 38.03MIN: 5.9 / MAX: 34.081. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: resnet50Jetson Orin NCNN612182430SE +/- 1.69, N = 324.69MIN: 14.35 / MAX: 97.31. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: yolov4-tinyJetson Orin NCNN612182430SE +/- 0.82, N = 327.30MIN: 18.35 / MAX: 58.631. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: squeezenet_ssdJetson Orin NCNN48121620SE +/- 0.84, N = 315.67MIN: 9.41 / MAX: 106.851. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: regnety_400mJetson Orin NCNN48121620SE +/- 0.43, N = 316.13MIN: 9.46 / MAX: 191.571. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: vision_transformerJetson Orin NCNN60120180240300SE +/- 0.66, N = 3273.10MIN: 244.91 / MAX: 407.131. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: FastestDetJetson Orin NCNN1.10252.2053.30754.415.5125SE +/- 0.64, N = 34.90MIN: 3.3 / MAX: 80.531. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: shufflenet-v2Jetson Orin NCNN0.96751.9352.90253.874.8375SE +/- 0.48, N = 24.30MIN: 2.65 / MAX: 61.581. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

FinanceBench

FinanceBench is a collection of financial program benchmarks with support for benchmarking on the GPU via OpenCL and CPU benchmarking with OpenMP. The FinanceBench test cases are focused on Black-Sholes-Merton Process with Analytic European Option engine, QMC (Sobol) Monte-Carlo method (Equity Option Example), Bonds Fixed-rate bond with flat forward curve, and Repo Securities repurchase agreement. FinanceBench was originally written by the Cavazos Lab at University of Delaware. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterFinanceBench 2016-07-25Benchmark: Bonds OpenMPJetson Orin15K30K45K60K75KSE +/- 179.12, N = 371545.791. (CXX) g++ options: -O3 -march=native -fopenmp

VkFFT

VkFFT is a Fast Fourier Transform (FFT) Library that is GPU accelerated by means of the Vulkan API. The VkFFT benchmark runs FFT performance differences of many different sizes before returning an overall benchmark score. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBenchmark Score, More Is BetterVkFFT 1.3.4Test: FFT + iFFT R2C / C2RJetson Orin2K4K6K8K10KSE +/- 73.34, N = 3114821. (CXX) g++ options: -O3