Comparison of DeepStream SSD Object Detection Performance on NVIDIA Xavier NX and AGX Xavier

In this tutorial, we tested our NVIDIA Xavier NX and AGX Xavier's DeepStream performance in object detector sample. Our test sources are a video file (FPS:60, resolution:1920x1080, type:MP4) and 4 different cameras (FPS:25, resolution:1920x1080, type:RTSP).

NVIDIA Xavier NX Info:

• Software: JetPack 4.5 (L4T-32.5)

• Hardware: Jetson Xavier NX with DSBoard-NX2 Carrier Board

• DeepStream Version: 5.0.1

• Power Mode: 15W 6CORE

NVIDIA AGX Xavier Info:

• Software: JetPack 4.4 (L4T-32.4.3)

• Hardware: Jetson AGX Xavier Developer Kit

• DeepStream Version: 5.0.0

• Power Mode: MAXN

Performance Test Setup

To begin with, let's set our test environment with maximum power mode:

(for Xavier NX)

• sudo nvpmodel -m 2

(for AGX Xavier)

• sudo nvpmodel -m 0

Type these commands and continue other steps in both of them:

• sudo jetson_clocks

• cd /opt/nvidia/deepstream/deepstream/sources/objectDetector_SSD/

• cd nvdsinfer_custom_impl_ssd

• sed -i 's/CUDA_VER?=/CUDA_VER=10.2/g' Makefile

• make

• cd /home/nvidia/Downloads/

• wget https://raw.githubusercontent.com/bower-media-samples/big-buck-bunny-1080p-60fps-30s/master/video.mp4

Then, copy sample_ssd_relu6.uff, ssd_coco_labels.txt and all configuration text files into /opt/nvidia/deepstream/deepstream/sources/objectDetector_SSD/ folder.

Change source URL (for source0, source1, source2 and source3) in each deepstream_app_config_ssd_rtsp... file (3 files).

DeepStream_SSD_files

.zip

Download ZIP • 92.59MB

Xavier NX Test Results

The performance of each test command:

• deepstream-app -c deepstream_app_config_ssd_fp32.txt (12-13 FPS)

• deepstream-app -c deepstream_app_config_ssd_rtsp_fp32.txt (12-13 FPS)

• deepstream-app -c deepstream_app_config_ssd_fp16.txt (~36 FPS)

• deepstream-app -c deepstream_app_config_ssd_rtsp_fp16.txt (~25 FPS - max FPS)

AGX Xavier Test Results

The performance of each test command:

• deepstream-app -c deepstream_app_config_ssd_fp32.txt (21-22 FPS)

• deepstream-app -c deepstream_app_config_ssd_rtsp_fp32.txt (21-22 FPS)

• deepstream-app -c deepstream_app_config_ssd_fp16.txt (55-56 FPS)

• deepstream-app -c deepstream_app_config_ssd_rtsp_fp16.txt (25-26 FPS - max FPS)

Comparison of Results

Xavier NX - Video Results (1080p, 60 FPS)

FP32 -> 12-13 FPS * 4 (48-52 FPS)

FP16 -> ~36 FPS * 4 (~144 FPS)

Xavier NX - RTSP Results (1080p, 25 FPS)

FP32 -> 12-13 FPS * 4 (48-52 FPS)

FP16 -> ~25 FPS (max) * 4 (~100 FPS)

AGX Xavier - Video Results (1080p, 60 FPS)

FP32 -> 21-22 FPS * 4 (84-88 FPS)

FP16 -> 55-56 FPS * 4 (220-224 FPS)

AGX Xavier - RTSP Results (1080p, 25 FPS)

FP32 -> 21-22 FPS * 4 (84-88 FPS)

FP16 -> 25-26 FPS (max) * 4 (100-104 FPS)

Thanks for reading.