Comparison of DeepStream SSD Object Detection Performance on NVIDIA Xavier NX and AGX Xavier

Updated: Feb 17

In this tutorial, we tested our NVIDIA Xavier NX and AGX Xavier's DeepStream performance in object detector sample. Our test sources are a video file (FPS:60, resolution:1920x1080, type:MP4) and 4 different cameras (FPS:25, resolution:1920x1080, type:RTSP).


NVIDIA Xavier NX Info:

  • Software: JetPack 4.5 (L4T-32.5)

  • Hardware: Jetson Xavier NX with DSBoard-NX2 Carrier Board

  • DeepStream Version: 5.0.1

  • Power Mode: 15W 6CORE


NVIDIA AGX Xavier Info:

  • Software: JetPack 4.4 (L4T-32.4.3)

  • Hardware: Jetson AGX Xavier Developer Kit

  • DeepStream Version: 5.0.0

  • Power Mode: MAXN


Performance Test Setup

To begin with, let's set our test environment with maximum power mode:


(for Xavier NX)

  • sudo nvpmodel -m 2

(for AGX Xavier)

  • sudo nvpmodel -m 0


Type these commands and continue other steps in both of them:

  • sudo jetson_clocks

  • cd /opt/nvidia/deepstream/deepstream/sources/objectDetector_SSD/

  • cd nvdsinfer_custom_impl_ssd

  • sed -i 's/CUDA_VER?=/CUDA_VER=10.2/g' Makefile

  • make

  • cd /home/nvidia/Downloads/

  • wget https://raw.githubusercontent.com/bower-media-samples/big-buck-bunny-1080p-60fps-30s/master/video.mp4


Then, copy sample_ssd_relu6.uff, ssd_coco_labels.txt and all configuration text files into /opt/nvidia/deepstream/deepstream/sources/objectDetector_SSD/ folder.

Change source URL (for source0, source1, source2 and source3) in each deepstream_app_config_ssd_rtsp... file (3 files).


DeepStream_SSD_files
.zip
Download ZIP • 92.59MB



Xavier NX Test Results

The performance of each test command:


  • deepstream-app -c deepstream_app_config_ssd_fp32.txt (12-13 FPS)


  • deepstream-app -c deepstream_app_config_ssd_rtsp_fp32.txt (12-13 FPS)


  • deepstream-app -c deepstream_app_config_ssd_fp16.txt (~36 FPS)


  • deepstream-app -c deepstream_app_config_ssd_rtsp_fp16.txt (~25 FPS - max FPS)



AGX Xavier Test Results

The performance of each test command:


  • deepstream-app -c deepstream_app_config_ssd_fp32.txt (21-22 FPS)


  • deepstream-app -c deepstream_app_config_ssd_rtsp_fp32.txt (21-22 FPS)


  • deepstream-app -c deepstream_app_config_ssd_fp16.txt (55-56 FPS)


  • deepstream-app -c deepstream_app_config_ssd_rtsp_fp16.txt (25-26 FPS - max FPS)



Comparison of Results

Xavier NX - Video Results (1080p, 60 FPS)

FP32 -> 12-13 FPS * 4 (48-52 FPS)

FP16 -> ~36 FPS * 4 (~144 FPS)


Xavier NX - RTSP Results (1080p, 25 FPS)

FP32 -> 12-13 FPS * 4 (48-52 FPS)

FP16 -> ~25 FPS (max) * 4 (~100 FPS)


AGX Xavier - Video Results (1080p, 60 FPS)

FP32 -> 21-22 FPS * 4 (84-88 FPS)

FP16 -> 55-56 FPS * 4 (220-224 FPS)


AGX Xavier - RTSP Results (1080p, 25 FPS)

FP32 -> 21-22 FPS * 4 (84-88 FPS)

FP16 -> 25-26 FPS (max) * 4 (100-104 FPS)



Thanks for reading.


74 views0 comments
Check out our latest tutorials and blog posts

Email us for any questions

info@forecr.io

For large quantity inquiries

sales@forecr.io

©2020 by forecr