Just Released: NVIDIA DeepStream 7.1

SOURCE | 1 year ago

🎙️ Daily Podcast (FR) : NViNiO•Podcast™

ADs | ✨ Enhance your Social Media content with NViNiO•AI™ for FREE

NVIDIA DeepStream SDK

NVIDIA’s DeepStream SDK is a multi-sensor AI-based streaming analytics toolkit for video, image, and audio understanding. DeepStream is an integral part of NVIDIA Metropolis, the platform for building end-to-end services and solutions that transform real-time pixels and sensor data into actionable insights. DeepStream SDK features hardware-accelerated building blocks, called plugins, which bring deep neural networks and other complex processing tasks into a processing pipeline. The DeepStream SDK allows you to focus on building optimized Vision AI applications without having to design complete solutions from scratch.

The DeepStream SDK uses AI to perceive pixels and generate metadata while offering integration from the edge-to-the-cloud. The DeepStream SDK can be used to build applications across various use cases including retail analytics, patient monitoring in healthcare facilities, parking management, optical inspection (AOI), supply chain management (logistics), operations and manufacturing.

What is in the NVIDIA DeepStream SDK Collection

NVIDIA NGC offers collections that easily group relevant information together. We have created the NVIDIA DeepStream SDK collection, so it is easy to find all the information in a single place.

DeepStream x86 Containers: Containers for Enterprise Grade GPUs. DeepStream Jetson containers: Containers for Orin based systems. DeepStream Debian Installers: For both x86 and Jetson (ARM) based platforms. These assets are now available under the resource page of NGC. GXF Runtime and Graph Composer Installers: GXF runtime is available for both x86 and Jetson. While Graph Composer can run on x86 systems running Ubuntu 22.04 and Windows 10. TAO Pretrained Models Supported: All models supported by DeepStream out-of-the-box are now available in the DeepStream collection. Details on how to run these models in DeepStream are available in DeepStream-TAO GitHub repo or the DeepStream documentation.

Please note that we have consolidated the DeepStream containers as follows:

Type

Architecture

Container Name

Target

Triton	Multi-Arch x86 + Jetson	deepstream:7.1-triton-multiarch	Deployment
DeepStream Samples	Multi-Arch x86 + Jetson	deepstream:7.1-samples-multiarch	Deployment
DeepStream-ARM-SBSA	ARM SBSA	depstream:7.1-triton-arm-sbsa	Deployment
Development and Graph Composer	x86	deepstream:7.1-gc-triton-devel	Development. Includes Graph Composer GUI

NOTE: All DeepStream dockerfiles are available on GitHub for easy customization.

DeepStream SDK 7.1 Release

For a full list of new features and changes, and known limitations please refer to the DeepStream 7.1 Release Notes.

Key New Features and Enhancements available in DeepStream 7.1:

Category

Details

New Features

• New Python DeepStream Service Maker. A new Gstreamer abstraction layer that enables developers to build vision AI applications in minutes using Python.

• Support Gray 16 LE, UYVY (8-bit YCbCr-4:2:2) on x86/dGPU

Key New Features and Enhancements available on GXF and Graph Composer 4.0/4.1

Category

Details

New Features

• C++ and Python Application APIs

• Event-based scheduler

• Complex valued parameter types

• Multi-arch support in container builder

• Runtime only package for x86

Enhancements

• Performance and benchmark improvements

• Typed Channels

• CUDA Memory pool

• Improved Python APIs with distributed execution support

• Asynchronous UCX transmitter/receiver

Documentation

Supported Hardware and Software Dependencies

Jetson Series

Modules

JetPack

Latest

DeepStream Supported

Orin	Jetson AGX Orin, Jetson Orin NX, Jetson Orin Nano IGX (including dGPU mode)	6.1	7.1
Xavier	Jetson AGX Xavier, Jetson Xavier NX	5.1.3	6.3 (legacy)
TX2	Jetson TX2 NX Jetson TX2	4.6.x	6.0 (legacy)
Nano	Jetson Nano	4.6.x	6.0 (legacy)

Enterprise GPU Architecture

GPUs

Ada Lovelace	L4, L40
Ampere	A2, A10, A16, A30, A40, A100, RTX A6000
Hopper	H100
Turing	T4

Software Dependencies

x86 / ARM SBSA

Jetson (via JetPack)

Operating System	Ubuntu LTS 22.04	Ubuntu LTS 22.04
GStreamer	1.20.3	1.20.3
Rivermax	1.5	1.5
DLFW (Triton)	24.08	24.08
TensorRT	10.3.0.26	10.3.0.26
CUDA	12.6	12.6
cuDNN	9.3.0	9.3.0
GPU Driver (RM)	535.183.06	N/A
CV-CUDA (DeepStream Libraries)	0.10.1-beta	N/A
NvImageCodec (DeepStream Libraries)	0.3.0.5	N/A
PyNvVideoCodec (DeepStream Libraries)	1.0.1	N/A

Technical Support

DeepStream Support is available via:

Known Limitations

There are known bugs and limitations in the SDK. To learn more about those, refer to the release notes.

License

The following licenses apply to the DeepStream SDK assets:

Asset

Applicable EULA

Notes

SDK	DeepStream SDK EULA	A copy of the license is available on the following folder of the SDK: /opt/nvidia/deepstream/deepstream-7.1/LicenseAgreement.pdf
Containers	DeepStream NGC License	License grants redistribution rights allowing developers to build applications on top of the DeepStream containers
Development Containers	DeepStream NGC Development License	A development-only license. Does not allow redistribution of the container
TAO Models	NVIDIA AI Product License	All TAO pre-trained models included in the DeepStream SDK are covered by the NVIDIA AI Product License.

NOTE: By pulling, downloading, or using the DeepStream SDK, you accept the terms and conditions of the EULA licenses listed above:

Ethical AI

NVIDIA’s platforms and application frameworks enable developers to build a wide array of AI applications. Consider potential algorithmic bias when choosing or creating the models being deployed. Work with the model’s developer to ensure that it meets the requirements for the relevant industry and use case; that the necessary instruction and documentation are provided to understand error rates, confidence intervals, and results; and that the model is being used under the conditions and in the manner intended.

✨ Enhance your brand's digital communication with NViNiO•Link™ : Get started for FREE here