NVIDIA today introduced groundbreaking inference software that developers everywhere can use to deliver conversational AI applications, slashing inference latency that until now has impeded true, interactive engagement. NVIDIA TensorRT 7 -- the seventh generation of the company's inference software development kit -- opens the door to smarter human-to-AI interactions, enabling real-time engagement with applications such as voice agents, chatbots and recommendation engines. It is estimated that there are 3.25 billion digital voice assistants being used in devices around the world, according to Juniper Research. By 2023, that number is expected to reach 8 billion, more than the world's total population. TensorRT 7 features a new deep learning compiler designed to automatically optimize and accelerate the increasingly complex recurrent and transformer-based neural networks needed for AI speech applications.

NVIDIA Corporation (NasdaqGS:NVDA) today introduced the TensorRT 7, which is "the seventh generation of the company's inference software development kit" to deliver conversational AI applications. "We have entered a new chapter in AI, where machines are capable of understanding human language in real time. TensorRT 7 helps make this possible, providing developers everywhere with the tools to build and deploy faster, smarter conversational AI services that allow more natural human-to-AI interaction." The company also announced that it will provide the transportation industry with access to its NVIDIA DRIVE deep neural networks (DNNs) for autonomous vehicle development on the NVIDIA GPU Cloud (NGC) container registry. "The AI autonomous vehicle is a software-defined vehicle required to operate around the world on a wide variety of datasets. By providing AV developers access to our DNNs and the advanced learning tools to optimize them for multiple datasets, we're enabling shared learning across companies and countries, while maintaining data ownership and privacy. Ultimately, we are accelerating the reality of global autonomous vehicles."

In GTC China yesterday, NVIDIA made a series of announcements. Some had to do with local partners and related achievements, such as powering the likes of Alibaba and Baidu. Partners of this magnitude are bound to generate impressive numbers and turn some heads. Another part of the announcements had to do with new hardware. NVIDIA unveiled Orin, a new system-on-a-chip (SoC) designed for autonomous vehicles and robots, as well as a new software-defined platform powered by the SoC, called Nvidia Drive AGX Orin.