Nvidia's TensorRT deep learning inference platform breaks new ground in conversational AI - SiliconANGLE

Nvidia Corp. is upping its artificial intelligence game with the release of a new version of its TensorRT software platform for high-performance deep learning inference. TensorRT is a platform that combines a high-performance deep learning inference optimizer with a runtime that delivers low-latency, high-throughput inference for AI applications. Inference is an important aspect of AI. Whereas AI training relates to the development of an algorithm's ability to understand a data set, inference refers to its ability to act on that data to infer answers to specific queries. The latest version brings with it some dramatic improvements on the performance side.