The AWS Deep Learning AMIs are available on Ubuntu 18.04, Ubuntu 16.04, Amazon Linux 2, and Amazon Linux with TensorFlow 1.15, Tensorflow 2.0, PyTorch 1.3.1, Also new in this version is support for AWS Neuron, a SDK for running inference using AWS Inferentia chips. It consists of a compiler, run-time, and profiling tools that enable developers to run high-performance and low latency inference using Inferentia-based EC2 Inf1 instances. Neuron is pre-integrated into popular machine learning frameworks including TensorFlow, Pytorch, and MXNet to deliver optimal performance of EC2 Inf1 instances. Customers using Amazon EC2 Inf1 instances will receive the highest performance and lowest cost for machine learning inference in the cloud, and no longer need to make the sub-optimal tradeoff between optimizing for latency or throughput when running large machine learning models in production.

The AWS Deep Learning AMIs are now available in four new AWS Regions: China (Beijing) operated by Sinnet, Europe (Frankfurt), Asia Pacific (Singapore), and Asia Pacific (Mumbai). The Amazon Machine Images (AMIs) provide provide machine learning practitioners with the infrastructure and tools to accelerate deep to quickly start experimenting with deep learning models. The AMIs come with pre-built packages of popular deep learning frameworks including Apache MXNet and Gluon, TensorFlow, Microsoft Cognitive Toolkit, Caffe, Caffe2, Theano, Torch, PyTorch, and Keras. In addition, to expedite development and model training, the AMIs are pre-configured with NVIDIA CUDA and cuDNN drivers, and are optimized for GPU acceleration on Amazon EC2 P2 and P3 instances. Companies are turning to deep learning to tackle a broad range of challenges.

The AMIs also come with improved framework support for NVIDIA Volta. They include PyTorch v0.3.0, and support NVIDIA CUDA 9 and cuDNN 7, with significant performance improvements for training models on NVIDIA Volta GPUs. As well, they include a version of TensorFlow built from the master and merged with NVIDIA processors for Volta support. We've also added Keras 2.0 support on the CUDA 9 version of the AWS Deep Learning AMIs to work with TensorFlow as the default backend.