Growing Pains: Scaling Deep Learning Inference - IT Peer Network

Training an effective deep neural network is one thing, but deploying it in a way that keeps up with customer demand and is both performant and cost-efficient is hard. We've combined a heavily optimized software stack with deep learning-enabled hardware to fix that. There's an exciting change in the mix of problems that machine learning folks talk about. Teams have found their groove with data management and model training, and now have rapidly expanding user-bases. Of course, as great as it is to see your user graph go vertical, success comes with new problems.