NVIDIAVoice: Why Did NVIDIA Build The World's Largest GPU?

At some point in the not too distant future, the answer will seem self-evident. Like a lot of things, time changes perspective; the essential advancements we take for granted now were once deemed insurmountable. I believe we'll look back at the introduction of a 2 petaFLOPS deep learning system as essential to the evolution of AI in the enterprise. Single GPU systems once offered a seemingly limitless playground for researchers and developers on which to innovate. As deep learning model complexity and datasets grew to address increasingly exotic (but important) use cases, the standard currency of deep learning compute grew in response.