Nvidia and Microsoft are building an AI supercomputer

Based on Microsoft's Azure cloud infrastructure, the AI supercomputer will use tens of thousands of Nvidia's powerful H100 and A100 data center GPUs and its Quantum-2 InfiniBand networking platform. According to Nvidia, the combination of Microsoft's Azure cloud platform and Nvidia's GPUs, networking, and full AI suite will allow more enterprises to train, deploy, and scale AI -- including large, state-of-the-art models. The two companies will also collaboratively develop DeepSpeed, Microsoft's deep learning optimization software.