Introducing Distributed Data Parallel support on PyTorch Windows - Microsoft Open Source Blog