ZeRO & DeepSpeed: New system optimizations enable training models with over 100 billion parameters - Microsoft Research

Open in new window