Optimus-CC: Efficient Large NLP Model Training with 3D Parallelism Aware Communication Compression

Open in new window