MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUs

Open in new window