Rethinking Memory and Communication Costs for Efficient Data Parallel Training of Large Language Models
–Neural Information Processing Systems
Recently, various strategies for distributed training of large language models (LLMs) have been proposed.
Neural Information Processing Systems
Nov-15-2025, 12:47:36 GMT
- Country:
- Asia > China
- Zhejiang Province > Hangzhou (0.04)
- Europe
- Austria (0.04)
- France > Nouvelle-Aquitaine
- Ireland > Leinster
- County Dublin > Dublin (0.04)
- United Kingdom > England
- West Midlands > Birmingham (0.04)
- North America
- Canada > Quebec
- Montreal (0.04)
- United States
- California
- Florida > Pinellas County
- St. Petersburg (0.04)
- Georgia > Fulton County
- Atlanta (0.04)
- Louisiana > Orleans Parish
- New Orleans (0.04)
- Missouri > St. Louis County
- St. Louis (0.04)
- Utah > Salt Lake County
- Salt Lake City (0.04)
- Virginia (0.04)
- Canada > Quebec
- Asia > China
- Genre:
- Research Report
- Experimental Study (0.93)
- New Finding (0.67)
- Research Report
- Industry:
- Information Technology (0.46)
- Law (0.67)
- Technology: