Scaling Data-Constrained Language Models
–Neural Information Processing Systems
We propose and empirically validate a scaling law for compute optimality that accounts for the decreasing value of repeated tokens and excess parameters.
Neural Information Processing Systems
Oct-9-2025, 02:46:03 GMT
- Country:
- Europe
- Austria (0.04)
- United Kingdom
- Scotland > City of Edinburgh
- Edinburgh (0.04)
- England > Hampshire
- Southampton (0.04)
- Scotland > City of Edinburgh
- Italy > Calabria
- Catanzaro Province > Catanzaro (0.04)
- Ireland > Leinster
- County Dublin > Dublin (0.04)
- Finland > Southwest Finland
- Turku (0.04)
- Belgium > Brussels-Capital Region
- Brussels (0.04)
- Asia > Middle East
- Jordan (0.04)
- Europe
- Genre:
- Research Report > New Finding (0.68)
- Technology: