The Stability-Efficiency Dilemma: Investigating Sequence Length Warmup for Training GPT Models

Aug-17-2025, 13:39:11 GMT–Neural Information Processing Systems

Recent works have demonstrated great success in pre-training large-scale autore-gressive language models (e.g., GPT -3) on massive GPUs.

large language model, machine learning, natural language, (17 more...)

Neural Information Processing Systems

Aug-17-2025, 13:39:11 GMT

Conferences PDF

Country:
- Asia > Middle East
  - Jordan (0.04)
- Europe > Italy
  - Calabria > Catanzaro Province > Catanzaro (0.04)
- North America > Canada
  - British Columbia > Vancouver (0.04)

Genre:
- Research Report > New Finding (0.68)

Technology:
- Information Technology > Artificial Intelligence
  - Machine Learning > Neural Networks
    - Deep Learning (1.00)
  - Natural Language
    - Chatbot (1.00)
    - Large Language Model (1.00)