Optimal Embedding Learning Rate in LLMs: The Effect of Vocabulary Size

Open in new window