Understanding the Role of Input Token Characters in Language Models: How Does Information Loss Affect Performance?

Open in new window