Towards Linguistically-Aware and Language-Independent Tokenization for Large Language Models (LLMs)

Open in new window