An Analysis of Tokenization: Transformers under Markov Data

Open in new window