Tokenization as Finite-State Transduction

Open in new window