N-gram language models -- Part 1

Language modeling -- that is, predicting the probability of a word in a sentence -- is a fundamental task in natural language processing. It is used in many NLP applications such as autocomplete, spelling correction, or text generation. Currently, language models based on neural networks, especially transformers, are the state of the art: they predict very accurately a word in a sentence based on surrounding words. However, in this project, I will revisit the most classic language model: the n-gram models. In this project, my training data set -- appropriately called train -- is "A Game of Thrones", the first book in the George R. R. Martin fantasy series that inspired the popular TV show of the same name.