Neural text generation – Phrasee – Medium

It all starts with a language model. Let's assume we have the sequence [my, cat's, breath, smells, like, cat, ____] and we want to guess the final word. There are several ways to create a language model. The most straightforward is an n-gram model that counts occurrences to estimate frequencies. A bare-bones implementation requires only a dozen lines of Python code and can be surprisingly powerful.