Building a Next Word Predictor in Tensorflow – Towards Data Science

Next Word Prediction or what is also called Language Modeling is the task of predicting what word comes next. It is one of the fundamental tasks of NLP and has many applications. You might be using it daily when you write texts or emails without realizing it. I recently built a next word predictor on Tensorflow and in this blog I want to go through the steps I followed so you can replicate them and build your own word predictor. I used the text8 dataset which is en English Wikipedia dump from Mar 2006.