Language modeling using Recurrent Neural Networks - Part 1

First of all, lets get motivated to learn Recurrent Neural Networks(RNNs) by knowing what they can do and how robust and sometimes surprisingly effective they can be. This amazing blog by Andrej Karpathy will help you get started. Our aim here is to make a neural network that can learn the structure and syntax of language. We'll provide a huge set of dialogues from the scripts of 2 of my favorite shows F.R.I.E.N.D.S and South Park as training data and hope that our model learns to talk like the characters. Basic layered neural networks are used when there are a set of distinct inputs and we expect a class or a real number etc.. assuming that all inputs are independent of each other. RNNs on the other hand, are used when the inputs are sequential.