An Introduction To Recurrent Neural Networks And The Math That Powers Them

Recurrent neural networks are designed to hold past or historic information of sequential data. An RNN is unfolded in time and trained via BPTT.