Introduction to Recurrent Neural Networks in Pytorch - CPUheater

This tutorial is intended for someone who wants to understand how Recurrent Neural Network works, no prior knowledge about RNN is required. We will implement the most simple RNN model – Elman Recurrent Neural Network. To get a better understanding of RNNs, we will build it from scratch using Pytorch tensor package and autograd library. I assume that you have some understanding of feed-forward neural network if you are new to Pytorch and autograd library checkout my tutorial. An Elman network was introduced by Jeff Elman, and was first published in a paper entitled Finding structure in time.