Understanding LSTMs and GRUs

In my last article, I have introduced Recurrent Neural Networks and the complications it carries. To combat the drawbacks we use LSTMs & GRUs. Recurrent Neural Networks are confined to short-term memory. If a long sequence is fed to the network, they'll have a hard time remembering the information and might as well leave out important information from the beginning. Besides, Recurrent Neural Networks faces Vanishing Gradient Problem when backpropagation comes into play.