LSTM Networks

LSTM networks were designed specifically to overcome the long-term dependency problem faced by recurrent neural networks RNNs (due to the vanishing gradient problem). LSTMs have feedback connections which make them different to more traditional feedforward neural networks. This property enables LSTMs to process entire sequences of data (e.g. As a result, LSTMs are particularly good at processing sequences of data such as text, speech and general time-series. An example -- Consider we are trying to predict monthly ice cream sales.