Second-order forward-mode optimization of recurrent neural networks for neuroscience

A common source of anxiety for the computational neuroscience student is the question "will my recurrent neural network (RNN) model finally learn that task?".