The interplay between randomness and structure during learning in RNNs

Here, we examine RNNs trained using gradient descent on different tasks inspired by the neuroscience literature.