Were RNNs All We Needed?