Kernel methods have recently attracted resurgent interest, showing performance competitive with deep neural networks in tasks such as speech recognition.
Despite their wide success in a variety of domains, recurrent neural networks (RNNs) are often inhibited by the difficulty of learning an internal state representation.