1ff8a7b5dc7a7d1f0ed65aaa29c04b1e-Reviews.html

We are currently contemplating better experiments to gauge the level of abstraction of each layer. One potential way is to sample optimal text sequences for individual node activations at different layers, and see whether these show higher levels of abstraction higher in the DRNN, but this is non-trivial due to the discrete nature of the input. Due to page restrictions (and time limitations) we will not be able to include this in the paper.