Reviews: Using Fast Weights to Attend to the Recent Past

Major comments: This paper contains a nice idea, namely, a weight matrix which is architecturally constrained to use a certain learning rule and update itself at various points during processing. This general scheme seems likely to lead to many variants in the future. The performance on the tasks considered is solid, and makes the technique worthy of further consideration. This paper makes a solid contribution to machine learning, but the results in the paper do not support the claim in the conclusion that "the main contribution is to computational neuroscience and cognitive science." The paper makes no contact with experimental data, whether neural or psychological.