Reviewer

We thank the reviewers for their helpful comments. The code and models will be open-sourced. Along with peak RAM, we report inference FLOPs for all the models. Finally, the rationale behind ImageNet-10 can be found in Appendix A.1. And even then ReNet's accuracy is GRU or LSTM as the RNN unit; we use GRU as it is more efficient.