Review for NeurIPS paper: Directional Pruning of Deep Neural Networks

Neural Information Processing Systems 

Thank you for your submission. There were many internal discussion about the paper. R3 championed the paper and appreciated the fact the method has theoretical footing. R1 & R2 raise critical issues with the empirical evaluation. R1 correctly highlighted that experiments do not include important baselines. Additionally, the evaluation was done on a nonstandard learning rate schedules, and results on standard learning rate schedule are not fully convincing (feedback didn't resolve this issue).