All Neural Networks are Created Equal