A Deeper Understanding Is Needed To Improve Neural Networks