What if Neural Networks had SVDs?