Efficient Matrix Factorization Via Householder Reflections