An Empirical Investigation of Matrix Factorization Methods for Pre-trained Transformers