Numerical Optimizations for Weighted Low-rank Estimation on Language Model