ARMOR: High-Performance Semi-Structured Pruning via Adaptive Matrix Factorization