A Free Lunch in LLM Compression: Revisiting Retraining after Pruning