On the Predictability of Pruning Across Scales