For Pre-Trained Vision Models in Motor Control, Not All Policy Learning Methods are Created Equal