How Do Transformers "Do" Physics? Investigating the Simple Harmonic Oscillator