Rapidly Adapting Policies to the Real World via Simulation-Guided Fine-Tuning