Dexterous Manipulation from Images: Autonomous Real-World RL via Substep Guidance