Search Beyond Queries: Training Smaller Language Models for Web Interactions via Reinforcement Learning