Guide Your Agent with Adaptive Multimodal Rewards