Improving Agent Interactions in Virtual Environments with Language Models