Integrating Open-World Shared Control in Immersive Avatars