MetaDecorator: Generating Immersive Virtual Tours through Multimodality

Xie, Shuang, Liu, Yang, Lee, Jeannie S. A., Dong, Haiwei

arXiv.org Artificial Intelligence 

Abstract--MetaDecorator, is a framework that empowers users to personalize virtual spaces. By leveraging text-driven prompts and image synthesis techniques, MetaDecorator adorns static panoramas captured by 360 imaging devices, transforming them into uniquely styled and visually appealing environments. This significantly enhances the realism and engagement of virtual tours compared to traditional offerings. Beyond the core framework, we also discuss the integration of Large Language Models (LLMs) and haptics in the VR application to provide a more immersive experience. This framework shown in FIGURE 1 a significant transformation with the introduction consists of two main stages.