HUMANISE: Language-conditioned HumanMotionGenerationin3DScenes

We automatically annotate the aligned motions with language descriptions that depict the action and the unique interacting objects in the scene;e.g., sit on the armchair near the desk. HUMANISE thus enables a new generation task,language-conditioned human motion generation in 3D scenes.The proposed task is challenging as itrequires joint modeling of the 3D scene, human motion, and natural language.