Video Frames Dynamic Content (Moving Object & Camera) Annotations Object Mask Object & Category Caption Scene Camera Caption

Understanding structure, real-w the orld dynamic motion, ph and ysical semantic world, content characterized with textual by its descriptions, evolving 3D is crucial for human-agent interaction and enables embodied agents to perceive and act datasets within are real often en deri vironments ved from with limited human simulators -like capabilities.