SPIN: Simultaneous Perception, Interaction and Navigation