PRISM: Probabilistic Real-Time Inference in Spatial World Models