Learning Hybrid Dynamics Models With Simulator-Informed Latent States