Reliable amortized variational inference with physics-based latent distribution correction