How to Train Your Latent Control Barrier Function: Smooth Safety Filtering Under Hard-to-Model Constraints