Robust Inference Methods for Latent Group Panel Models under Possible Group Non-Separation