Adaptive Latent-Space Constraints in Personalized Federated Learning