Latent Guided Sampling for Combinatorial Optimization