Sampling with Trusthworthy Constraints: A Variational Gradient Framework