From Biased to Unbiased Dynamics: An Infinitesimal Generator Approach