When and how can inexact generative models still sample from the data manifold?