Uniform-in-Time Wasserstein Stability Bounds for (Noisy) Stochastic Gradient Descent

It also illustrates that ergodicity is an important component for obtaining time-uniform bounds - which might not be achieved for convex or non-convex losses unless additional noise is injected to the iterates.