First Order Methods with Markovian Noise: from Acceleration to Variational Inequalities

This paper delves into stochastic optimization problems that involve Markovian noise. We present a unified approach for the theoretical analysis of first-order gradient methods for stochastic optimization and variational inequalities.