Multi-block-Single-probe Variance Reduced Estimator for Coupled Compositional Optimization

V ariance reduction techniques such as SPIDER/SARAH/STORM have been extensively studied to improve the convergence rates of stochastic non-convex optimization, which usually maintain and update a sequence of estimators for a single function across iterations.