To solve this problem, convergent algorithms are developed with both single-loop and stochastic variants. Notably, this is the firstsingle-loop primalalgorithmforconstrained optimization toourknowledge.
Our results motivate a natural partial order over covariate shifts that provides a sufficient condition for determining when the shift will harm (or even help) test performance.