Goto

Collaborating Authors

 Statistical Learning





Public-data Assisted Private Stochastic Optimization: Power and Limitations

Neural Information Processing Systems

We study the limits and capability of public-data assisted differentially private (P A-DP) algorithms. Specifically, we focus on the problem of stochastic convex optimization (SCO) with either labeled or unlabeled public data.






RandomShufflingBeatsSGDOnlyAfterMany EpochsonIll-ConditionedProblems

Neural Information Processing Systems

However, known lower bounds ignore the problem's geometry,including itscondition number,whereas theupper bounds explicitly depend on it. Perhaps surprisingly, we prove that when the condition number is taken into account, without-replacement SGDdoesnotsignificantly improveon withreplacement SGD in terms of worst-case bounds, unless the number of epochs (passes overthedata) islargerthanthecondition number.