Public-data Assisted Private Stochastic Optimization: Power and Limitations