SEBOOST - Boosting Stochastic Learning Using Subspace Optimization Techniques

Elad Richardson, Rom Herskovitz, Boris Ginsburg, Michael Zibulevsky

Neural Information Processing Systems 

SEBOOST applies a secondary optimization process in the subspace spanned by the last steps and descent directions.