Accelerated Stochastic Matrix Inversion: General Theory and Speeding up BFGS Rules for Faster Second-Order Optimization

Robert Gower, Filip Hanzely, Peter Richtarik, Sebastian U. Stich

Neural Information Processing Systems 

A new wave of second order stochastic methods are being developed with the aim of solving large scale optimization problems.