New Subsampling Algorithms for Fast Least Squares Regression Yichao Lu2 Dean Foster

Neural Information Processing Systems 

We address the problem of fast estimation of ordinary least squares (OLS) from large amounts of data (n p). We propose three methods which solve the big data problem by subsampling the covariance matrix using either a single or two stage estimation.