Faster Ridge Regression via the Subsampled Randomized Hadamard Transform Yichao Lu Dean Foster

Neural Information Processing Systems 

We propose a fast algorithm for ridge regression when the number of features is much larger than the number of observations (p n).