SySCD: A System-Aware Parallel Coordinate Descent Algorithm

Nikolas Ioannou, Celestine Mendler-Dünner, Thomas Parnell

Neural Information Processing Systems 

Today's individual machines offer dozens of cores and hundreds of gigabytes of RAM that can, if used efficiently, significantly improve the training performance of machine learning models.