Cyclades: Conflict-free Asynchronous Machine Learning

Xinghao Pan, Maximilian Lam, Stephen Tu, Dimitris Papailiopoulos, Ce Zhang, Michael I. Jordan, Kannan Ramchandran, Christopher Ré

Neural Information Processing Systems 

Cores will access the same data points and read/write the same subset of model variables. This has the additional benefit of reducing false sharing across cores.