Goto

Collaborating Authors

 Statistical Learning



Shadowheart SGD: Distributed Asynchronous SGD with Optimal Time Complexity Under Arbitrary Computation and Communication Heterogeneity

Neural Information Processing Systems

We consider nonconvex stochastic optimization problems in the asynchronous centralized distributed setup where the communication times from workers to a server can not be ignored, and the computation and communication times are potentially different for all workers.









A fast, universal algorithm to learn parametric nonlinear embeddings

Neural Information Processing Systems

Using the method of auxiliary coordinates, we derive a training algorithm that works by alternating steps that train an auxiliary embeddingwith steps that train the mapping.