Goto

Collaborating Authors

 Country









VarianceReduced

Neural Information Processing Systems

In recent centralized nonconvex distributed learning and federated learning, localmethods areoneofthepromising approaches toreducecommunication time. However, existing work has mainly focused on studying first-order optimality guarantees. On the other side, second-order optimality guaranteed algorithms, i.e., algorithms escaping saddle points, havebeen extensivelystudied inthenondistributed optimization literature.


PARD: Permutation-invariantAutoregressiveDiffusion forGraphGeneration

Neural Information Processing Systems

Specifically, we show that contrary to sets, elements in a graph are not entirely unordered and there is a unique partial order for nodes and edges. With this partial order,PARD generates a graph in a block-by-block, autoregressivefashion, where each block'sprobability isconditionally modeled by a shared diffusion model with an equivariant network.