Accelerating Particle-based Energetic Variational Inference

Bao, Xuelian, Kang, Lulu, Liu, Chun, Wang, Yiwei

arXiv.org Machine Learning 

In this work, we propose a novel particle-based variational inference (ParVI) method that accelerates the EVI-Im, proposed in Ref. [41]. Inspired by energy quadratization (EQ) and operator splitting techniques for gradient flows, our approach efficiently drives particles towards the target distribution. Unlike EVI-Im, which employs the implicit Euler method to solve variational-preserving particle dynamics for minimizing the KL divergence, derived using a "discretize-then-variational" approach, the proposed algorithm avoids repeated evaluation of inter-particle interaction terms, significantly reducing computational cost. The framework is also extensible to other gradient-based sampling techniques. Through several numerical experiments, we demonstrate that our method outperforms existing ParVI approaches in efficiency, robustness, and accuracy.

Duplicate Docs Excel Report

Title
None found

Similar Docs  Excel Report  more

TitleSimilaritySource
None found