Momentum-based gradient descent methods for Lie groups
Campos, Cédric M., de Diego, David Martín, Torrente, José
–arXiv.org Artificial Intelligence
Classical Momentum, and Nesterov's Accelerated Gradient (NAG; Nesterov, 1983) are well know examples of momentum-descent methods for optimization. While the latter outperforms the former, solely generalizations of PHB-like methods to nonlinear spaces have been described in the literature. We propose here a generalization of NAG-like methods for Lie group optimization based on the variational one-to-one correspondence between classical and accelerated momentum methods (Campos et al., 2023).
arXiv.org Artificial Intelligence
Apr-14-2024
- Country:
- North America > United States
- New Jersey > Mercer County
- Princeton (0.04)
- Massachusetts > Suffolk County
- Boston (0.04)
- Florida > Palm Beach County
- Boca Raton (0.04)
- New Jersey > Mercer County
- Europe > Spain
- Galicia > Madrid (0.04)
- Andalusia > Córdoba Province
- Córdoba (0.04)
- Asia > Middle East
- Jordan (0.04)
- North America > United States
- Genre:
- Research Report (0.64)
- Technology: