Understanding Lookahead Dynamics Through Laplace Transform
Sanyal, Aniket, Chavdarova, Tatjana
We introduce a frequency-domain framework for convergence analysis of hyperparameters in game optimization, leveraging High-Resolution Differential Equations (HRDEs) and Laplace transforms. Focusing on the Lookahead algorithm--characterized by gradient steps $k$ and averaging coefficient $α$--we transform the discrete-time oscillatory dynamics of bilinear games into the frequency domain to derive precise convergence criteria. Our higher-precision $O(γ^2)$-HRDE models yield tighter criteria, while our first-order $O(γ)$-HRDE models offer practical guidance by prioritizing actionable hyperparameter tuning over complex closed-form solutions. Empirical validation in discrete-time settings demonstrates the effectiveness of our approach, which may further extend to locally linear operators, offering a scalable framework for selecting hyperparameters for learning in games.
Jun-17-2025
- Country:
- Asia
- Middle East > Jordan (0.04)
- Russia (0.04)
- Europe
- Germany > Bavaria
- Upper Bavaria > Munich (0.04)
- Russia (0.04)
- Germany > Bavaria
- Asia
- Genre:
- Research Report (0.50)
- Technology: