On the Learning and Learnability of Quasimetrics
Wang, Tongzhou, Isola, Phillip
–arXiv.org Artificial Intelligence
Our world is full of asymmetries. Gravity and wind can make reaching a place easier than coming back. Social artifacts such as genealogy charts and citation graphs are inherently directed. In reinforcement learning and control, optimal goal-reaching strategies are rarely reversible (symmetrical). Distance functions supported on these asymmetrical structures are called quasimetrics. Despite their common appearance, little research has been done on the learning of quasimetrics. Our theoretical analysis reveals that a common class of learning algorithms, including unconstrained multilayer perceptrons (MLPs), provably fails to learn a quasimetric consistent with training data. In contrast, our proposed Poisson Quasimetric Embedding (PQE) is the first quasimetric learning formulation that both is learnable with gradient-based optimization and enjoys strong performance guarantees. Experiments on random graphs, social graphs, and offline Q-learning demonstrate its effectiveness over many common baselines.
arXiv.org Artificial Intelligence
Oct-3-2022
- Country:
- North America > United States
- California
- Santa Clara County > Palo Alto (0.04)
- San Diego County > San Diego (0.04)
- Los Angeles County > Santa Monica (0.04)
- California
- Europe
- United Kingdom > England
- Cambridgeshire > Cambridge (0.04)
- Hungary > Hajdú-Bihar County
- Debrecen (0.04)
- United Kingdom > England
- Asia
- Middle East
- Japan > Honshū
- Chūbu > Ishikawa Prefecture > Kanazawa (0.04)
- Afghanistan > Parwan Province
- Charikar (0.04)
- North America > United States
- Genre:
- Research Report > New Finding (0.67)
- Industry:
- Information Technology (0.46)
- Technology: