Transformers Can Do Arithmetic with the Right Embeddings
–Neural Information Processing Systems
We mend this problem by adding an embedding to each digit that encodes its position relative to the start of the number.
Neural Information Processing Systems
Feb-18-2026, 00:01:48 GMT
- Country:
- Europe
- Germany > Baden-Württemberg
- Tübingen Region > Tübingen (0.04)
- Italy > Tuscany
- Florence (0.04)
- Germany > Baden-Württemberg
- North America > United States
- Maryland (0.04)
- South America > Chile
- Europe
- Genre:
- Research Report
- Experimental Study (0.93)
- New Finding (0.93)
- Research Report
- Industry:
- Banking & Finance (0.46)
- Education (0.46)
- Government > Regional Government (0.46)
- Technology: