The Scattering Compositional Learner: Discovering Objects, Attributes, Relationships in Analogical Reasoning
Wu, Yuhuai, Dong, Honghua, Grosse, Roger, Ba, Jimmy
–arXiv.org Artificial Intelligence
In this work, we focus on an analogical reasoning task that contains rich compositional structures, Raven's Progressive Matrices (RPM). To discover compositional structures of the data, we propose the Scattering Compositional Learner (SCL), an architecture that composes neural networks in a sequence. Our SCL achieves state-of-the-art performance on two RPM datasets, with a 48.7% relative improvement on Balanced-RAVEN and 26.4% on PGM over the previous state-of-the-art. We additionally show that our model discovers compositional representations of objects' attributes (e.g., shape color, size), and their relationships (e.g., progression, union). We also find that the compositional representation makes the SCL significantly more robust to test-time domain shifts and greatly improves zero-shot generalization to previously unseen analogies.
arXiv.org Artificial Intelligence
Jul-8-2020
- Country:
- North America
- United States
- Indiana (0.04)
- New York > Tompkins County
- Ithaca (0.04)
- Nevada > Clark County
- Las Vegas (0.04)
- Massachusetts > Suffolk County
- Boston (0.04)
- Louisiana > Orleans Parish
- New Orleans (0.04)
- Hawaii > Honolulu County
- Honolulu (0.04)
- California > San Diego County
- San Diego (0.04)
- Canada
- Ontario > Toronto (0.29)
- British Columbia > Metro Vancouver Regional District
- Vancouver (0.04)
- United States
- Europe
- United Kingdom > England
- Oxfordshire > Oxford (0.04)
- Sweden > Stockholm
- Stockholm (0.04)
- United Kingdom > England
- Africa > Ethiopia
- Addis Ababa > Addis Ababa (0.04)
- North America
- Genre:
- Research Report (0.82)
- Technology: