Can Peanuts Fall in Love with Distributional Semantics?
Michaelov, James A., Coulson, Seana, Bergen, Benjamin K.
–arXiv.org Artificial Intelligence
Context changes expectations about upcoming words - following a story involving an anthropomorphic peanut, comprehenders expect the sentence the peanut was in love more than the peanut was salted, as indexed by N400 amplitude (Nieuwland & van Berkum, 2006). This updating of expectations has been explained using Situation Models - mental representations of a described event. However, recent work showing that N400 amplitude is predictable from distributional information alone raises the question whether situation models are necessary for these contextual effects. We model the results of Nieuwland and van Berkum (2006) using six computational language models and three sets of word vectors, none of which have explicit situation models or semantic grounding. We find that a subset of these can fully model the effect found by Nieuwland and van Berkum (2006). Thus, at least some processing effects normally explained through situation models may not in fact require explicit situation models.
arXiv.org Artificial Intelligence
May-22-2023
- Country:
- Asia
- Japan > Kyūshū & Okinawa
- Kyūshū > Miyazaki Prefecture > Miyazaki (0.04)
- Middle East
- Qatar > Ad-Dawhah
- Doha (0.04)
- Republic of Türkiye > Istanbul Province
- Istanbul (0.04)
- UAE > Abu Dhabi Emirate
- Abu Dhabi (0.04)
- Qatar > Ad-Dawhah
- Japan > Kyūshū & Okinawa
- Europe
- Austria > Vienna (0.14)
- Middle East > Republic of Türkiye
- Istanbul Province > Istanbul (0.04)
- Slovenia (0.04)
- United Kingdom > England
- Cambridgeshire > Cambridge (0.04)
- Oxfordshire > Oxford (0.04)
- North America > United States
- California > San Diego County
- District of Columbia > Washington (0.04)
- Massachusetts > Suffolk County
- Boston (0.04)
- Minnesota > Hennepin County
- Minneapolis (0.14)
- New York > New York County
- New York City (0.04)
- Oceania > Australia
- Australian Capital Territory > Canberra (0.04)
- Asia
- Genre:
- Research Report > New Finding (0.95)
- Industry:
- Health & Medicine > Therapeutic Area > Neurology (0.47)
- Technology: