Reviews: Modeling Conceptual Understanding in Image Reference Games

Neural Information Processing Systems 

Summary --- Consider a speaker agent and many listeners where listeners perceive differently (e.g., some know what cat furr looks like and others don't). This paper proposes an image reference game and develops a speaker that performs better at the reference game by modeling listener abilities. For example, one person might be able to visually classify many specific dog breeds wheras another person might not know anything about what dogs look like. The speaker utters image attributes which the listener uses to distinguish between the two images. Reference Game Flow: There are two stages of interaction analogous to meta-learning setups: practice and evaluation.