Large language models are not zero-shot communicators

Understanding of pragmatics is an essential and ubiquitous part of human communication. We show large language models (LLMs) mostly don't capture this aspect of language, hindering their applicability in the real world. Our analysis indicates where the largest room for improvement is to ultimately make this technology more useful. Recently, a large language model (LLM) called LaMDA beautifully passed (a variation of) the Turing test. In our most recent paper's title we state that LLMs are not zero-shot communicators.