Me, Myself, and AI: The Situational Awareness Dataset (SAD) for LLMs

AI assistants such as ChatGPT are trained to respond to users by saying, I am a large language model".This raises questions. Do such models know'' that they are LLMs and reliably act on this knowledge? Are they aware of their current circumstances, such as being deployed to the public?We refer to a model's knowledge of itself and its circumstances as situational awareness