Discovering the Hidden Vocabulary of DALLE-2 - Technology Org

DALLE-2 is a deep generative model that takes a text caption and generates images that match the given text. However, it has its limitations. Sample image generated using DALL·E 2. Image credit: OpenAI Researchers discover that this text is not random but reveals a hidden vocabulary that the model seems to have developed internally. Researchers find that words that sound gibberish for humans may have a meaning for DALLE-2; for example, Vicootes means vegetables. Researchers notice that a system behaving in unpredictable ways may cause security concerns.