This Could Lead to the Next Big Breakthrough in Common Sense AI

You've probably heard us say this countless times: GPT-3, the gargantuan AI that spews uncannily human-like language, is a marvel. You can tell with a simple trick: Ask it the color of sheep, and it will suggest "black" as often as "white"--reflecting the phrase "black sheep" in our vernacular. That's the problem with language models: because they're only trained on text, they lack common sense. Now researchers from the University of North Carolina, Chapel Hill, have designed a new technique to change that. They call it "vokenization," and it gives language models like GPT-3 the ability to "see."