Synthetic Data Is a Dangerous Teacher

In April 2022, when Dall-E, a text-to-image visio-linguistic model, was released, it purportedly attracted over a million users within the first three months. This was followed by ChatGPT, in January 2023, which apparently reached 100 million monthly active users just two months after launch. Both mark notable moments in the development of generative AI, which in turn has brought forth an explosion of AI-generated content into the web. The bad news is that, in 2024, this means we will also see an explosion of fabricated, nonsensical information, mis- and disinformation, and the exacerbation of social negative stereotypes encoded in these AI models. The AI revolution wasn't spurred by any recent theoretical breakthrough--indeed, most of the foundational work underlying artificial neural networks has been around for decades--but by the "availability" of massive data sets.