The Generative AI Paradox: "What It Can Create, It May Not Understand"