Did ChatGPT Really Pass Graduate-Level Exams?

Way back in 2019--an eon ago in AI time--the New York Times reported an AI milestone: Aristo, a natural-language processing and reasoning system scored over 90% on parts of the New York Regents 8th Grade Science Exam, and over 83% on parts of the corresponding Grade 12 Science Exam. Aristo, the Times proclaimed, "is ready for high school science. I argued this at the time: "The truth is that while these systems perform well on specific language-processing tests, they can only take the test. None come anywhere close to matching humans in reading comprehension or other general abilities that the test was designed to measure." Moreover, such systems lack the basic commonsense understanding of the world that is assumed of humans taking the same tests.