Why you shouldn't trust AI search engines – MIT Technology Review

What makes all of this all the more shocking is that it came as a surprise to precisely no one who has been paying attention to AI language models. Here's the problem: the technology is simply not ready to be used like this at this scale. AI language models are notorious bullshitters, often presenting falsehoods as facts. They are excellent at predicting the next word in a sentence, but they have no knowledge of what the sentence actually means. That makes it incredibly dangerous to combine them with search, where it's crucial to get the facts straight.