The Download: why LLMs are like aliens, and the future of head transplants

MIT Technology Review 

How large is a large language model? We now coexist with machines so vast and so complicated that nobody quite understands what they are, how they work, or what they can really do--not even the people who build them. Even though nobody fully understands how it works--and thus exactly what its limitations might be--hundreds of millions of people now use this technology every day. To help overcome our ignorance, researchers are studying LLMs as if they were doing biology or neuroscience on vast living creatures--city-size xenomorphs that have appeared in our midst. And they're discovering that large language models are even weirder than they thought. The Italian neurosurgeon Sergio Canavero has been preparing for a surgery that might never happen.