Tesla Full Self Driving Is Using GPT For Vision -- Dr. Know It All Explains What This Means

Tesla's Full-Self Driving is using generative pre-trained transformers (GPT) for vision, Elon Musk tweeted recently. He added that the GPTs are running natively on Tesla TRIP chips versus needing to round trip to iGPU. I think it's important to take a quick deep dive into this, because this is kind of the heart and soul of FSD. Know It All Knows It All" to translate what all of this means. Learning new things is something we all should be open to, and that's why I'm writing this today. Elon Musk's initial tweet was a response to @JeffTutorials, who asked Elon Musk to add software release notes into the Tesla app, adding that it would be nice to see what was new right from the phone. In that thread, Elon Musk noted that the transformers are replacing C heuristics for post-processing of the vision neural networks' giant bag of points. I asked Dr. Know It All to share a bit more about TRIP chips and he pointed me to a project that the Department of Computer Science at The University of Texas at Austin worked on. I think, but am not 100% sure, that Elon was referring to TRIPS chips, which is a type of microprocessor architecture. You can read up on the project here. In the tweet below, KL Manish shared a definition of a TRIP chip and Elon Musk confirmed this. Dr. Know It All noted that Elon Musk revealed a lot of useful information, and his video is a short dive into what exactly Elon Musk is talking about and why it matters. I'm sure Jeff didn't plan on initiating a conversation about artificial intelligence and GPT, and Elon's reply to Jeff is a bit off the topic. What Jeff was referring to was making the release notes available in the Tesla app as well as on the screen of the car. It's a brilliant suggestion and would make taking screenshots of the release notes easier for those who share them on Twitter for us writers to write about. Dr. Know It All explained that GPT is something that OpenAI is working on -- specifically GPT3. GPT3 has 175 billion parameters. Now, I'm not saying GPT3 is what Tesla is using here but I just wanted to put that as a contextual element there."