Tesla AI Head Andrej Karpathy Creates His Own Mini GPT

"minGPT tries to be small, clean, interpretable and educational, as most of the currently available ones are a bit sprawling." On Monday, Andrej Karpathy, senior director of AI at Tesla, released a library for GPT language model called minGPT. This library written for PyTorch is a re-implementation of GPT training. Karpathy created this clean, interpretable library over the weekend. This library aims to address the existing implementations of GPT on PyTorch, which Karpathy finds to be sprawling.