Stanford's Alpaca shows that OpenAI may have a problem

Researchers train a language model from Meta with text generated by OpenAI's GPT-3.5 for less than $600 – and achieve similar performance. Training large language models is expensive, and powerful models remain the monopoly of large technology companies – right? Researchers at Stanford used 52,000 instruction-following demonstrations generated by OpenAI's GPT-3.5 (text-davinci-003) to fine-tune a seven-billion-parameter variant of Meta's recently announced LLaMA model. Check your inbox or spam folder to confirm your subscription. Instruction training is one of the key techniques that make GPT-3.5 superior to the original GPT-3 model, and the training data used is proprietary to OpenAI.