Damien Benveniste, PhD on LinkedIn: #machinelearning #datascience #chatgpt

Do you know how ChatGPT was trained? ChatGPT is "simply" a fined-tuned GPT-3 model with a surprisingly small amount of data! Moreover, ChatGPT is using 1.3B parameters where GPT-3 uses 175B parameters! It is first fine-tuned with supervised learning and then further fine-tuned with reinforcement learning. They hired 40 human labelers to generate the training data.