Meet GPT-JT, the Closest Open Source Alternative to GPT-3

Recently, Together, an open source community led by researchers and technocrats, released a new version of GPT-JT trained on six billion parameters. This new model has been built using recently published open source techniques and datasets. It has been trained with its decentralised approach on the Together Research Computer, a local, in-house network developed by the team. Unlike GPT-3, which is available on-demand/request, GPT-JT is now available as open source. Click here to access the code and datasets.