Training a Language Model To Give (Non) Legal Advice – Towards AI

Originally published on Towards AI. In this article, I go through the basics of finetuning large language models like BLOOM on a legal text dataset. You can try it on HuggingFace Spaces! I am currently on a quest to learn the ropes of working with large language models (LLMs). This includes learning how to finetune pre-trained models such as OPT and BLOOM.