Goto

Collaborating Authors

 llambert

LlamBERT: Large-scale low-cost data annotation in NLP

Csanády, Bálint, Muzsai, Lajos, Vedres, Péter, Nádasdy, Zoltán, Lukács, András

arXiv.org Artificial Intelligence

Despite their effectiveness, the high costs associated with their use pose a challenge. We present LlamBERT, a hybrid approach that leverages LLMs to annotate a small subset of large, unlabeled databases and uses the results for fine-tuning transformer encoders like BERT and RoBERTa. This strategy is evaluated on two diverse datasets: the IMDb review dataset and the UMLS Meta-Thesaurus. Our results indicate that the LlamBERT approach slightly compromises on accuracy while offering much greater cost-effectiveness.

2403.15938
  Country:
  Genre: Research Report (0.84)
  Industry:
  Technology:

Add feedback