ReProCon: Scalable and Resource-Efficient Few-Shot Biomedical Named Entity Recognition
Yoo, Jeongkyun, Riddle, Nela, Hoblitzell, Andrew
–arXiv.org Artificial Intelligence
Named Entity Recognition (NER) in biomedical domains faces challenges due to data scarcity and imbalanced label distributions, especially with fine-grained entity types. We propose ReProCon, a novel few-shot NER framework that combines multi-prototype modeling, cosine-contrastive learning, and Reptile meta-learning to tackle these issues. By representing each category with multiple prototypes, ReProCon captures semantic variability, such as synonyms and contextual differences, while a cosine-contrastive objective ensures strong interclass separation. Reptile meta-updates enable quick adaptation with little data. Using a lightweight fastText + BiLSTM encoder with much lower memory usage, ReProCon achieves a macro-$F_1$ score close to BERT-based baselines (around 99 percent of BERT performance). The model remains stable with a label budget of 30 percent and only drops 7.8 percent in $F_1$ when expanding from 19 to 50 categories, outperforming baselines such as SpanProto and CONTaiNER, which see 10 to 32 percent degradation in Few-NERD. Ablation studies highlight the importance of multi-prototype modeling and contrastive learning in managing class imbalance. Despite difficulties with label ambiguity, ReProCon demonstrates state-of-the-art performance in resource-limited settings, making it suitable for biomedical applications.
arXiv.org Artificial Intelligence
Aug-26-2025
- Country:
- Asia > South Korea
- Europe
- Ireland > Leinster
- County Dublin > Dublin (0.04)
- Italy
- Piedmont > Turin Province
- Turin (0.04)
- Sardinia (0.04)
- Piedmont > Turin Province
- Ireland > Leinster
- North America > United States
- District of Columbia > Washington (0.05)
- Georgia > Fulton County
- Atlanta (0.04)
- Indiana > Marion County
- Indianapolis (0.04)
- Minnesota > Hennepin County
- Minneapolis (0.14)
- New York > New York County
- New York City (0.04)
- South America > Chile
- Genre:
- Research Report > New Finding (0.46)
- Industry:
- Technology: