An Evaluation Study of Hybrid Methods for Multilingual PII Detection

Rajgarhia, Harshit, Gupta, Suryam, Shaik, Asif, Kumar, Gulipalli Praveen, Santhoshraj, Y, Nishitha, Sanka Nithya Tanvy, Mukherji, Abhishek

arXiv.org Artificial Intelligence 

The detection of Personally Identifiable Information (PII) is critical for privacy compliance but remains challenging in low-resource languages due to linguistic diversity and limited annotated data. We present RECAP, a hybrid framework that combines deterministic regular expressions with context-aware large language models (LLMs) for scalable PII detection across 13 low-resource locales. RECAP's modular design supports over 300 entity types without retraining, using a three-phase refinement pipeline for disambiguation and filtering. Benchmarked with nervaluate, our system outperforms fine-tuned NER models by 82% and zero-shot LLMs by 17% in weighted F1-score. This work offers a scalable and adaptable solution for efficient PII detection in compliance-focused applications.