Retrieval Augmented Anomaly Detection (RAAD): Nimble Model Adjustment Without Retraining

Pastoriza, Sam, Yousfi, Iman, Redino, Christopher, Vucovich, Marc, Rahman, Abdul, Aguinaga, Sal, Nandakumar, Dhruv

arXiv.org Artificial Intelligence 

--We propose a novel mechanism for real-time (human-in-the-loop) feedback focused on false positive reduction to enhance anomaly detection models. It was designed for the lightweight deployment of a behavioral network anomaly detection model. This methodology is easily integrable to similar domains that require a premium on throughput while maintaining high precision. In this paper, we introduce Retrieval Augmented Anomaly Detection, a novel method taking inspiration from Retrieval Augmented Generation. Human annotated examples are sent to a vector store, which can modify model outputs on the very next processed batch for model inference. T o demonstrate the generalization of this technique, we benchmarked several different model architectures and multiple data modalities, including images, text, and graph-based data. I NTRODUCTION Cybersecurity artificial intelligence (AI) models designed for network intrusion threat detection require very high, but nuanced, model precision.