Weakly Supervised Anomaly Detection via Knowledge-Data Alignment
Zhao, Haihong, Zi, Chenyi, Liu, Yang, Zhang, Chen, Zhou, Yan, Li, Jia
–arXiv.org Artificial Intelligence
Anomaly detection (AD) plays a pivotal role in numerous web-based applications, including malware detection, anti-money laundering, device failure detection, and network fault analysis. Most methods, which rely on unsupervised learning, are hard to reach satisfactory detection accuracy due to the lack of labels. Weakly Supervised Anomaly Detection (WSAD) has been introduced with a limited number of labeled anomaly samples to enhance model performance. Nevertheless, it is still challenging for models, trained on an inadequate amount of labeled data, to generalize to unseen anomalies. In this paper, we introduce a novel framework Knowledge-Data Alignment (KDAlign) to integrate rule knowledge, typically summarized by human experts, to supplement the limited labeled data. Specifically, we transpose these rules into the knowledge space and subsequently recast the incorporation of knowledge as the alignment of knowledge and data. To facilitate this alignment, we employ the Optimal Transport (OT) technique. We then incorporate the OT distance as an additional loss term to the original objective function of WSAD methodologies. Comprehensive experimental results on five real-world datasets demonstrate that our proposed KDAlign framework markedly surpasses its state-of-the-art counterparts, achieving superior performance across various anomaly types.
arXiv.org Artificial Intelligence
Feb-6-2024
- Country:
- Oceania > Australia
- Western Australia > Perth (0.04)
- North America
- United States > New York
- New York County > New York City (0.04)
- Canada > Ontario
- Toronto (0.04)
- United States > New York
- Europe
- Latvia (0.04)
- Spain > Valencian Community
- Valencia Province > Valencia (0.04)
- France > Centre-Val de Loire
- Asia
- Singapore > Central Region
- Singapore (0.05)
- Myanmar > Tanintharyi Region
- Dawei (0.04)
- China
- Guangdong Province > Guangzhou (0.05)
- Hong Kong (0.04)
- Singapore > Central Region
- Oceania > Australia
- Genre:
- Research Report (1.00)
- Industry:
- Information Technology > Security & Privacy (1.00)
- Technology: