CableInspect-AD: An Expert-Annotated Anomaly Detection Dataset
Arodi, Akshatha, Luck, Margaux, Bedwani, Jean-Luc, Zaimi, Aldo, Li, Ge, Pouliot, Nicolas, Beaudry, Julien, Caron, Gaétan Marceau
–arXiv.org Artificial Intelligence
Machine learning models are increasingly being deployed in real-world contexts. However, systematic studies on their transferability to specific and critical applications are underrepresented in the research literature. An important example is visual anomaly detection (VAD) for robotic power line inspection. While existing VAD methods perform well in controlled environments, real-world scenarios present diverse and unexpected anomalies that current datasets fail to capture. To address this gap, we introduce $\textit{CableInspect-AD}$, a high-quality, publicly available dataset created and annotated by domain experts from Hydro-Qu\'ebec, a Canadian public utility. This dataset includes high-resolution images with challenging real-world anomalies, covering defects with varying severity levels. To address the challenges of collecting diverse anomalous and nominal examples for setting a detection threshold, we propose an enhancement to the celebrated PatchCore algorithm. This enhancement enables its use in scenarios with limited labeled data. We also present a comprehensive evaluation protocol based on cross-validation to assess models' performances. We evaluate our $\textit{Enhanced-PatchCore}$ for few-shot and many-shot detection, and Vision-Language Models for zero-shot detection. While promising, these models struggle to detect all anomalies, highlighting the dataset's value as a challenging benchmark for the broader research community. Project page: https://mila-iqia.github.io/cableinspect-ad/.
arXiv.org Artificial Intelligence
Sep-30-2024
- Country:
- South America > Chile
- Oceania
- New Zealand (0.04)
- Australia > Western Australia
- Perth (0.04)
- North America > Canada
- Quebec (0.05)
- Genre:
- Research Report (1.00)
- Industry:
- Energy > Power Industry > Utilities (0.34)
- Technology:
- Information Technology
- Sensing and Signal Processing > Image Processing (1.00)
- Data Science > Data Mining
- Anomaly Detection (1.00)
- Artificial Intelligence
- Vision (1.00)
- Robots (1.00)
- Natural Language > Large Language Model (1.00)
- Machine Learning
- Performance Analysis > Accuracy (0.93)
- Neural Networks > Deep Learning (0.68)
- Information Technology