CableInspect-AD: An Expert-Annotated Anomaly Detection Dataset
Arodi, Akshatha, Luck, Margaux, Bedwani, Jean-Luc, Zaimi, Aldo, Li, Ge, Pouliot, Nicolas, Beaudry, Julien, Caron, Gaétan Marceau
–arXiv.org Artificial Intelligence
Machine learning models are increasingly being deployed in real-world contexts. However, systematic studies on their transferability to specific and critical applications are underrepresented in the research literature. An important example is visual anomaly detection (VAD) for robotic power line inspection. While existing VAD methods perform well in controlled environments, real-world scenarios present diverse and unexpected anomalies that current datasets fail to capture. To address this gap, we introduce $\textit{CableInspect-AD}$, a high-quality, publicly available dataset created and annotated by domain experts from Hydro-Qu\'ebec, a Canadian public utility. This dataset includes high-resolution images with challenging real-world anomalies, covering defects with varying severity levels. To address the challenges of collecting diverse anomalous and nominal examples for setting a detection threshold, we propose an enhancement to the celebrated PatchCore algorithm. This enhancement enables its use in scenarios with limited labeled data. We also present a comprehensive evaluation protocol based on cross-validation to assess models' performances. We evaluate our $\textit{Enhanced-PatchCore}$ for few-shot and many-shot detection, and Vision-Language Models for zero-shot detection. While promising, these models struggle to detect all anomalies, highlighting the dataset's value as a challenging benchmark for the broader research community. Project page: https://mila-iqia.github.io/cableinspect-ad/.
arXiv.org Artificial Intelligence
Sep-30-2024
- Country:
- North America > Canada
- Quebec (0.05)
- Oceania
- Australia > Western Australia
- Perth (0.04)
- New Zealand (0.04)
- Australia > Western Australia
- South America > Chile
- North America > Canada
- Genre:
- Research Report (1.00)
- Industry:
- Energy > Power Industry > Utilities (0.34)
- Technology:
- Information Technology
- Artificial Intelligence
- Machine Learning
- Neural Networks > Deep Learning (0.68)
- Performance Analysis > Accuracy (0.93)
- Natural Language > Large Language Model (1.00)
- Robots (1.00)
- Vision (1.00)
- Machine Learning
- Data Science > Data Mining
- Anomaly Detection (1.00)
- Sensing and Signal Processing > Image Processing (1.00)
- Artificial Intelligence
- Information Technology