From Vision to Sound: Advancing Audio Anomaly Detection with Vision-Based Algorithms

Barusco, Manuel, Borsatti, Francesco, Pezze, Davide Dalle, Paissan, Francesco, Farella, Elisabetta, Susto, Gian Antonio

arXiv.org Artificial Intelligence 

A BSTRACT Recent advances in Visual Anomaly Detection (V AD) have introduced sophisticated algorithms leveraging embeddings generated by pre-trained feature extractors. Inspired by these developments, we investigate the adaptation of such algorithms to the audio domain to address the problem of Audio Anomaly Detection (AAD). Unlike most existing AAD methods, which primarily classify anomalous samples, our approach introduces fine-grained temporal-frequency localization of anomalies within the spectrogram, significantly improving explainability. This capability enables a more precise understanding of where and when anomalies occur, making the results more actionable for end users. We evaluate our approach on industrial and environmental benchmarks, demonstrating the effectiveness of V AD techniques in detecting anomalies in audio signals. Moreover, they improve explainability by enabling localized anomaly identification, making audio anomaly detection systems more interpretable and practical.Keywords Anomaly Detection Audio Pre-training Embedding 1 Introduction Audio anomaly detection (AAD) is the task of detecting unexpected or out-of-distribution sounds in audio sequences.