Refining music sample identification with a self-supervised graph neural network
Bhattacharjee, Aditya, Higgs, Ivan Meresman, Sandler, Mark, Benetos, Emmanouil
–arXiv.org Artificial Intelligence
Automatic sample identification (ASID), the detection and identification of portions of audio recordings that have been reused in new musical works, is an essential but challenging task in the field of audio query-based retrieval. While a related task, audio fingerprinting, has made significant progress in accurately retrieving musical content under "real world" (noisy, reverberant) conditions, ASID systems struggle to identify samples that have undergone musical modifications. Thus, a system robust to common music production transformations such as time-stretching, pitch-shifting, effects processing, and underlying or overlaying music is an important open challenge. In this work, we propose a lightweight and scalable encoding architecture employing a Graph Neural Network within a contrastive learning framework. Our model uses only 9% of the trainable parameters compared to the current state-of-the-art system while achieving comparable performance, reaching a mean average precision (mAP) of 44.2%. To enhance retrieval quality, we introduce a two-stage approach consisting of an initial coarse similarity search for candidate selection, followed by a cross-attention classifier that rejects irrelevant matches and refines the ranking of retrieved candidates - an essential capability absent in prior models. In addition, because queries in real-world applications are often short in duration, we benchmark our system for short queries using new fine-grained annotations for the Sample100 dataset, which we publish as part of this work.
arXiv.org Artificial Intelligence
Jun-23-2025
- Country:
- Asia
- Europe
- Greece (0.04)
- Italy (0.04)
- Spain > Catalonia
- Barcelona Province > Barcelona (0.04)
- United Kingdom > England
- Greater London > London (0.04)
- North America
- Canada > Ontario
- Toronto (0.04)
- United States
- California
- San Diego County > San Diego (0.04)
- San Francisco County > San Francisco (0.14)
- Georgia > Clarke County
- Athens (0.04)
- North Carolina > Durham County
- Durham (0.04)
- Rhode Island (0.04)
- California
- Canada > Ontario
- Genre:
- Research Report (0.64)
- Industry:
- Leisure & Entertainment (1.00)
- Media > Music (1.00)
- Technology: