vocal recording
Attention-Based Efficient Breath Sound Removal in Studio Audio Recordings
Elgiriyewithana, Nidula, Kodikara, N. D.
In this research, we present an innovative, parameter-efficient model that utilizes the attention U-Net architecture for the automatic detection and eradication of non-speech vocal sounds, specifically breath sounds, in vocal recordings. This task is of paramount importance in the field of sound engineering, despite being relatively under-explored. The conventional manual process for detecting and eliminating these sounds requires significant expertise and is extremely time-intensive. Existing automated detection and removal methods often fall short in terms of efficiency and precision. Our proposed model addresses these limitations by offering a streamlined process and superior accuracy, achieved through the application of advanced deep learning techniques. A unique dataset, derived from Device and Produced Speech (DAPS), was employed for this purpose. The training phase of the model emphasizes a log spectrogram and integrates an early stopping mechanism to prevent overfitting. Our model not only conserves precious time for sound engineers but also enhances the quality and consistency of audio production. This constitutes a significant breakthrough, as evidenced by its comparative efficiency, necessitating only 1.9M parameters and a training duration of 3.2 hours - markedly less than the top-performing models in this domain. The model is capable of generating identical outputs as previous models with drastically improved precision, making it an optimal choice.
Artificial intelligence is helping scientists decode animal languages
In the Pixar movie Up, a cartoon dog called Dug sports a magical collar of sorts that can translate his barks and whines into fluent human speech. Elsewhere in the real world, very well-trained dogs can be taught to press buttons that produce human speech for simple commands like "outside," "walk," and "play." Humans have always been fascinated by the potential to communicate with the animals that they share the world with, and recently, machine learning, with its ever more advanced capabilities for parsing human speech, has presented itself as a hopeful route to animal translation. An article in the New York Times this week documented major efforts from five groups of researchers that looked at using machine-learning algorithms to analyze the calls of rodents, lemurs, whales, chickens, pigs, bats, cats, and more. Typically, artificial intelligence systems learn through training with labeled data (which can be supplied by the internet, or resources like e-books).