rascon
Multi-agent Auditory Scene Analysis
Rascon, Caleb, Gato-Diaz, Luis, García-Alarcón, Eduardo
Auditory scene analysis (ASA) aims to retrieve information from the acoustic environment, by carrying out three main tasks: sound source location, separation, and classification. These tasks are traditionally executed with a linear data flow, where the sound sources are first located; then, using their location, each source is separated into its own audio stream; from each of which, information is extracted that is relevant to the application scenario (audio event detection, speaker identification, emotion classification, etc.). However, running these tasks linearly increases the overall response time, while making the last tasks (separation and classification) highly sensitive to errors of the first task (location). A considerable amount of effort and computational complexity has been employed in the state-of-the-art to develop techniques that are the least error-prone possible. However, doing so gives rise to an ASA system that is non-viable in many applications that require a small computational footprint and a low response time, such as bioacoustics, hearing-aid design, search and rescue, human-robot interaction, etc. To this effect, in this work, a multi-agent approach is proposed to carry out ASA where the tasks are run in parallel, with feedback loops between them to compensate for local errors, such as: using the quality of the separation output to correct the location error; and using the classification result to reduce the localization's sensitivity towards interferences. The result is a multi-agent auditory scene analysis (MASA) system that is robust against local errors, without a considerable increase in complexity, and with a low response time. The complete proposed MASA system is provided as a publicly available framework that uses open-source tools for sound acquisition and reproduction (JACK) and inter-agent communication (ROS2), allowing users to add their own agents.
- North America > Mexico > Mexico City > Coyoacan (0.04)
- North America > United States > Massachusetts (0.04)
- Europe > Germany > Bavaria > Upper Bavaria > Munich (0.04)
Tamales are hot today, yet savory wraps are as old as civilization
Fox News Flash top headlines are here. Check out what's clicking on Foxnews.com. Tamales are one of the hottest topics in the American food scene -- proving that food-on-the-run paired with great flavor never goes out of style. Social conversations about tamales exploded 47% over the past year, according to Tastewise, a new platform that uses artificial intelligence to find food trends by tracking social media, restaurant menus and digital content. The platform found that about 34,000 eateries in the United States serve tamales: a corn dough wrap called masa, filled with any of an array of meats, vegetables and spices, then steamed inside corn husks or banana leaves.
- North America > United States > California > Los Angeles County > Los Angeles (0.16)
- North America > United States > Texas > Oldham County > Vega (0.08)
- North America > Mexico (0.08)
- (8 more...)