Goto

Collaborating Authors

 deep learning audio-visual model


Google deep learning audio-visual model can pinpoint one voice in many

#artificialintelligence

Google says that people are very good at separating out other voices and hearing the one we are looking at, this is called the cocktail party effect. Google wants to make computers better at hearing the voice that we want to hear and has developed a new deep learning audio-visual model for isolating single speech signal from a mixture of sounds. That separation can be from other voices or from background sounds. Google says that thanks to this new model, it can computationally produce videos where the speech of specific people is enhanced while other sounds are suppressed. Google's method works on ordinary videos with a single audio track and all the user must do is select the face of the person in the video they want to hear.