Cognitive hearing aid uses AI and brain waves to enhance voices

A smart cognitive hearing aid could make life significantly easier for people who are deaf or hard of hearing. Whether it's Apple's smart cochlear implant collaboration or tools designed to make sign language communication easier, there is no shortage of cutting-edge gadgetry available to make life easier for people who are deaf or hard of hearing. A new piece of technology coming out of Columbia University School of Engineering and Applied Science could make things even better, however -- courtesy of a hearing aid that is designed to read brain activity to determine which voice a hearing aid user is most interested in listening to and then focusing in on it. The resulting "cognitive hearing aid" could be transformative in settings like crowded rooms in which multiple people are speaking at the same time. "My research has been focused on understanding how speech is processed in the brain, and to create models of it that can be used in automatic speech-recognition technologies," Nima Mesgarani, an associate professor of electrical engineering, told Digital Trends. "Working at the intersection of brain science and engineering, I saw a unique opportunity to combine the latest advances from both fields, to create a solution for decoding the attention of a listener to a specific speaker in a crowded scene which can be used to amplify that speaker relative to others."