Training a Speaker Embedding from Scratch – Paul Mou – Medium

For the past few months, I have been researching on building an end to end speaker identification system with deep learning. The area of research I focused on is metric learning. Knowing almost nothing going in, I have significantly underestimated the effort required (surprise!). While the effort is ongoing, I have learnt much along and have some preliminary results I am excited to share. In this blog post, I will explain what metric learning is, what is speaker identification, how metric learning applies in this context, and share the lessons I learnt from applying those knowledge to build a speaker embedding function.