EmoSpeech: Guiding FastSpeech2 Towards Emotional Text to Speech
Diatlova, Daria, Shutov, Vitaly
–arXiv.org Artificial Intelligence
State-of-the-art speech synthesis models try to get as close as possible to the human voice. Hence, modelling emotions is an essential part of Text-To-Speech (TTS) research. In our work, we selected FastSpeech2 as the starting point and proposed a series of modifications for synthesizing emotional speech. According to automatic and human evaluation, our model, EmoSpeech, surpasses existing models regarding both MOS score and emotion recognition accuracy in generated speech. We provided a detailed ablation study for every extension to FastSpeech2 architecture that forms EmoSpeech. The uneven distribution of emotions in the text is crucial for better, synthesized speech and intonation perception. Our model includes a conditioning mechanism that effectively handles this issue by allowing emotions to contribute to each phone with varying intensity levels. The human assessment indicates that proposed modifications generate audio with higher MOS and emotional expressiveness.
arXiv.org Artificial Intelligence
Jun-28-2023
- Country:
- Asia
- Europe
- Austria (0.04)
- Czechia > South Moravian Region
- Brno (0.04)
- Germany > Bavaria
- Upper Bavaria > Munich (0.04)
- Russia > Northwestern Federal District
- Leningrad Oblast > Saint Petersburg (0.04)
- Spain > Catalonia
- Barcelona Province > Barcelona (0.04)
- North America
- Canada > Quebec
- Montreal (0.04)
- United States > California
- San Diego County > San Diego (0.04)
- Canada > Quebec
- Genre:
- Research Report (0.50)
- Technology: