Integrating Verbal and Nonvebval Input into a Dynamic Response Spoken Dialogue System
Hu, Ting-Yao (Carnegie Mellon University) | Raman, Chirag (Carnegie Mellon University) | Maza, Salvador Medina (Carnegie Mellon University) | Gui, Liangke (Carnegie Mellon University) | Baltrusaitis, Tadas ( Carnegie Mellon University ) | Frederking, Robert (Carnegie Mellon University) | Morency, Louis-Philippe (Carnegie Mellon University) | Black, Alan W. (Carnegie Mellon University) | Eskenazi, Maxine (Carnegie Mellon University)
In this work, we present a dynamic response spoken dialogue system (DRSDS). It is capable of understanding the verbal and nonverbal language of users and making instant, situation-aware response. Incorporating with two external systems, MultiSense and email summarization, we built an email reading agent on mobile device to show the functionality of DRSDS.
Feb-14-2017