In this paper we survey the methods and concepts developed for the evaluation of dialogue systems. Evaluation is a crucial part during the development process. Often, dialogue systems are evaluated by means of human evaluations and questionnaires. However, this tends to be very cost and time intensive. Thus, much work has been put into finding methods, which allow to reduce the involvement of human labour. In this survey, we present the main concepts and methods. For this, we differentiate between the various classes of dialogue systems (task-oriented dialogue systems, conversational dialogue systems, and question-answering dialogue systems). We cover each class by introducing the main technologies developed for the dialogue systems and then by presenting the evaluation methods regarding this class.
Moore's law has driven silicon chip circuitry to the point where we are surrounded by devices equipped with microprocessors. The devices are frequently wonderful; communicating with them – not so much. Pressing buttons on smart devices or keyboards is often clumsy and never the method of choice when effective voice communication is possible. The keyword in the previous sentence is "effective". Technology has advanced to the point where we are in the early stages of being able to communicate with our devices using voice recognition.
PayPal may be looking into voice recognition to enable more digital commerce use cases in the near future, if a new post-MWC blog post offers any hints. Looking back on last week's event -- for which we featured extensive firsthand coverage -- PayPal Head of Global Initiatives Anuj Nayar notes two dominant trends. One is the Internet of Things, including new connected car technologies like PayPal's new car commerce feature with Shell and Jaguar (and Apple). The other, as Nayar puts it, is "conversational commerce." Looking at emerging digital commerce opportunities in areas like virtual reality, connected appliances, and even drones, Nayar asserts that it "won't be convenient or realistic to pull out a credit card or punch in your information in any of these scenarios".
The Kit originally came with a copy of the Raspberry Pi Magazine. Google is working on more artificial intelligence projects to follow its Voice Kit for Raspberry Pi. Four ways to explore the use of voice technology for your business. Google's AIY Voice Kit is a do-it-yourself voice-recognition kit for Raspberry Pi-based maker projects. The initial run of the kits sold out in a few hours, but Google said more will be available for purchase in stores and online in the US in the coming weeks, and the kit will be available elsewhere by the end of the year.