I ask 100 information questions to four digital assistants. All of them fail at least half.
Despite the massively larger size of the Google Home speaker, the winner of "who can actually hear a user" is the Echo Dot, which was able to hear me from farther away and without me having to look at it. After seeing the poor feedback of Watson in Bridge Crew, I decided to take my four digital assistants for a spin. After 21 questions across four assistants, I learned that Alexa cannot give basic information about Amazon Prime videos, none of them can properly understand which movie you're looking for information for, and none of them can actually recommend stuff. Also, Google still needs to learn how to round up. I also learned I'm going to need a bigger set of questions. First, the purpose of this test is to test the assistants on the one skill that is a must-have for a disembodied speaker: Information retrieval and processing. This is not a comprehensive test, but is indicative of the types of questions that one might ask based on conversation, i.e. two or more people are having a conversation and they reach a question that needs an answer. To begin with, I summarise the results, mostly for fun. After that, you can browse what I found the most interesting 40 questions, and the varied (or non-varied) answers offered by each assistant for those. This piece is not intended to be illustrative on who is the "best" assistant.
Jul-3-2017, 11:45:13 GMT
- Country:
- Europe > Sweden
- North America > United States
- Oceania > Australia (0.04)
- Industry:
- Government > Voting & Elections (0.47)
- Leisure & Entertainment (1.00)
- Media > Film (0.46)
- Technology: