In the annual Digital Assistant IQ study conducted by Loup Ventures they tested the top virtual assistants on the market. Asking 800 questions to Siri (Apple), Google Assistant, Alexa (Amazon) and Cortana (Microsoft) they set out to see which AI performed the best.
The Test
The 800 questions were broken down into 5 categories:
Local – Where is the nearest coffee shop?
Commerce – Can you order me more paper towels?
Navigation – How do I get to uptown on the bus?
Information – Who do the Twins play tonight?
Command – Remind me to call Steve at 2pm today.
Based on their performance the virtual assistants were graded on two metrics: 1. Did it understand what was being asked? 2. Did it deliver a correct response?
Understood the Question
1. Google Assistant: 100%
2. Siri: 99%
3. Alexa: 98%
4. Cortana: 98%
As you can see all four did well at understanding the questions but when it came to giving a correct answer it was a different story.
Giving the Correct Answer
1. Google Assistant: 85.5%
2. Siri: 78.5%
3. Alexa: 61.4%
4. Cortana: 52.4%
While Siri was able to answer a respectable 628 questions correctly, Google Assistant had 684 correct answers. With over 50 more right answers over Siri and 192 more correct answers than Alexa it’s pretty clear that Google Assistant is the leader in terms of answering question.
While Siri may have taken the overall L in this test there is a bright spot for iOS users. When it came to command features for controlling your phone, smart home and music Siri scored a 90% compared to Google Assistant at 76%. To read the full results of this test head on over to Loup Ventures full write up here.
