Apple’s (AAPL – Get Report) Siri, for its part, delivered the largest improvement relative to the last time it was tested. And all four of the assistants that were tested on smart speakers did a meaningfully better job relative to their last go-around.
Loup’s Smart Speaker Test
In the 2018 edition of its Smart Speaker IQ Test, research firm Loup Ventures asked smart speakers powered by Google Assistant, Siri, Amazon.com’s (AMZN – Get Report) Alexa and Microsoft’s (MSFT – Get Report) Cortana a common set of 800 questions. The questions were split into five categories: Local information, commerce, navigation, information in general and commands (for example, alarms or reminders).
Google Assistant, which was tested on a Google Home speaker, managed to answer 87.9% of the questions correctly, up from 81.1% a year ago. Siri, which was naturally tested on Apple’s HomePod speaker, got 74.6% of the questions right, up from about 52% in February, when the HomePod first became available. Loup does note that Siri benefited from the fact that some Siri requests were passed on to a paired iOS device that handled them, rather than directly handled by the HomePod.
Alexa (tested on an Amazon Echo) saw its accuracy improve to 72.5% from 63.8%, and Cortana (tested on Harman Kardon’s Invoke speaker) improved to 63.4% from 56.4%. Google Assistant was the only assistant to properly understand all 800 of the questions, but the others were able to understand 99% or more.
Apple, Alphabet, Amazon.com and Microsoft are holdings in Jim Cramer’s Action Alerts PLUS member club. Want to be alerted before Jim Cramer buys or sells AAPL, GOOGL,…