In the latest test shared today by Loup Ventures, Apple’s HomePod was put through its paces in categories which included Siri, sound quality, and usage.
For Siri, Loup Ventures’ Gene Munster revealed that while the AI assistant comprehended 99.4 percent of queries asked of it, it answered just 52.3 percent of them accurately.Three separate HomePods were tested by Loup Ventures and 782 queries were asked.
Siri is good for “local” and “commerce” queries. Despite of the lesser percentage of correct answers of the total queries, Munster said Siri’s performance rises above expectations given the constrained extent of HomePod’s music center.
The researchers shared their views that Siri and HomePod should grow, match or exceed rivals by simply adding query domains like calling, navigation, calendar, and email.
Some domains like navigation, calendar, email, and calling are simply not supported. These questions were met with, “I can’t ___ on HomePod.” Also, in any case that iPhone-based Siri would bring up Google search results, HomePod would reply, “I can’t get the answer to that on HomePod,” which forces you to use your phone or give up on the question altogether. Removing navigation, calling, email, and calendar-related queries from our question set yields a 67% correct response, a jump from overall of 52.3% correct.
This means added support for these domains would bring HomePod performance above that of Alexa (64%) and Cortana (57%), though still shy of Google Home (81%). We know Siri has the ability to correctly answer a whole range of queries that HomePod cannot, evidenced by our note here. Apple’s limiting of HomePod’s domains should change over time, at which point we expect the speaker to be vastly more useful and integrated with your other Apple devices.
As found in the research, where HomePod exceeded expectations was its excellent listening skills. The HomePod enables users to speak normally even when music from the speaker is particularly boisterous, and Siri will get on the voice and hear the users. “This was HomePod’s most stellar element,” as indicated by Munster.
HomePod’s sound quality was also favored by Loup Ventures, saying that it sounds incredible. Like different surveys and impressions of the device, Munster’s enjoyment of the HomePod’s sound quality was countered with the speaker’s dull Siri performance, which he thinks will change reasonably soon.