Study: Apple’s Siri is wrong over one third of the time

Zooey Deschanel Siri Commercial

According to a Piper Jaffray study cited by Forbes earlier this week, the investment firm conducted an extensive test of Siri’s accuracy both on a busy Minneapolis street and within a quiet room. The researchers conducting the study asked Siri 800 questions in each location and checked the accuracy of the responses. According to the results, Siri was able to understand 83 percent of the questions on a noisy street and 89 percent of the questions in the quiet room. When providing answers to those questions, Siri was only 62 percent accurate when on the street and 68 percent accurate when providing an answer within the room. Alternatively, Google’s voice assistant provided accurate results approximately 86 percent of the time when asked the same questions.

Siri wrongBased off these results, Piper Jaffray’s Gene Munster gives Apple a letter grade of a “D” and gives Google’s voice assistant a “B+.”  However, Munster is optimistic about future improvements with each revision of Apple’s mobile operating system.

In an email to clients, Munster wrote “In order to become a viable mobile search alternative, Siri must match or surpass Google’s accuracy of B+ and move from a grade D to a B or higher. With the iOS 6 release in the fall, we expect Siri to improve meaningfully while reducing its reliance on Google from 60 percent to 48 percent.”

According to Munster, Apple relies on Google significantly for responses supplied by Siri. The specific breakdown of Siri responses includes sixty percent of the information from Google’s search engine, twenty percent from review site Yelp, fourteen percent from search engine Wolfram Alpha, four percent from Yahoo’s search engine and two percent from Wikipedia. Also breaking down Google’s share, Munster stated “Google provides 100 percent of navigation results, 61 percent of information results, 48 percent of commerce results and 42 percent of local results.”

When iOS 6 is released later this year with the new iPhone, Apple plans to add Fandango for movie tickets and times, Rotten Tomatoes for movie reviews, Open Table for restaurant reservations and Yahoo! Sports for scores and player information.

Siri help

In addition, Apple is transitioning away from Google Maps and Siri will provide walking or driving directions based on Apple’s new maps software. Munster estimates that Apple will be able to reduce the company’s dependence on Google search results from 60 percent down to approximately 48 percent after iOS 6 is released.  

Munster provided a variety of examples of the types of questions that Siri would get incorrect. For instance, when Munster or his staff asked “When did the movie Cinderella come out?“, Siri brought up movie theater listings on Yelp. The statement “I want to go to Lake Superior.” caused Siri to provide directions to a local business with Lake Superior in the title. The question “How do I get from Boston to New York?” was impossible to answer as Siri wasn’t able to provide directions for a place that the user wasn’t currently located. According to Munster, the most common error that Siri made was answering a new question with the response from the previous question. 

Mobile

FCC to help first responders pinpoint 911 callers in multistory buildings

When someone calls 911 from their cell phone, wireless carriers provide operators with an approximate location. Now the FCC wants the carriers to provide vertical location data to pinpoint 911 callers inside multi-story buildings.
Home Theater

Apple's Airpods 2 could be released as early as this week

Apple may release new AirPods in the first half of 2019. A wireless charging case, health sensors, water resistance, and better Siri integration are some of the improvements rumored to be part of the new package.
Mobile

How to use Samsung's Bixby assistant for all of your smartphone tasks

Samsung Bixby is a powerful tool, but not the most intuitive one we've encountered. Here's how to set up and use every feature of Samsung's digital assistant, as well as what to expect in the future.
Music

Apple Music vs. Spotify: Which service is the streaming king?

Apple Music is giving Spotify a run for its money, but which service is best for you? In our Apple Music vs. Spotify showdown, we compare and contrast all we know about the two streaming music services.
Movies & TV

Apple bet big on TV and movie projects. Here’s what we know about them so far

Apple has an ambitious slate of original programming it has been developing in recent years, so will the March 25 event finally reveal when — and where — we will be able to see some of these TV shows and movies?
Mobile

How to choose an iPad in 2019: A practical guide to Apple’s tablets

Selecting an iPad from Apple's lineup can be intimidating, but it doesn't have to be. Our comprehensive guide should put the numbers and specs in practical, easy-to-understand terms. Find your ideal iPad with the help of our guide.
Mobile

Apple’s new iPads are hardly new at all. Don’t waste your money

It has taken Apple four years to get around to updating the iPad Mini line, but the new iPad Mini is virtually identical to its predecessor. It’s joined by a confusing iPad Air with no obvious target audience. Is Apple just trying to sell…
Mobile

These voice-changing apps will have you punking friends and family like a pro

Have you ever wanted to call your friends as Darth Vader or Alvin from the Chipmunks? If you want to play a prank on your friends, we have the best voice-changer apps for iOS and Android, whether you want to record audio or make a call.
Mobile

iPad Air vs. iPad Mini: Which new tablet from Apple is best for you?

Apple has unveiled two new iPad models, including a new iPad Air and a new iPad Mini. Both devices have a lot to offer. But which iPad is right for your needs? We put the iPad Air and iPad Mini to the test to find out.
Deals

The best Apple AirPods alternatives for Android, Windows, and iOS devices

Apple AirPods, nice as they are, aren't the only game in town. Other makers are offering their own truly wireless earbuds, and if you're looking to buy a pair of high-end in-ear headphones, we've got the best AirPod alternatives on the…
Mobile

Even older Apple Watches could be effective at spotting heart conditions

The Apple Watch Series 4 is known for detecting heart conditions like atrial fibrillation thanks to having an electrocardiograph feature. It turns out that older Apple Watches could be effective at tracking AFib, too.
Deals

It’s time to check out the best Apple Watch deals for March 2019

The Apple Watch has surged to prominence in recent years. If you're in the market for an iOS wearable, we've sniffed out the best Apple Watch deals available right now for all three models of this great smartwatch.
Deals

Need a new tablet? Here are the best iPad deals for March 2019

In the wide world of tablets, Apple is still the king. If you're on team Apple and just can't live without iOS, we've curated an up-to-date list of all of the best iPad deals currently available for March 2018.
Deals

Amazon drops price on Apple Watch Series 4 with a rare deal

Since Apple first unveiled the Series 4, the price for one has pretty much held fast. This has finally started to change with a nice little $15 discount on Amazon. If you've been wanting the newest Apple Watch, now is a great time.