Report finds that Siri’s accuracy continues to improve under iOS 7

By , Dec 10, 2013

siri ios 7

Gene Munster—yes the iTV guy—is out with a new report today looking at the state of Siri’s ability to accurately answer and respond to queries. The Piper Jaffray analyst regularly assesses the accuracy of Apple’s digital assistant.

In his latest look, Munster found that Siri has continued to improve with the release of iOS 7, particularly in its ability to properly interpret questions being asked and its overall performance when accessed in noisier situations…

MacRumors has Munster’s report:

“The primary improvement between Siri in iOS 6 and iOS 7 came from its performance in noisier areas, where Siri was able to translate better through a noisy environment (94% vs. 83% correct in Aug iOS 6). Based on our testing, iOS 7 Siri’s net ability to answer questions (factors in questions not correctly understood) improved to 79% from 77% in August with iOS 6.”

And here’s his report card for Siri:

munster_siri_dec13_reportMunster goes on to note that Siri’s ongoing improvements are also benefitting Apple in its efforts to reduce its dependance on Google. In his latest testing, only 4% of Siri’s answers relied on the search giant, compared to 27% last fall.

munster_siri_dec13.services-800x211

It would seem that Siri has come a long way from a year ago, when Munster graded the assistant a “D” in search accuracy. He now grades in a C+, and after doing some comparison testing, has ranked it even with Google’s ‘Now’ service.

In September of this year, Apple released iOS 7 to the public with a number of improvements for Siri including a new design, new voice options, and more, but I’d be lying if I said I’ve noticed it being more accurate than it was in iOS 6.

What do you think?

  • Share:
  • Follow:
  • Bill Slenter

    It has definitely improved for me, especially after Apple patched the response time lag (it was horrible with the first iOS 7 release). Now, it’s almost always immediate and I do notice an accuracy improvement. It has also gotten better about picking up the name of my hometown and local restaurants. Though not up to Google standards on that aspect, it’s getting there.

    • mehrab

      Its better then google now
      Its faster understands better and i noticed that google now messes up long sentences or messages when i try to type with my voice
      And system integration of different services and is an actually personal assistant whereas google now is just you googling on the web for the weather and etc

      • So optimistic

        I think google voice works must better and gets right to what I asked for. When I ask for direction to a place, Siri says…”sorry, I didn’t get that or I couldn’t find that in your contact.” I said in K&P voice…..”BIIIIIIIIIIICCCCCCCCHHHHHHHTTTTTTT” lol….

  • ClaudieX X

    why Siri goes to internet when I ask to call someone ???????? why the delay ?????? I can’t call anyone if i dont have internet service.

    • http://twitter.com/sharbeen Sharbeen

      if they have to store all algorithm for converting your speech to command it’ll need a lot of space. way more than what your handset got thats why they had to put siri over the internet. But yeah they could somehow get the simple features such as calling offline but will require more work. Maybe in the future I guess. No delay for me except when my internet is weak.

      • http://twitter.com/int3nsive Int3nsive

        Before SIRI, the voice commands didn’t needed internet, so at least that commands (for phone or open apps) should be “built in” …

      • http://twitter.com/sharbeen Sharbeen

        that is still there built in. If you switch off Siri that works. But running both simultaneously might be a time consuming and a more complicated algorithm. Suppose You say call so and so… it has to 1st check with the in built one and if that fails then goes to the server. Here it has to always run checksum in the offline command.

      • http://twitter.com/int3nsive Int3nsive

        Yeah, I know but that really sucks, having to disable siri on settings to use that… it’s time to merge both and make it simple. Apple is master on making complex things simple… so I hope they never forget that philosophy.

  • http://twitter.com/int3nsive Int3nsive

    But still, doesn’t speak a lot of languages…
    2 years… little improvements on that. And the big problem is that in many countries they advertised SIRI and had the excuse of being beta…and we waited, and waited… and waited…

    Now what’s your excuse Apple? To get more languages we will need to buy other devices…?

    Is that going to be a ultimate feature for the iPhone 6? “Siri 2.0 now with more languages?”

    • Daniel Eliasson

      I think knowing english is pretty much necessary at present. Why waste time on adding more languages? They should keep it english-only and work harder on user experience and not on languages.

      • http://twitter.com/int3nsive Int3nsive

        That doesn’t make sense at all.

        Google Now understand almost every language and pretty well. If Apple want’s to be in the service war, they need to try harder to deliver a complete package.

        The world is bigger than the United States and the English language.. you know…

        There’s no excuse. That is like saying: “oh, why apple should improve Apple Maps in other counties?.. let all move to the United States and forget about the other 99% of our world.

      • RarestName

        People have to stop calling Google Search as Google Now. Google Now is the card-based service that is merged together into the Google Search app.

      • NSA

        Not all people wanna learn English. Not all people speak English. Adding more languages is important to let Apple users who don’t speak English to get benefit of using Siri.

        There is no person is going to learn English just because to use Siri…

      • Kenrick Fernandes

        Hey just to add this, apart from the languages they should focus on the accents too. Google now got this right from the start and i’m very impressed with the same.

      • dialogueanalog

        American by any chance?

  • Tony Trenkle Jr.

    I’m still hoping for the 3rd party access rumor for 7.1 But I think I may be holding onto to hope too much.

    • Daniel Eliasson

      >3rd party access rumor

      With Apple? No way.

      • dialogueanalog

        errrrr. have you not seen passbook which has third party access?

  • mehrab

    I said it from the ios 7 beta sthat siri understands words more never gets rhings wrong and answers quicker thanks to wikipedia and bing integration and better optimization

  • Malay Mody

    definitely faster for me, and more accurate. i can actually use siri now lol. Now i just wish we could do local actions using Siri without an internet connection lol

  • http://www.eraser.org B. Braun

    It’s still not working without internet connection, so where is the deal? How can i set a timer when there is no internet available??

  • bobism

    i have urned siri off on all my devices