Jon Pielak is the former lead iPhone developer for Siri, the voice technology that Apple has implemented in the iPhone 4S. Pielak helped start the Siri project back in 2008.

Some may have forgotten that Siri actually started as a popular App Store app for the iPhone. In a recent blog post, Siri’s former lead developer talks about why Apple bought Siri, what makes Siri special, the what’s on the horizon for the most advanced consumer voice technology on earth…

The original Siri application was begun in early August of 2008. From a development aspect, Siri Assistant was actually an HTML-intensive web experience wrapped in Objective-C code. The web view worked with native elements of iOS to utilize the service’s “VLingo” backend (where the real magic happened). Believe it or not, Siri didn’t have Nuance as a partner until 2010.

Pielak helped unveil the Siri iPhone app to the world at All Things D’s D7 conference in May 2009. By then, the app was starting to gain traction with the media. Pielak said that, “It was the first time I really got the sense that I was involved with a product that would be used by millions of people.”

Apple ended up buying Siri because of its ability to recognize context. There are plenty of voice assistant technologies on the market, including Google’s own Voice Actions for Android. Siri separated itself from the competition with its ability to correlate data — Pielak and his team focused on natural language processing.

“Often times reviews on iTunes would comment on how the Siri app seems to do a better job than the Nuance app or Dragon dictate. The iPhone application is just the portal to the brains of Siri running on a bunch of servers. There, it can take a sentence and dissect it naturally. An example might be “Book a table at Il Fornaio in Novi for 7PM” and it determines that “Il Fornaio” is likely the name of a place and “Novi” is likely a location. This is referred to as natural language processing, and it is incredibly difficult to get right.”

According to Pielak, the real magic of Siri is what happens after a voice command is converted to text.

“Tell another system to “Book at table at Il Fornaio at 7:00 with my mom;” the system can no doubt create a calendar entry at 7:00 and might even know who your mom is. It might even be possible for that device to figure out the closest Il Fornaio restaurant. What differentiates the NLP logic in Siri is that it will maintain context so you could say: “Also send her an email reminder.” Siri will understand ‘her’ and compose the email accordingly.

This comprehension of context requires a great deal of logic and processing behind the scenes.”

Siri’s ability to interpret meaning caught the eye of the folks in Cupertino, and Siri needed an established, trusted company like Apple to back its technology. Mass adoption was never going to happen until Siri became a fully integrated part of the operating system.

While some would say that Siri is another Apple flop, Pielak sees a bright future on the horizon. He no longer works on Siri, (the Siri team at Apple is apparently the largest, according to reports) but he has a good idea of where the technology will be taken in the future.

Apple says that Siri is in beta, and more features will be added over time. A highly requested feature is third party app access. Pielak says:

“Intelligence needs to come from many sources. Siri will need to mine collective input from as many data sources as possible in order to grow and stay relevant. Siri can’t be a marketing engine for select partners. True digital assistants have to put the user first, just as the user would do when making a decision on their own. There is enormous potential for Siri to integrate with data sources of many different types. Opening Siri up while ensuring the quality of the data will be a challenge for Apple. However, the recent success with the iOS and Mac App Stores has given Apple an effective way to influence its third part developers.”

In a perfect world, Siri would be able to reserve your movie tickets, tell you the latest game scores, post to social networks, etc. Third party app integration is coming, it just takes time. Yelp and Wolfram Alpha were lucky enough to get in on the Siri action at the beginning. Imagine what will happen when the floodgates open.

Siri is limited to the iPhone 4S right now, but hackers are already trying to port the technology to other iOS devices. It’s obvious that Apple wants to restrict Siri to the iPhone 4S as a main selling point, but there’s a good chance that Siri access could be opened up to other devices, including the Mac, in the future.

BMW has already said that it wants to integrate Siri with its future automobiles. Imagine a world in which all kinds of hardware and software integrate with Siri. Your Mac becomes controlled by your voice. Your car becomes an extension of what you can do with Siri on your iPhone.

If you think that Siri is only for mobile devices, you’re wrong. This technology, if improved upon, will permeate all aspects of consumer technology. And Apple will be leading the race, again.

That’s the world that Apple imagined when it bought Siri.

And that’s why Siri is here to stay.

  • Spencer

    Sorry I just posted this else where because I’m completely shocked. I just learned that in the UK Siri is a Man!!! I’m gonna have to learn to speak “American English” to have a female personal assistant…… Siri is a man NOOOO!!!!!

    • Matt

      The UK Siri also sounds like the man off “Blood Sugar” by Pendulum! haha

      • KiraXD

        well now i want the UK Rob Swire-Siri

      • Spencer

        Dude I can’t ask another man for directions!!

      • KiraXD

        oh wait… you mean the announcer? hmm…

        http://www.youtube.com/watch?v=i_5zvV0btCo

      • matt

        Ah yeh, sorry! I meant the announcer guy! 🙂 I prefer the US female voice though, it sounds more natural. The UK guy reminds me of Microsoft Sam and all of those terrible voices :/

    • KiraXD

      yeah it should give an option to switch between male and female similar to GPS units in cars

    • Cameron Carlyon

      Dam! Now I can’t try that ”I Love You” trick. Or can I… 😀

  • Max

    This sure is an awesome article.

  • Connor

    Jarvis! 🙂

  • kadz

    Kadz** — Wakes up n says .. ” good morning ”

    House replies ** — good morning sir, what would u like for breakfast ?

    Kadz** — Pussy !!

    House** — great choice sir !! .. she will be up in a few

    apple .. will take over the world **dead**

  • babe

    siri is the best artificial intelegence using neural network implementation so far. The power of answer will increase as apple add the answer database. However the speech recognition still depends on third party like nuance. Dont expect soon any languange that not implemented yet in nuance dragon.

  • Congrats Alex, good work. Keep it up

  • John doe

    This is the type of artical i expect. Keep up the good wotlrk

  • MrA

    I agree with your view on Siri much more than Oliver’s.

  • Mr. R

    i think i saw a movie about this… something about skynet!

  • Sonncee37

    The reason why apple bought siri was because they needed a flag ship to help sell the iPhone 4s. The reason why I say this is most people that upgraded came from a 3g in hopes there would be an iPhone 5 and people upgrading from 3gs which could care less about a faster processor. Believe me if processing speed was of any concern to any of these people they probly would have switched to a whole different device.

  • EduGeek

    @Sonncee37 You are completely out of touch with reality. Most that upgraded didn’t come from a 3G, they came from 3GS and 4’s. There was no “Flagship” needed. The phone with the new hardware is quite good enough. Siri is probably the reason everything took so long.

    Anyone with sense wouldn’t leave the polished iOS for Android. Even with Ice Cream Sandwich Android has no “Game Changers”.

    Obviously you didn’t have your OJ today..

    • sonncee37

      your right I’m not as tech savvy as you probably are but I did know not to upgrade from an iPhone 4 to a 4s

  • QuarterSwede

    Tea. Early Grey. Hot.

    Nuff said.