First hands-on demo of Siri’s app integration doesn’t disappoint

wwdc 2016 siri for devs

Capabilities of SiriKit, a new iOS 10 framework that lets third-party apps work with Siri, were on full display in the first hands-on demonstration given to Nathan Olivarez-Giles of the Wall Street Journal. In addition to extending Siri’s support for messaging, photo search and phone calls to more apps, SiriKit also adds support for new services, including ride booking and personal payments.

Nathan was pretty impressed with the usefulness of Siri’s app integration on iOS 10, calling it a “long-overdue” enhancement that will make Apple’s personal digital assistant “more useful in everyday life” than it’s ever been.

WhatsApp, LinkedIn, WeChat, Pinterest, Vogue Runway, Pikazo, Square Cash, Monzo, Slack, Looklive, Lyft, Fandango and The Roll are among first apps to support Siri integration at launch. Note that updates for any Siri-enabled apps won’t go live on the App Store until iOS 10 releases for public consumption this fall.

Nathan writes:

I’ve tried out Siri’s new abilities in demos with developers over the past few days. After getting an early look at a more capable Siri, it’s clear that this long-overdue feature is important to making Siri more useful in everyday life. Still, controlling third-party apps is merely a first step toward Siri living up to Apple’s promise as a new way to control our devices.

Here are some of the things he was able to ask Siri:

  • “Send Catherine $20 for lunch with Cash”
  • “Send Jim Gonzalez a message in LinkedIn”
  • “Show me photos of what Kanye West wore to the VMA awards this year in Looklive”

It’s important to note that those requests don’t simply launch an appropriate app: Siri immediately fulfills the request and then presents you the results in a rich overlay that comes with app branding and custom layout.

“In most of these demos, Siri carried out the task without opening the app itself,” he said. “Instead, a card, styled like the app, appeared with the details of the action.”

Needless to say, any financial transactions like sending money with Cash are not carried out automatically until a user authenticates them by resting their finger on Touch ID.

Nathan also details three app categories that will support Siri integration at launch:

  • Messaging: LinkedIn, WhatsApp, WeChat and Slack. If you can’t remember someone’s full name, Siri can help. For example, say “Hey Siri, I want to send Michael a LinkedIn message,” and Siri will list all the Michaels you’re connected to in that network, and ask you which one you meant.
  • Mobile payments: Square Cash and Monzo. Square Cash lets you use Siri to send money to people in your iPhone’s contact list, and ask those people for money, too. In both instances, the final step is Siri asking you to scan your fingerprint on the iPhone’s home-button TouchID sensor, so your friends (or enemies) can’t just grab your phone and ask it to send them your money.
  • Photo search: Pinterest, Vogue Runway, Looklive, The Roll and Pikazo. Once the photo-search results show up, you can tap any thumbnail to open the related app. Photo-search commands can include contents of the images, as well as when they were taken. For instance: “Hey Siri, show me my best photos of sunsets taken last summer using The Roll?”

I’m very excited for Siri’s integration with messaging apps.

iOS’s Dictation feature has saved me a lot of time by seamlessly turning speech to text with remarkable accuracy and speed. I’ve been regularly dictating my messages to friends and family in apps like WhatsApp, Messenger and iMessage for at least a year. I also trust Dictation when creating messages accompanying posts I publish on social media using iOS’s multi-puprose Share sheet.

iOS 10 Siri Support for Third Party Apps

While Dictation has benefited me a lot, lack of third-party integration for Siri has been a pain in the you-know-what: I have to manually launch an app like WhatsApp, navigate to a desired chat, tap to bring up the on-screen keyboard, then tap the Dictation icon on the keyboard before I can actually start dictating my message.

iOS 10 makes this convoluted whole process a lot easier.

With Siri, an app sort of fades into the background, allowing you to simply say something along the lines of “Text Mom on WhatsApp saying I’m gonna be later for dinner” and be done with it. In Nathan’s demo experience, telling Siri what to do was quicker than launching the app and carrying out the task with his fingers.

Siri needed this. Since 2011, we’ve been able to use Apple’s assistant to check the weather, dial a phone number and get sports scores. It’s novel, but not imperative. This wasn’t the computing Holy Grail we’ve dreamed about since the earliest episodes of “Star Trek.”

I couldn’t agree more.

Even better, Siri will be able to control the air conditioning in a CarPlay-compatible vehicle and provide third-party integration for Apple Watch apps.

It sure feels like Siri is finally growing up, wouldn’t you agree?

Are you looking forward to using Siri to interact with your favorite apps?

Source: The Wall Street Journal