Apple unveils SignTime, AssistiveTouch, and more software features designed for individuals with disabilities

Accessibility features are a core element to Apple’s many platforms and services. The company is extending that belief with new software features that are coming soon to all of its operating systems.

Today, Apple previewed powerful new software technology that’s meant to make things a bit easier for people with disabilities. The announcement says the new software features are designed for those with mobility, vision, cognitive, and hearing disabilities. The press release echoes Apple’s belief that “accessibility is a human right,” and shows that Apple’s devices are customizable in such a way to make them useful tools for all users.

Apple says that, later this year, the company will launch new software updates across all of its operating systems to welcome these new software features. New elements like AssistiveTouch will make it easier for those with “limb differences” to use Apple Watch; while the iPad will gain support for third-part eye-tracking hardware. And using on-device intelligence, Apple’s existing VoiceOver screen reading software will be much improved for those with vision disabilities.

Apple has a completely new feature coming soon, launching on May 20, 2021. It’s called SignTime, and it will make it easier for those with speech disabilities to communicate with Retail Customer Care and AppleCare specialists. They will rely on American Sign Language (ASL) in the United States, British Sign Language (BSL) in the United Kingdom, and French Sign Language (FSL) in France. All of this will be possible from within their web browser, with a clear video call making it possible to have a one-on-one conversation.

At Apple, we’ve long felt that the world’s best technology should respond to everyone’s needs, and our teams work relentlessly to build accessibility into everything we make,’ said Sarah Herrlinger, Apple’s senior director of Global Accessibility Policy and Initiatives. ‘With these new features, we’re pushing the boundaries of innovation with next-generation technologies that bring the fun and function of Apple technology to even more people — and we can’t wait to share them with our users.

Apple has a video showing off AssistiveTouch. As soon as the company uploads it to its official YouTube channel, we will add them here.

Here’s how Apple describes AssistiveTouch for Apple Watch, new eye-tracking hardware support for iPad, and expanded VoiceOver:

AssistiveTouch

To support users with limited mobility, Apple is introducing a revolutionary new accessibility feature for Apple Watch. AssistiveTouch for watchOS allows users with upper body limb differences to enjoy the benefits of Apple Watch without ever having to touch the display or controls. Using built-in motion sensors like the gyroscope and accelerometer, along with the optical heart rate sensor and on-device machine learning, Apple Watch can detect subtle differences in muscle movement and tendon activity, which lets users navigate a cursor on the display through a series of hand gestures, like a pinch or a clench. AssistiveTouch on Apple Watch enables customers who have limb differences to more easily answer incoming calls, control an onscreen motion pointer, and access Notification Center, Control Center, and more.

VoiceOver

Apple is introducing new features for VoiceOver, an industry‑leading screen reader for blind and low vision communities. Building on recent updates that brought Image Descriptions to VoiceOver, users can now explore even more details about the people, text, table data, and other objects within images. Users can navigate a photo of a receipt like a table: by row and column, complete with table headers. VoiceOver can also describe a person’s position along with other objects within images — so people can relive memories in detail, and with Markup, users can add their own image descriptions to personalize family photos.

iPad with eye-tracking support

iPadOS will support third-party eye-tracking devices, making it possible for people to control iPad using just their eyes. Later this year, compatible MFi devices will track where a person is looking onscreen and the pointer will move to follow the person’s gaze, while extended eye contact performs an action, like a tap.

The press release offers much more.

Support for bi-directional hearing aids and more

Apple has made a “significant update” to the Made for iPhone (MFi) hearing devices program, now supporting bi-directional hearing aids. With this support, these hearing aids with their improved microphones will make it possible for those “who are deaf or hard of hearing to have hands-free phone and FaceTime conversations,” with models available later this year.

Apple is also bringing support for recognizing audiograms — charts that show the results of a hearing test — to Headphone Accommodations. Users can quickly customize their audio with their latest hearing test results imported from a paper or PDF audiogram. Headphone Accommodations amplify soft sounds and adjust certain frequencies to suit a user’s hearing.

In an effort to support neurodiversity, Apple is introducing new background sounds to help people focus, rest, or otherwise stay calm:

Everyday sounds can be distracting, discomforting, or overwhelming, and in support of neurodiversity, Apple is introducing new background sounds to help minimize distractions and help users focus, stay calm, or rest. Balanced, bright, or dark noise, as well as ocean, rain, or stream sounds continuously play in the background to mask unwanted environmental or external noise, and the sounds mix into or duck under other audio and system sounds.

And there’s even more coming later this year, including more customization options for Memoji:

  • Sound Actions for Switch Control replaces physical buttons and switches with mouth sounds — such as a click, pop, or “ee” sound — for users who are non-speaking and have limited mobility.
  • Display and Text Size settings can be customized in each app for users with colorblindness or other vision challenges to make the screen easier to see. Users will be able to customize these settings on an app-by-app basis for all supported apps.
  • New Memoji customizations better represent users with oxygen tubes, cochlear implants, and a soft helmet for headwear.

Apple is also celebrating Global Accessibility Awareness Day within Apple Fitness+ and other areas:

  • This week in Apple Fitness+, trainer and award-winning adaptive athlete Amir Ekbatani talks about Apple’s commitment to making Fitness+ as accessible and inclusive as possible. Fitness+ features workouts inviting to all, from trainers using sign language in each workout to say “Welcome” or “Great job!,” to “Time to Walk” episodes changing to “Time to Walk or Push” for wheelchair workouts on Apple Watch, and all videos include closed captioning. Fitness+ also includes a trainer demonstrating modifications in each workout, so users at all levels can join in.
  • The Shortcuts for Accessibility Gallery provides useful Siri Shortcuts for tracking medications and supporting daily routines, and a new Accessibility Assistant Shortcut helps people discover Apple’s built-in features and resources for personalizing them.
  • Today at Apple is offering live, virtual sessions in ASL and BSL throughout the day on May 20 that teach the basics of iPhone and iPad for people with disabilities. In some regions, Today at Apple will offer increased availability of Accessibility sessions in stores, through May 30.
  • In the App Store, customers can read stories about Lucy Edwards, an influencer on TikTok who is blind and shares her favorite accessible apps; App of the Day FiLMiC Pro, which is among the most accessible video apps for blind and low vision filmmakers; and more in the new Express Yourself Your Way collection.
  • The Apple TV app will spotlight its Barrier-Breaking Characters collection which celebrates authentic disability representation onscreen and behind the camera. It features guest curation from creators and artists like the cast of “Best Summer Ever,” who share their favorite movies and shows in an editorial experience designed by American Pop-Op and Urban Folk artist Tennessee Loveless, known for his vibrant illustrations and colorful storytelling told through the lens of his colorblindness.
  • Apple Books adds reading recommendations from author and disability rights activist Judith Heumann, along with other themed collections.
  • Apple Maps features new guides from Gallaudet University, the world’s premier university for Deaf, hard of hearing, and Deafblind students, that help connect users to businesses and organizations that value, embrace, and prioritize the Deaf community and signed languages.

There is a lot coming from Apple in terms of support for accessibility.