Several developers tweeted out curious video clips that show off some of the major new features that Apple has added to its newly updated ARKit framework, such as the ability to detect vertical and irregularly shaped surfaces, 2D image recognition capabilities and more.
London-based mobile app development studio Ubicolor and iOS developers Mohammad Azam and Tim Field recently tweeted out a few videos showing off ARKit 1.5’s biggest new features.
For starters, this is how ARKit 1.5 handles irregularly shaped surfaces and vertical planes.
So I've been playing with the new ARKit wall detection today…what do you think?#arkit #madewitharkit #augmentedreality #iOS113 #arkit15 #ar #AugmentedReality pic.twitter.com/J9tj6sJf9S
— Ubicolor™ (@ubicolorapps) January 25, 2018
Made a weird ass #GGJ18 game Creature-z this weekend with @tristan_damron, @marknerys and @ericklind using #ARkit verticalPlane detection. Big up to @PIGSquad for hosting 🤙 pic.twitter.com/BKRdhVKHvq
— Lauri (@lingoded) January 29, 2018
New in iOS 11.3 – vertical & irregularly shaped surfaces with #ARKit pic.twitter.com/z54OuiIxuv
— Tim Field (@nobbis) January 24, 2018
Vertical surface detection didn’t make the cut for the initial ARKit version.
TechCrunch imagined a game that would let you throw darts at a wall, with the target mounted to an actual wall rather than floating in space. For those wondering, ARKit’s wall detection is initially able to detect planes that are vertical or just off vertical but not heavily angled.
The Future of Art galleries! ARKit vertical plane detection. #ARKit #AugmentedReality pic.twitter.com/8pAxM8OrKZ
— azamsharp (@azamsharp) January 26, 2018
Also new in ARKit 1.5: 2D image recognition, allowing it to detect movie posters, signs and other artwork in order to boost your augmented reality experience.
The Future of Movie Posters. ARKit 1.5 image detection and reference images. #ARKit #AugmentedReality pic.twitter.com/ruVxMCQtD3
— azamsharp (@azamsharp) January 30, 2018
As an example, a developer may use ARKit’s image recognition capabilities for a virtual museum app offering interactive exhibits. In another example, an app could bring a movie poster to life and start playing the corresponding trailer soon as the camera detects it.
#arkit image detection 1st try: success! As @Apple said, great feature for museums. Now I need content for 2300 paintings @NationalGallery pic.twitter.com/1m3LZVVCfJ
— Romain (@romainderrien) January 28, 2018
Reference Image Detection in ARKit 1.5 is pretty awesome! One book is configured to be detected while other is not. #ARkit #AugmentedReality pic.twitter.com/eLOKm0ZTGR
— azamsharp (@azamsharp) January 28, 2018
Here’s everything new in ARKit 1.5:
- Horizontal plotting—In addition to horizontal surfaces like tables and chairs, ARKit can now recognize and place virtual objects onto vertical surfaces, like walls and doors, and more accurately map irregularly shaped surfaces like circular tables or chairs.
- Improved scene understanding—ARKit can see and place virtual objects on vertical surfaces and more accurately map irregularly shaped surfaces like circular tables.
- 2D images—ARKit apps can now detect 2D images in your real world, like signs, posters and artwork, which can be integrated into the augmented reality experience.
- Higher resolution—The pass-through camera view of the real world has 50% higher resolution, going from 720p to full HD for a more believable experience.
- Sharper view—The view of the real world through your iPhone’s camera is now sharper as well because ARKit 1.5 brings support for the auto-focus feature.
- Tidbits—ARKit now supports line detection while the overall tracking has been improved in speed and accuracy.
It’s especially nice that ARKit video resolution has increased from 720p to 1080p, which makes for a much more believable experience.
How do you like these ARKit 1.5 examples?
Sound off in the comment section below.