Several developers tweeted out curious video clips that show off some of the major new features that Apple has added to its newly updated ARKit framework, such as the ability to detect vertical and irregularly shaped surfaces, 2D image recognition capabilities and more.
For starters, this is how ARKit 1.5 handles irregularly shaped surfaces and vertical planes.
— Ubicolor™ (@ubicolorapps) January 25, 2018
— Lauri (@lingoded) January 29, 2018
— Tim Field (@nobbis) January 24, 2018
Vertical surface detection didn’t make the cut for the initial ARKit version.
TechCrunch imagined a game that would let you throw darts at a wall, with the target mounted to an actual wall rather than floating in space. For those wondering, ARKit’s wall detection is initially able to detect planes that are vertical or just off vertical but not heavily angled.
— azamsharp (@azamsharp) January 26, 2018
Also new in ARKit 1.5: 2D image recognition, allowing it to detect movie posters, signs and other artwork in order to boost your augmented reality experience.
— azamsharp (@azamsharp) January 30, 2018
As an example, a developer may use ARKit’s image recognition capabilities for a virtual museum app offering interactive exhibits. In another example, an app could bring a movie poster to life and start playing the corresponding trailer soon as the camera detects it.
— Romain (@romainderrien) January 28, 2018
— azamsharp (@azamsharp) January 28, 2018
Here’s everything new in ARKit 1.5:
- Horizontal plotting—In addition to horizontal surfaces like tables and chairs, ARKit can now recognize and place virtual objects onto vertical surfaces, like walls and doors, and more accurately map irregularly shaped surfaces like circular tables or chairs.
- Improved scene understanding—ARKit can see and place virtual objects on vertical surfaces and more accurately map irregularly shaped surfaces like circular tables.
- 2D images—ARKit apps can now detect 2D images in your real world, like signs, posters and artwork, which can be integrated into the augmented reality experience.
- Higher resolution—The pass-through camera view of the real world has 50% higher resolution, going from 720p to full HD for a more believable experience.
- Sharper view—The view of the real world through your iPhone’s camera is now sharper as well because ARKit 1.5 brings support for the auto-focus feature.
- Tidbits—ARKit now supports line detection while the overall tracking has been improved in speed and accuracy.
It’s especially nice that ARKit video resolution has increased from 720p to 1080p, which makes for a much more believable experience.
How do you like these ARKit 1.5 examples?
Sound off in the comment section below.