Due to popular demand, a cool new demo that lets you cut and paste your surroundings into Photoshop using augmented reality is currently being turned into a proper iPhone app.
Created by Paris-based designer and artist Cyril Diagne, the software, dubbed AR Copy and Paste, circumvents the traditional copy-paste method using a single app. It works by leveraging computer vision and machine learning to find distinct objects in your surroundings. The app then removes the background to isolate the foreground object itself.
All it takes to paste the resulting image into Photoshop or another supported app on your computer is hovering your iPhone over the computer screen. The results are nothing short of breathtaking — this is one of the few practical uses for augmented reality currently.
And here it is in action.
This sure looks like something Apple might bring to iOS as a standard Continuity feature.
As a matter of fact, Apple has a similar Continuity feature in iOS 13 and macOS Catalina that permits you to paste an image captured with an iOS device’s camera into any Mac app that supports copy and paste, but it doesn’t use augmented reality.
AR Copy and Paste currently works with the Adobe products such as Photoshop, InDesign and Illustrator, but Diagne says it may add support for pairing with other apps in the future, including Figma, GIMP, Sketch, Powerpoint, Keynote and others.
Once AR Copy and Paste has been fully fleshed out, its creator plans to submit the software to Apple for inclusion on the App Store.
The secret sauce here is BASNet (Qin et al, CVPR 2019) for salient object detection and background removal.
— Cyril Diagne (@cyrildiagne) May 3, 2020
Is AR Copy and Paste super impressive or what?
Meet us in comments!