A few tinkering developers have actually used the facial data collected from the iPhone X’s TrueDepth camera system to create 3D models of their face. One was even able to 3D print his face, though with questionable results.

In a short video, visual effects artist Elisha Hung was able to use the data collected from the TrueDepth camera to create a 3D floating head, able to mimic his movements. He utilized the iPhone X’s camera, then used ARKit and Xcode to fetch that data, and later transform it into full 3D renders.

While that actually looks pretty great, it does take the effort of a visual effects artist to achieve that outcome. The actual imagery collected by the iPhone’s camera is far less precise.

It doesn’t collect quite enough points to make such a realistic model, so it takes a lot of effect to smooth out the data into something that looks more like a face. Brad Dwyer, founder of game company Hatchlings, showed what an actual frame looks like as collected by the TrueDepth camera.

In this form, it is a whole lot blockier.

Still, they’ve shown what impressive feats can be achieved using the latest technology built into Apple’s phones. Since developers are able to take advantage of these APIs, it will be interesting to see what developers do with this in the future.

  • Sohail Wahab

    So, you can actually make an Animoji of yourself. Cool! ?

  • therealjjohnson

    And all of this information “stays on chip”…right.

    • askep3

      If only you knew what you were talking about…

      The Face ID security data stays on chip, it is completely seperate from the ARKit data provided by the TrueDepth cameras to app developers. This guy used ARKit along with he TrueDepth cameras to later map his face onto the muscle movements recorded. IT has nothing to do with the security functions of the iPhone X.

      • therealjjohnson

        If only you knew what “I” was talking about is a better statement. I know you don’t view that as “security functions” but i do. Just as the post suggest, it was one shot that got him that facial data. It was a bit rocky. But with multiple you could likely put together a real facial map. I don’t want each app i have on my phone to potential have a 3D facial map of my face. That’s is important data to me. I can create an app with my $99 developerer account and make it free and collect data. Major apps that already have giant user bases can technically do it too. That’s important to me.

      • Aniket Bhatt

        Well in order to do that you’d have to instruct the user to take enough images to get a 3D map. At which point you as a user know exactly whats happening. You can do similar things with an Xbox kinect or a playstation camera. Quite a few video games have this functionality. It is not simple it takes a significant amount of effort on the users part. Also, if someone badly wanted a 3D scan of your face they could do it with 2D images. If you’re concerned about an app 3D scanning your face then don’t use that app, or don’t give it camera access. pretty simple

      • askep3

        Stays on chip implied Face ID security data including the mathematical representation of a Face. That is what my comment was directed towards.