Samsung working on standalone VR headset with eye/hand tracking & facial expression recognition

At last month's Mobile World Congress Shanghai, Samsung showed a secret standalone virtual headset prototype to partners. As spotted on VR Focus, the product uses technologies allowing it to track eye and hand movement as well as determine various facial expressions.

Dubbed Exynos VR III, the head-mounted accessory is apparently a successor to another Samsung headset prototype, called Exynos VR II, that was never officially released. Samsung already offers a virtual reality headset in the form of the Gear VR device which requires the user to dock and undock their smartphone every time they use it.

Thanks to Visual Camp, a VR company that developed eye-tracking technology for the secret VR headset, we know it's powered by a Samsung-designed 10nm hexa-core chip.

The chip includes a pair of Samsung M2 CPU cores clocked at 2.5 GHz, four ARM Cortex-A53 CPU cores clocked at 1.7 GHz and ARM Mali G71 MP20 graphics capable of driving two built-in 2,560-by-1,440 pixel displays at 90Hz or a single 4K external screen at 75Hz.

As mentioned, unlike Samsung's current Gear VR headset that requires a smartphone to process data and render visuals, this all-in-one head-mounted display prototype packs in all the technology needed to render virtual worlds and apps standalone.

Visual Camp's press release announcing the Samsung deal says its eye-tracking tech lets VR headsets conserve power by rendering parts of a scene the user is currently looking at very high resolution while showing anything in peripheral vision in reduced resolution.

This technique is known as “foveated rendering”.

“Several other technologies will be applied to the Exynos 3, in addition to the company's eye-tracking technology, including hand tracking, voice recognition, and facial expression recognition,” reads the press release.

A measurement of the CPU power consumption of Samsung Electronics' Exynos 8890 chip resulted in the relatively low average figure of less than three percent, said Visual Camp.

Companies like Apple, Google and Facebook are researching eye-tracking technology, too.

Apple is rumored to be working on a digital glasses or a virtual headset product that may use optics by German specialists Carl Zeiss, thought to be released in 2018 or 2019. The Cupertino giant recently acquired SensoMotoric Instruments for an undisclosed sum.

SensoMotoric Instruments is a German company that specializes in eye tracking. Their technology also uses foveated rendering, understands facial expressions and recognizes participant gestures and external events.

WSJ: Samsung working on Bixby powered smart speaker

The Wall Street Journal reported Tuesday that Samsung has been developing a wireless speaker powered by its Bixby personal assistant to take on the rival Amazon Echo, Google Home and Apple HomePod devices.

Internally code-named “Vega”, the project has been in development for more than a year.

Citing people familiar with the matter, the report states that the release timing is far from determined because the device's feature set and other specifications are yet to be decided, much less a release date.

The development is said to have been held back by the progress of Bixby itself, which already forced the South Korean firm to launch Galaxy S8 without proper support for English voice commands which rolled out in preview form last month.

According to the report, Samsung sees the full release of Bixby voice support as “unlikely before the second half of July.”

The best jailbreak tweaks for the Volume HUD

Perhaps one of the worst experiences in iOS out of the box is the volume HUD; it's clunky and appears right in the middle of the screen as you try to get things done.

Since it gets in the way so much, jailbreak developers have been creating alternative solutions for years, and in this roundup, we'll be talking about the best volume HUD-based jailbreak tweaks that work great with the Yalu jailbreak for iOS 10.

Let’s Talk iOS 194: I took the risk and I lost

Cody and Sebastien confirm that living life on a beta software isn't always a smart idea. The pair talks about iOS 11 features, ARKit, and iPhone 8. Surprisingly, no talk about the iPhone's ten year anniversary.

Subscribe on iTunes

Support Let’s Talk iOS: Visit our Deals Store and buy something from us.

Bloomberg: 3D face scanning feature could replace Touch ID in iPhone 8

Apple is working on a 3D face scanning feature that could replace Touch ID in iPhone 8, reports Bloomberg. Citing sources familiar with the product, the outlet says that the "improved security system" allows users to log in, authenticate payments, and launch secure apps by scanning their face.

This is powered by a new 3-D sensor, added the people, who asked not to be identified discussing technology that’s still in development. The company is also testing eye scanning to augment the system, one of the people said.

The sensor’s speed and accuracy are focal points of the feature. It can scan a user’s face and unlock the iPhone within a few hundred milliseconds, the person said. It is designed to work even if the device is laying flat on a table, rather than just close up to the face. The feature is still being tested and may not appear with the new device. However, the intent is for it to replace the Touch ID fingerprint scanner, according to the person.

Apple wouldn't be the first tech company to integrate face-scanning tech into its handset. Samsung's Galaxy S8 has an iris scanner that can be used to unlock the phone, although it has received mostly negative reviews. Apple's face-scanning sensor is believed to be more secure, thanks to 3D depth perception.

Thus far, a majority of the leaks and reports we've seen regarding the iPhone 8 have pointed to a device without a Home button, leading many to believe Apple found a way to embed Touch ID into the display. Noted analyst Ming-Chi Kuo, however, agrees with Bloomberg's facial recognition theory.

Source: Bloomberg

Apple could make major upfront investment into LG’s OLED production lines

Apple is reportedly in talks with LG Display about investing anywhere between $1.75 billion and $2.62 billion into the South Korean firm's new “E6” plant with a target monthly capacity of about 30,000 units of sixth-generation OLED panels.

According to The Korea Herald newspaper on Monday, the upcoming facility would be “exclusively dedicated to Apple orders” and should come online as early as 2019. A source said that the funding from Apple should help LG Display reduce risks from the lower margin.

The two companies have tentatively agreed on the investment plans, but details on the timing and size of the investment have yet to be finalized. The final decision is expected to be made following LG Display's board meeting later this month.

LG previously discussed an $870 million Google investment into its OLED plant.

An anonymous source said:

Samsung Display is the only display maker that meets Apple’s strict quality criteria for now. LG Display is said to be meeting about 70 percent level of the requirements, while Chinese display makers are still struggling to catch up with that of LG.

LG Display’s OLED supply for iPhone was delayed because the company failed to purchase Canon Tokki’s vacuum machine, the most advanced OLED production equipment whose supply is extremely limited. Recently, LG secured two units of the machine to speed up production.

With the new equipment installations expected in December 2017 and February 2018, LG Display’s production capacity is expected to double to 60,000 OLED panel units per month.

LG’s other new OLED plant, called “E5”, will focus on orders from LG Electronics and Chinese clients. Samsung Display is expected to be the sole supplier of OLED panels for iPhone 8 this year. LG Display currently builds flexible OLED panels for Apple Watch on an exclusive basis.

Samsung Display is reportedly building the world's biggest OLED manufacturing facility dedicated to orders from Apple and Samsung Electronics.

iPhone 8 concept via Benjamin Geskin.

Sharp beats everyone to completely bezeless phone

Forget Xiaomi's Mi MIX, Samsung's, Galaxy S8 or Apple's upcoming iPhone 8: Apple supplier Sharp is set to launch a completely bezeless devices on the July 17. According to GizChina, Sharp's rather mundanely branded FS8016 and FS8010 phones will have 100 percent seamless appearance with no bezels on the sides and really high screen to body ratios.

The otherwise identical Android devices have different processors: the FS8016 model uses a Snapdragon 660 processor with 6GB of RAM while its FS8010 counterpart is powered by a Snapdragon 330 chip with 4GB of RAM.

Each phone will come running on Android 7.1.1 and have a 5.5-inch display with with a 2,048-by-1,080 pixel resolution, dual twelve-megapixel rear cameras, an eight-megapixel camera on the front and 64 GB of onboard memory.

I'm not surprised that Sharp has managed to design what's essentially a seamless phone with a 100 percent full-screen face with no visible bezels given their awesome Aquos Crystal device in 2014, which filed as the first phone to have three of its sides completely bezel-less.

Are you surprised that Sharp is set to beat other smartphone vendors and launch a completely bezeless device? Chime in with your thoughts in the comment section.

New ARKit demos: Tesla Model 3, food ordering & inter-dimensional portal

With the new ARKit framework for building augmented reality (AR) apps, Apple is turning existing iOS devices into the largest AR platform in the world.

We previously shared a bunch of interesting ARKit demos showcasing the possibilities of the framework, including an upcoming furniture-ordering app from Ikea, a measuring tape, an ARKit-powered VR mode in Maps and more.

Today, we're highlight three more examples of ARKit-driven apps: a Tesla Model 3 app by an impatient fan, an example of an inter-dimensional portal in the middle of the street and an app that promises to change how we order food.

First up, a demo app by an impatient Tesla fan who couldn't wait for his ordered Model 3 so he made this ARKit-powered app that lets him drive around a virtual Model 3 in his real world, activate the headlights and so forth.

@elonmusk Couldn't wait 4 my #Model3, so made this AR app, what do you think? #ARkit pic.twitter.com/lIRLTZox7N

— Jelmer Verhoog (@JelmerVerhoog) July 1, 2017

Food ordering will never be the same, says developer Alper Guler who created an ARKit-driven app which renders various foods on your table that you can pan around, zoom in and out, rotate and more.

https://www.youtube.com/watch?v=oFdgVNg4ryM

And last but not least, we have French consulting agency Nedd which came up with a great example of AR+VR, via iPhoneAddict.fr.

https://www.youtube.com/watch?v=rIPfpGCxONQ

Before signing off, here's a quick volumetric capture example with ARKit.

hint pic.twitter.com/WOuqVer1Ph

— Made With ARKit (@madewithARKit) June 27, 2017

Very impressive so far, don't you think?

Supposed iPhone 8 screen frame leaks

Last night, prolific smartphone leakster Benjamin Geskin published an image on his Twitter, reportedly obtained from a Foxconn source, which he claims represents a screen frame holding the iPhone 8's OLED display and rumored glass sandwich design together.

The leaked screen bracket lacks any Home button placement because iPhone 8 is widely expected to adopt a virtual Home button in a so-called function area at the screen bottom.

The presumed iPhone 8 part has a large circular cutout at the top.

The cutout could house additional ambient light sensors to make the OLED display of iPhone 8 True Tone-capable or it could be for a rumored 3D sensor for advanced facial recognition, improved selfie quality, 3D mapping and other features.

According to KGI Securities analyst Ming-Chi Kuo, iPhone 8 will feature “the highest screen-to-body ratio of any smartphone currently available worldwide” and no in-screen Touch ID.

Corners just don't look right to me—they're too rounded and radius is too small, looking more like Samsung than Apple design. I think this is a Note 8 bracket, but that's just me.

Feel free to share your own observations in the comments section below.