Take a hike, Alexa: Wendy’s a beautiful digital human ready to be your friend

While voice assistants like Amazon Alexa and Google Assistant continue to become more commonplace and find their way into a variety of different devices, there is a growing movement to add artificial intelligence to “digital humans,” or virtual characters that go beyond doing our bidding, and become companions or even friends. Korean technology giant SK Telecom is the latest to experiment with the concept, and demonstrated its HoloBox at Mobile World Congress.

We spoke to SK Telecom and Reality Reflection, the development team behind the digital character inside the HoloBox, to better understand this fascinating, sci-fi-infused future.

HoloBox

The HoloBox looks like a compact, cylindrical fish tank, but instead of water and a few fish, you’ll find Wendy living inside. Wendy is just one of the characters, or digital humans, created by Reality Reflection for the project. She is Alexa, Siri, or Google Assistant given form, and will do everything you’d expect from a modern virtual assistant. She appears on a flat, 8.6-inch screen mounted at the rear of the glass cylinder, and is made “real” by a projector mounted just in front of it.

Holobox and Reality Reflection
Andy Boxall/Digital Trends
Andy Boxall/Digital Trends

You’ll find all the usual technology inside the HoloBox, including a front-facing camera, multi-directional microphones, and touch controls on the top. Primarily though, Wendy reacts to your voice — using SK Telecom’s Nugu AI platform — and performs simple tasks, like turning on lights or reminding you of an appointment. It’s really only the beginning of her capabilities.

The HoloBox also fits neatly into SK Telecom’s 5G plans. Generating the holographic character takes a massive amount of visual data — one square centimeter of hologram is about 1GB of data, according to SK Telecom. That cannot be streamed over 4G LTE, but it is possible with 5G’s speed and capacity. The intention is for HoloBox to show how emerging forms of entertainment, from augmented and virtual reality to holograms, can benefit from 5G.

Who is Wendy?

SK Telecom may be using the HoloBox and Wendy to promote 5G and its technology, but like any good human — digital or otherwise — there are other levels to Wendy and her glass home. Reality Reflection built the Wendy character, and see her evolving to become a companion to those living alone. She’s capable of listening, understanding, reacting, and even emoting through her facial expressions. To do this, she has to look just right.

Holobox and Reality Reflection
Andy Boxall/Digital Trends
Andy Boxall/Digital Trends

Wendy the digital human is based on Wendy, or Son Seung-wan, a singer in the K-pop group Red Velvet. Digital Wendy is more than just her namesake. Reality Reflection used its massive camera rig consisting of 160 DSLRs to scan Wendy’s face and body to come up with the final digital human we see inside the HoloBox. To render her into a single photorealistic model was a massive undertaking. A scan takes three to four hours to complete, and at least two weeks to create a basic render. To get the desired level of detail in the model can take two or three months.

Beyond the HoloBox

The model inside HoloBox is nowhere near as detailed as it could be. The technology to create such a highly realistic model, and project it in 3D, is beyond the scope of the project. Reality Reflection’s Vice President of Business Development, Don Lim, said he was disappointed that the final version of Wendy didn’t show off the true extent of the team’s hard work, while SK Telecom’s Immersive Labs Manager Gukchan Lim explained that a desire to keep the unit relatively small made the use of 3D projectors impossible.

The trade-off comes when Wendy, or Aria, the other SK Telecom character shown to us, leaps out of the HoloBox and onto your smartphone. Using augmented reality technology, Wendy and Aria can live on your phone to help your through the day. The demo we saw looked great, and the higher-resolution phone screen helped more of the character’s detail show through.

Reality Reflection created another digital human, again based on Wendy, called Zena. This character lives inside virtual reality and can be seen on the Oculus Rift, HTC Vive, and Samsung Gear VR. Zena dances, emotes, and maintains eye contact in VR. The level of realism in her movements is impressive, and evidence of what the firm could do with next-generation holographic hardware.

Living with Digital Humans

It’s not the first time we’ve seen a project like this. Japan’s Gatebox was one of the first to attract mainstream attention, and messaging app Line has expressed considerable interest in pursuing the concept of using digital characters and artificial intelligence to combat loneliness, or to create virtual companions.

Artificial intelligence is making it possible for computers to think and act more like people, and by increasing the visual realism of the character itself, particularly in movements and facial expressions, it’s hoped we’ll be more willing to accept these characters into our lives. Wendy can make more than 100 different expressions and movements at the moment.

Holographic digital humans can be seen as a logical step beyond verbally interacting with a faceless smart speaker, but whether it’s a direction everyone will be comfortable with remains to be seen. The response to Gatebox was split, with many finding it disturbing, and it doesn’t seem like SK Telecom is convinced HoloBox and Wendy will quickly find more favor.

Although we were told the intention is to put HoloBox on sale in the future, it may not be for another year or so before it happens, and that’s a shame. Living with a device like the HoloBox doesn’t have to become a depressing episode of Black Mirror. For us, the concept of having a digital companion is a sci-fi fantasy we can almost truly experience, and HoloBox brings it one step closer to reality.

Product Review

'NBA 2K19' will dunk on you, but don’t worry. You’re going to like it.

NBA 2K19 makes smart changes that force you to dig deep into your bag of tricks to succeed. This might be the most accurate virtual version of NBA basketball yet.
Emerging Tech

VR experience shows caregivers what it’s like to live with Alzheimer’s disease

Los Angeles-based VR startup Embodied Labs has developed a virtual experience that puts users in the shoes of a person with Alzheimer’s disease, the most common type of dementia in the U.S.
Emerging Tech

A treasure trove of 3D scientific specimens is now free to see online

Thanks to the California Academy of Sciences, you can access more than 700 scientific specimens and artifacts from the world-class collection via the online 3D and virtual reality platform Sketchfab.
Computing

Should you OK Google, Hey Siri, or talk to Cortana? Here's the top voice assistant

In this virtual assistant comparison, we examine how they're becoming an important part of our lives. So how do Cortana, Google Assistant, and Siri stack up against one another when it comes to features and voice recognition?
Wearables

Leak suggests Fitbit may soon release another 'swim-proof' fitness tracker

Fitbit is reportedly launching another fitness tracker -- the Fitbit Charge 3. The new wearable is expected to include a touchscreen display, connected GPS, the ability to reply to text messages, and more. Here's everything we know about…
Mobile

We found out which Sony Xperia phones will get Android 9 Pie in 2019

Android 9.0 Pie has been released. But is your phone getting Android 9.0 Pie, and if so, when? We've done the hard work and asked every device manufacturer to see when their devices would be getting the update.
Product Review

From its stunning screen to its slick S-Pen, Samsung's Note 9 is a masterpiece

It’s jaw-dropping how much tech Samsung has fit inside the Galaxy Note 9. It’s one of Samsung’s largest phones ever thanks to its 6.4-inch screen, and the S Pen is better than ever.
Mobile

Google may finally create its first flagship store in Chicago

Google is reportedly nearing an agreement on a lease for its first flagship retail store. The store will be located in Chicago, and will presumably be where the company shows off Google Pixel phones and other hardware.
Home Theater

The best MP3 player you can buy (and four alternatives)

Want to go for a run, but your phone is weighing you down? No worries. Can't fit your whole music library on your smartphone? Don't sweat it. Check out our list of the best MP3 players, and find one that works for you.
Mobile

Google confirms it still tracks users who turn Location History off

Google is tracking your location -- even when you tell it not to. According to an investigation by the Associated Press, Google services store location data, regardless of whether privacy settings claim otherwise.
Mobile

Is your smartphone frozen? Here's how to reset your iPhone

You can do a lot with an iPhone, but if you ever run into an issue with it, the first thing you should do is restart it. In this guide, we tell you how to reset your iPhone, and explain how it differs from a factory reset.
Mobile

The HTC U12 Plus is now available in color-shifting Flame Red shade

HTC has released some pretty great flagship phones in the past few years, and it's now aiming to follow up with another one. After plenty of rumors and leaks, the company has finally taken the wraps off of the new HTC U12 Plus.
Home Theater

Crazybaby’s Air 1S true wireless earbuds won’t make you look like a dork

Audio technology company Crazybaby has launched the Air 1S true wireless earbuds, offering considerable connectivity improvements over previous models while retaining the sleek style and supreme comfort.
Mobile

A subway passenger may have snagged a shot of the upcoming Pixel 3 XL

It hasn't been too long since Google launched the Pixel 2, but it's already gearing up for the next iteration, the Google Pixel 3. Here's everything we know about the upcoming phones so far.