Research suggests glasses-free 3D videos could be coming soon to home TVs

mit csail glasses free 3d videos home3d display copy
Jason Dorfman / MIT CSAIL
Third-dimensional movies could soon be venturing outside the theaters — and ditching those red and blue paper glasses too. New research out of the Massachusetts Institute of Technology and the Computer Science and Artificial Intelligence Laboratory (CSAIL), published on July 12, devises a way to watch 3D movies at home, without the need for glasses. Called Home3D, the new platform converts existing stereoscopic 3D movies by using artificial intelligence, rather than using a new camera system for natively recording the content.

The 3D glasses correct a pair of offset, polarized images to create a sense of depth. Home 3D, however, uses what’s called an automultiscopic display. The display is actually three (or more) images, but those images are presented in a slightly offset way that looks different when the screen is viewed from different angles. That allows the brain to see a coherent image with depth information, creating a 3D effect without the glasses.

Automultiscopic displays have already allowed for glasses-free TVs. While the display type recently introduced is promising, it requires creating a 3D video using 30 different cameras. The unusual format creates a sort of chicken-and-egg problem: Producers aren’t going to create this 30-camera content when no consumers actually own a automultiscopic TV, but no consumers are actually going to buy a automultiscopic TV when there’s no content being produced for it. Companies like Toshiba already have glasses-free displays on the market, but they’ve failed to grow in popularity because of limited content.

What the latest MIT/CSAIL research does is to create a way to convert existing, glasses-required 3D content into the proper format for automultiscopic displays (the study is based off a similar work that focused on glasses-free viewing at movie theaters last year). By converting content that already exists into the new glasses-free format, automultiscopic TVs could actually wind up in homes since it only requires some software to convert content to the new format. That’s why when YouTube announced a new 180-degree format, they launched a way to view the content and, with manufacturing partners, a way to create the content at the same time.

“Automultiscopic displays aren’t as popular as they could be because they can’t actually play the stereo formats that traditional 3D movies use in theaters,” said  Petr Kellnhofer, lead author on the Home3D research. “By converting existing 3D movies to this format, our system helps open the door to bringing 3D TVs into people’s homes.”

The MIT/CSAIL study isn’t the first to try computerized conversions to the new format, but reverses some of the current limitations. Phase-based rendering is a quick and accurate method for converting to the video type, but it can’t handle every type of 3D image. A technique called depth image-based rendering can handle those types of images, but is low-resolution and loses finer details like in transparent objects or motion blur.

The new software uses AI to mix the two conversion methods, creating a high-resolution 3D result without the glasses and without the limitations of earlier methods. The software can convert videos in real-time, running on a graphics processing unit (GPU), which means that the program could run off existing gaming devices like an Xbox or PlayStation, effectively mixing existing videos with existing hardware through software conversion. Future media players or smart automultiscopic TVs could integrate a GPU to enable the conversion as well, the research group says.

When Home3D-converted movies including The Avengers and Big Buck Bunny were presented to a study group, 60 percent of participants said the quality was better than existing 3D videos.

As we mentioned in our DT10 series on the future of the television, glasses-free 3D TVs will be a future technology manufacturers tap into, and this research backs up this trend. While the new method brings glasses-free home TVs closer to reality, the researchers say the current program does create some ghosting, or offset images, an issue the team plans to continue to refine through software.

Home Theater

New TV? Here's where to go to watch the best 4K content available

Searching for content for your new 4K UHD TV? Look no further. We have every major source of the best 4K content, along with the cost, hardware requirements, and features that make each service worth a look.
Home Theater

The seven best TVs you can buy right now, from budget to big screen

Looking for a new television? In an oversaturated market, buying power is at an all-time high, but you'll need to cut through the rough to find a diamond. We're here to help with our picks for the best TVs of 2018.
Home Theater

Looking to cut cable? Here’s everything you need to know about Pluto TV

Pluto TV offers plenty of entertainment in a fashion similar to live internet TV services, only at no cost — you don’t even need to register. Too good to be true? Here’s everything you need to know.
Home Theater

The best movies on Netflix in December, from 'Buster Scruggs’ to endangered cats

Save yourself from hours wasted scrolling through Netflix's massive library by checking out our picks for the streamer's best movies available right now, whether you're into explosive action, witty humor, or anything else.
Home Theater

OLED or LED? We pick the winner in the battle of competing TV tech

The acronyms OLED and LED sound and look very similar, but the two technologies are vastly different in terms of engineering, performance, and capabilities. Which technology wins when you pit OLED versus LED in a TV?
Home Theater

Sling TV ramps up its base programming with Discovery Networks for free

Sling TV has grown a great deal since its launch. Now there are more channels and more packages to chose from, with prices to match, and more is being added all the time. Everything you need to know is right here.
Emerging Tech

Awesome Tech You Can’t Buy Yet: Folding canoes and ultra-fast water filters

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!
Movies & TV

The best shows on Netflix, from 'Haunting of Hill House’ to ‘Twilight Zone’

Looking for a new show to binge? Lucky for you, we've curated a list of the best shows on Netflix, whether you're a fan of outlandish anime, dramatic period pieces, or shows that leave you questioning what lies beyond.
Product Review

Sennheiser brings audio perfection to wireless earbuds like no one else can

Sennheiser took its time entering the true wireless earbud market, and the results are what you’d expect from the storied audio brand. The new Momentum offer seamless operation, best-in-class sound, and a high price tag to match.
Home Theater

What are HDMI ARC and eARC? Here’s how they can simplify your home theater

HDMI ARC is one of the coolest TV features at your disposal. But if you're like most folks, you have no idea how it works, if you even know what it is at all. Here's our primer on HDMI ARC, as well as the next generation technology, eARC.
Movies & TV

Out of movies to binge? Our staff picks the best flicks on Hulu right now

From classics to blockbusters, Hulu offers some great films to its subscribers. Check out the best movies on Hulu, whether you're into charming adventure tales or gruesome horror stories.
Movies & TV

The best new movie trailers: ‘Avengers: Endgame,’ ‘Bumblebee,’ ‘Alita,’ and more

Everyone loves a good trailer, but keeping up with what's new isn't easy. That's why we round up the best ones for you. This week, it's the first trailer for Avengers: Endgame, as well as new trailers for Alita: Battle Angel and Bumblebee.
Movies & TV

The best movies on Amazon Prime right now (December 2018)

Prime Video provides subscribers with access to a host of fantastic films, but sorting through the catalog can be an undertaking. Luckily, we've done the work for you. Here are the best movies on Amazon Prime Video right now.
Movies & TV

Best new shows and movies to stream: ‘The Marvelous Mrs. Maisel’ and more

Need something to watch this weekend? Check out our list of the best new shows and movies to stream right now. On the list this week: The Marvelous Mrs. Maisel season 2, Neo Yokio: Pink Christmas, and more.