Skip to main content

Research suggests glasses-free 3D videos could be coming soon to home TVs

mit csail glasses free 3d videos home3d display copy
Jason Dorfman / MIT CSAIL
Third-dimensional movies could soon be venturing outside the theaters — and ditching those red and blue paper glasses too. New research out of the Massachusetts Institute of Technology and the Computer Science and Artificial Intelligence Laboratory (CSAIL), published on July 12, devises a way to watch 3D movies at home, without the need for glasses. Called Home3D, the new platform converts existing stereoscopic 3D movies by using artificial intelligence, rather than using a new camera system for natively recording the content.

The 3D glasses correct a pair of offset, polarized images to create a sense of depth. Home 3D, however, uses what’s called an automultiscopic display. The display is actually three (or more) images, but those images are presented in a slightly offset way that looks different when the screen is viewed from different angles. That allows the brain to see a coherent image with depth information, creating a 3D effect without the glasses.

Automultiscopic displays have already allowed for glasses-free TVs. While the display type recently introduced is promising, it requires creating a 3D video using 30 different cameras. The unusual format creates a sort of chicken-and-egg problem: Producers aren’t going to create this 30-camera content when no consumers actually own a automultiscopic TV, but no consumers are actually going to buy a automultiscopic TV when there’s no content being produced for it. Companies like Toshiba already have glasses-free displays on the market, but they’ve failed to grow in popularity because of limited content.

What the latest MIT/CSAIL research does is to create a way to convert existing, glasses-required 3D content into the proper format for automultiscopic displays (the study is based off a similar work that focused on glasses-free viewing at movie theaters last year). By converting content that already exists into the new glasses-free format, automultiscopic TVs could actually wind up in homes since it only requires some software to convert content to the new format. That’s why when YouTube announced a new 180-degree format, they launched a way to view the content and, with manufacturing partners, a way to create the content at the same time.

“Automultiscopic displays aren’t as popular as they could be because they can’t actually play the stereo formats that traditional 3D movies use in theaters,” said  Petr Kellnhofer, lead author on the Home3D research. “By converting existing 3D movies to this format, our system helps open the door to bringing 3D TVs into people’s homes.”

The MIT/CSAIL study isn’t the first to try computerized conversions to the new format, but reverses some of the current limitations. Phase-based rendering is a quick and accurate method for converting to the video type, but it can’t handle every type of 3D image. A technique called depth image-based rendering can handle those types of images, but is low-resolution and loses finer details like in transparent objects or motion blur.

The new software uses AI to mix the two conversion methods, creating a high-resolution 3D result without the glasses and without the limitations of earlier methods. The software can convert videos in real-time, running on a graphics processing unit (GPU), which means that the program could run off existing gaming devices like an Xbox or PlayStation, effectively mixing existing videos with existing hardware through software conversion. Future media players or smart automultiscopic TVs could integrate a GPU to enable the conversion as well, the research group says.

When Home3D-converted movies including The Avengers and Big Buck Bunny were presented to a study group, 60 percent of participants said the quality was better than existing 3D videos.

As we mentioned in our DT10 series on the future of the television, glasses-free 3D TVs will be a future technology manufacturers tap into, and this research backs up this trend. While the new method brings glasses-free home TVs closer to reality, the researchers say the current program does create some ghosting, or offset images, an issue the team plans to continue to refine through software.

Editors' Recommendations

Hillary K. Grigonis
Hillary never planned on becoming a photographer—and then she was handed a camera at her first writing job and she's been…
AMD teases performance of its revolutionary 3D V-cache chip
AMD CEO holding 3D V-Cache CPU.

AMD is currently readying its new Ryzen 7 5800X3D, featuring a 3D V-cache, and it looks like we may soon have a powerful processor on our hands. AMD has teased that we can expect an up to 15% performance boost over the base Ryzen 7 5800X.

The tech giant talked about the new chip during the International Solid-State Circuits Conference (ISSSC) and revealed more information about its architecture. While the Ryzen 7 5800X3D will certainly be an improvement, will it be enough to compete with Intel's best processors?

Read more
Fighting football injuries with 3D-printed, hyper-personalized pads
The Protect3d 3D scanning process.

If you’ve ever watched a movie about sports, you’ve seen it. It's that moment that occurs two-thirds of the way into the story, when the protagonists’ inevitable victory suddenly seems a lot less certain. Maybe the inspirational mentor winds up in the ER, muttering motivational slogans from a hospital bed. Perhaps the unorthodox coach wins over the team, only to be fired by management for thinking too far outside the box. Possibly the star lacrosse player has a crisis of faith and realizes he wants to be an acapella singer rather than a jock.

For the three co-founders of Protect3D, a real-life version of that moment took place between the second and fifth game of Duke University's football season several years ago, back when the company's founders were engineering students. The team’s starting quarterback was the recipient of a particularly tough sack during a game. He went down hard, and stayed down. Things looked bleak.

Read more
AMD’s 3D-stacked Ryzen 7 5800X3D is ‘world’s fastest gaming processor’
AMD CEO presenting new CPU.

The first processor to use a 3D V-Cache technology was announced at the big AMD CES 2022 keynote. The tech was first announced at Computex 2021, and fans have been eagerly awaiting a processor that will put it to use.

That processor is the Ryzen 7 5800X3D, which seems like a strange place to start a new range of processors. AMD has its Ryzen 9 chips, after all. That's because the new Ryzen 7 can outclass AMD's Ryzen 9 5900X while gaming, despite using the same architecture.

Read more