Disney’s Magic Bench brings animated characters to life, no AR goggles needed

Disney has begun showcasing one potential application for augmented reality: third-person interactions with digital characters. Using an RGB camera and depth sensor, Disney Research was able to create an experience where a user who sits on the bench can see themselves sitting next to a fully animated and interactive character. With haptic actuators fitted to the bench as well, there’s even the ability to ‘feel’ those digital characters’ actions in the real world.

Augmented reality headsets like Microsoft’s Hololens show an exciting potential future for the technology, and Disney’s Magic Bench shows how this tech can be leveraged now to create unique experiences. Magic Bench offers an insight into how some relatively simple hardware and software can be used to build memorable interactions with animals, useful weather features, and a changing environment.

As well as being quite hardware light, these experiences can also be enjoyed by groups, with a number of people in each scene able to interact with the characters, what’s going on around them and most importantly see it all happening on the screen in front of them.

Set to be shown off to the public for the first time at the upcoming SIGGRAPH 2017 event on July 30 in Los Angeles, the Magic Bench uses a clever combination of its limited hardware components to construct the digital scene. The RGB camera creates a 2D rendition of the scene, which is combined with 3D information from the depth sensor. Although their perspectives are subtly different, creating what Disney calls “depth shadows,” a recreated 2D backdrop can be algorithmically lined up to create the final, complete digital scene.

The standard wooden bench is an important part of the hardware involved, too. It acts as a stage and a middle-ground between foreground and background. That way, Disney knows that a digital character passing behind the bench should pass behind the viewers and if moving in front, it should appear in front of the viewers.

As Phys highlights, it even acts as a controller, automatically activating the experience when someone sits down upon it, potentially creating a joyful surprise for anyone not expecting to see themselves interacting with digital characters on the screen in front of them.

Disney seems particularly excited by the potential of augmented reality to bring physical-world features into the digital, some of which were shown off in another video by the research division. From children’s drawings impacting digital models, to augmented reality museums, it seems safe to say that Disney is investing heavily in augmented and mixed reality research and its developments will be worth keeping an eye on in the years to come.


From the road to your wrist, see how Android has evolved over the past 10 years

Android started out as just a mobile operating system, but 10 years in it's pretty much everywhere. Check out our round-up of all the different Android variations that have cropped up so far, and what might be coming in the future.
Emerging Tech

Say cheese: InSight lander posts a selfie from the surface of Mars

NASA's InSight mission to Mars has commemorated its arrival by posting a selfie. The selfie is a composite of 11 different images which were taken by one of its instruments, the Instrument Deployment Camera.
Virtual Reality

Oculus Rift vs. HTC Vive: Prices drop, but our favorite stays the same

The Oculus Rift and HTC Vive are the two big names in the virtual reality arena, but most people can only afford one. Our comparison tells you which is best when you pit the Oculus Rift vs. HTC Vive.

Listen up! White noise device may make VR motion sickness a thing of the past

A simple device that sends white noise vibrations to the inner ear could be all it takes to fix the long-running problem of nausea in virtual reality. The developers are now seeking FDA approval.

Honor to out-megapixel the competition with 48MP camera on upcoming View 20

After its phenomenal success with the View 10 in 2018, it looks like Honor is getting ready up the ante with its forthcoming Honor View 20. Here's everything we know about it so far.

Oculus VR could upgrade the Rift with a new display in 2019

Oculus could be set to release a new version of its Rift headset in 2019, but it will be more of a modest upgrade than a true sequel. The Rift S, as its purportedly called, will have a new display, and inside-out tracking.

Google awarded patent for using eye tracking to detect expressions in VR

Google was awarded a patent that involves using eye tracking to infer facial expressions using machine learning in virtual reality. The tech could help make virtual reality a whole lot more immersive than it already is.

Immerse yourself in a new universe with these incredible PSVR games

The PSVR has surpassed expectations and along with it comes an incredible catalog of games. There's plenty of amazing experiences to be had so we've put together a list of the best PSVR games available today.
Virtual Reality

Prototype Valve VR headset leaked: HTC Vive challenger confirmed?

Leaked images revealed that a Valve VR headset is in development, even amid Valve's partnership with HTC for the HTC Vive. Sources confirmed the device, which may be bundled with a Half-Life VR game.
Virtual Reality

Is the Vive Pro better than the original Vive? Our answer might surprise you

HTC Vive vs. Vive Pro, which comes out on top? That's the subject of our latest comparison, which looks at everything from tracking solutions, to controllers, and the brand new headset that could set a new standard for VR.

The best HTC Vive games available today

So you’re considering an HTC Vive, but don't know which games to get? Our list of 25 of the best HTC Vive games will help you out, whether you're into rhythm-based gaming, interstellar dogfights, or something else entirely.

A Google patent shows a way to make VR even more immersive

Virtual reality can be a really immersive experience, but it does sometimes it does have boundaries. Google has addressed this problem by patenting shoes with a flexible region on the bottom.
Virtual Reality

Think virtual reality is just for games? These awesome apps will change your mind

Virtual reality isn't all about gaming. Swim with turtles, paint in 3D, and immerse yourself in some unique experiences the platform has to offer with our curated list of the best VR apps.

Dive head first into the best experiences available now on the Oculus Rift

The Oculus Rift brought back virtual reality and put a modern twist to it. Grab your Touch Controllers, put on your VR headset, and jump into the fun with some of the best Oculus Rift games available now.