Project Tango can remember where it's been, making AR work even when your device is distracted

Project Tango
If you’re not familiar with Google’s Project Tango, it’s an image recognition platform, to put it simply. Using a special 3D camera, a Tango equipped device “looks” at the world around it, and uses that information to map a space, add in augmented reality objects, or simply track the location of a mobile device.

It has a wide variety of uses, even in its developer-oriented form, but there are some issues. For one, even the precision accelerometers and gyroscopes in mobile phones tend to have a margin of error, especially with vigorous movement. Add to that the way lighting changes, and user movement, and you might notice some drift or enlarging of objects that are supposed to stay still. Which brings us to the topic of today’s Google I/O talk by Tango team leader Wim Meeussen.

Learning its way around

The solution to object drift is area learning. Instead of constantly looking at its surroundings and calculating a new position, area learning allows a Tango device to recognize its surroundings. By building a memory of the world around it, the Tango device can recognize those spaces, and properly fit objects back into them.

Several demos served to illustrate how well this worked. A simple app, lacking area learning, placed a virtual box on a flat surface. After turning away from the podium and shaking the Tango powered device, the box began to slide around. Eventually, it disappeared, as the device entirely lost track of where the box should be.

Turning on area learning produced entirely different results. Not only did the box stay as the device shook and looked away, but even covering the camera for several seconds didn’t affect its positioning. Granted, it sometimes took a few seconds to re-identify the space around it, but once it did, the box popped right back up.

Memory makes for better multiplayer

Area learning really opens up the possibilities of VR and AR gaming with multiple users. Google says the Tango area learning code is easy to implement (capturing a location memory takes one line of code), and sharing it with other devices even easier (also just one line of code.)

For a multiplayer game, one device can capture a location memory of the space, and then export that location memory to other devices in the area. Working from the same model of the room, the devices are able to keep even better track of each other and their surroundings.

The results speak for themselves. In a video demo two users handed back and forth a Tango enabled tablet, with their heads and the device mirrored perfectly in a virtual rendering of the space. All of this takes place without establishing any infrastructure in the area, and with minimal code alterations.

What’s next?

If the results of area learning are any indication, Tango is coming along quite nicely. Object permanence, navigation, and multiplayer components are all a big part of the equation, and they must not be far from production. In fact, Meeussen made sure to remind everyone that Lenovo would be releasing a Tango-equipped device targeted at consumers later this year.

For now, eager AR users will either need to learn to develop, or wait patiently for the first device with Google’s powerful new technology.

Emerging Tech

Google plots radar-sensing tech that could make any object smart

Computer scientists have shown how Google’s Soli sensor can be used to make dumb objects smart. Here's why radar-powered computing could finally make the dream of smart homes a reality.
Gaming

Take a trip to a new virtual world with one of these awesome HTC Vive games

So you’re considering an HTC Vive, but don't know which games to get? Our list of 25 of the best HTC Vive games will help you out, whether you're into rhythm-based gaming, interstellar dogfights, or something else entirely.
Emerging Tech

CES 2019 recap: All the trends, products, and gadgets you missed

CES 2019 didn’t just give us a taste of the future, it offered a five-course meal. From 8K and Micro LED televisions to smart toilets, the show delivered with all the amazing gadgetry you could ask for. Here’s a look at all the big…
Computing

Google is giving its G Suite web apps new touches of visual improvements

Your G Suite applications will soon have a different look. Several of the web apps are getting updated with subtle visual improvements inspired by Google's Material Design guidelines. 
Gaming

HTC brings two new headsets, a VR browser, and ‘Netflix for VR’ to CES 2019

HTC Vive made several new announcements to CES 2019, including two new headsets, a new subscription service, and a new user interface that completely transforms how applications are launched.
Photography

Camera records real-life scenes to design virtual worlds using a single device

Creating virtual reality worlds may get a bit easier in 2019 -- the Axis is a camera module that records a 180-degree depth map, allowing designers to reconstruct the scene for virtual or augmented reality.
Product Review

HTC puts eye-tracking tech in Vive Pro Eye to make next-gen VR hands-free

With the announcement of integrated eye tracking for the Vive Pro Eye, hands-free VR, less demanding high-quality experiences, and intuitive software, are all on the table.
Gaming

The Vive Pro Eye uses Tobii eye-tracking technology to make VR more lifelike

HTC revealed the Vive Pro Eye with eye-tracking support at its CES 2019 press conference on January 7. We now know that Tobii will be the company responsible for integrating the technology.
Computing

Oculus’ Quest is the headset that will make me (and you) a VR believer

Without excessive wires or complicated setup, and a price point that makes sense for tech that just isn't there yet, Oculus' upcoming standalone headset, the Quest, could bring VR mainstream.
Gaming

Dive headfirst into the best experiences available now on the Oculus Rift

The Oculus Rift brought back virtual reality and put a modern twist to it. Grab your Touch Controllers, put on your VR headset, and jump into the fun with some of the best Oculus Rift games available now.
Gaming

The best VR headsets at CES 2019 could bring the technology to the mainstream

While there weren't a ton of new VR headset on display at CES 2019, the ones we saw led us to believe that VR could have a real moment soon, both from a gaming and business standpoint.
Gaming

These are the coolest virtual and augmented reality gadgets from CES 2019

CES 2019 had plenty of VR and AR gadgets on display, including headsets that completely change how you experience virtual reality, and some that don't even require a PC or a phone to run.
Gaming

These shoes let me stroll through ‘Skyrim,’ and I desperately want to go back

After being funded in just two hours on Kickstarter back in October 2018, Cybershoes has earned itself a place among the coolest VR walking and running tech. At CES 2019, we got to try them out and they live up to the hype.
Gaming

The Teslasuit could turn Black Mirror’s terrifying ‘Playtest’ into a reality

We spoke with Teslasuit co-founder Dimitri Mikhalchuk about VR gaming at CES 2019. With all its features, the future of the Teslasuit and virtual reality look bright. And it also sounds a bit like a Black Mirror episode.