Project Tango can remember where it's been, making AR work even when your device is distracted

Project Tango
If you’re not familiar with Google’s Project Tango, it’s an image recognition platform, to put it simply. Using a special 3D camera, a Tango equipped device “looks” at the world around it, and uses that information to map a space, add in augmented reality objects, or simply track the location of a mobile device.

It has a wide variety of uses, even in its developer-oriented form, but there are some issues. For one, even the precision accelerometers and gyroscopes in mobile phones tend to have a margin of error, especially with vigorous movement. Add to that the way lighting changes, and user movement, and you might notice some drift or enlarging of objects that are supposed to stay still. Which brings us to the topic of today’s Google I/O talk by Tango team leader Wim Meeussen.

Learning its way around

The solution to object drift is area learning. Instead of constantly looking at its surroundings and calculating a new position, area learning allows a Tango device to recognize its surroundings. By building a memory of the world around it, the Tango device can recognize those spaces, and properly fit objects back into them.

Several demos served to illustrate how well this worked. A simple app, lacking area learning, placed a virtual box on a flat surface. After turning away from the podium and shaking the Tango powered device, the box began to slide around. Eventually, it disappeared, as the device entirely lost track of where the box should be.

Turning on area learning produced entirely different results. Not only did the box stay as the device shook and looked away, but even covering the camera for several seconds didn’t affect its positioning. Granted, it sometimes took a few seconds to re-identify the space around it, but once it did, the box popped right back up.

Memory makes for better multiplayer

Area learning really opens up the possibilities of VR and AR gaming with multiple users. Google says the Tango area learning code is easy to implement (capturing a location memory takes one line of code), and sharing it with other devices even easier (also just one line of code.)

For a multiplayer game, one device can capture a location memory of the space, and then export that location memory to other devices in the area. Working from the same model of the room, the devices are able to keep even better track of each other and their surroundings.

The results speak for themselves. In a video demo two users handed back and forth a Tango enabled tablet, with their heads and the device mirrored perfectly in a virtual rendering of the space. All of this takes place without establishing any infrastructure in the area, and with minimal code alterations.

What’s next?

If the results of area learning are any indication, Tango is coming along quite nicely. Object permanence, navigation, and multiplayer components are all a big part of the equation, and they must not be far from production. In fact, Meeussen made sure to remind everyone that Lenovo would be releasing a Tango-equipped device targeted at consumers later this year.

For now, eager AR users will either need to learn to develop, or wait patiently for the first device with Google’s powerful new technology.

Emerging Tech

What would it take to build a Matrix-level simulation of reality?

What would it take, technologically speaking, to build a real version of the Matrix? We definitely don't have the technical abilities to do that now, but we're rapidly approaching the point that we will. In this article, MIT computer…
Product Review

It's a shame the U.S. banned Huawei. The new Honor 20 Pro is a kick-ass phone

Where does Honor go after the Honor View 20, the best device it has ever made? The answer is the Honor 20 Pro, which takes what made the View 20 great, and then improves on it by adding more camera lenses and shrinking the size.
Gaming

The best iOS games you can play offline on your iPhone and iPad

Even though we're always glued to our phones, we don't always have access to Wi-Fi or have steady service. Whether you're on a flight, riding the bus, or sitting in a waiting room, you can always play these excellent iOS games.
Gaming

Your PlayStation 4 game library isn't complete without these games

Looking for the best PS4 games out there? Out of the massive crop of titles available, we selected the best you should buy. No matter what your genre of choice may be, there's something here for you.
Gaming

Valve Index VR headset costs $500, but the full bundle will set you back $1,000

Valve is stepping into the VR market with the high-end Index, and the company finally revealed the price and release date. The Index can be purchased individually or as part of a couple of bundles.
Computing

Oculus Rift S gets a release date, pre-orders are now available

Oculus plans to phase out its flagship Rift VR headset for its newly created Rift S. The Rift S made its debut at the 2019 Game Developers Conference and will be released in May.
Virtual Reality

Oculus Quest taunts some customers after arriving more than two weeks early

The Oculus Quest has arrived early for some customers. The standalone VR headset, which is not supposed to ship out until May 21, is taunting the people who now have it in their hands due to limitations with the Oculus mobile app.
Virtual Reality

Getting into VR is spendy. Which headset is truly worth your hard-earned cash?

Virtual reality has finally gone mainstream, but how do you find the best VR headset for you? Check out a few of our favorites, whether you want the best of the best or a budget alternative for your mobile device.
Gaming

Minecraft AR teased during Microsoft Build 2019, full reveal arrives on May 17

At the Vision Keynote during the first day of Microsoft Build 2019, we saw a short trailer of what looks to be Minecraft AR, an upcoming experience coming to mobile devices. Watch the video here and join us for the full reveal on May 17.
Photography

As AR heads to Google search, Lens learns to translate, add tips, and more

Google Lens can soon help you decide what to eat by scanning the menu, then calculate the tip with one look at the receipt. Translation options are also expanding for Lens, while augmented reality tools will be built into search results.
Mobile

Google’s ARCore is getting better at tracking moving images

Google has announced a series of updates to ARCore that should make the augmented reality experience a whole lot more fluid. For example, ARCore is getting better at tracking moving images through Augmented Images.
Mobile

Nike Fit aims to help you slip into your new sneakers more easily

Nike says a new augmented reality feature for its app should increase the chances of a snug fit for customers buying its shoes online, or even in-store. Nike Fit launches in the U.S. in July and the following month in Europe.
Computing

Dive headfirst into the best VR experiences available now on the Oculus Rift

The Oculus Rift brought back virtual reality and put a modern twist on it. Grab your Touch Controllers, put on your VR headset, and jump into the fun with some of the best Oculus Rift games available now.
Virtual Reality

Your first augmented reality work helmet might be made by Lenovo

A new augmented reality headset from Lenovo could challenge Microsoft's dominance in the commercial AR industry, with the ThinkReality A6 offering an AR experience akin to something between the first and second-generation Hololens headsets.