Project Tango can remember where it's been, making AR work even when your device is distracted

Project Tango
If you’re not familiar with Google’s Project Tango, it’s an image recognition platform, to put it simply. Using a special 3D camera, a Tango equipped device “looks” at the world around it, and uses that information to map a space, add in augmented reality objects, or simply track the location of a mobile device.

It has a wide variety of uses, even in its developer-oriented form, but there are some issues. For one, even the precision accelerometers and gyroscopes in mobile phones tend to have a margin of error, especially with vigorous movement. Add to that the way lighting changes, and user movement, and you might notice some drift or enlarging of objects that are supposed to stay still. Which brings us to the topic of today’s Google I/O talk by Tango team leader Wim Meeussen.

Learning its way around

The solution to object drift is area learning. Instead of constantly looking at its surroundings and calculating a new position, area learning allows a Tango device to recognize its surroundings. By building a memory of the world around it, the Tango device can recognize those spaces, and properly fit objects back into them.

Several demos served to illustrate how well this worked. A simple app, lacking area learning, placed a virtual box on a flat surface. After turning away from the podium and shaking the Tango powered device, the box began to slide around. Eventually, it disappeared, as the device entirely lost track of where the box should be.

Turning on area learning produced entirely different results. Not only did the box stay as the device shook and looked away, but even covering the camera for several seconds didn’t affect its positioning. Granted, it sometimes took a few seconds to re-identify the space around it, but once it did, the box popped right back up.

Memory makes for better multiplayer

Area learning really opens up the possibilities of VR and AR gaming with multiple users. Google says the Tango area learning code is easy to implement (capturing a location memory takes one line of code), and sharing it with other devices even easier (also just one line of code.)

For a multiplayer game, one device can capture a location memory of the space, and then export that location memory to other devices in the area. Working from the same model of the room, the devices are able to keep even better track of each other and their surroundings.

The results speak for themselves. In a video demo two users handed back and forth a Tango enabled tablet, with their heads and the device mirrored perfectly in a virtual rendering of the space. All of this takes place without establishing any infrastructure in the area, and with minimal code alterations.

What’s next?

If the results of area learning are any indication, Tango is coming along quite nicely. Object permanence, navigation, and multiplayer components are all a big part of the equation, and they must not be far from production. In fact, Meeussen made sure to remind everyone that Lenovo would be releasing a Tango-equipped device targeted at consumers later this year.

For now, eager AR users will either need to learn to develop, or wait patiently for the first device with Google’s powerful new technology.


Bringing realism to VR is complex, but these developers found a way in holograms

Making virtual reality feel real is the hardest job of all VR developers. For Awake: Episode One, StartVR used volumetric recording, rather than motion capture, to bring its characters to life like never before.

The Division 2 offers nothing but a funhouse mirror of America

Tom Clancy's The Division 2 improves on the design shortcomings of the original game in several different ways, but its version of Washington D.C. is completely removed from reality.
Product Review

The Ferrari Portofino is the super stallion you’ll want to drive every day

With the introduction of the Portofino, Ferrari addresses the California T’s stylistic shortcomings while improving comfort, convenience, and performance. There’s little “entry-level” about this super stallion.
Product Review

The Division 2 brings the most fun we've ever had to Washington, D.C.

After 55 hours with The Division 2, it’s clear that Ubisoft has improved on the original in almost every way. The world is richly detailed, the story missions are wonderful, gunplay and enemy design are great, and the endgame content is…

The best Apple AirPods alternatives for Android, Windows, and iOS devices

Apple AirPods might be new and improved, but they aren't the only game in town. Other makers are offering their own truly wireless earbuds, with attractive features. These are the best AirPod alternatives on the market today.

Samsung files a VR patent featuring a curved OLED display

Doubling down on its emphasis on curved displays, Samsung recently filed a design patent for a new virtual reality headset that could feature a curved OLED display, which would be an interesting development in VR.

HP’s high-resolution VR headset provides comfort and Windows Mixed Reality

HP's new VR headset reportedly offers an exceptionally high resolution, highlights comfort and runs on Windows Mixed Reality. HP hasn't officially announced the new headset, but here's a look at some of its features.
Virtual Reality

Think virtual reality is just for games? These awesome apps will change your mind

Virtual reality isn't all about gaming. Swim with turtles, paint in 3D, and immerse yourself in some unique experiences the platform has to offer with our curated list of the best VR apps.
Virtual Reality

Getting into VR is spendy. Which headset is truly worth your hard-earned cash?

Virtual reality has finally gone mainstream, but how do you find the best VR headset for you? Check out a few of our favorites, whether you want the best of the best or a budget alternative for your mobile device.
Virtual Reality

HTC Vive Focus Plus makes it easier for developers to port PC content

HTC Vive has announced the Vive Focus Plus headset. The upgraded stand-alone headset makes use of "six degrees of freedom" support in controllers for a PC-like virtual reality experience.

Here’s how to watch Microsoft’s HoloLens 2 press conference

It is widely believed that Microsoft's WMC conference will be the stage for the unveiling of the next generation of its HoloLens mixed reality headset. We have the live stream right here.

Microsoft unveils $3,500 HoloLens 2 at MWC 2019. Here’s what you need to know

The HoloLens 2 is ripe for an announcement. Here's what Microsoft has revealed so far, what's likely in store for the next generation HoloLens, and everything that we know about this mixed reality headset.

Nissan designers use HaptX VR gloves to shape future cars

New car designs usually start out as clay before becoming metal, but designers are now swapping clay for pixels. Nissan is using virtual reality gloves from HaptX that give designers a tactile feel of virtual models.

Apple’s AR Glasses could pair up with your iPhone in 2020

According to an investor note sent by reliable Apple analyst Ming-Chi Kuo, Apple's AR glasses will be mass manufactured starting in the fourth quarter of 2019, but not later than the second half of 2020.