Skip to main content

Niantic wants to make its augmented reality apps more realistic

Codename: Niantic Occlusion - Real World AR Occlusion featuring Pikachu and Eevee

Niantic — the company behind Pokémon Go and the upcoming Harry Potter: Wizards Unite — is on a mission to make augmented reality more realistic. To truly augment reality, computer systems need to be able to understand the real world a little more, and Niantic thinks the technology isn’t quite there yet.

That’s why it’s launching the Niantic Real World Platform, a program that aims to tackle today’s issues with AR on multiple levels. The platform’s launch comes as the company also announces the acquisition of Matrix Mill, a U.K.-based AR research and development firm developing neural networks that can infer information about the world using data from your smartphone’s camera.

The Niantic Real World Platform is first going to attempt to “model reality.” Niantic wants the platform to be able to adapt and change as the real world changes. In the real world, buildings are constructed, parks are formed, roads are closed, and cities expand — if there’s a significant delay in the platform adapting to those changes, it can affect game-play. The digital model of the world that Niantic has needs to be able to adapt almost in real-time, and it requires a combination of computer vision and machine learning.

Niantic also said its platform needs to be able to “understand reality,” meaning it needs to be able to see an object, recognize exactly what it is, and what the object’s place is in a broader environment. Computer vision is key here — Niantic is training its platform to accurately recognize objects based on data from a phone’s camera, and as time goes on, more and more objects will be added to the platforms “AR vocabulary.”

Recognizing objects is only one part of the puzzle, as systems need to learn where those objects are in a 3D space. Simply knowing that an object is a car doesn’t necessarily matter in the context of a game if that car is 50 feet away. That’s why Niantic is working on developing better depth maps, which can understand exactly how far away an object is at any given time. That can help digital elements better interact with the real world.

The platform will also try to cut down latency, which is when you experience delays in multiplayer games thanks to connectivity issues. Latency in multiplayer games can also affect game-play, and Niantic showed off a demo game called “Codename: Neon,” which involved people moving around an environment, collecting balls of light, and launching them at other players to get points. The interactions were smooth and seamless between all the players, and it was a testament to the progress Niantic has made to reduce latency in its platforms.

Codename: Neon - Real World Multiplayer AR Demo

Niantic is throwing a lot of resources into its AR tech, and it’s work that it won’t be keeping all to itself. The Real World Platform will be available to third-party developers in the future, and while more information will be available in the coming weeks, Niantic said it’s selecting a few developers to work with later this year. Hopefully, this means we’ll start seeing better-looking and better-performing AR games in the future.

Niantic’s CEO John Hanke said games like Pokémon Go “never have to end.” Hanke envisions continuously improving games that are such a huge part of people’s lives, that they pass them on to their children.

Editors' Recommendations

Christian de Looper
Christian’s interest in technology began as a child in Australia, when he stumbled upon a computer at a garage sale that he…
New report suggests Apple will launch augmented reality headset in 2020
lenovo mirage ar marvel dimension of heroes review superhero

Apple has been rumored to be working on an augmented reality (AR) headset for some time, and now fresh rumors suggest that the company could launch the headset relatively soon. According to a new report from Bloomberg that cites well-known analyst Ming-Chi Kuo, Apple is targeting a 2020 release for the new device.

The report also sheds some light on what the headset might be capable of. According to the report, the headset will sync with your iPhone to deliver messages, mapping data, and even games straight to your eyes. Apple may also implement a dedicated App Store for the device, similar to the Apple Watch App Store that was launched this year as part of WatchOS 6.

Read more
IKEA’s augmented reality app just got a whole lot more clever
ikeas augmented reality app just got a whole lot cleverer ikea place

When you step inside an IKEA store, you do so in the full knowledge that it might be half a day -- perhaps longer -- before you'll be reemerging into the daylight. And when you do finally make it to the exit, it’s likely to be with a wallet far lighter than when you arrived. That’s just the way it goes with IKEA.

When your purchases get delivered, the final step is to discover whether they actually fit the rooms they were intended for. While most of your judgments may be on the mark, there’ll always be a couch that looks out of place or a dining table that doesn’t quite fit. And situations like that can cause all kinds of hassle.

Read more
Apple patent provides more details about rumored augmented reality headset
apple file system

Apple has long been rumored to be working on an augmented reality headset, and a newly published Apple patent may give us a better look at what that headset could end up looking like.

The patent was filed by Apple in March, and gives details about the tech that may power the headset. In fact, according to the patent, instead of using a display to show off information, the glasses may make use of a "reflective holographic combiner" to display an image. In other words, the headset will reflect an image off the lens of the glasses, working kind of like a projector.

Read more