Skip to main content

Niantic wants to make its augmented reality apps more realistic

Codename: Niantic Occlusion - Real World AR Occlusion featuring Pikachu and Eevee

Niantic — the company behind Pokémon Go and the upcoming Harry Potter: Wizards Unite — is on a mission to make augmented reality more realistic. To truly augment reality, computer systems need to be able to understand the real world a little more, and Niantic thinks the technology isn’t quite there yet.

Recommended Videos

That’s why it’s launching the Niantic Real World Platform, a program that aims to tackle today’s issues with AR on multiple levels. The platform’s launch comes as the company also announces the acquisition of Matrix Mill, a U.K.-based AR research and development firm developing neural networks that can infer information about the world using data from your smartphone’s camera.

The Niantic Real World Platform is first going to attempt to “model reality.” Niantic wants the platform to be able to adapt and change as the real world changes. In the real world, buildings are constructed, parks are formed, roads are closed, and cities expand — if there’s a significant delay in the platform adapting to those changes, it can affect game-play. The digital model of the world that Niantic has needs to be able to adapt almost in real-time, and it requires a combination of computer vision and machine learning.

Niantic also said its platform needs to be able to “understand reality,” meaning it needs to be able to see an object, recognize exactly what it is, and what the object’s place is in a broader environment. Computer vision is key here — Niantic is training its platform to accurately recognize objects based on data from a phone’s camera, and as time goes on, more and more objects will be added to the platforms “AR vocabulary.”

Recognizing objects is only one part of the puzzle, as systems need to learn where those objects are in a 3D space. Simply knowing that an object is a car doesn’t necessarily matter in the context of a game if that car is 50 feet away. That’s why Niantic is working on developing better depth maps, which can understand exactly how far away an object is at any given time. That can help digital elements better interact with the real world.

The platform will also try to cut down latency, which is when you experience delays in multiplayer games thanks to connectivity issues. Latency in multiplayer games can also affect game-play, and Niantic showed off a demo game called “Codename: Neon,” which involved people moving around an environment, collecting balls of light, and launching them at other players to get points. The interactions were smooth and seamless between all the players, and it was a testament to the progress Niantic has made to reduce latency in its platforms.

Codename: Neon - Real World Multiplayer AR Demo

Niantic is throwing a lot of resources into its AR tech, and it’s work that it won’t be keeping all to itself. The Real World Platform will be available to third-party developers in the future, and while more information will be available in the coming weeks, Niantic said it’s selecting a few developers to work with later this year. Hopefully, this means we’ll start seeing better-looking and better-performing AR games in the future.

Niantic’s CEO John Hanke said games like Pokémon Go “never have to end.” Hanke envisions continuously improving games that are such a huge part of people’s lives, that they pass them on to their children.

Christian de Looper
Christian de Looper is a long-time freelance writer who has covered every facet of the consumer tech and electric vehicle…
Android 16 put a digital bodyguard on my phone and you must enable it
Advanced Protection in Android 16.

Over the past couple of years, Android’s focus on user safety and device security has been pretty evident. The company has leveraged AI to build features that listen to calls and read messages in real-time and alert users if they are at risk of getting scammed. 

Similar guardrails have also been put in place for web browsing in Chrome, and a whole bunch of lost device portion protocols have been baked into the OS' core. A few of them have remained exclusive to Google’s Pixel phones (and some Samsung devices) so far, but with the release of Android 16, these benefits are now being extended to the entire platform.

Read more
Nothing Phone 3 is the firm’s biggest swing at Apple and Samsung yet
Is this the shot-in-the-arm the smartphone market desperately needs?
A person holding the Nothing Phone 2, with the lights active.

The Nothing Phone 3 will officially be available in the US, as the company looks to take on the likes of the iPhone 16, Samsung Galaxy S25 and Google Pixel 9 with a handset Nothing founder and CEO, Carl Pei, calls its "first true flagship smartphone".

Those looking for an alternative smartphone option this year will be able to pick up the Phone 3 from Amazon and Nothing's own website, reports TechCrunch.

Read more
This one iPadOS 26 feature has me excited for the iPhone Fold
Semi-open state of a foldable iPhone concept

Samsung is set to launch the seventh generation of its Galaxy Z Fold book-style folding phone this Summer, but its biggest rival is yet to show its folding phone hand. Apple has long been expected to unveil an iPhone Fold, and the latest rumors suggest that it will launch next year.

I’ve used almost every folding phone released globally, with some exceptions for extremely obscure ones. While I've always been curious what an iPhone Fold would look like, I was fairly certain that Apple shouldn't build it, as I wasn’t sure they could deliver on one necessary feature.

Read more