Skip to main content

Lego partners with Apple to add augmented component to physical playsets

iPad Lego AR game
Image used with permission by copyright holder

Lego already gives creative builders the chance to physically make something only limited by their own imagination, but now your playsets are going to look a whole lot cooler with the addition of Apple’s ARKit 2.0 technology. Lego has created a new augmented reality experience that supplements your physical Lego kits with virtual buildings, people, foliage, and vehicles.

During Apple’s WWDC 2018 presentation, Martin Sanders, Lego’s director of innovation, took the stage to show off how ARKit 2.0 can be used with physical Lego sets to create something even more impressive in augmented reality. With the help of Apple ARKit 2.0, Lego has created a new augmented reality experience that supplements your physical Lego kits with virtual buildings, people, foliage, and vehicles.

With the “Assembly Square” playset placed on a table in front of him, Sanders aimed at it with an iPad and, with the press of a button, created an entire town around the physical building on his screen. Other shops, sidewalks, and grass appeared, nearly indistinguishable from the physical set.

It’s made possible through the 3D object detection in the ARKit 2.0, which allows users to add additional foliage, buildings, people, or cars. Small icons visible above certain people and objects in the world even allow you to take part in missions. These can include situations that require urgent action, such as a building catching fire (with a firetruck, you can put out the inferno). During the WWDC stage demonstration, Sanders also rescued multiple trapped citizens from the roof of a building using a helicopter.

If you approach one of the buildings with your camera and attempt to peer inside, you’ll find the buildings bustling with activity. With a quick tap, you can even peel back the outside walls of multiple buildings to observe them like you would a dollhouse.

ARKit 2.0 allows up to four players to experience a Lego world at the same time, with the changes made by one player instantly visible on the others’ screens. When you’re done playing for the day, you can save all progress and tie it to your physical set, allowing you to start from the same point when you’re ready to play again.

“When we combine physical and digital together like this, it really opens up those creative play possibilities,” Sanders said.

Lego promises more AR experiences will be available in the App Store later this year. We’re crossing our fingers for something Harry Potter- or Star Wars-themed.

Editors' Recommendations

Gabe Gurwin
Former Digital Trends Contributor
Gabe Gurwin has been playing games since 1997, beginning with the N64 and the Super Nintendo. He began his journalism career…
The 7 biggest features we expect to see in iOS 18
The home screen on the Apple iPhone 15 Plus.

Apple revealed that its Worldwide Developers Conference (WWDC) will take place on June 10. This is when we expect to see the next iteration of software across all of Apple’s products, including iOS 18.

From the sounds of it, we’re in for a big update with iOS 18, rumored to be one of the “biggest updates” yet. Here’s what we expect from Apple's next major iPhone update with iOS 18.
A more customizable home screen

Read more
This could be our first look at iOS 18’s huge redesign
An iPhone 14 Pro Max and iPhone 14 Pro standing upright on a desk.

While iOS 17 fell short on a visual overhaul, Apple is rumored to be working on an updated identity for its next iOS version. Previous reports have claimed that the upcoming iOS 18 will feature visionOS-like elements introduced on the Apple Vision Pro. A new report confirms this with a leaked image of the iOS 18 Camera app.

According to a report from MacRumors, the next version of the Camera app could feature visionOS-style design elements. It is based on an iPhone frame template that the publication received from an anonymous source who claimed to have received it from an iOS engineer. It is said to have been included as part of the Apple Design Resources for iOS 18.

Read more
10 reasons you should buy an iPhone in 2024
Purple iPhone 14 (left) and a green iPhone 15 in hand.

The iPhone 15 lineup — which includes the standard iPhone 15 and the iPhone 15 Pro — is the iPhone at its best. It's the latest series of iPhones available today and the default choice if you're buying a new iPhone in 2024.

But it’s not the only choice of iPhones you can purchase. In fact, Apple still sells the iPhone 14, iPhone 13, and the iPhone SE on its website. You could also find other iPhone models available – refurbished or new — from other retailers or carrier stores.

Read more