Skip to main content

Lego partners with Apple to add augmented component to physical playsets

iPad Lego AR game
Image used with permission by copyright holder

Lego already gives creative builders the chance to physically make something only limited by their own imagination, but now your playsets are going to look a whole lot cooler with the addition of Apple’s ARKit 2.0 technology. Lego has created a new augmented reality experience that supplements your physical Lego kits with virtual buildings, people, foliage, and vehicles.

During Apple’s WWDC 2018 presentation, Martin Sanders, Lego’s director of innovation, took the stage to show off how ARKit 2.0 can be used with physical Lego sets to create something even more impressive in augmented reality. With the help of Apple ARKit 2.0, Lego has created a new augmented reality experience that supplements your physical Lego kits with virtual buildings, people, foliage, and vehicles.

With the “Assembly Square” playset placed on a table in front of him, Sanders aimed at it with an iPad and, with the press of a button, created an entire town around the physical building on his screen. Other shops, sidewalks, and grass appeared, nearly indistinguishable from the physical set.

It’s made possible through the 3D object detection in the ARKit 2.0, which allows users to add additional foliage, buildings, people, or cars. Small icons visible above certain people and objects in the world even allow you to take part in missions. These can include situations that require urgent action, such as a building catching fire (with a firetruck, you can put out the inferno). During the WWDC stage demonstration, Sanders also rescued multiple trapped citizens from the roof of a building using a helicopter.

If you approach one of the buildings with your camera and attempt to peer inside, you’ll find the buildings bustling with activity. With a quick tap, you can even peel back the outside walls of multiple buildings to observe them like you would a dollhouse.

ARKit 2.0 allows up to four players to experience a Lego world at the same time, with the changes made by one player instantly visible on the others’ screens. When you’re done playing for the day, you can save all progress and tie it to your physical set, allowing you to start from the same point when you’re ready to play again.

“When we combine physical and digital together like this, it really opens up those creative play possibilities,” Sanders said.

Lego promises more AR experiences will be available in the App Store later this year. We’re crossing our fingers for something Harry Potter- or Star Wars-themed.

Editors' Recommendations

Gabe Gurwin
Former Digital Trends Contributor
Gabe Gurwin has been playing games since 1997, beginning with the N64 and the Super Nintendo. He began his journalism career…
When will Apple release iOS 18? Here’s what we know
An iPhone 14 laying face-down on a wood table.

Apple's annual Worldwide Developers Conference (WWDC) will start on Monday, June 10. During the conference keynote, the company is expected to unveil new software updates for its major products, including iOS 18 for iPhones.

iOS 18 is expected to be a major iPhone update, likely ushering in a new design and AI features. If you are wondering when you can get your hands on the latest software version, here's everything you need to know about iOS 18's release date.
When will the iOS 18 beta be released?

Read more
Everything you need to know about the massive Apple App Store outage
App Store on-screen illustration

Happy Wednesday evening, everyone! You're unwinding for the day, getting ready for a relaxing night, and ... you realize that the App Store and a bunch of other Apple services aren't working. Don't worry, you aren't alone.

What Apple services are down? When did the problems start? Is the outage still ongoing? Here's everything you need to know.
When did the App Store outage start?
According to DownDetector, reports of outages with the App Store flooded in a little after 6 p.m. ET. Reports appear to have spiked at over 6,000, indicating pretty widespread problems.

Read more
The 7 biggest features we expect to see in iOS 18
The home screen on the Apple iPhone 15 Plus.

Apple revealed that its Worldwide Developers Conference (WWDC) will take place on June 10. This is when we expect to see the next iteration of software across all of Apple’s products, including iOS 18.

From the sounds of it, we’re in for a big update with iOS 18, rumored to be one of the “biggest updates” yet. Here’s what we expect from Apple's next major iPhone update with iOS 18.
A more customizable home screen

Read more