Skip to main content

Lego partners with Apple to add augmented component to physical playsets

iPad Lego AR game
Image used with permission by copyright holder

Lego already gives creative builders the chance to physically make something only limited by their own imagination, but now your playsets are going to look a whole lot cooler with the addition of Apple’s ARKit 2.0 technology. Lego has created a new augmented reality experience that supplements your physical Lego kits with virtual buildings, people, foliage, and vehicles.

During Apple’s WWDC 2018 presentation, Martin Sanders, Lego’s director of innovation, took the stage to show off how ARKit 2.0 can be used with physical Lego sets to create something even more impressive in augmented reality. With the help of Apple ARKit 2.0, Lego has created a new augmented reality experience that supplements your physical Lego kits with virtual buildings, people, foliage, and vehicles.

With the “Assembly Square” playset placed on a table in front of him, Sanders aimed at it with an iPad and, with the press of a button, created an entire town around the physical building on his screen. Other shops, sidewalks, and grass appeared, nearly indistinguishable from the physical set.

It’s made possible through the 3D object detection in the ARKit 2.0, which allows users to add additional foliage, buildings, people, or cars. Small icons visible above certain people and objects in the world even allow you to take part in missions. These can include situations that require urgent action, such as a building catching fire (with a firetruck, you can put out the inferno). During the WWDC stage demonstration, Sanders also rescued multiple trapped citizens from the roof of a building using a helicopter.

If you approach one of the buildings with your camera and attempt to peer inside, you’ll find the buildings bustling with activity. With a quick tap, you can even peel back the outside walls of multiple buildings to observe them like you would a dollhouse.

ARKit 2.0 allows up to four players to experience a Lego world at the same time, with the changes made by one player instantly visible on the others’ screens. When you’re done playing for the day, you can save all progress and tie it to your physical set, allowing you to start from the same point when you’re ready to play again.

“When we combine physical and digital together like this, it really opens up those creative play possibilities,” Sanders said.

Lego promises more AR experiences will be available in the App Store later this year. We’re crossing our fingers for something Harry Potter- or Star Wars-themed.

Editors' Recommendations

Gabe Gurwin
Former Digital Trends Contributor
Gabe Gurwin has been playing games since 1997, beginning with the N64 and the Super Nintendo. He began his journalism career…
Apple just gave Mac gamers a big reason to be excited
Craig Ferguson introducing Mac Gaming at WWDC.

When Apple announced it would revolutionize the world of Mac gaming at its Worldwide Developers Conference (WWDC) in June, many people were skeptical. But the latest update to the company’s Game Porting Toolkit has made some important changes to how games run on the Mac -- and the results are impressive.

The toolkit allows developers to move their Windows games across to macOS Sonoma. Games makers can test out how well their products run on Apple’s hardware and find out what they need to do to make the jump, something that Apple says ends up “significantly reducing the total development time.”

Read more
17 hidden iOS 17 features that you need to know about
iOS 17 Preview on iPHone display.

Apple announced a slew of features coming to your iPhone with iOS 17. The most prominent ones include changes to the Phone, FaceTime, and Messages apps. You can now create beautiful contact cards, share contacts with gorgeous animations, create your own stickers, see practical information through StandBy when the iPhone is charging, and much more.

But that’s not all. Some of the most useful features come in the form of unannounced ones that can only be found when you actually use the latest version of the iPhone’s operating system — and that's exactly what I've done.

Read more
I hope Apple brings this Vision Pro feature to the iPhone
A concept of spatial FaceTime from Apple Vision Pro mixed reality headset running on iPhone.

Digitally crafted alternative realities can be exciting or discomforting, based on how you envision them. But Apple, among other companies invested in AR- and VR-dominant future, clearly wants you to focus on the bright side. That's why Apple spent a substantial chunk of time at its WWDC 2023 developer conference to highlight the various features of the Apple Vision Pro — Apple's extravagant new mixed reality headset.

As per Apple's surefooted narrative at the event, the Vision Pro delivers us into a new era in computing and pushes beyond the boundaries of fixed displays. The promotional walkthroughs easily convince us the headset is both visually and functionally unique in many ways.

Read more