Skip to main content

Lego partners with Apple to add augmented component to physical playsets

iPad Lego AR game
Image used with permission by copyright holder

Lego already gives creative builders the chance to physically make something only limited by their own imagination, but now your playsets are going to look a whole lot cooler with the addition of Apple’s ARKit 2.0 technology. Lego has created a new augmented reality experience that supplements your physical Lego kits with virtual buildings, people, foliage, and vehicles.

During Apple’s WWDC 2018 presentation, Martin Sanders, Lego’s director of innovation, took the stage to show off how ARKit 2.0 can be used with physical Lego sets to create something even more impressive in augmented reality. With the help of Apple ARKit 2.0, Lego has created a new augmented reality experience that supplements your physical Lego kits with virtual buildings, people, foliage, and vehicles.

With the “Assembly Square” playset placed on a table in front of him, Sanders aimed at it with an iPad and, with the press of a button, created an entire town around the physical building on his screen. Other shops, sidewalks, and grass appeared, nearly indistinguishable from the physical set.

It’s made possible through the 3D object detection in the ARKit 2.0, which allows users to add additional foliage, buildings, people, or cars. Small icons visible above certain people and objects in the world even allow you to take part in missions. These can include situations that require urgent action, such as a building catching fire (with a firetruck, you can put out the inferno). During the WWDC stage demonstration, Sanders also rescued multiple trapped citizens from the roof of a building using a helicopter.

If you approach one of the buildings with your camera and attempt to peer inside, you’ll find the buildings bustling with activity. With a quick tap, you can even peel back the outside walls of multiple buildings to observe them like you would a dollhouse.

ARKit 2.0 allows up to four players to experience a Lego world at the same time, with the changes made by one player instantly visible on the others’ screens. When you’re done playing for the day, you can save all progress and tie it to your physical set, allowing you to start from the same point when you’re ready to play again.

“When we combine physical and digital together like this, it really opens up those creative play possibilities,” Sanders said.

Lego promises more AR experiences will be available in the App Store later this year. We’re crossing our fingers for something Harry Potter- or Star Wars-themed.

Editors' Recommendations

Gabe Gurwin
Former Digital Trends Contributor
Gabe Gurwin has been playing games since 1997, beginning with the N64 and the Super Nintendo. He began his journalism career…
We now know when Apple is adding RCS to the iPhone
The iPhone 14 Plus held in a man's hand.

Last November, Apple made a surprise announcement when it confirmed that RCS was coming to the iPhone in 2024. It's something iPhone and Android phone users alike have been waiting years for, but there was just one small problem: Apple never said when in 2024 RCS was coming. Thanks to Google, of all companies, we now have a better idea of when RCS is heading to the iPhone.

As spotted by 9to5Google, the Android website was recently updated with a new page dedicated to Google Messages. If you click on the "See more features" button for the section talking about RCS, there's a section titled "Better messaging for all" with the following text: "Apple has announced it will be adopting RCS in the fall of 2024. Once that happens, it will mean a better messaging experience for everyone."

Read more
Apple just announced the dates for WWDC 2024
WWDC 2024 banner.

Apple has just announced the dates for its Worldwide Developers Conference (WWDC) 2024. WWDC will take place from June 10 through June 14, 2024. A special event will be held at Apple Park in Cupertino, California, on June 10, and we expect to see the reveal of iOS 18, iPadOS 18, watchOS 11, tvOS 18, macOS 15, and visionOS 2.

WWDC will be free for all developers online. Developers will be able to access a variety of online sessions and labs that will showcase the latest advancements in software across all of Apple’s hardware.

Read more
iOS 18 could add a customization feature I’ve waited years for
iOS 17 interactive widgets on an iPhone 15 Pro Max.

iOS 18 is coming later this year, and all signs point to it being a dramatic iPhone update. Now, thanks to one new report, it looks like iOS 18 could add a customization feature I've been waiting years and years and years for: better home screen customization.

According to Bloomberg's Mark Gurman, iOS 18 will introduce a "more customizable" home screen. More specifically, iOS 18 will allow you to place app icons and widgets anywhere you want. If you want a space or break between an app icon or your widget, welcome to the future: iOS 18 may finally let you do that. MacRumors corroborated this report with its own sources, too.

Read more