Skip to main content

Lego partners with Apple to add augmented component to physical playsets

Promotional logo for WWDC 2023.
This story is part of our complete Apple WWDC coverage

iPad Lego AR game
Image used with permission by copyright holder

Lego already gives creative builders the chance to physically make something only limited by their own imagination, but now your playsets are going to look a whole lot cooler with the addition of Apple’s ARKit 2.0 technology. Lego has created a new augmented reality experience that supplements your physical Lego kits with virtual buildings, people, foliage, and vehicles.

Recommended Videos

During Apple’s WWDC 2018 presentation, Martin Sanders, Lego’s director of innovation, took the stage to show off how ARKit 2.0 can be used with physical Lego sets to create something even more impressive in augmented reality. With the help of Apple ARKit 2.0, Lego has created a new augmented reality experience that supplements your physical Lego kits with virtual buildings, people, foliage, and vehicles.

With the “Assembly Square” playset placed on a table in front of him, Sanders aimed at it with an iPad and, with the press of a button, created an entire town around the physical building on his screen. Other shops, sidewalks, and grass appeared, nearly indistinguishable from the physical set.

It’s made possible through the 3D object detection in the ARKit 2.0, which allows users to add additional foliage, buildings, people, or cars. Small icons visible above certain people and objects in the world even allow you to take part in missions. These can include situations that require urgent action, such as a building catching fire (with a firetruck, you can put out the inferno). During the WWDC stage demonstration, Sanders also rescued multiple trapped citizens from the roof of a building using a helicopter.

If you approach one of the buildings with your camera and attempt to peer inside, you’ll find the buildings bustling with activity. With a quick tap, you can even peel back the outside walls of multiple buildings to observe them like you would a dollhouse.

ARKit 2.0 allows up to four players to experience a Lego world at the same time, with the changes made by one player instantly visible on the others’ screens. When you’re done playing for the day, you can save all progress and tie it to your physical set, allowing you to start from the same point when you’re ready to play again.

“When we combine physical and digital together like this, it really opens up those creative play possibilities,” Sanders said.

Lego promises more AR experiences will be available in the App Store later this year. We’re crossing our fingers for something Harry Potter- or Star Wars-themed.

Gabe Gurwin
Former Digital Trends Contributor
Gabe Gurwin has been playing games since 1997, beginning with the N64 and the Super Nintendo. He began his journalism career…
The iPad doesn’t need AI, but Apple must fix something else
Top view of the rear shell on the 11th Gen iPad.

I just finished testing the new entry-level iPad, and so far, I am fairly impressed by the tablet. You can’t get a better value than this slate for $349. From the external hardware to the innards, there is hardly any alternative from the Android side that can deliver a superior experience.
This year, Apple delivered a couple of surprises, in addition to the expected chip upgrade. You now get twice the storage for the same ask, and the RAM has also been bumped up. In a nutshell, it’s faster, better at multi-tasking, and without any storage headaches, even if your budget is tight.
Apple, however, hasn’t fixed the software situation with iPadOS, which continues to bother with its fair share of quirks in tow. This year, however, the software gulf is even wider between the baseline iPad and every other tablet in Apple’s portfolio. Stage Manager has been the big differentiator so far, but in 2025, we have another deep chasm.

A good riddance with AI

Read more
iPadOS 19: everything you need to know
Control Center on the 11th Gen iPad.

We're expecting iPadOS 19, the next software version for iPad, to land during Apple's Worldwide Developers Conference (WWDC) this year. From what we've heard, it looks like it could be a significant update. Here's what we know so far about iPadOS 19 — we'll find out if these rumors are true in June.
When will iPadOS 19 be revealed?
Apple announced that this year's WWDC will run from June 9 to 13. That means iPadOS 19, codenamed "Luck," will likely be announced during the keynote event, held on June 9. The start time for this is yet to be confirmed, but last year it was at 10 a.m. PDT, so we can likely expect something similar this year.

Alongside iPadOS 19, we should also see iOS 19, watchOS 12, and macOS 16 — and there may even be some hardware announcements.
What do the rumors say?
We don't know as much about iPadOS 19 as we do iOS 19, but there are a few things we could expect.

Read more
WWDC 2025: everything you need to know
Apple WWDC 2025 logo

The Worldwide Developer Conference or WWDC is one of Apple's most vital annual events where software updates take the center stage. At WWDC 2025, Apple is expected to showcase changes to the iOS and macOS that will substantially improve how we interact with the iPhone, iPad, and the Mac. But that are not all the announcements, as Apple will also discuss improvements to all of its interface running on different categories of devices. Besides software, we might witness some hardware announcements too.

Here's everything you need to know about the potential announcements Apple is likely to make in June this year at WWDC 2025.
WWDC 2025: When will it happen?
WWDC typically takes place in the first half of June every year, though the dates change every year. Apple likes to kick off the event with a keynote on a Monday, and will continue the tradition this year.

Read more