Skip to main content

Digital Trends may earn a commission when you buy through links on our site. Why trust us?

HoloLens concept lets you control your smart home via augmented reality

Hololens Hackathon Project: IoT x MR
There’s no doubt that device-filled connected smart homes are on the way. The real question is how we’re going to control them.

That was the starting point of a nifty proof-of-concept project created by interaction designer Ian Sterling and software engineer Swaroop Pal during a recent HoloLens hackathon in San Francisco. Their augmented reality pitch shows how smart devices could be controlled with glances and gestures — in what Sterling calls a “virtual Zen mode,” complete with calming lights and sounds.

“The primary goal of the app is to provide a 3D spatial UI for cross-platform devices — Android Music Player app and Arduino-controlled Fan and Light — and to interact with them using gaze and gesture control,” Ian Sterling, a design student at California College of the Arts, told Digital Trends.

“The connectivity between Arduino and a mixed reality device is something which holds a huge amount of creative opportunity for developers to create some very exciting applications — be it [Internet of Things], robotics, or other sensor data visualization. Besides this, our app features some fun ways to connect devices. Our demo featured a connection between a music player and a light in order to set a certain mood in your home.”

While the so-called IoTxMR concept is just a demo, Sterling thinks it signals the way our interactions with smart devices need to go. “I feel that in order for smart devices to be less obtrusive, while at the same time becoming more robust in functionality, new forms of interaction will be a requirement,” he continues. “Whether this is with a simple app on your phone, or using mixed reality software on your phone or wearable device — such as HoloLens or Magic Leap — we will be interfacing with our smart home devices through a separate piece of smart technology.”

Hey, if it means we get to feel like Neo from The Matrix, by controlling our devices with the simple wave of a hand, courtesy of Sterling and Pal’s “visually serene and relaxing” Zen mode, consider us sold.

Editors' Recommendations

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
6 smart home devices that can save you hundreds per year
A stack of ten-dollar bills.

There's plenty of novelty in the smart home. Not long ago, casually telling a computer to tweak the lights or adjust the temperature was straight out of sci-fi. It's not all about flash, though. There are real efficiencies you can enjoy with a kitted-out home that translate into saved dollars and cents. With sensors all over the place and the ability to run automations on your home appliances, you can ensure you're never using more power than you absolutely need to.
Smart thermostats

Smart thermostats have been making their case for energy savings for years. By connecting to your phone, they can figure out if you're home and if the heating or cooling should be turned on. Features continue to vary by model, but you'll see some that will check in with utility providers and adjust your home's climate control to take advantage of cheaper rates when available.

Read more
Smart home tech for your office
temperature controlled ember mug deal best buy flash sale white charging

If you’re like most of us, you’ve increasingly spent time in your home office over the last few years and could benefit from adding more smart home tech to your space. Smart tech makes life a little easier and allows you to remove some steps and inconveniences from your routine. Not only that, but being able to issue voice commands or have lights and fans set up to activate when needed can improve your comfort and mood and even put a little change back in your wallet.

Add ambient lighting
Just because the downtown office has harsh fluorescents and bright white lighting doesn’t mean your awesome home office needs to be the same. It’s time to make your lighting funkier and less eye-strain-inducing.

Read more
Is your smart home child-safe?
Roborock S7 cleaning while kids and pets play.

Smart home devices excel at saving time and taking orders, as well as provide us with a lot more data about how our homes behave. But those capabilities are mostly focused on adults – what happens when you add kids to the mix? While some brands like to tout the ability to track or monitor your kids, it’s not always that simple.

Families quickly learn that their children can become masters at using smart home tech, but that doesn’t mean all home automation is safe for them. That’s especially true for toddlers who may not understand what smart homes can do yet.

Read more