Skip to main content

Digital Trends may earn a commission when you buy through links on our site. Why trust us?

HoloLens concept lets you control your smart home via augmented reality

Hololens Hackathon Project: IoT x MR
There’s no doubt that device-filled connected smart homes are on the way. The real question is how we’re going to control them.

That was the starting point of a nifty proof-of-concept project created by interaction designer Ian Sterling and software engineer Swaroop Pal during a recent HoloLens hackathon in San Francisco. Their augmented reality pitch shows how smart devices could be controlled with glances and gestures — in what Sterling calls a “virtual Zen mode,” complete with calming lights and sounds.

“The primary goal of the app is to provide a 3D spatial UI for cross-platform devices — Android Music Player app and Arduino-controlled Fan and Light — and to interact with them using gaze and gesture control,” Ian Sterling, a design student at California College of the Arts, told Digital Trends.

“The connectivity between Arduino and a mixed reality device is something which holds a huge amount of creative opportunity for developers to create some very exciting applications — be it [Internet of Things], robotics, or other sensor data visualization. Besides this, our app features some fun ways to connect devices. Our demo featured a connection between a music player and a light in order to set a certain mood in your home.”

While the so-called IoTxMR concept is just a demo, Sterling thinks it signals the way our interactions with smart devices need to go. “I feel that in order for smart devices to be less obtrusive, while at the same time becoming more robust in functionality, new forms of interaction will be a requirement,” he continues. “Whether this is with a simple app on your phone, or using mixed reality software on your phone or wearable device — such as HoloLens or Magic Leap — we will be interfacing with our smart home devices through a separate piece of smart technology.”

Hey, if it means we get to feel like Neo from The Matrix, by controlling our devices with the simple wave of a hand, courtesy of Sterling and Pal’s “visually serene and relaxing” Zen mode, consider us sold.

Editors' Recommendations

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
How to save money with your smart home this winter
The Google Nest Learning Thermostat in stainless steel.

Keeping your home warm and cozy during the winter is a challenge. Homes equipped with a fireplace benefit from a frugal heating option -- though there's no doubt they can be messy and time-consuming to clean. You can also ramp up your furnace, but that's a quick way to spend a fortune on your heating bill.

Instead, consider using smart home gadgets to save money and keep your house at a nice temperature until spring rolls around. If you need some help getting started, here are a few smart home gadgets that can help you make it through the cold, dark winter.
Invest in smart blinds

Read more
Here’s how to throw a killer Halloween party with your smart home
spooky halloween lighting haunted house

The spooky season is almost here, and if you’re worried about throwing the perfect Halloween party, consider using your smart home to do the heavy lifting. Common smart home gadgets such as motion sensors, light bulbs, and smart plugs make it easy to pull off a horrifying Halloween party for your guests. From assisting with your playlist and movie selections to creating a chilling ambiance, here’s a look at all the ways your smart home can help you throw a killer Halloween party.
Use motion sensors to trigger spooky sounds
Have a smart home security system? Then you can probably rig up your motion sensors to play a spooky noise. It doesn't necessarily have to be a motion sensor, either -- your smart camera can trigger other devices in your smart home when it detects motion.

Just place a speaker on your porch, perhaps tucked away behind a pumpkin or a bit of straw. When a group of unsuspecting kids shows up to ask for candy, they set off the motion sensor on the camera, which triggers the speaker to play the sound of a zombie's moan or the cackle of a witch. Bonus points if you set up an animatronic hand to rise up out of the straw.

Read more
Why moving your smart home could be a nightmare
Philips Hue Appear Outdoor smart light.

The smart home concept is a great thing. It allows us to automate things from lighting to temperature, make video calls while we prepare dinner, and get answers to questions instantly. In its current state, it has one fatal flaw, however: The smart home is not really meant to move.

In fact, you might want to leave behind the majority of your smart home gadgets when selling your property.
What to know about moving smart home gadgets
Think about it: Some of us have literally dozens of devices including lights, thermostats, robot vacuums, speakers, security cameras, wireless alarm systems, and more. How would you go about removing, relocating, and reconnecting all those devices to Wi-Fi in a new house if you ever need to move? On the surface, it sounds daunting.

Read more