Your next contractor may walk in wearing a Microsoft HoloLens

hololens collaboration augmented reality object theory cdm smith building mode 640x427 c
My first experience with the HoloLens was a trip to a water treatment plant.

Physically, I visited the Portland office of software developer Object Theory, surrounded by programmers and designers tapping away on the usual startup blend of MacBooks and PCs. But what I saw was the 3D model of a water treatment plant, projected on my eyes, and over my surroundings. I was in two places at once.

Augmented reality headsets like the HoloLens are hard to describe. The display is transparent, so I was aware of my real-world surroundings, yet still immersed in the 3D projection that was also, in a sense, surrounding me. I could walk around the treatment plant and see the walls. I could even interact with it, drawing in the air or adding notes.

It was a crude demo, without a lot of detail. But Object Theory hopes it will become a useful tool for construction projects. And at least one construction firm, CDM Smith, wants to put it to work. The company focuses on large-scale infrastructure projects, and is convinced that augmented reality will help improve collaboration and prevent mistakes.

Warning: Do not enter without HoloLens

Would you wear a HoloLens on a construction site? Scott Aldridge, leader of CDM Smith’s innovation group, has — and he told Digital Trends that it’s the future.

“Scott looked like an idiot when he was doing this,” joked David Neitz, Chief Information Officer at the company. Kidding aside, Neitz thinks headsets like the HoloLens could eventually become common at construction sites.

“It allows us to collaborate in a way we have not collaborated in the past.”

Aldridge agreed. The group has been experimenting with a variety of virtual reality headsets, from the Oculus Rift to the HTC Vive, in an attempt to imagine their use in designing and refining large-scale construction projects. But augmented reality, which overlays holograms over the real world, could turn out to be uniquely useful.

Aldridge and Neitz ran through the potential uses with me. They could overlay a 3D model of a project over the construction site itself, showing the crew where walls and equipment will be put later.

“Being able to put on a HoloLens and show it to the people who are building the wall, the concrete, the steel, to show them what it will look like before they build it is phenomenal,” said Aldridge.

Another scenario might help in judging whether heavy machinery will work well in a given room.

“You could create a hologram of the large piece of equipment and make sure all the bolt holes line up before you pay for a crane to bring it in,” said Aldridge. “You’d be able to place it wherever it’s going to be put.”

Blueprints are flat, but structures are 3D

Ideas like these see the HoloLens as a practical tool, a sort of hologram-assisted tape measure. And they came up more than once. But what got the team really interested is the potential for collaboration, for speeding up conversations.

Structures are decidedly three dimensional, but for the most part they’re planned out on flat screens, and more commonly flat pieces of paper. According to Neitz, that makes communicating simple ideas complicated.


“We have this challenge with errors, omissions, and change orders, ineffective collaboration that’s occurring between different groups,” said Nietz. “Take a 3D model. It very often becomes a 2D print that loses some of the richness of the data that we’re dealing with.”

The software Object Theory is working on, and CDM Smith hopes to use, attempts to enable better conversations by making sure everyone is looking at the same thing.

“When we started demonstrating it to engineers in the office they were blown away by the potential of it,” said Aldridge. “They see the value of reducing errors and omissions and not having to re-work jobs.”

Hololens helps, because you can’t resize a room

Back in the Object Theory office, I was shown a hologram of a room with a pump in it. But there’s a problem. It was the wrong pump, and the correct one was bigger than the room itself. A wall needed to be moved to make room for the new pump, but moving the wall meant it would overlap with a door in the adjacent room. That door needed to be moved as well, which meant we’d need to re-think the layout of that entire room.

“We want to let people build models as a hologram.”

And so on. Trying to explain it in words is convoluted, which is why so many engineer reports don’t make for a riveting read. But in Object Theory’s demo, the wall was moved to accommodate the bigger pump in just a few moments, followed by the door. I saw what needed to be done, quickly.

“We want to let people build models as a hologram, give them the ability to manipulate the model, let them see different scenarios and solve them right there,” said Aldridge.

The demo is just a starting point. The focus here is collaboration, for the architects, engineers, and on-the-ground crew discussing a potential problem to all be looking at a 3D model together and quickly create solutions.

“It allows us to collaborate in a way we have not collaborated in the past,” said Neitz. “Teams can visualize the environment they’re looking at. It’s pretty powerful.”

Your coworker, the avatar

Wearing the HoloLens, I didn’t just see the water treatment plant. I also saw a yellow avatar representing Michael Hoffman, co-founder of Object Theory. When he moved his head, the head of the avatar moved, and when he walked around I could see his avatar moving as well. A line showed me where he his looking.

“The avatars are there because we’re used to talking with humans, not pointers and indicators,” Hoffman told me. “It makes it a much more natural interaction.”

While he spoke about the model, I could tell what Hoffman was looking at because of his avatar. not only because of his head movement, but also thanks to a line that showed me his field of vision. It’s not a complex avatar, but it gets the job done.

Changing the way collaboration happens

A startup veteran, Hoffman has also worked for big companies including Nike and Google. He most recently worked at Microsoft, as part of the HoloLens team.

He’s a true believer in the platform.

“This is a revolution,” he told me. “Microsoft is really knocking this out of the park, I totally believe in what they’re doing, and I have this ability to be an early player as a startup guy in a revolution.”

Hoffman joined up with mobile design veteran Raven Zachary to found Object Theory. The company has been building CDM Smith’s prototype for seven months now. He had a revelation when he discovered how much time he could save with 3D models.

“The aha moment is how efficient it is to have a conversation about a 3D object and know exactly what everyone’s talking about,” said Hoffman.

The team hopes to grow quickly, and they’re particularly interested in convincing game developers to use their 3D modeling skill sets to build practical tools.

“We tend to find kindred spirits with people who really want to solve big problems,” Amy Hillman, Creative Director at Object Theory, told me. “We think of designs as tools more than entertainment, they’re really meaningful tools that we expect to profoundly change the professional landscape moving forward.”

Leaving a tiger on the table

My HoloLens demo started in a small room with a coffee table and a few chairs. Hoffman talked me through the tutorial, which outlines the gestures necessary to control the device. I threw a hologram of a tiger onto the table before leaving to play Project X-Ray out in the larger conference room.The game was fun, and involved aliens bursting out of the walls around me, but it’s not what blew me away.

No, what impressed me most happened when I returned to that small room: the tiger was still on the table, waiting for me. It’s hard to describe how it felt that I’d “left” that tiger there, in a tangible sense. I couldn’t see it through the walls while outside the room, but approaching the door I could make it out even from a distance. The door frame partially obscured the tiger, just like it would a real-world object, and the tiger grew bigger as I came closer. It was uncanny.

It sounds simple, even mundane, but it clicked for me. I felt the potential, even as I struggled with the HoloLens’ gesture-based control scheme and small field of vision. It’s moments like these that have people so excited about augmented reality.

It’s not at all clear whether the sort of collaboration Object Theory is working on will ultimately prove itself useful. It’s not even clear to CDM Smith that the HoloLens will ultimately be the device they end up using most: the company is currently researching several devices, including the Oculus Rift and the HTC Vive. But whatever happens, virtual reality and augmented reality have the potential to change things well beyond gaming.

CDM Smith, meanwhile, is looking to make an even bigger leap.

“We think we’re going to become a digital company,” Neitz said.

A company that literally works with brick and motor wants to think of itself as digital. Maybe this is a revolution.

Emerging Tech

Here’s how Microsoft’s Hololens is helping NASA build the new Orion spacecraft

Lockheed Martin is turning to Microsoft’s mixed reality Hololens smartglasses to help build NASA's Orion spacecraft, which could one day help rocket astronauts as far afield as Mars.

Amy Winehouse is coming back as a ‘hologram’ for a 2019 world tour

Amy Winehouse is set for a holographic return to the stage in 2019 in a global tour featuring her greatest hits, though how fans of the late singer feel about the "comeback" is another question entirely.
Movies & TV

The best movies on Netflix in October, from 'The Witch’ to ‘Black Panther’

Save yourself from hours wasted scrolling through Netflix's massive library by checking out our picks for the streamer's best movies available right now, whether you're into explosive action, subdued humor, or anything in between.
Emerging Tech

With VR dinosaurs and ‘Minecraft,’ one hospital is making medicine less scary

From augmented reality rabbits on the wards to a Minecraft recreation of the hospital for kids to explore, one of the world's most renowned children's hospitals just got a major tech overhaul.

The $400 Oculus Quest brings more power to untethered VR gaming

Oculus announced its latest stand-alone virtual reality headset, the Oculus Quest, at its Connect 5 keynote. The new Quest headset is intended to deliver a more immersive VR experience without the need for a powerful PC.

The Facebook Red Manifold shows what 360 content from 16 8K lenses looks like

Hollywood videos will now get the same movement seen in VR video games. The Facebook Red Manifold is a 6DoF camera that uses 16 8K sensors from Red to capture 3D video with enough data to move in. So what's 6DoF cinema look like?
Product Review

With the cord-free Quest, Oculus finally makes high-quality VR easy

Oculus announced that its Project Santa Cruz virtual reality headset will ship next year as the Oculus Quest, and we got to try out several new game titles on the Quest. Find out our impressions of VR without wires.

The best HTC Vive games available today

So you’re considering an HTC Vive, but don't know which games to get? Our list of 25 of the best HTC Vive games will help you out, whether you're into rhythm-based gaming, interstellar dogfights, or something else entirely.

Cyber Monday 2018: When it takes place and where to find the best deals

Cyber Monday is still a ways off, but it's never too early to start planning ahead. With so many different deals to choose from during one of the biggest shopping holidays of the year, going in with a little know-how makes all the…
Virtual Reality

The Oculus Quest’s competitor isn’t Rift or Vive. It’s the Nintendo Switch

While Oculus is optimistic that its standalone Quest VR headset will deliver a quality experience, the headset was designed on a mobile chipset. That means its less of a Rift replacement and more like the VR equivalent of Nintendo’s…
Virtual Reality

The Oculus Quest and Go both let you play without a PC, but which is better?

The mid-range of virtual reality hardware is by far the most competitive, with Oculus VR now offering two excellent products to those with more limited budgets. We pitted the Oculus Quest vs. Oculus Go, to see which is best.

The Oculus Quest is the new kid on the block, but can it beat the Rift?

The Oculus Rift has been available for two year, and the Oculus Quest will be available near the start of the next, but which one is best for you? That depends on the power of your gaming PC.

Still confused about how the Oculus Quest works? Here's the scoop

Oculus' Quest looks to offer PC-quality VR without the need for a PC. From revamped Oculus Touch controls to its sleek design, here's everything we know about the next-gen headset.

From horror to first-person shooters, these are the best games in VR

Whether you own a PlayStation VR, and Oculus Rift, or an HTC Vive, you have a ton of different choices when it comes to games. These are 15 of the best virtual reality games available right now.