Techies adore the HoloLens. Now Microsoft wants to win over grease monkeys

windows holographic idf 2016 microsoft hololens motorcycle

Imagine automotive students learning to take apart engines in virtual reality, or using an augmented reality headset to identify all the parts in an engine they’re actually working on. It sounds right out of Star Trek, right?

But Oregon Story Board, a Portland nonprofit that specializes in the “support of digital storytelling,” is working with Intel and Clackamas Community College to build exactly this system. Their tool of choice? Microsoft’s HoloLens. The device only just became available for preorder to developers, but the college hopes to have it integrated into an automotive repair class by September.

“The holodeck is not that far away, people,” Shelley Midthun, Director of Oregon Story Board, told Digital Trends.

And she means it. To Midthun, augmented reality will become part of everyday life sooner than most people suspect, and it’s worth figuring out how to ensure that technology helps as many people as possible.

“How can we take something as high-tech and exclusive as HoloLens, and put it in the hands of more people?”

Microsoft, certainly, hopes that Midthun is right. There’s a lot of hype building around the HoloLens, which uses a clear lens to augment the real world with 3D holograms. But while the tech is impressive, there’s plenty of questions to ask about this early technology. Mainly, what will it actually do?

“At the highest level, what interests Microsoft is working out what the HoloLens can be used for,” Tawny Schlieski, Chairman of the Oregon Story Board and Research Scientist at Intel, told Digital Trends.

With this in mind, Microsoft has announced five $100,000 grants, each accompanied by two highly sought after HoloLens Development Kits, to researchers around the country. Over 600 organizations applied with their ideas for the technology, and the Oregon Story Board team was one of only five winners.

One of the winning pitches? Use the HoloLens for hands-on education in the trades, specifically the automotive department at Clackamas Community College. Microsoft found the idea intriguing enough to let them give it a shot.

“The reason that Microsoft is interested is the hands on component,”  said Schlieski. “The ability to have feedback layered immediately over real objects.”

The grant is in hand, and the development kits are coming soon. Now the software needs to be built.

Bringing the future to the masses

If using a futuristic prototype in a community college automotive class sounds unique, that’s not an accident.

“It was extremely intentional,” said Midthun. “How can we take something as high-tech and exclusive as HoloLens, and put it in the hands of more people?”

Virtual reality, which uses a headset to fully immerse people in a simulated environment, is tied to gaming in the popular imagination. Augmented reality, which supplements the real world, is less widely known, and use cases haven’t been fully worked out yet. Google tried with Glass, which was initially marketed as a sort of lifestyle device. An early promotional video showed a user drifting from his apartment to coffee shops, without clear objectives.

The HoloLens isn’t aiming to be that sort of consumer device, a smartphone that happens to sit on your face. Instead, Microsoft is positioning the HoloLens as an immersive workstation, a device with specific work-driven purposes. Think more PC than iPhone.

Most of the proposed purposes have been far from the lives of average people, however.

“We’d seen videos of augmented reality being used at medical centers, and at NASA,” said Midthun. “We wanted to put this technology into the hands of community college students.”

A skeptical automotive professor

Rick Lockwood, a professor in Clackamas’ automotive department, admitted the idea sounds cool. But he isn’t sure how it will fit into the day-to-day educational workflow.

“The people that we train are hands-on people, they’ve got to get their hands on stuff,” Lockwood told Digital Trends. “Nothing is like getting under the hood of a car, there’s no better training than being on a car.”

A simulated engine, to him, doesn’t sound pratical for instruction — at least, not without some sort of assessment for putting things together properly.

“A really complex digital model can have tremendous fidelity in a way that a picture cannot.”

“They want to do a virtual assembly of an engine of some sort, and that would be just fine,” said Lockwood. “But what’s preventing the students from putting it together wrong, or missing a step?”

Any simulated engine, to Lockwood, needs consequences when things are put together incorrectly. But what if the engine isn’t simulated? What if the HoloLens could recognize, a real-world engine and point out what all the parts are using an AR overlay?

“That would be much more useful, for sure,” said Lockwood.

A series of complex design questions

Lockwood is helping to guide the design process.

“We’re working with the automotive department to find out what the best thing to do is,” Midthun said. “We’re not going to build something that the instructor finds useless. We’re going to explore where they think this augmented reality addition could provide additional instruction.”

But before the HoloLens can be used in class, someone has to build the software. That’s what a class in session right now is trying to do. Students from Clackamas, other nearby community colleges, and even a few area high schools, are learning the tools necessary for HoloLens development alongside a variety of industry professionals.

“People from the Indie game community allow us to access talent from the coding side of things, while people with film and animation backgrounds allow us to bring that content creation and creative to the table,” said Midthun.

Together the class will learn to design objects for HoloLens. 3D models will be created in Maya, then exported to the gaming engine Unity, then finally ported over to the HoloLens SDK. The current class is learning to use all these tools together, and an upcoming class will focus on building the engine-building tool for Clackamas’ automotive department.

Designing the future of education

“There’s a design school tradition of taking a class and working together on a single project,” said Schlieski. “Once we get the basics of using HoloLens, then the class works to collaborate to build a training curriculum in HoloLens for the automotive students.”

“Technology isn’t its own thing, technology runs through everything we do. AR and VR are going to be widespread.”

The real challenge will be one of design. How can this new tool best be put to work for practical education? The focus on engines provides a starting point, because 3D models of engines already exist.

“The nice thing about engines is we’re already looking at objects that exist as a fully realized CAD design,” said Schlieski. “It’s easier for the system to then map the things together.”

One idea would be for the cameras on the HoloLens to recognize objects, and possibly identify them for students.

“A really complex digital model can have tremendous fidelity in a way that a picture cannot,” said Schlieski. “Augmented realities that point out components, and offer step-by-step instruction, could prove invaluable to trade schools.”

The cameras on the HoloLens could also prove invaluable. Instructors might see through their students eyes, even from far away, allowing them to give realtime feedback during hands-on exercises.

“If you can share the same view as someone, they could see whether what you’re doing is what she asked you to do,” said Schlieski. “There are layers of fidelity.”

Education is changing. More classes are being taken online, which is giving more opportunities to people in rural areas without physical access to institutions. But remote classes aren’t great for hands-on learning and trades. Technology like the HoloLens could be big on this front, giving simulated environments for students to learn in, and also giving professors the means to offer hands-on instruction from afar.

“What tools can help make that remote learning experience more robust and more satisfying?” asked Schlieski.

Bringing economic diversity to the future of tech

Schlieksi hopes technology like the HoloLens can help make design more accessible, even to non-programmers.

“A lot of the optimism, and the desire for these other tools, is for something that’s a little more fluid. Less in machine code, more in human code,” said Schlieski.

Tools that allow creators to think visually, instead of in terms of code, could change the way games and other content is created. As this future takes shape, it’s important to think about design from multiple perspectives. To Midthun, working with a community college to supplement education in the trades is one part of a broader mission to bring more diversity — social and economic — to the conversations around futuristic technology.

“We’re trying to expand what has been a very elite, similar group of humans that design things for people like them,” said Midthun. “Technology isn’t its own thing, technology runs through everything we do. AR and VR are going to be widespread, so let’s make sure we’re creating a diverse pool of human beings creating the products and services for the very diverse group of human beings that we are on this planet.”

It will be months before the any automotive students at Clackamas puts on a headset. The devices themselves haven’t even shipped to the grant winners as of this writing. But in using an early prototype to supplement education in the trades, Microsoft’s grant could make its newest technology more inclusive.


With Q#, Microsoft is throwing programmers the keys to quantum

Quantum computers aren’t yet practical, but Microsoft has already developed a programming language for them. Q# works inside Visual Studio, just like most other languages, and could offer a gateway into the weird world of quantum physics.
Movies & TV

The best shows on Netflix in August, from ‘Dark Tourist’ to 'Disenchantment'

Looking for a new show to binge? Lucky for you, we've curated a list of the best shows on Netflix, whether you're a fan of outlandish anime, dramatic period pieces, or shows that leave you questioning what lies beyond.

Apple Car may make its debut in the middle of the next decade

Apple likely won't become a full-fledged manufacturer like General Motors or Ford, but the tech giant is diving into the auto industry pool. Here's everything we know about the company's automotive efforts.
Emerging Tech

‘Rogue medicine in a bathtub’: 4 experts on the vice and virtue of pharma hacking

A biohacker, pharmahacker, and two bioethicists walk into a bar. We ordered them a metaphorical round and had a chat about the risks and rewards of DIY medicine — from unsanctioned gene therapy to medication made on the kitchen counter.

PDF to JPG conversion is quick and easy using these simple methods

Converting file formats can be an absolute pain, but it doesn't have to be. We've put together a comprehensive guide on how to convert a PDF to JPG, no matter which operating system you're running.
Product Review

Recent production woes make the Eve V a worse buy than it once was

Our Eve V review looks at a crowdsourced detachable tablet that checks some boxes for its backers. Its delay in making it to the market holds it back in some areas, and Eve Technology is an unknown quantity.

Art-inspired face blurring can obscure identity without losing humanity

Researchers have developed an AI-generated anonymity system that “paints” over video frames, using inspiration from masters like Picasso and Van Gogh to reimagine a person’s appearance. The goal is to minimize outer resemblance but…

Here's how to convert an MP4 to an MP3 file with online and offline tools

Sometimes you just want the audio without the video. In this guide, we'll show you how to convert an MP4 to an MP3 using web-based software and dedicated programs for both Windows and MacOS.

Crypto-intrigued? Here's how to buy Bitcoin for the first time

Is it time to purchase your first Bitcoin investment? If you're ready to get involved in the cryptocurrency, we'll walk you through how to pick an exchange, how to choose the right wallet, and how to buy Bitcoin the safe way!
Product Review

Dell's classic 4K P2715Q monitor still holds up today

The Dell P2715Q might not be the most modern of 4K displays, but its IPS panel, extensive connectivity, and easily adjusted stand make it more than competitive with the newest crop of screens.

Style up your MacBook Air with one of these great cases or sleeves

Whether you’re looking for added protection or a stylish flourish, you’re in the right place for the best MacBook Air cases. We have form-hugging cases, luxurious covers and padded sleeves priced from $7 to $130. Happy shopping!

Nvidia ‘more than happy to help’ if Tesla’s self-driving chip doesn’t pan out

After Tesla CEO Elon Musk announced the intention to use an in-house Autopilot chip, Nvidia CEO Jensen Huang responded to an analyst's question, saying that if the Tesla chip doesn't work out, he'd be more than happy to help.
Emerging Tech

Awesome Tech You Can’t Buy Yet: inflatable backpacks and robotic submarines

Check out our roundup of the best new crowdfunding projects and product announcements that hit the Web this week. You can't buy this stuff yet, but it sure is fun to gawk!
Product Review

Dell's XPS 15 is the PC every laptop wishes it could be

Not everyone needs the power that a laptop like the Dell XPS 15 provides. But if you need a computer that can handle the heavy workload you use every day, the XPS 15 might be the best you can buy.