Techies adore the HoloLens. Now Microsoft wants to win over grease monkeys

windows holographic idf 2016 microsoft hololens motorcycle

Imagine automotive students learning to take apart engines in virtual reality, or using an augmented reality headset to identify all the parts in an engine they’re actually working on. It sounds right out of Star Trek, right?

But Oregon Story Board, a Portland nonprofit that specializes in the “support of digital storytelling,” is working with Intel and Clackamas Community College to build exactly this system. Their tool of choice? Microsoft’s HoloLens. The device only just became available for preorder to developers, but the college hopes to have it integrated into an automotive repair class by September.

“The holodeck is not that far away, people,” Shelley Midthun, Director of Oregon Story Board, told Digital Trends.

And she means it. To Midthun, augmented reality will become part of everyday life sooner than most people suspect, and it’s worth figuring out how to ensure that technology helps as many people as possible.

“How can we take something as high-tech and exclusive as HoloLens, and put it in the hands of more people?”

Microsoft, certainly, hopes that Midthun is right. There’s a lot of hype building around the HoloLens, which uses a clear lens to augment the real world with 3D holograms. But while the tech is impressive, there’s plenty of questions to ask about this early technology. Mainly, what will it actually do?

“At the highest level, what interests Microsoft is working out what the HoloLens can be used for,” Tawny Schlieski, Chairman of the Oregon Story Board and Research Scientist at Intel, told Digital Trends.

With this in mind, Microsoft has announced five $100,000 grants, each accompanied by two highly sought after HoloLens Development Kits, to researchers around the country. Over 600 organizations applied with their ideas for the technology, and the Oregon Story Board team was one of only five winners.

One of the winning pitches? Use the HoloLens for hands-on education in the trades, specifically the automotive department at Clackamas Community College. Microsoft found the idea intriguing enough to let them give it a shot.

“The reason that Microsoft is interested is the hands on component,”  said Schlieski. “The ability to have feedback layered immediately over real objects.”

The grant is in hand, and the development kits are coming soon. Now the software needs to be built.

Bringing the future to the masses

If using a futuristic prototype in a community college automotive class sounds unique, that’s not an accident.

“It was extremely intentional,” said Midthun. “How can we take something as high-tech and exclusive as HoloLens, and put it in the hands of more people?”

Virtual reality, which uses a headset to fully immerse people in a simulated environment, is tied to gaming in the popular imagination. Augmented reality, which supplements the real world, is less widely known, and use cases haven’t been fully worked out yet. Google tried with Glass, which was initially marketed as a sort of lifestyle device. An early promotional video showed a user drifting from his apartment to coffee shops, without clear objectives.

The HoloLens isn’t aiming to be that sort of consumer device, a smartphone that happens to sit on your face. Instead, Microsoft is positioning the HoloLens as an immersive workstation, a device with specific work-driven purposes. Think more PC than iPhone.

Most of the proposed purposes have been far from the lives of average people, however.

“We’d seen videos of augmented reality being used at medical centers, and at NASA,” said Midthun. “We wanted to put this technology into the hands of community college students.”

A skeptical automotive professor

Rick Lockwood, a professor in Clackamas’ automotive department, admitted the idea sounds cool. But he isn’t sure how it will fit into the day-to-day educational workflow.

“The people that we train are hands-on people, they’ve got to get their hands on stuff,” Lockwood told Digital Trends. “Nothing is like getting under the hood of a car, there’s no better training than being on a car.”

A simulated engine, to him, doesn’t sound pratical for instruction — at least, not without some sort of assessment for putting things together properly.

“A really complex digital model can have tremendous fidelity in a way that a picture cannot.”

“They want to do a virtual assembly of an engine of some sort, and that would be just fine,” said Lockwood. “But what’s preventing the students from putting it together wrong, or missing a step?”

Any simulated engine, to Lockwood, needs consequences when things are put together incorrectly. But what if the engine isn’t simulated? What if the HoloLens could recognize, a real-world engine and point out what all the parts are using an AR overlay?

“That would be much more useful, for sure,” said Lockwood.

A series of complex design questions

Lockwood is helping to guide the design process.

“We’re working with the automotive department to find out what the best thing to do is,” Midthun said. “We’re not going to build something that the instructor finds useless. We’re going to explore where they think this augmented reality addition could provide additional instruction.”

But before the HoloLens can be used in class, someone has to build the software. That’s what a class in session right now is trying to do. Students from Clackamas, other nearby community colleges, and even a few area high schools, are learning the tools necessary for HoloLens development alongside a variety of industry professionals.

“People from the Indie game community allow us to access talent from the coding side of things, while people with film and animation backgrounds allow us to bring that content creation and creative to the table,” said Midthun.

Together the class will learn to design objects for HoloLens. 3D models will be created in Maya, then exported to the gaming engine Unity, then finally ported over to the HoloLens SDK. The current class is learning to use all these tools together, and an upcoming class will focus on building the engine-building tool for Clackamas’ automotive department.

Designing the future of education

“There’s a design school tradition of taking a class and working together on a single project,” said Schlieski. “Once we get the basics of using HoloLens, then the class works to collaborate to build a training curriculum in HoloLens for the automotive students.”

“Technology isn’t its own thing, technology runs through everything we do. AR and VR are going to be widespread.”

The real challenge will be one of design. How can this new tool best be put to work for practical education? The focus on engines provides a starting point, because 3D models of engines already exist.

“The nice thing about engines is we’re already looking at objects that exist as a fully realized CAD design,” said Schlieski. “It’s easier for the system to then map the things together.”

One idea would be for the cameras on the HoloLens to recognize objects, and possibly identify them for students.

“A really complex digital model can have tremendous fidelity in a way that a picture cannot,” said Schlieski. “Augmented realities that point out components, and offer step-by-step instruction, could prove invaluable to trade schools.”

The cameras on the HoloLens could also prove invaluable. Instructors might see through their students eyes, even from far away, allowing them to give realtime feedback during hands-on exercises.

“If you can share the same view as someone, they could see whether what you’re doing is what she asked you to do,” said Schlieski. “There are layers of fidelity.”

Education is changing. More classes are being taken online, which is giving more opportunities to people in rural areas without physical access to institutions. But remote classes aren’t great for hands-on learning and trades. Technology like the HoloLens could be big on this front, giving simulated environments for students to learn in, and also giving professors the means to offer hands-on instruction from afar.

“What tools can help make that remote learning experience more robust and more satisfying?” asked Schlieski.

Bringing economic diversity to the future of tech

Schlieksi hopes technology like the HoloLens can help make design more accessible, even to non-programmers.

“A lot of the optimism, and the desire for these other tools, is for something that’s a little more fluid. Less in machine code, more in human code,” said Schlieski.

Tools that allow creators to think visually, instead of in terms of code, could change the way games and other content is created. As this future takes shape, it’s important to think about design from multiple perspectives. To Midthun, working with a community college to supplement education in the trades is one part of a broader mission to bring more diversity — social and economic — to the conversations around futuristic technology.

“We’re trying to expand what has been a very elite, similar group of humans that design things for people like them,” said Midthun. “Technology isn’t its own thing, technology runs through everything we do. AR and VR are going to be widespread, so let’s make sure we’re creating a diverse pool of human beings creating the products and services for the very diverse group of human beings that we are on this planet.”

It will be months before the any automotive students at Clackamas puts on a headset. The devices themselves haven’t even shipped to the grant winners as of this writing. But in using an early prototype to supplement education in the trades, Microsoft’s grant could make its newest technology more inclusive.


Adventure Academy is an MMO for kids that combines learning with fun

Age of Learning’s follow-up to ABCmouse is an educational MMO called Adventure Academy. Targeted at kids ages 8-13, Adventure Academy has a comprehensive curriculum and all of the rewarding trappings of a modern MMO.

These are the must-have games that every Xbox One owner needs

More than four years into its life span, Microsoft's latest console is finally coming into its own. From Cuphead to Halo 5, the best Xbox One games offer something for players of every type.
Movies & TV

The best shows on Netflix right now (May 2019)

Looking for a new show to binge? Lucky for you, we've curated a list of the best shows on Netflix, whether you're a fan of outlandish anime, dramatic period pieces, or shows that leave you questioning what lies beyond.

Apple Mac users should take a bite out of these awesome games

Contrary to popular belief, there exists a bevy of popular A-list games compatible for Mac computers. Take a look at our picks for the best Mac games available for Apple fans to enjoy.

These external drives have speed, durability, and storage space to spare

Whether you want an external storage drive that is fast, portable, or comes with a ton of storage, these are the best external hard drives available today. They all come with great features and competitive pricing.

The 2019 ThinkPad lineup is robust. Here's how to pick the right one for you

Be it the X series, the T series, E series, it can be tough to find the best Lenovo laptop that is right for you. To help, we'll break down all the options available to make your choice a more informed one.

Here’s how to watch AMD reveal its new Ryzen chips at Computex

AMD will hold a pre-Computex keynote May 27 to announce its new line of 3rd-generation Ryzen processors and accompanying Radeon Navi graphics cards. Here's how to watch the keynote live wherever you are in the world.

Should you buy a MacBook Pro or a Razer Blade Stealth? We'll help you decide

Laptop head to heads are a great way to see which one might be the right one for you. Our latest sees the Razer Blade Stealth (2019) vs. MacBook Pro in a fight to see which one deserves to be your next laptop.

AMD's latest Navi graphics cards are incoming. Here's what to expect

AMD's Navi graphics cards could be available as soon as July 2019 — as long as it's not delayed by stock problems. Billed as a successor to Polaris, Navi promises to deliver better performance to consoles like Sony's PlayStation 5.

Ryzen 3000 chips will pack a punch, and could launch as early as July

AMD's upcoming Ryzen 3000 generation of CPUs could be the most powerful processors we've ever seen, with higher core counts, greater clock speeds, and competitive pricing. Here's what we know so far.

Want to watch Netflix in bed or browse the web? We have a tablet for everyone

There’s so much choice when shopping for a new tablet that it can be hard to pick the right one. From iPads to Android, these are our picks for the best tablets you can buy right now whatever your budget.

The best Amazon Prime Day 2019 deals: Everything you need to know

Amazon Prime Day 2019 is still a few months off, but it's never too early to start preparing. We've been taking a look at the best discounts from previous Prime Days to give you our predictions of what to expect this year.

Microsoft might finally embrace USB-C on next-gen Surface Pro 7

USB-C could finally come to Microsoft's Surface Pro tablet. According to a Microsoft patent filing, the port was shown in an illustration, suggesting that the company is working to support this feature in the future.

Here’s how to watch the Nvidia Computex 2019 press conference

Here’s everything you need to know about Nvidia’s upcoming press conference at Computex 2019 in Taipei, Taiwan; including what to expect during the press conference and how and when to watch it.