Skip to main content

The next version of HoloLens will include built-in artificial intelligence

HPU 2.0
Microsoft’s HoloLens mixed reality system hasn’t quite made its way to the mainstream market yet, but the company is already planning its successor. And Microsoft will be adding some artificial intelligence (AI) to the next version, to make it even better at merging real and simulated realities.

The information comes from the Microsoft Research team, via a video that was taken at the Computer Vision and Pattern Recognition (CVPR) 2017 event in Hawaii. The video shows off Microsoft’s presentation of a new Holographic Processing Unit (HPU) that incorporates some advanced speech and image processing capabilities.

Specifically, HPU 2.0 will add in a dedicated AI coprocessor that will help the next HoloLens version make better sense of what a user is looking at and listening to while using the device. By incorporating the new AI chip on the HoloLens itself, the latency of sending data to the cloud for processing can be avoided and the resulting experience significantly enhanced. The video shows off the new system’s real-time ability to recognize each individual hand segment in action.

As the Microsoft Research Blog wrote:

“The AI coprocessor is designed to work in the next version of HoloLens, running continuously, off the HoloLens battery. This is just one example of the new capabilities we are developing for HoloLens, and is the kind of thing you can do when you have the willingness and capacity to invest for the long term, as Microsoft has done throughout its history. And this is the kind of thinking you need if you’re going to develop mixed reality devices that are themselves intelligent. Mixed reality and artificial intelligence represent the future of computing, and we’re excited to be advancing this frontier.”

There’s no additional information on when the next HoloLens will be released or what it will be called. Today, HoloLens is primarily a device aimed at larger organizations for real-world applications and at developers for pushing mixed reality into more mainstream applications. It remains far too expensive for consumer applications.

Nevertheless, it’s obvious that Microsoft wants the next version of HoloLens to be even smarter. It might not bring human-level intelligence or consciousness to the market, but at least HoloLens will be able to help users more easily comprehend the world around them.

Editors' Recommendations

Mark Coppock
Mark has been a geek since MS-DOS gave way to Windows and the PalmPilot was a thing. He’s translated his love for…
Microsoft’s new HoloLens hologram tech can do language translation
Microsoft HoloLens 2

Not only is it possible to have a fairly realistic holographic replica of yourself, but Microsoft has just shown that it is also possible to have that same replica speak in different languages, too.

According to The Verge, on Wednesday, July 17, Microsoft provided a demo of this latest innovation during its keynote speech at the Microsoft Inspire partner conference in Las Vegas. Tom Warren of The Verge posted a video clip on YouTube of Microsoft’s demonstration of the hologram’s language translation capabilities.

Read more
Unreal Engine 4 support for developers coming to Microsoft’s HoloLens 2 in May
hololens 2 news roundup demo mwc 2019

Julia Schwarz, Microsoft corporate vice president for Azure marketing, demonstrates the HoloLens 2 headset at MWC 2019. Jeremy Kaplan / Digital Trends

In an effort to get developers on board to create new and exciting content for its mixed reality HoloLens 2 headset, Microsoft announced the HoloLens 2 Development Edition package. Though the initial version of HoloLens will be sold to businesses and corporate customers for $5,000, developers can pick up HoloLens 2 as part of the Development Edition pricing for just $3,500. In addition to the glasses, Microsoft announced that the package will also include $500 of Azure credits along with a three-month trial of Unity Pro and Unity PiXYZ Plugin for CAD data.

Read more
Army uses modified Microsoft HoloLens 2 for ‘real-life game of Call of Duty’
Person wearing HoloLens 2.

The U.S. Army showed off its Integrated Visual Augmentation System, or IVAS, which is a modified version of the Microsoft HoloLens 2 augmented reality headset.

Microsoft received a $480 million contract last November to equip soldiers with its HoloLens technology, which the Army said would "increase lethality by enhancing the ability to detect, decide, and engage before the enemy." It was also suggested that the Army would likely use the HoloLens 2 as a training tool.

Read more