Skip to main content

HoloLens virtual touchscreen is the futuristic tech we’ve been waiting for

Image used with permission by copyright holder

Researchers at Microsoft Research have developed a way to give HoloLens users a virtual touchscreen through a system called MRTouch. This allows users of Microsoft’s mixed reality headset an additional way to interact while using HoloLens, complementing gesture, voice, and controller inputs, according to a Microsoft Research video demoing the use of the MRTouch prototype.

Although Microsoft Research hasn’t announced plans to bring MRTouch to the market or allow third-party developers to make use of the multi-touch interactions at this time, the good news is that it works on an unmodified Microsoft HoloLens headset. All users would need to do is use their fingers and swipe across a flat surface to create a virtual touchscreen. You can do this on a number of surfaces, including walls and tabletops. This virtual touch area could be used to display content, and you can interact with the virtual screen using multi-touch gestures, similar to how you would use a tablet.

Recommended Videos

One application for MRTouch and HoloLens is the ability to launch apps that rely on touch inputs, like a browser. This allows you to use a mixed reality device as your day-to-day computer, Microsoft said. In the photos app, Microsoft showed that you can pan and zoom using your fingers, just as you would on the Windows 10 Photos app on your touchscreen-enabled laptop or convertible. MRTouch even edges ahead of traditional touchscreens if you need to render realistic 3D content. Here, touch input could be combined with in-air gestures for specific interactions in three-dimensional space.

MRTouch essentially allows HoloLens owners to overlay a touchscreen that’s capable of displaying and rendering content on any flat surface.

MRTouch works by utilizing the short-length depth camera on the HoloLens headset for finger tracking. A reflectivity map is also captured at 25 frames per second, and the data is fed to the tracker engine, Microsoft said. Microsoft’s study tested for accuracy, and the results show that touch was detected 97.5 percent of the time with a mean distance error of 5.4mm. According to Microsoft, the accuracy rate of MRTouch is very competitive with the capacitive touchscreens today used on many modern laptops, tablets, and smartphones.

Chuong Nguyen
Silicon Valley-based technology reporter and Giants baseball fan who splits his time between Northern California and Southern…
The robot takeover comes another step closer — at Amazon
An Amazon robot working inside one of the company's warehouses.

Amazon is close to having more robots operating inside its warehouses than humans after the e-commerce giant announced this week that it now has more than a million robots working at its facilities around the world.

Over the years, Amazon has spent billions of dollars on the development and deployment of warehouse-based robots, which handle an array of tasks once performed by human workers.

Read more
This Lenovo ThinkPad laptop is over $1,400 off — hurry while stocks last!
The Lenovo ThinkPad T14 Gen 5 Intel laptop on a white background.

Now's an excellent time to take advantage of laptop deals from Lenovo, which has slashed the prices of a wide range of devices for its Black Friday in July sale. Lenovo's ThinkPad laptops are up to 45% off, and here's one of the most interesting offers available with such a discount — the Lenovo ThinkPad T14 Gen 5 at $1,440 off its estimated value of $3,199, so you'll only have to pay $1,759. That's an excellent price for this fantastic productivity tool, but you're going to have to push forward with your purchase as soon as possible because stocks may run out at any moment.

BUY NOW

Read more
Early Prime Day deal: Samsung’s 27-inch Odyssey G3 at its annual low price
Samsung Odyssey G3 gaming monitor on desk with keyboard and headset.

If you're ready to upgrade your monitor, this Samsung deal over at Amazon just might be your best bet. The 27-inch version of Samsung's Odyssey G3 is $130 right now, a full $100 off its regular $230 price and its lowest price of the year. It's a part of early Prime Day deals and a good sampling of what we can expect for the shopping holiday, which officially lands on July 8th. Tap the button below to see it for yourself or keep reading to see why we like this deal and why this should be your next monitor.

Buy Now

Read more