Microsoft patent paves way for a touch- and smudge-free tablet future

new microsoft patent eliminates smudges with touchless input

While touchscreens are great for navigating on smartphones and tablets, your greasy fingers leave annoying prints on the surface, blurring the view. Microsoft aims to change that, at least on future Surface devices, by implementing a design that relies on touch-free input. This design appears in a granted patent published by the U.S. Patent and Trademark Office on July 10 simply named as “Touchless input.”

Similar to how Apple’s TrueDepth camera on the iPhone X maps your face to eliminate the need for login credentials, Microsoft’s design would rely on a similar camera that captures a series of depth maps of an entire scene, including a human subject. A detection system built within the device scans each pixel in each map to determine what is static junk and what consists of the device owner.

According to the patent, this process includes “modeling the human subject with a virtual skeleton including a plurality of virtual joints including a virtual hand joint and one or more other virtual joints.” These virtual joints are compared across all captured depth maps to determine a finger gesture based on machine learning. The system can track more than one human user and/or physical objects.

new microsoft patent eliminates smudges with touchless input 2

In an example, as the device owner is navigating the user interface, the integrated tracking system is tracking the position of the user’s finger in physical space. The device maps the physical location of the finger to the on-screen cursor. That said, the user can simply move the finger in physical space to move the cursor in the same direction without having to actually touch the screen’s surface.

But the tracking system doesn’t just support simple cursor movements. Given that it can track multiple fingers, users can click and drag files and folders, zoom in and out, pan across the screen, double-tap, rotate, and more. To that extent, Microsoft is emulating mouse functions and physical gestures used on touchscreens and trackpads, only they are performed in the air instead of on a hard surface.

“In embodiments in which the depth camera has sufficient resolution, fingerprints of a human subject may be identified and matched to a user,” the patent states. “In this way, the user can be identified, and cursor control or other computing attributes may be set to preferences associated with the identified user.”

Device configurations may include an additional visible-light camera that may or may not have the same resolution as the depth camera. It would be used to detect the light intensity of a surface using red, green, and blue values, thus adding color to the depth maps to provide more detail. Another configuration would use a “structured light” depth camera that projects a structured infrared illumination.

Microsoft notes that the touch-free control would be integrated into the operating system as a natural user input, joining your typical mouse, keyboard, touchscreen, and game controller. Processing the actual finger gestures via machine vision and/or gesture recognition may be handled on- or off-board, depending on the setup.


We want every laptop to be as thin as an iPhone. But is it practical?

The Acer Swift 7 is the thinnest notebook you can buy, and it feels like the notebook of the future. But it makes too many compromises along the way, and some weird design choices hold it back.

Apple's iOS 12.1.1 makes it easier to switch cameras in FaceTime

After months of betas, the final version of iOS 12 is here to download. The latest OS comes along with tons of new capabilities, from grouped notifications to Siri Shortcuts. Here are all the features you'll find in iOS 12.
Product Review

The iPad Pro is the best tablet ever. But don't sell your laptop just yet

Apple has unveiled a big redesign for the iPad Pro, slimming down the bezels, adding Face ID, and the ability to attach and charge the Apple Pencil. All of this comes at a high cost however, as the iPad Pro starts at $799.
Product Review

It's not the sharpest tool, but the Surface Go does it all for $400

Microsoft has launched the $400 Surface Go to take on both the iPad and Chromebooks, all without compromising its core focus on productivity. Does it work as both a tablet and a PC?

Is your PC slow? Here's how to restore Windows 10 to factory settings

Computers rarely work as well after they accumulate files and misconfigure settings. Thankfully, with this guide, you'll be able to restore your PC to its original state by learning how to factory reset Windows.

The Titan RTX graphics card is nearly here. Here's what you need to know

The Nvidia Titan RTX is arguably the most powerful consumer graphics card ever made, even if it's not really aimed at consumers. It bridges the 2080 Ti and RTX Quadro cards with boat loads of power.

Leak reveals that Nvidia’s RTX 2060 gaming chipsets will be headed to laptops

The latest leaks of Nvidia's upcoming RTX 2060 have given performance benchmarks and further detail about the future chipset and its capabilities, while a RTX 2060 Max-Q variant has also been discovered for thin and light gaming machines.

Looking for an Apple MacBook below $900? Woot has you covered

If you're looking for a great deal on an Apple MacBook, then Amazon's Woot may just have what you have been seeking. It has Macbooks available for only $810 with Intel M3 CPUs, 8GB of RAM, and 256GB SSDs.

Want to save a webpage as a PDF? Just follow these steps

Need to quickly save and share a webpage? The best way is to learn how to save a webpage as a PDF file, as they're fully featured and can handle images and text with ease. Here's how.

New rumors say the Pixelbook 2 could show up at CES 2019

What will the Pixelbook 2 be like? Google hasn't announced it, but thanks to rumors and leaks, we think we have a pretty good idea of what the potential new flagship Chromebook will be like.

A dead pixel doesn't mean a dead display. Here's how to repair it

Dead pixel got you down? We don't blame you. Check out our guide on how to fix a dead pixel and save yourself that costly screen replacement or an unwanted trip to your local repair shop.

You could spend $1,000 on an iPhone, or buy one of these awesome laptops instead

Finding a decent laptop is easy, but finding one under $1,000 is a bit tricky. Luckily, we've taken some of the guesswork out of picking out a budget laptop. Here are some of our favorites, the best laptops under $1,000.

Don't know what to do with all your old DVDs? Here's how to convert them to MP4

Given today's rapid technological advancements, physical discs are quickly becoming a thing of the past. Check out our guide on how to convert a DVD to MP4, so you can ditch discs for digital files.

Here’s how to install Windows on a Chromebook

If you want to push the functionality of your new Chromebook to another level, and Linux isn't really your deal, you can try installing Windows on a Chromebook. Here's how to do so, just in case you're looking to nab some Windows-only…