Skip to main content

Microsoft patent paves way for a touch- and smudge-free tablet future

Image used with permission by copyright holder

While touchscreens are great for navigating on smartphones and tablets, your greasy fingers leave annoying prints on the surface, blurring the view. Microsoft aims to change that, at least on future Surface devices, by implementing a design that relies on touch-free input. This design appears in a granted patent published by the U.S. Patent and Trademark Office on July 10 simply named as “Touchless input.”

Similar to how Apple’s TrueDepth camera on the iPhone X maps your face to eliminate the need for login credentials, Microsoft’s design would rely on a similar camera that captures a series of depth maps of an entire scene, including a human subject. A detection system built within the device scans each pixel in each map to determine what is static junk and what consists of the device owner.

According to the patent, this process includes “modeling the human subject with a virtual skeleton including a plurality of virtual joints including a virtual hand joint and one or more other virtual joints.” These virtual joints are compared across all captured depth maps to determine a finger gesture based on machine learning. The system can track more than one human user and/or physical objects.

Image used with permission by copyright holder

In an example, as the device owner is navigating the user interface, the integrated tracking system is tracking the position of the user’s finger in physical space. The device maps the physical location of the finger to the on-screen cursor. That said, the user can simply move the finger in physical space to move the cursor in the same direction without having to actually touch the screen’s surface.

But the tracking system doesn’t just support simple cursor movements. Given that it can track multiple fingers, users can click and drag files and folders, zoom in and out, pan across the screen, double-tap, rotate, and more. To that extent, Microsoft is emulating mouse functions and physical gestures used on touchscreens and trackpads, only they are performed in the air instead of on a hard surface.

“In embodiments in which the depth camera has sufficient resolution, fingerprints of a human subject may be identified and matched to a user,” the patent states. “In this way, the user can be identified, and cursor control or other computing attributes may be set to preferences associated with the identified user.”

Device configurations may include an additional visible-light camera that may or may not have the same resolution as the depth camera. It would be used to detect the light intensity of a surface using red, green, and blue values, thus adding color to the depth maps to provide more detail. Another configuration would use a “structured light” depth camera that projects a structured infrared illumination.

Microsoft notes that the touch-free control would be integrated into the operating system as a natural user input, joining your typical mouse, keyboard, touchscreen, and game controller. Processing the actual finger gestures via machine vision and/or gesture recognition may be handled on- or off-board, depending on the setup.

Editors' Recommendations

Kevin Parrish
Former Digital Trends Contributor
Kevin started taking PCs apart in the 90s when Quake was on the way and his PC lacked the required components. Since then…
Best OLED monitor deals: Get an OLED screen from just $450
Marvel's Spider-Man running on the Samsung Odyssey OLED G8.

Shopping some of the best monitor deals is a good way to save on some extra screen real estate, but if you’re looking for something that can produce a stunning image you should turn your shopping cart toward the OLED monitors. OLED is one of the best picture technologies currently available, and it can create a lifelike image that makes interacting with games, presentations, and creative work much more immersive. The best OLED monitors can run pretty expensive, but that’s what OLED monitor deals are for. If you’re looking for superior picture quality and some ways to save, read onward for more details on the best OLED monitor deals taking place right now.
ViewSonic 15.6-inch VX1655 4K OLED portable monitor — $450, was $500

Getting into the OLED game can be both affordable and portable with the ViewSonic VX1655. It’s a 4K OLED display that’s made to function as either a laptop extension or something to pair with a tablet. It comes in at a super sharp 4K resolution and a refresh rate of 60Hz. This isn’t something you’d want to pair with a gaming PC, but it’s a great little display to keep with you if you do creative work on the run or want some extra screen real estate while working on a tablet at your desk.

Read more
Best monitor deals: Gaming, office, curved, OLED and more
Dell UltraSharp 27 4K PremierColor Monitor

Whether you prefer to work at one of the best desktop computers, the best laptops, or anything in between, an external monitor can be helpful to add some extra screen real estate. One of the best monitors can even go a long way toward reducing eye strain and creating an immersive digital or gaming experience. While high end monitors can get quite expensive, there are always some impressive monitor deals to shop, and we’ve tracked them all down. Reading onward you’ll find what we feel are the best monitor deals, whether you’re shopping for 4K monitors, gaming monitors, ultrawide monitors, or more general monitors meant for all-purpose users.
Best monitor deals

The following deals represent a best-of of the deals below. They're selected to give a mixture of prices, styles, and levels of discount. If you don't see something you like, don't worry, as the following sections will have plenty more deals for you to choose from. However, this is a highly recommended place to start:

Read more
7 best Chromebooks for 2024: the best for every budget
Close up of the Chrome logo on the top of a Chromebook.

Chromebooks might have a hard time competing with Windows laptops and MacBooks, but that doesn't mean they don't have their place. We've reviewed hundreds of laptops over the years, testing for important qualities like performance, battery life, and display quality — and we've found that Chromebooks consistently excel at performance and reliability.

You can find Chromebooks from Google, HP, Lenovo, Acer, and many others, and we've dug through them to put together this roundup of the best Chromebooks on the market. They're incredibly accessible devices, and for the right person, a Chromebook can be the best laptop in terms of value.

Read more