Microsoft patent paves way for a touch- and smudge-free tablet future

new microsoft patent eliminates smudges with touchless input

While touchscreens are great for navigating on smartphones and tablets, your greasy fingers leave annoying prints on the surface, blurring the view. Microsoft aims to change that, at least on future Surface devices, by implementing a design that relies on touch-free input. This design appears in a granted patent published by the U.S. Patent and Trademark Office on July 10 simply named as “Touchless input.”

Similar to how Apple’s TrueDepth camera on the iPhone X maps your face to eliminate the need for login credentials, Microsoft’s design would rely on a similar camera that captures a series of depth maps of an entire scene, including a human subject. A detection system built within the device scans each pixel in each map to determine what is static junk and what consists of the device owner.

According to the patent, this process includes “modeling the human subject with a virtual skeleton including a plurality of virtual joints including a virtual hand joint and one or more other virtual joints.” These virtual joints are compared across all captured depth maps to determine a finger gesture based on machine learning. The system can track more than one human user and/or physical objects.

new microsoft patent eliminates smudges with touchless input 2

In an example, as the device owner is navigating the user interface, the integrated tracking system is tracking the position of the user’s finger in physical space. The device maps the physical location of the finger to the on-screen cursor. That said, the user can simply move the finger in physical space to move the cursor in the same direction without having to actually touch the screen’s surface.

But the tracking system doesn’t just support simple cursor movements. Given that it can track multiple fingers, users can click and drag files and folders, zoom in and out, pan across the screen, double-tap, rotate, and more. To that extent, Microsoft is emulating mouse functions and physical gestures used on touchscreens and trackpads, only they are performed in the air instead of on a hard surface.

“In embodiments in which the depth camera has sufficient resolution, fingerprints of a human subject may be identified and matched to a user,” the patent states. “In this way, the user can be identified, and cursor control or other computing attributes may be set to preferences associated with the identified user.”

Device configurations may include an additional visible-light camera that may or may not have the same resolution as the depth camera. It would be used to detect the light intensity of a surface using red, green, and blue values, thus adding color to the depth maps to provide more detail. Another configuration would use a “structured light” depth camera that projects a structured infrared illumination.

Microsoft notes that the touch-free control would be integrated into the operating system as a natural user input, joining your typical mouse, keyboard, touchscreen, and game controller. Processing the actual finger gestures via machine vision and/or gesture recognition may be handled on- or off-board, depending on the setup.

Computing

You can use Chrome OS on a tablet, but it’s not an iPad competitor yet

We took a look at the first Chrome OS tablet to hit the market, the Acer Chromebook Tab 10, to see just how Google's lightweight tablet runs on a touch-only device thanks to a few new tablet-centric features.
Computing

Microsoft’s pressure-sensitive software keyboard is ripe for dual-screen laptops

Microsoft is working on a new keyboard that will make it easier to type on glass. The software keyboard will be able to recognize pressure and gestures to help speed up your typing, especially when you're entering symbols.
Wearables

Apple patent hints at better gesture control on the Apple Watch

The Apple Watch already does things like shows you the time when you raise your wrist, but soon the gesture controls on the Apple Watch may get a whole lot better, if Apple's latest patent is anything to go by.
Computing

Microsoft's foldable Andromeda device may debut this year. Here's what we know

Microsoft was reportedly working on a pocket-sized clamshell device code-named 'Andromeda' sporting two touchscreens. Meant to disrupt the mobile market, it's now put on hold. Here's everything we know about the Surface Phone.
Mobile

We tried all the latest and greatest smartphones to find the best of 2018

Smartphones are perhaps the most important and personal piece of tech on the planet. That’s why it’s important to pick the best phone for your individual needs. Here are the best smartphones you can buy.
Photography

How Huawei and Leica made a camera phone so good, we ditched our DSLR

What makes the Leica-designed Huawei P20 Pro camera so good? We traveled to Leica’s HQ in Wetzlar, Germany to hear it from the source. In short, it took a lot of experience, technology, and passion.
Emerging Tech

Awesome Tech You Can’t Buy Yet: Laptop screen extenders and self-healing tents

Check out our roundup of the best new crowdfunding projects and product announcements that hit the Web this week. You can't buy this stuff yet, but it sure is fun to gawk!
Mobile

Apple fixes its battery drain issue with iOS 11.4.1 update

Apple's iOS 11 is the latest version of the company's mobile operating system, but it still has some issues to be worked out. We've searched the internet to find the biggest iOS 11 problems, along with some potential solutions.
Photography

What is portrait mode? How tech helps smartphones capture a better you

Several years ago, portrait modes started showing up on phones and quickly became one of the most popular ways to capture selfies, profile pics, and more. But how does portrait mode work, and how much difference does it make?
Virtual Reality

Got a Gear VR headset? These are the apps and games you've got to try

Before you put on your new Gear VR headset, you should know which apps and games are worth downloading. Whether you're a fan of documentaries or arcade games, here's a list of the best Gear VR apps and games to be had.
Photography

These point-and-shoot cameras make your smartphone pics look like cave paintings

If your smartphone camera just isn't giving you the results you're looking for, maybe it's time to step up your game. The latest and greatest point-and-shoot cameras offer large sensors, tough bodies, and long lenses - something no phone…
Mobile

Apple's third iOS 12 beta may help you save a lot of data

At this year's Worldwide Developer Conference, Apple unveiled its latest operating system, iOS 12. From app updates to group FaceTime, ARKit 2.0, and more, here are all the new features in iOS 12.
Android Army

From Apple’s charging mat to Google’s modular phone, these gadgets went MIA

Sometimes tech companies unveil a new gadget or tease a new product but never actually deliver. Plans get changed, things go wrong, and products are canceled. It’s time to look at some of the most exciting tech that never materialized.
Product Review

DJI's Twinkie-sized Spark drone packs more features than a Swiss army knife

If there’s one thing DJI is good at, it’s stuffing a ton of features and functionality into increasingly small drones. Nothing showcases this talent more than the DJI Spark.
Mobile

Apple stops offering free repairs for iPhones with grayed speaker buttons

Getting a new iPhone should be a pleasurable experience, but if you run into an issue, it can quickly become frustrating. Luckily, we’ve gathered a few potential solutions for any iPhone 7 problems you may be facing.
Computing

VR is in a tailspin, and the sales numbers prove it

VR is the future! Except if you look at the data. Sales of the biggest VR headsets, including the HTC Vive, PlayStation VR, and Oculus Go, are all declining. What does it mean for the state of VR, and where do we go from here?
Computing

The launch of the new MacBook Pro has been a complete disaster

Apple has flubbed what should've been a simple processor bump for the MacBook Pro. From issues with pricing and CPU throttling to the keyboard, the MacBook Pro is in an even worse position than before the update.
Computing

Installing fonts in Windows 10 is quick and easy -- just follow these steps

Want to know how to install fonts in Windows 10? Here's our guide on two easy ways to get the job done, no matter how many you want to add to your existing catalog, plus instructions for deleting fonts in the process.
Computing

Millions of health records may be at stake in ransomware attack

LabCorps revealed that it was a victim of a data breach, and the FBI confirmed it was notified of a ransomware attack. With millions of health records at stake, it's still unclear what information, if any, the attackers accessed.
Computing

Congressman says we should be banned from mining, using cryptocurrency

Congressman Brad Sherman believes the government should prohibit U.S. citizens from mining and using cryptocurrency. As a medium of exchange, cryptocurrencies facilitate narcotics trafficking, terrorism, and tax evasion.
Computing

Apple quietly confirms 2018 MacBook Pro keyboard ships with anti-debris design

Apple appears to have a permanent fix in place to address the MacBook Pro's sticky key problem when it announced the 2018 refresh. But the fix won't be coming to the company's older notebooks, leaving existing owners out in the cold.
Computing

Tired of choosing between Windows and Mac? Check out these Chromebooks instead

We've compiled a list of the best Chromebooks -- laptops that combine great battery life, comfortable keyboards, and the performance it takes to run Google's lightweight Chrome OS. From Samsung to Acer, these are the Chromebooks that really…
Mobile

Fuchsia could eventually replace Android, but it's years away from doing so

Details have emerged about a new operating system Google's developers are working on dubbed Fuchsia OS. Here's everything we know about Google's mysterious new operating system so far.