Work with your hands, at your desk: Intel refocuses on gesture input with RealSense

intel re commits realsense voiceassist ces 2015 1
Surely you’ve seen, either in movies or educational shows, those artificial intelligence (AI) computers that you interact with through various cables, or input leads, connected to your fingers, your hands, your head, and your feet. Depending on the sophistication of the devices and the software, nearly all parts of your body create input for the AI computer. Now, imagine interacting with, even controlling, your computer via hand and head movements, even facial expressions, without the input leads and cables.

Or maybe you want to control your computer with voice commands, like iPads and Android devices? Enter RealSense and VoiceAssist, two new interactivity enhancement features slated for the next generation of Intel CPUs.

If it all works the way Intel claims, you’ll soon be interacting with your computer via voice commands, hand, and head gestures, rather than actual physical pointing devices and keyboards. Here’s a real sense of how Intel’s new RealSense and VoiceAssist technologies work.

What is RealSense?

As part of Intel’s fifth-gen processor technology enhancements, “RealSense devices can see in 3D.” Among other things, what this means is that objects, such as, say, your hands, your face, and other objects, can be separated from backgrounds in real-time, which lets your computer capture the shape and depth of objects.

RealSense

A primary component of RealSense technology is its 3D camera, which lets you capture 3D scans of people and objects for any number of uses. RealSense also lets you interact with the device via hand gestures. In fact, RealSense supports 22 tracking points per hand in 3D space.

The RealSense 3D camera

Much of the RealSense experience will come from something called an Intel RealSense 3D Camera. Intel describes how RealSense and the camera works like this: “Devices with Intel RealSense 3D camera have three lenses: a conventional camera, an infrared camera, and an infrared laser projector. Together, the three lenses allow the device to infer depth by detecting infrared light that has bounced back from objects in front of it. This visual data, taken in combination with Intel RealSense motion-tracking software, creates a touch-free interface that responds to hand, arm, and head motions as well as facial expressions.”

Intel says that the 3D camera will let you interact with your device more like you interact with people — with natural movements. While there’s nothing particularly natural about gesturing in front of a computer screen, the ability to gesture midair to navigate and manipulate your computer is intriguing.

VoiceAssist

Intel has been working with voice-recognition leader Nuance, maker of Dragon Dictate, for quite some time, in an attempt to get voice commands integrated into Intel’s chips. Looks like it’ll be soon. Between RealSense 3D and VoiceAssist, we should have several new ways to interact with our computers, hybrids, and 2-in-1s—and soon.

Home Theater

TV calibration 101: Here's how to tune up the picture of your new TV

You’ve got your new TV out of the box, but now what? Our TV picture adjustment guide takes you through the simple steps to get the best picture from your brand new TV so you can set it and forget it.
Mobile

How to downgrade your iPhone or iPad from iOS 12 to iOS 11.4

Apple's iOS 12 may be the latest and greatest version of the mobile operating system, but perhaps it's not right for you right now. If that is the case, thankfully there are some ways to go back to iOS 11.4.
Emerging Tech

7 drone crashes that will make you fly your bird more carefully

If you've been getting a bit reckless with your drone and suspect you may be heading toward a spectacular crash, then these messy drone mishaps should help you avoid such a calamity.
Computing

How to easily record your laptop screen with apps you already have

Learning how to record your computer screen shouldn't be a challenge. Lucky for you, our comprehensive guide lays out how to do so using a host of methods, including both free and premium utilities, in both MacOS and Windows 10.
Computing

Nvidia GeForce RTX 2080 vs. RTX 2080 Ti

Nvidia's RTX 2080 Ti is a beast of a graphics card, packing in RT, Tensor, and CUDA cores to enhance your gaming experience. We'll compare the Ti variant to the standard RTX 2080, and we'll let you know which card to buy.
Computing

Nvidia GeForce RTX 2080 vs. GTX 1080

Should you upgrade from your GeForce GTX 1080 to the GeForce RTX 2080? Even if you won't take advantage of ray tracing, there are other benefits to the RTX series. We'll examine how each GPU performs to help you decide.
Computing

We tested Nvidia’s RTX 2080 and 2080 Ti. Are they a worthy upgrade?

We finally have Nvidia's newest graphics cards, the RTX 2080 and 2080 Ti, and put them through our standard suite of benchmarks and game tests to see how they performed in a standard play of Battlefield 1 and Fornite. How do they compare to…
Photography

Not just for photographers anymore, Loupdeck+ now supports Adobe Premiere Pro

Video editors can now get physical with the Loupdeck+ control board. Originally for Lightroom, a software update allows the controls to adapt to video editing, including color grading, clip trimming, and navigating through the timeline.
Computing

PowerDirector, PhotoDirector aim to balance advanced tools with easy editing

CyberLink's latest photo- and video-editing programs fix advanced tools with a simple UI. PowerDirector adds Chroma-Key tools and multicam features, while PhotoDirector gains tethered shooting, an updated layer, and Content-Aware tools.
Computing

Here are all the games that support Nvidia’s RTX ray tracing

These are the upcoming games that support ray tracing rendered on Nvidia's RTX series graphics cards. They aren't many in number at this point, but thanks to the power of ray tracing, they are some of the best looking games ever made.
Computing

Nvidia's new GPUs are all about ray tracing. Here's why that matters

Nvidia's new GTX 2000 series graphics cards bring Ray Tracing technology to modern real-time 3D graphics, including games, for the first time. But what is ray tracing, and what does it mean for your games?
Emerging Tech

Giant wind farm in Morocco will help mine cryptocurrency, conserve energy

One of the windiest parts of Morocco is set to get a $2 billion wind farm power plant, which could help power eco-friendly cryptocurrency mining in a more environmentally friendly way.
Computing

AT&T’s new 5G network could adopt tiered billing, including a gaming plan

AT&T may be leveraging its 5G's fast speeds and low latency in order to create a special plan for gamers. AT&T didn't disclose what the 5G gaming plan will cost, but gamers could be free from Wi-Fi in the future.
Computing

Nvidia's new RTX GPUs have arrived. Here's what you need to know about them

Nvidia's new RTX 2000 series graphics cards are impressive pieces of hardware, with some amazing advancements and some rather high price tags to match. Here's everything you need to know about Nvidia's new top-tier cards.