Skip to main content

Work with your hands, at your desk: Intel refocuses on gesture input with RealSense

intel re commits realsense voiceassist ces 2015 1
Image used with permission by copyright holder
Surely you’ve seen, either in movies or educational shows, those artificial intelligence (AI) computers that you interact with through various cables, or input leads, connected to your fingers, your hands, your head, and your feet. Depending on the sophistication of the devices and the software, nearly all parts of your body create input for the AI computer. Now, imagine interacting with, even controlling, your computer via hand and head movements, even facial expressions, without the input leads and cables.

Or maybe you want to control your computer with voice commands, like iPads and Android devices? Enter RealSense and VoiceAssist, two new interactivity enhancement features slated for the next generation of Intel CPUs.

If it all works the way Intel claims, you’ll soon be interacting with your computer via voice commands, hand, and head gestures, rather than actual physical pointing devices and keyboards. Here’s a real sense of how Intel’s new RealSense and VoiceAssist technologies work.

What is RealSense?

As part of Intel’s fifth-gen processor technology enhancements, “RealSense devices can see in 3D.” Among other things, what this means is that objects, such as, say, your hands, your face, and other objects, can be separated from backgrounds in real-time, which lets your computer capture the shape and depth of objects.

RealSense
Image used with permission by copyright holder

A primary component of RealSense technology is its 3D camera, which lets you capture 3D scans of people and objects for any number of uses. RealSense also lets you interact with the device via hand gestures. In fact, RealSense supports 22 tracking points per hand in 3D space.

The RealSense 3D camera

Much of the RealSense experience will come from something called an Intel RealSense 3D Camera. Intel describes how RealSense and the camera works like this: “Devices with Intel RealSense 3D camera have three lenses: a conventional camera, an infrared camera, and an infrared laser projector. Together, the three lenses allow the device to infer depth by detecting infrared light that has bounced back from objects in front of it. This visual data, taken in combination with Intel RealSense motion-tracking software, creates a touch-free interface that responds to hand, arm, and head motions as well as facial expressions.”

Intel says that the 3D camera will let you interact with your device more like you interact with people — with natural movements. While there’s nothing particularly natural about gesturing in front of a computer screen, the ability to gesture midair to navigate and manipulate your computer is intriguing.

VoiceAssist

Intel has been working with voice-recognition leader Nuance, maker of Dragon Dictate, for quite some time, in an attempt to get voice commands integrated into Intel’s chips. Looks like it’ll be soon. Between RealSense 3D and VoiceAssist, we should have several new ways to interact with our computers, hybrids, and 2-in-1s—and soon.

Editors' Recommendations

Topics
William Harrel
William Harrel has been writing about computer technology for well over 25 years. He has authored or coauthored 20…
Why Llama 3 is changing everything in the world of AI
Meta AI on mobile and desktop web interface.

In the world of AI, you've no doubt heard about what OpenAI and Google have been up to. And now, Meta's Llama LLM (large language model) is becoming an increasingly important player in the game, especially with its open-source nature. Meta recently made a big splash with the launch of its Llama 3 AI model, and it's shaken up the field dramatically.

The reasons why are multiple and varied. It's free to use, it has a wide user base, and yes, it's open source, to name but a few. Here's why Llama 3 is taking the AI industry by storm and may shape its future for some time to come.
Llama 3 is really good
We can debate until the cows come home about how useful AIs like ChatGPT and Llama 3 are in the real world -- they're not bad at teaching you board game rules -- but the few benchmarks we have for how capable these AI are give Llama 3 a distinct advantage.

Read more
How to delete messages on your Mac
A MacBook and iPhone in shadow on a surface.

Apple likes to make things easy for its iPhone, iPad, and macOS devotees. When signed in with the same Apple ID on more than one of these devices, you’ll be able to sync your messages from one Apple product to the next. This means when you get a text on your iPhone, you’ll be able to pull it up through the Messages app on your Mac desktop.

Read more
The best laptop brands for 2024
best laptop brands hp spectre x360 13  2021 1

If you like to write, browse, game, or work in different parts of your home or office, one of the best laptops is a necessity in 2024. There are many to choose from, but you can first narrow your options by looking at laptops from the most established and respected brands.

Here's a list of the best laptop brands in 2024 to get you started.
Dell

Read more