Microsoft’s OmniTouch turns any surface into a touchscreen

By Mike Flacy Published October 17, 2011

Omnitouch — Image used with permission by copyright holder

With the combined effort of the Carnegie Mellon Human Computer Interaction Institute and Microsoft, researchers have developed wearable hardware that turns any surface into a usable workspace. Similar in design to the Microsoft Kinect for the Xbox 360, the OmniTouch device uses a camera that senses short-range depth, a small pico projector and a 3D modeling system to understand where the user is touching. The projector and the camera have to be calibrated to the user in order for the touch system to accurately match up to the user’s actions. The device can sense when a user’s hand if hovering over the surface as well as understand the depth when a user taps a button on the main surface.

The surface can be anything from a nearby table to something as simple as the human hand. The current size of the device is approximately the same size at the Kinect, but researchers are planning to shrink the device down as they continue to modify the hardware. A demonstration of the hardware showed users dialing a number on the phone interface, likely tying into a future ability to dial a number on a smartphone. Another example alerted the user to a new email and the user had the ability to select a new surface and define a region for the email to appear. Users could also zoom and pan around within the application.

Recommended Videos

When projecting the main screen on a surface like a desk or table, the user can bring up a full QWERTY keyboard to type. The user can also use their hand to pull up a secondary pop-up menu to interact with the program on the main screen. The research team completed the OmniTouch prototype while working at Microsoft Research in Redmond, Washington. For more information and media on the OmniTouch, take a look at one of the researcher’s personal Web page.

Contributing Editor

By day, I'm the content and social media manager for High-Def Digest, Steve's Digicams and The CheckOut on Ben's Bargains…

Topics

Cars

The Apple Car may be dead, but it became the foundation of Apple Intelligence

A decade of work on a canceled car project reportedly laid the groundwork for Apple Intelligence.

Apple Intelligence in Apple Car

The Apple Car may have never left the garage, but it apparently gave birth to Apple's AI ambitions. According to Bloomberg's Mark Gurman, Apple's canceled autonomous vehicle project, one that consumed more than a decade of work and over $10 billion before being scrapped in 2024, ended up laying the technological foundation for Apple Intelligence. In a rather ironic twist, one of Apple's most expensive failures may also become one of its most important long-term investments.

The Apple Car forced Apple to think like an AI company

Emerging Tech

Researchers hid a prompt injection inside a PNG, and AI fell for it

Hacker

AI coding assistants like Claude are becoming every developer's favorite coworker. They can review code, explain confusing functions, and even write entire features with a single prompt. But new research suggests that this growing trust could also become their biggest weakness.

A team of security researchers (professor Sudipta Chattopadhyay and researcher Murali Ediga) has demonstrated an unusual attack that doesn't target the AI model directly. Instead, it targets what the AI doesn't pay enough attention to during code reviews. Rather than hiding malicious instructions in lines of code, the researchers tucked them inside an image file. Since many AI review tools treat images as decorative assets rather than as something worth inspecting, the pull request can appear perfectly harmless and sail through the review.

Emerging Tech

AI has already fallen into the wrong hands and they’re using it to make bombs

Artificial intelligence has quickly become the go-to tool for everything from writing emails and summarizing meetings to helping students study or developers debug code. But the same technology that saves people time can also be misused, and a new report suggests that terrorist organizations are finding ways to do exactly that.

According to a research paper shared with The New York Times ahead of its publication, researchers found evidence that members of Boko Haram have been using popular AI chatbots to support both day-to-day activities and combat-related tasks. Interviews with 27 former members conducted in Nigeria over the past two years suggest that tools such as ChatGPT, Gemini, Claude, Grok, Meta AI, and DeepSeek were used to gather technical information, troubleshoot weapons, and even assist with planning attacks.