Could posture-based inputs soon replace keyboard shortcuts?

By Brad Jones May 17, 2016

finger aware shortcuts — Jingjie Zheng/University of Waterloo

Researchers at the University of Waterloo in Ontario, Canada, may have found a way to make your keystrokes more productive. A team working at the David R. Cheriton School of Computer Science has published a study that demonstrates how different hand positions can be used as shortcuts.

The paper outlines how a laptop camera can be repurposed to watch over the user’s hands as they operate the keyboard. This camera would determine whether the hand was open or closed, recognizing particular postures in place of a shortcut activated via a combination of keys.

The study suggests 10 simple postures per hand: each finger outstretched individually to press a key, with the hand being either open or closed. These postures were then filtered into three categories based on comfort: recommended, intermediate and avoided.

The postures were then put head to head with the most common forms of keyboard shortcut mappings. These range from individual keys used in applications like Photoshop that require minimal text entry, to shortcuts that use a single modifier key like Ctrl or Shift combined with several different keys, and the inverse.

An experiment demonstrated that posture-based shortcuts were about as effective as traditional shortcuts that use one key and three modifiers. Shortcuts that use three keys and a single modifier and those that just use single keys both fared a little better.

The paper describes these results as “encouraging,” because the participants were completely unfamiliar with the posture-based shortcuts, but had some experience with the other methods from their own computer usage. It’s expected that users could become even more proficient with a little more time to acclimate.

While computer hardware is in a constant state of evolution, the methods we use to interact with it have remained much the same for years. It might seem unlikely that users could be convinced to relearn input methods to such a dramatic degree, but given the rise of the touchscreen over the past decade, there’s evidence that a majority are willing to learn something new.

Editors' Recommendations

Topics

Former Digital Trends Contributor

Brad is an English-born writer currently splitting his time between Edinburgh and Pennsylvania. You can find him on Twitter…

Computing

Quest Pro 2: What we know about Meta’s next premium VR headset

From a side view, you can see how glasses can be worn along with a Quest Pro.

While Meta’s Quest Pro is one of the best VR headsets available, it never reached its full potential as a laptop replacement for spatial computing. Meta hasn’t given up on making a work-centric solution, and rumors suggest a Meta Quest Pro 2 is still in development. Here’s what we know so far about Meta's answer to Apple's Vision Pro.
Meta Quest Pro 2 release date speculation
It’s difficult to make a solid prediction on when Meta will launch the Quest Pro 2. Meta CTO Andrew “Boz” Bosworth made it clear in an Instagram AMA that Meta is continually prototyping new VR headsets to find out what’s possible with current technology. That gives Meta more flexibility than manufacturers that research for years before doing hardware testing.

If Meta is satisfied with the performance of the Snapdragon XR2+ Gen 2 and LG can deliver enough micro-OLED displays, the Quest Pro 2 could arrive as early as this October at Meta Connect 2024.

Computing

Does RAM speed matter for PC performance?

Installing RAM sticks in a motherboard.

RAM is one of the primary components in a PC, and it's important that you have at least a certain amount of RAM depending on what you want to do with your PC. However, there are more things to RAM than just capacity: Frequency and latency are important considerations, too.

The question of whether RAM speed matters is especially important now that we have two generations of RAM available, both DDR4 and DDR5 -- and they have vastly different speeds. The official maximum clock speed for DDR4 was 3200MHz, while DDR5 starts at 4800MHz, an increase of 50%; however, you'll easily find RAM kits reaching above 7000MHz. Although latency significantly went up, from CL14 on most 3200MHz DDR4 kits to CL40 on most 4800MHz DDR5 kits, DDR5 is still found to be faster.

Computing

The 6 best 2-in-1 laptops for drawing in 2024

Portal RTX running on the Surface Laptop Studio 2.

Whether you're a seasoned professional or enjoy drawing as a hobby, investing in a 2-in-1 laptop is a great idea for all sorts of artists. Drawing on a laptop makes it easy to quickly share your creation with others, which is especially useful if you're doing it as a professional–negating the need to upload your pen-and-paper sketch to the computer before sending it to a client. Moreover, working on a laptop lets you undo mistakes, zoom in to better handle small details, and quickly change utensils.

There are a lot of perks to drawing on a 2-in-1 laptop, but not all of them are great for creators. Some have unresponsive displays that can't register all your movements, while others might have a lackluster resolution or color spectrum that turns most images into a muddled mess. Because of that, it can be hard figuring out which laptop is best for your needs. And if you'll be spending a good chunk of change on the laptop, you'll want to make sure you get it right.