Skip to main content

Researchers develop always-on camera that only responds to certain gestures

georgia tech smart gesture camera justinn romberg and arijit raychowdury
Rob Felt / Georgia Tech
Motion detection cameras are widely used in applications from security to gaming, but a group from Georgia Tech is designing a camera that will recognize a “secret handshake” of sorts and only respond to certain types of movement. On top of that, the group has adjusted the hardware and software to make the device so energy efficient that it can, theoretically, always be on.

The always-on camera uses the gesture recognition to improve efficiency — since the camera doesn’t have to analyze every pixel to determine whether or not to record. “What this camera is actually looking at is not pixel values, but pixels added together in all different ways and a dramatically smaller number of measurements than if you had it in standard mode,” said Georgia Tech School of Electrical and Computer Engineering professor Justin Romberg.

Recommended Videos

With less to analyze, the software gives the camera a big efficiency boost, which is improved even more by a lower frame rate as well as hardware changes. That efficiency is essential for many remote applications, researchers say. The camera could also be used in surveillance and robotics or, more simply, for taking selfies hands-free.

Please enable Javascript to view this content

“Cameras are being added to more and more devices these days, but they don’t have much interactivity,” said Arijit Raychowdhury, an associate professor in the Georgia Tech School of Electrical and Computer Engineering. “What we are studying are smart cameras that can look at something specific in the environment at extreme energy efficiencies and process the data for us.”

The group is working to make the camera energy efficient enough that it can run solely on ambient energy, such as solar power. Along with conserving energy, the gesture feature could also prevent a data overload — essentially running out of room on an SD card or internal hard drive — from recording unnecessary images, in the way that wind can trigger a traditional motion sensor.

The team, which also includes Anvesha A, Shaojie Xu and Ningyuan Cao, is next looking to add wireless capabilities to send the images to another device remotely. The project is being supported by Intel Corp. and the National Science Foundation.

Hillary K. Grigonis
Hillary never planned on becoming a photographer—and then she was handed a camera at her first writing job and she's been…
Hyundai Ioniq 5 sets world record for greatest altitude change
hyundai ioniq 5 world record altitude change mk02 detail kv

When the Guinness World Records (GWR) book was launched in 1955, the idea was to compile facts and figures that could finally settle often endless arguments in the U.K.’s many pubs.

It quickly evolved into a yearly compilation of world records, big and small, including last year's largest grilled cheese sandwich in the world.

Read more
Global EV sales expected to rise 30% in 2025, S&P Global says
ev sales up 30 percent 2025 byd sealion 7 1stbanner l

While trade wars, tariffs, and wavering subsidies are very much in the cards for the auto industry in 2025, global sales of electric vehicles (EVs) are still expected to rise substantially next year, according to S&P Global Mobility.

"2025 is shaping up to be ultra-challenging for the auto industry, as key regional demand factors limit demand potential and the new U.S. administration adds fresh uncertainty from day one," says Colin Couchman, executive director of global light vehicle forecasting for S&P Global Mobility.

Read more
Faraday Future could unveil lowest-priced EV yet at CES 2025
Faraday Future FF 91

Given existing tariffs and what’s in store from the Trump administration, you’d be forgiven for thinking the global race toward lower electric vehicle (EV) prices will not reach U.S. shores in 2025.

After all, Chinese manufacturers, who sell the least expensive EVs globally, have shelved plans to enter the U.S. market after 100% tariffs were imposed on China-made EVs in September.

Read more