Skip to main content

Researchers develop always-on camera that only responds to certain gestures

georgia tech smart gesture camera justinn romberg and arijit raychowdury
Rob Felt / Georgia Tech
Motion detection cameras are widely used in applications from security to gaming, but a group from Georgia Tech is designing a camera that will recognize a “secret handshake” of sorts and only respond to certain types of movement. On top of that, the group has adjusted the hardware and software to make the device so energy efficient that it can, theoretically, always be on.

The always-on camera uses the gesture recognition to improve efficiency — since the camera doesn’t have to analyze every pixel to determine whether or not to record. “What this camera is actually looking at is not pixel values, but pixels added together in all different ways and a dramatically smaller number of measurements than if you had it in standard mode,” said Georgia Tech School of Electrical and Computer Engineering professor Justin Romberg.

With less to analyze, the software gives the camera a big efficiency boost, which is improved even more by a lower frame rate as well as hardware changes. That efficiency is essential for many remote applications, researchers say. The camera could also be used in surveillance and robotics or, more simply, for taking selfies hands-free.

“Cameras are being added to more and more devices these days, but they don’t have much interactivity,” said Arijit Raychowdhury, an associate professor in the Georgia Tech School of Electrical and Computer Engineering. “What we are studying are smart cameras that can look at something specific in the environment at extreme energy efficiencies and process the data for us.”

The group is working to make the camera energy efficient enough that it can run solely on ambient energy, such as solar power. Along with conserving energy, the gesture feature could also prevent a data overload — essentially running out of room on an SD card or internal hard drive — from recording unnecessary images, in the way that wind can trigger a traditional motion sensor.

The team, which also includes Anvesha A, Shaojie Xu and Ningyuan Cao, is next looking to add wireless capabilities to send the images to another device remotely. The project is being supported by Intel Corp. and the National Science Foundation.

Hillary K. Grigonis
Hillary never planned on becoming a photographer—and then she was handed a camera at her first writing job and she's been…
Why AI will never rule the world
image depicting AI, with neurons branching out from humanoid head

Call it the Skynet hypothesis, Artificial General Intelligence, or the advent of the Singularity -- for years, AI experts and non-experts alike have fretted (and, for a small group, celebrated) the idea that artificial intelligence may one day become smarter than humans.

According to the theory, advances in AI -- specifically of the machine learning type that's able to take on new information and rewrite its code accordingly -- will eventually catch up with the wetware of the biological brain. In this interpretation of events, every AI advance from Jeopardy-winning IBM machines to the massive AI language model GPT-3 is taking humanity one step closer to an existential threat. We're literally building our soon-to-be-sentient successors.

Read more
The best hurricane trackers for Android and iOS in 2022
Truck caught in gale force winds.

Hurricane season strikes fear into the hearts of those who live in its direct path, as well as distanced loved ones who worry for their safety. If you've ever sat up all night in a state of panic for a family member caught home alone in the middle of a destructive storm, dependent only on intermittent live TV reports for updates, a hurricane tracker app is a must-have tool. There are plenty of hurricane trackers that can help you prepare for these perilous events, monitor their progress while underway, and assist in recovery. We've gathered the best apps for following storms, predicting storm paths, and delivering on-the-ground advice for shelter and emergency services. Most are free to download and are ad-supported. Premium versions remove ads and add additional features.

You may lose power during a storm, so consider purchasing a portable power source,  just in case. We have a few handy suggestions for some of the best portable generators and power stations available. 

Read more
Don’t buy the Meta Quest Pro for gaming. It’s a metaverse headset first
Meta Quest Pro enables 3D modeling in mixed reality.

Last week’s Meta Connect started off promising on the gaming front. Viewers got release dates for Iron Man VR, an upcoming Quest game that was previously a PS VR exclusive, as well as Among Us VR. Meta, which owns Facebook, also announced that it was acquiring three major VR game studios -- Armature Studio, Camouflaj Team, and Twisted Pixel -- although we don’t know what they’re working on just yet.

Unfortunately, that’s where the Meta Connect's gaming section mostly ended. Besides tiny glimpses and a look into fitness, video games were not the show's focus. Instead, CEO Mark Zuckerberg wanted to focus on what seemed to be his company’s real vision of VR's future, which involves a lot of legs and a lot of work with the Quest Pro, a mixed reality headset that'll cost a whopping $1,500.

Read more