Skip to main content
  1. Home
  2. Computing
  3. News

MIT learns to make robots less clumsy by putting cameras in their fingers

Add as a preferred source on Google

New research from the Massachusetts Institute of Technology could help robots get a literal grip.

Two research groups from the Computer Science and Artificial Intelligence Lab (CSAIL) today shared research to improve grippers in soft robotics, which unlike traditional robotics, uses flexible materials.

Recommended Videos

The technology could lead to robotic hands that are not only able to grasp a variety of items but also sense what the object is and even twist and bend it.

Using a method called GelFlex, one research group embedded cameras in the “fingertips” of a two-fingered gripper, allowing the robotic arm to better grasp different shapes, from large items like cans to thin objects like a CD case. The researchers found the GelFlex had an accuracy rate of more than 96% at recognizing different shaped objects to grasp.

Using a transparent silicone for the finger, the group embedded cameras with fisheye lenses. By painting the fingers with a reflective ink and adding LED lights, the embedded camera could see how the silicon on the opposite finger responded to the feel of the object. Using specially trained artificial intelligence, the computer used data on how the finger bent to estimate the shape and size of the object.

“Our soft finger can provide high accuracy on proprioception and accurately predict grasped objects, and also withstand considerable impact without harming the interacted environment and itself,” said Yu She, the lead author of the paper. “By constraining soft fingers with a flexible exoskeleton, and performing high-resolution sensing with embedded cameras, we open up a large range of capabilities for soft manipulators.”

Another research team developed a system of sensors that, through touch, allowed soft robotic hands to correctly identify what it was picking up more than 90 percent of the time. The project gives a cone-shaped gripper, created from earlier research from MIT and Harvard, tactile sensors. The team is lead by postdoc Josie Hughes as well as professor and CSAIL director Daniela Rus.

The sensors are miniature latex “balloons” connected to a pressure transducer or sensor. Changes in the pressure on those balloons are fed to an algorithm to determine how to best grasp the object.

Adding the sensors to a robotic hand that’s both soft and strong allows the gripper to pick up small delicate objects, like a potato chip — and also classify what that item is. By understanding what the object is, the gripper can correctly grasp the object, rather than turning the potato chip to crumbs.

While having a robot feed you potato chips sounds cool, the research is likely destined for manufacturing. Further research, however, could potentially lead to robotic “skin” that can sense the feel of different objects.

Hillary K. Grigonis
Hillary never planned on becoming a photographer—and then she was handed a camera at her first writing job and she's been…
Subvocal’s glasses promise to let you talk to your computer in complete silence
Voice dictation is incredibly convenient, but talking to your computer in public can be embarrassing. Subvocal thinks it has a solution.
Subvocal smart glasses use radar to track your mouth movement and convert it to text using AI

Typing has always been a bottleneck between what we think and how quickly we can communicate it to a computer. AI-powered dictation tools like Wispr Flow have made things considerably better. You can practically ramble your way through an entire email, or even an article, and have it transcribed into text in seconds.

But there's a rather awkward problem with talking to your computer. Try doing it in a quiet office, a library, or even your favorite cafe, and more often than not, you tend to attract some attention or end up disturbing others. A startup called The Subvocal Company thinks it has found a solution to this issue. It has developed a pair of smart glasses that promise to turn silent mouth movements into text at over 200 words per minute.

Read more
North Korean hackers pull off a $6.3 billion crypto heist in one of the biggest thefts so far
Cryptocurrency issuers and networks froze approximately $2.7 billion, the remaining stolen assets pose a major challenge.
binance-crypto-theft

North Korean hackers have stolen a staggering $6.36 billion in cryptocurrency from Binance, according to blockchain intelligence firm TRM Labs. On October 29 the attack reportedly drained funds across 10 different blockchains in roughly 20 minutes. TRM attributes the operation to TraderTraitor, a North Korean state-sponsored hacking group.

How did hackers steal $6.3 billion from Binance?

Read more
Apple has finally made it easier to find your lost TV remote, and it’s about time
One less thing to turn the sofa upside down for.
Apple TV 4K New

I’ve always found it odd that my iPhone can track my AirPods and my Mac. But for some odd reason, I can’t use it to find my Apple TV remote, which is probably the most easily lost thing in the entire house. Fortunately, that has changed.

iOS 27.2 now lets the Find My app track Apple TV 4K remotes, officially called the Siri Remote. Finally, you can hunt down a lost one like a missing iPhone.

Read more