Skip to main content
  1. Home
  2. Computing
  3. News

MIT learns to make robots less clumsy by putting cameras in their fingers

Add as a preferred source on Google

New research from the Massachusetts Institute of Technology could help robots get a literal grip.

Two research groups from the Computer Science and Artificial Intelligence Lab (CSAIL) today shared research to improve grippers in soft robotics, which unlike traditional robotics, uses flexible materials.

Recommended Videos

The technology could lead to robotic hands that are not only able to grasp a variety of items but also sense what the object is and even twist and bend it.

Using a method called GelFlex, one research group embedded cameras in the “fingertips” of a two-fingered gripper, allowing the robotic arm to better grasp different shapes, from large items like cans to thin objects like a CD case. The researchers found the GelFlex had an accuracy rate of more than 96% at recognizing different shaped objects to grasp.

Using a transparent silicone for the finger, the group embedded cameras with fisheye lenses. By painting the fingers with a reflective ink and adding LED lights, the embedded camera could see how the silicon on the opposite finger responded to the feel of the object. Using specially trained artificial intelligence, the computer used data on how the finger bent to estimate the shape and size of the object.

“Our soft finger can provide high accuracy on proprioception and accurately predict grasped objects, and also withstand considerable impact without harming the interacted environment and itself,” said Yu She, the lead author of the paper. “By constraining soft fingers with a flexible exoskeleton, and performing high-resolution sensing with embedded cameras, we open up a large range of capabilities for soft manipulators.”

Another research team developed a system of sensors that, through touch, allowed soft robotic hands to correctly identify what it was picking up more than 90 percent of the time. The project gives a cone-shaped gripper, created from earlier research from MIT and Harvard, tactile sensors. The team is lead by postdoc Josie Hughes as well as professor and CSAIL director Daniela Rus.

The sensors are miniature latex “balloons” connected to a pressure transducer or sensor. Changes in the pressure on those balloons are fed to an algorithm to determine how to best grasp the object.

Adding the sensors to a robotic hand that’s both soft and strong allows the gripper to pick up small delicate objects, like a potato chip — and also classify what that item is. By understanding what the object is, the gripper can correctly grasp the object, rather than turning the potato chip to crumbs.

While having a robot feed you potato chips sounds cool, the research is likely destined for manufacturing. Further research, however, could potentially lead to robotic “skin” that can sense the feel of different objects.

Hillary K. Grigonis
Hillary never planned on becoming a photographer—and then she was handed a camera at her first writing job and she's been…
Microsoft wants Windows 11’s right-click menu to work the way it should, by giving users more control
A new compact design promises better performance, cleaner menus, and long-awaited customization options.
Windows 11 laptop on a desk

One of the biggest complaints about Windows 11 since launch has been its slow and cluttered right-click menu. Now, Microsoft appears ready to finally address both issues. According to a new report from Windows Central, the company is working on a major overhaul of Windows 11's context menu, introducing a new compact design that's not only faster to load but also fully customizable. The redesign is said to be part of Microsoft's broader Windows K2 initiative, which focuses on improving the operating system's performance, consistency, and overall user experience.

A faster menu with less clutter

Read more
Maingear’s Zero desktop is a wire-free beauty with curved glass and plenty of firepower
Hate cables? This is the one to get if a clutter-free PC was ever your dream.
Maingear Zero desktop PC.

When building a PC, especially one that you want to flaunt, wires always spoil the looks if you are chasing the glass aesthetic. Exposed cables, visible RGB strips, and cooling tubes spoil the whole look. Maingear finally has a solution for fans of glass-y desktops.  

The brand has today introduced its next-gen Zero series pre-built desktop PCs that focus on a minimalist look as much as they are concerned about serving brute computing power. The objective, as per Maingear, is to deliver “no visible motherboard cables, no exposed RGB diodes, and nothing standing between you and your build."

Read more
Lenovo’s leaked Yoga 9n could be the first RTX Spark-powered convertible laptop
NVIDIA RTX Spark, a 360-degree design, and AI-focused hardware could make this Lenovo's most ambitious Yoga yet.
Lenovo Yoga 9n 2-in-1 Featured leak

NVIDIA's RTX Spark platform is about to make its way into an entirely new category of laptops. Freshly leaked images suggest Lenovo is working on the Yoga 9n 2-in-1, which is expected to become the world's first convertible laptop powered by NVIDIA's RTX Spark (N1X) superchip. The leak, published by Windows Latest, shows a premium 360-degree Yoga convertible that closely resembles the existing Yoga 9i, but swaps Intel's processor for NVIDIA's new Arm-based AI platform.

A familiar Yoga design with a new heart

Read more