Skip to main content
  1. Home
  2. Computing
  3. News

MIT learns to make robots less clumsy by putting cameras in their fingers

Add as a preferred source on Google

New research from the Massachusetts Institute of Technology could help robots get a literal grip.

Two research groups from the Computer Science and Artificial Intelligence Lab (CSAIL) today shared research to improve grippers in soft robotics, which unlike traditional robotics, uses flexible materials.

Recommended Videos

The technology could lead to robotic hands that are not only able to grasp a variety of items but also sense what the object is and even twist and bend it.

Using a method called GelFlex, one research group embedded cameras in the “fingertips” of a two-fingered gripper, allowing the robotic arm to better grasp different shapes, from large items like cans to thin objects like a CD case. The researchers found the GelFlex had an accuracy rate of more than 96% at recognizing different shaped objects to grasp.

Using a transparent silicone for the finger, the group embedded cameras with fisheye lenses. By painting the fingers with a reflective ink and adding LED lights, the embedded camera could see how the silicon on the opposite finger responded to the feel of the object. Using specially trained artificial intelligence, the computer used data on how the finger bent to estimate the shape and size of the object.

“Our soft finger can provide high accuracy on proprioception and accurately predict grasped objects, and also withstand considerable impact without harming the interacted environment and itself,” said Yu She, the lead author of the paper. “By constraining soft fingers with a flexible exoskeleton, and performing high-resolution sensing with embedded cameras, we open up a large range of capabilities for soft manipulators.”

Another research team developed a system of sensors that, through touch, allowed soft robotic hands to correctly identify what it was picking up more than 90 percent of the time. The project gives a cone-shaped gripper, created from earlier research from MIT and Harvard, tactile sensors. The team is lead by postdoc Josie Hughes as well as professor and CSAIL director Daniela Rus.

The sensors are miniature latex “balloons” connected to a pressure transducer or sensor. Changes in the pressure on those balloons are fed to an algorithm to determine how to best grasp the object.

Adding the sensors to a robotic hand that’s both soft and strong allows the gripper to pick up small delicate objects, like a potato chip — and also classify what that item is. By understanding what the object is, the gripper can correctly grasp the object, rather than turning the potato chip to crumbs.

While having a robot feed you potato chips sounds cool, the research is likely destined for manufacturing. Further research, however, could potentially lead to robotic “skin” that can sense the feel of different objects.

Hillary K. Grigonis
Hillary never planned on becoming a photographer—and then she was handed a camera at her first writing job and she's been…
Microsoft has begun rolling out Copilot Code for building apps with natural language
The workplace-focused vibe coding tool can pull context from emails, documents, meetings, and chats.
Microsoft Copilot code logo

Microsoft introduced Code last month as one of the three core parts of its revamped Copilot app. The app was pitched as an easy-to-use coding agent that lets users describe what they want to build in natural language, like an app, a tracker, a dashboard, an automation, or a workflow, and Copilot would build it for them.

Essentially, it's a workplace-focused vibe-coding app that turns existing work into a functional app, and Microsoft has begun rolling it out through the Frontier program.

Read more
AI agents are acting like rogues and causing a huge headache for US banks
US banks block AI agents over fears they could make unauthorised financial moves
Banking

US banks are facing a new kind of digital headache: artificial intelligence agents attempting to access customer accounts and perform actions that may go beyond what users intended. As AI tools become more capable of navigating websites and carrying out tasks independently, financial institutions are scrambling to prevent them from crossing security boundaries.

According to a report published by Axios on October 22, major US banks have detected third-party AI agents operating inside customer accounts without authorisation. Some agents reportedly appeared to attempt actions independently of user instructions. The banks involved have not publicly detailed every incident, and there is no evidence that the reported activity resulted in widespread theft of customer funds.

Read more
Canva enters the AI image generation race with Craft, and it’s thinking beyond pretty pictures
The new model plans layouts before generating images, with precise editing and support for 30 aspect ratios.
Canva Craft Featured Image

AI can generate all kinds of pretty pictures, but getting it to spell a headline correctly or keep a poster's layout intact can be another story. Canva wants to fix that with Canva Craft, its first in-house image generation model. Rather than focusing primarily on photographs, Craft is designed around the posters, presentations, social media graphics, and other visual content people actually create. The goal is simple: spend less time fixing AI's mistakes and more time making something useful.

Canva Craft plans before it generates

Read more