Skip to main content
  1. Home
  2. Emerging Tech
  3. News

Social robots taught to ask for clarification when confused about a command

Add as a preferred source on Google

Robots already work the front desk in some hotels, run cash registers at a few fast food restaurants, and clean up around the house for us. Though they’ve been programmed to receive to commands, they rarely engage in meaningful, dynamic communications with us like other people do. But if social robots are ever going to truly catch on, they’ll need to learn to communicate and pick up on social cues.

A team of researchers from Brown University are working to instill this social competence into robots, recently developing an algorithm that allows them to perform tasks better by collaborating with people.

Recommended Videos

In the study, conducted by Brown’s Humans to Robots Laboratory, the robots were programmed to ask for clarification. When a person told the robot to grab a certain object, the robot could ask “Which one?” if the command was ambiguous. This communication allowed the robot to perform tasks 25 percent faster and 2.1 percent more accurate than a state-of-the-art baseline, according to the research, which will be presented at the International Conference on Robotics and Automation in Singapore this spring.

Reducing Errors in Object-Fetching Interactions through Social Feedback

The goal for the Brown lab at this point is less about creating flawless machines than it is about creating machines that can catch and correct their mistakes.

“It is very hard to go from 90 percent accuracy to 99.9 percent accuracy,” Stefanie Tellex, computer science professor and lead researcher, told Digital Trends. “Yet 90 percent accuracy means the robot will fail on one in ten interactions. If it is interacting with you every day, that means it will fail every single day. With our technology though, the robot will automatically detect the failure and ask questions.

“Using this feedback loop, a failure isn’t the end of the story,” she added. “It can ask a question, and recover.”

The question-asking algorithm is a step forward for Tellex and her team, which previously created an algorithm that could respond to verbal and gesture commands from people. However, the new system does becomes confused when asked to retrieve an object among many other similar objects on the table. The algorithm still worked surprisingly well for untrained participants though, who even assumed it could understand and respond to complex phrases that it wasn’t programmed to comprehend.

“We envision robots assisting astronauts in space,” Tellex said, pointing out that the research was funded in part by NASA. She also thinks these machines could help workers here on Earth from the assisting patients at hospitals to people at home.

Dyllan Furness
Former Contributor
Dyllan Furness is a freelance writer from Florida. He covers strange science and emerging tech for Digital Trends, focusing…
A new startup wants to fix the military’s working-dog shortage with cloning and gene editing
Promising pitch, plenty of unanswered questions about the dogs.
a new startup wants to fix the militarys working dog shortage with cloning and gene editing warhound featured image

Military working dogs charge into places the rest of us would flee. So, I understand why anyone would want to breed tougher, healthier dogs for the job.

Warhound, a new startup from Colossal Biosciences co-founder Ben Lamm and Anduril co-founder Palmer Luckey, has stepped out of stealth with $200 million to clone and gene-edit working dogs for American troops, police departments, and emergency services (via TechCrunch).

Read more
AI can describe a picture, but it still struggles to understand blind users
A University of Maryland study finds that Be My AI often buries useful answers in lengthy descriptions, leaving blind users to work harder to get the information they need.
Blind Man using walking stick

AI can describe a picture, identify objects, and answer questions about what a camera sees. But when a blind user needs a quick answer, getting an entire spoken essay about the scene isn't exactly helpful. Researchers at the University of Maryland (UMD) have found that AI-powered visual assistance can leave blind users doing too much work to get the information they actually need.

The study, titled Say It My Way: Exploring Control in Conversational Visual Question Answering with Blind Users, examined how people interact with Be My AI, an AI-powered feature of the Be My Eyes app. The researchers found that users often received lengthy descriptions that didn't adequately address their immediate goals, forcing them to ask follow-up questions or find ways to steer the AI towards a more useful answer.

Read more
Etsy cracks down on AI slop listings. Everyone else needs to take note.
Now every platform must decide what counts as handmade.
Etsy featured image

Platforms tend to shrug off AI clutter until it threatens what they sell. For Etsy, that thing is trust in the maker.

To protect that, Etsy has banned AI-generated how-to guides and listings made entirely by bots. Most sellers must show at least one unretouched photo of the item (via Etsy Seller Handbook).

Read more