Skip to main content

Georgia Tech researchers upgrade robot arm with point-and-click interface

Georgia Tech Creates Point and Click Method for Controlling Robots
The Georgia Institute of Technology has developed a new, intuitive method for controlling a robotic arm: Point and click. While not exactly like the adventure games of old, it definitely draws its inspiration from the ability to highlight objects and perform a small selection of preselected tasks.

Although typical robotic arm controls offer a wide variety of options thanks to six degrees of motion, that can be cumbersome for people just getting to grips with the technology. What the new solution looks to do, is make it possible for novice robotics owners to utilize the technology in a manner that has a much shorter and shallower difficulty curve.

“Roboticists design machines for specific tasks, then often turn them over to people who know less about how to control them,” said David Kent, a Georgia Tech robotics doctoral student who headed up the project. “Most people would have a hard time turning virtual dials if they needed a robot to grab their medicine. But pointing and clicking on the bottle? That’s much easier.”

While simpler on the surface, such a system is a lot more complicated under the hood. Instead of displaying 3D information to the user, they simply offer a video feed. However, the arm itself needs to understand the 3D environment and know that when a person clicks on an object in the background and tells it to pick it up, it must differentiate that from objects in the foreground. It needs to know the distance that it must travel and the correct angle to “attack” it from.

The algorithm that the research team has come up with is capable of analyzing the geometry of objects, even making assumptions about them when the camera can’t see their entirety. This is something that the human brain does automatically, the researchers explained, but it was a challenge to make the robotic arm infer that detail for itself.

Although this technique of control does bequeath much of the responsibility of control to the algorithm and the arm, the system is actually less error prone than giving humans full control. In a trial, researchers found the point and click method delivered only one mistake per task, whereas the more traditional six degrees of motion control method had as many as four per task.

By giving users control over what to grab and how to do so when the arm is in the right position, researchers hope that robotic technology could more easily be adopted by those without training, or with limited mobility themselves, like the elderly. There are also potential applications for such robotic arms in sensitive settings, like search and rescue operations or in space travel.

Editors' Recommendations

Jon Martindale
Jon Martindale is the Evergreen Coordinator for Computing, overseeing a team of writers addressing all the latest how to…
How to do hanging indent on Google Docs
Google Docs in Firefox on a MacBook.

The hanging indent is a classic staple of word processing software. One such platform is Google Docs, which is completely free to start using. Google Docs is packed with all kinds of features and settings, to the point where some of its more basic capabilities are overlooked. Sure, there are plenty of interface elements you may never use, but something as useful as the hanging indent option should receive some kind of limelight.

Read more
How to disable VBS in Windows 11 to improve gaming
Highlighting VBS is disabled in Windows 11.

Windows 11's Virtualization Based Security features have been shown to have some impact on gaming performance — even if it isn't drastic. While you will be putting your system more at risk, if you're looking to min-max your gaming PC's performance, you can always disable it. Just follow the steps below to disable VBS in a few quick clicks.

Plus, later in this guide, we discuss if disabling VBS is really worth it, what you'd be losing if you choose to disable it, and other options for boosting your PCs gaming performance that don't necessarily involve messing with VBS.

Read more
How to do a hanging indent in Microsoft Word
A person typing on a keyboard, connected to a Pixel Tablet.

Microsoft Word is one of the most feature-rich word processing tools gifted to us human beings. In fact, the very word “Word” has invaded nomenclature to the point where any discussion of this type of software, regardless of what the product is actually called, typically results in at least one person calling the software “Word.”

Read more