Skip to main content

Robot learns how to grab objects by analyzing them in simulated reality

Our hands are pretty great at picking up all manner of objects, while our brains are fine-tuned at working out exactly where and how to pick up an object most securely. That’s not easy for a robot, however. Faced with a world full of strange-shaped objects to pick up and manipulate, there’s no easy way of programming a robot to be able to know the precise grip it should employ to deal with every single object it might encounter.

That’s where researchers from the University of California, Berkeley come into play. They’ve developed a system called DexNet 2.0 that works out how to perform this task not by endlessly practicing in real life, but by analyzing the objects in virtual reality — courtesy of a deep learning neural network.

Recommended Videos

“We construct a probabilistic model of the physics of grasping, rather than assuming the robot knows the true state of the world,” Jeff Mahler, a postdoctoral researcher who worked on the project, told Digital Trends. “Specifically we model the robustness, or probability of achieving a successful grasp, given an observation of the environment. We use a large dataset of 1,500 virtual 3D models to generate 6.7 million synthetic point clouds and grasps across many possible objects. Then we can learn to predict the probability of success of grasps given a point cloud using deep learning. Deep learning allows us to learn this mapping across such as large and complex dataset.”

Image used with permission by copyright holder

The most obvious application for DexNet would be to improve robots used in warehousing or manufacturing by enabling them to cope with new components or other objects, and be able to manipulate them by packing them into boxes for shipping or performing assemblies. However, as Mahler points out, the technology could also help improve the capabilities of home robots — such as those that can clean up items or be used for assistive care, such as bringing items to elderly folks who can’t otherwise reach them.

There’s still more work to be done, though. “The big thrust of research in the next year is related to having the robot grasp for a particular use case,” Mahler said. “For example, orienting a bottle so it can be placed standing up or flipping legos over to plug them into other bricks.”

Other specifics on the agenda include the ability to grasp objects in clutter and reorienting objects for assembly. The team also plans to release the necessary code to let users generate their own training datasets and deploy the system on their own parallel-jaw robot. This will take place later in 2017.

“We have some interest in commercialization, but are primarily interested in furthering research on the subject in the next 6-12 months,” Mahler concluded.

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
Sebastian Stan lays out Bucky’s future after Thunderbolts
Sebastian Stan in Thunderbolts.

There are some spoilers ahead for the ending of Marvel's Thunderbolts. Stop reading now if you don't want to be spoiled.

Earlier this year, Captain America: Brave New World briefly introduced a new direction for James "Bucky" Barnes, a character Sebastian Stan has been playing since 2011 in Captain America: The First Avenger. In Brave New World, the former Winter Soldier apparently retired from being a reformed hero and went into politics by running for Congress. Thunderbolts reveals that Bucky won his election to the House of Representatives. But his stay in Congress was short.

Read more
Jeep Compass EV breaks cover—but will it come to the U.S.?
jeep compass ev us newjeepcompassfirsteditionhawaii  4

Jeep just pulled the wraps off the all-new Compass EV, and while it’s an exciting leap into the electric future, there's a catch—it might not make it to the U.S. anytime soon.
This is a brand new electric version of the Jeep Compass, and being built on Stellantis' STLA platform—the same architecture underpinning models like the Peugeot E-3008 and E-5008—it looks much slicker and packs a lot more inside than previous versions of the Compass.
Let’s start with what’s cool: the new Compass EV is packing up to 404 miles of range on a single charge, a 74 kWh battery, and fast-charging that gets you from 20% to 80% in about 30 minutes. Not bad for a compact SUV with Jeep's badge on the nose.
There are two versions: a front-wheel-drive model with 213 horsepower and a beefier all-wheel-drive version with 375 horsepower. That AWD setup isn’t just for looks—it can handle 20% inclines even without front traction, and comes with extra ground clearance and better off-road angles. In short, it’s still a Jeep.
The design's been refreshed too, and inside you’ll find the kind of tech and comfort you’d expect in a modern EV—sleek, smart, and ready for both city streets and dirt trails.
But here’s the thing: even though production starts soon in Italy, Jeep hasn’t said whether the Compass EV is coming to America. And the signs aren’t promising.
Plans to build it in Canada were recently put on hold, with production now delayed until at least early 2026. Some of that might have to do with possible U.S. tariffs on Canadian and Mexican vehicles—adding a layer of uncertainty to the whole rollout.
According to Kelley Blue Book, a Stellantis spokesperson confirmed that the company has “temporarily paused work on the next-generation Jeep Compass, including activities at” the Canadian plant that was originally meant to build the model. They added that Stellantis is “reassessing its product strategy in North America” to better match customer needs and demand for different powertrain options.
So while Europe and other markets are gearing up to get the Compass EV soon, American drivers might be left waiting—or miss out entirely.
That’s a shame, because on paper, this electric Jeep hits a lot of sweet spots. Let’s just hope it finds a way over here.

Read more
Charlie Cox singles out his least favorite Daredevil: Born Again episode
Charlie Cox in Daredevil: Born Again.

Daredevil: Born Again season 1 was largely reconceived after the 2023 actor and writer strikes. Dario Scardapane -- a veteran of The Punisher series on Netflix -- was brought in to be the new showrunner and he made a lot of changes to the series that were well-received. However, there's one episode that Scardapane didn't really change at all, and it happens to be the least favorite episode of Daredevil: Born Again's leading man, Charlie Cox.

During an appearance on The Playlist, Cox noted that he wasn't very fond of the season's fifth episode, "With Interest," which was a largely standalone episode that featured his character, Matt Murdock, in a bank during a hostage crisis.

Read more