Skip to main content

Gemini might soon drive futuristic robots that can do your chores

DIGIT sensors mounted on a robot hand manipulating glass marbles.
Meta

The inevitable outcome of artificial intelligence was always its use in robots, and that future might be closer than you think. Google today announced Gemini Robotics, an initiative to bring the world closer than ever to “truly general purpose robots.”

Google says AI robotics have to meet three principal qualities. First, they should be able to adapt on the fly to different situations. They must be able to not only understand but also respond to changing environments. Finally, the robots have to be dexterous enough to perform the same kind of tasks that humans can with their hands and fingers.

Recommended Videos

Google writes, “While our previous work demonstrated progress in these areas, Gemini Robotics represents a substantial step in performance on all three axes, getting us closer to truly general purpose robots.”

Gemini Robotics: Dynamic interactions

Research and studies into robotics have advanced by leaps and bounds over the past few years. Boston Dynamics is particularly well known for its bots that can walk and navigate in public, and you’ve no doubt seen footage of the robot dogs on TikTok. If Gemini Robotics fulfills its mission statement, we could be on the cusp of introducing true household assistants that can do everything from cleaning the house to packing your lunch.

The earliest tests of Gemini Robotics used mounted arms to perform tasks like playing tic-tac-toe, packing a lunchbox, and even playing cards — and removing individual cards from a hand without bending them. It does this by incorporating an advanced vision-language model dubbed Gemini Robotics-ER (Embodied Reasoning).

Google is bringing together cutting-edge research from each of these areas of robotics to combine it into one form, governed by a set of safety guidelines that dictate robotic behavior. In January 2024, Google suggested a “Robot Constitution” that would govern how these machines behaved, based largely on Isaac Asimov’s Three Laws of Robotics. The team has since expanded that to something called the ASIMOV dataset that will allow researchers to better measure and test robot behavior in the real world.

Gemini Robotics: Dexterous skills

Google published a paper that’s free to read, but fair warning: it’s highly technical and complex. However, if you’re interested in the world of robotics and what implications these projects hold for the future of the world, it’s worth a read.

Patrick Hearn
Patrick has written about tech for more than 15 years and isn't slowing down anytime soon. With previous clients ranging from…
Apple is hoping your emails will fix its misfiring AI
Categories in Apple Mail app.

Apple’s AI efforts haven’t made the same kind of impact as Google’s Gemini, Microsoft Copilot, or OpenAI’s ChatGPT. The company’s AI stack, dubbed Apple Intelligence, hasn’t moved the functional needle for iPhone and Mac users, even triggering an internal management crisis at the company. 

It seems user data could rescue the sinking ship. Earlier today, the company published a Machine Learning research paper that details a new approach to train its onboard AI using data stored on your iPhone, starting with emails. These emails will be used to improve features such as email summarization and Writing Tools. 

Read more
I tested the world-understanding avatar of Gemini Live. It was shocking
Scanning a sticker using Gemini Live with camera and screen sharing.

It’s somewhat unnerving to hear an AI talking in an eerily friendly tone and telling me to clean up the clutter on my workstation. I am somewhat proud of it, but I guess it’s time to stack the haphazardly scattered gadgets and tidy up the wire mess. 

My sister would agree, too. But jumping into action after an AI “sees” my table, recognizes the mess, and doles out homemaker advice is the bigger picture. Google’s Gemini AI chatbot can now do that. And a lot more. 

Read more
Pixel users, beware: A Google Assistant bug can disable your alarms
Person holds Pixel 9a in hand while sitting in a car.

A Google Assistant bug is causing chaos with Do Not Disturb profiles and causing users to miss alarms, appointments, and more. The bug was first reported on Reddit earlier today by u/Rawalanche, who claimed it started when Pixel received new Do Not Disturb modes.

Their report states that any non-standard DnD profile, such as one that allows calls from only certain contacts or specific applications, will only work if you activate it through the Settings menu or the notification menu. If you request the DnD profile with Google Assistant, it does not activate and instead mutes everything on the phone.

Read more