Skip to main content

Boston Dynamics uses ChatGPT to create a robot tour guide

Making Chat (ro)Bots

Boston Dynamics’ Spot robot has already impressed us with its astonishing agility, but now it can make a pretty good tour guide, too.

Keen to explore how generative AI tools like OpenAI’s ChatGPT chatbot can be used with its robot dog, the company’s clever engineers recently decided to create a tour guide using the technology.

A video (top) demonstrating the effort reveals some very impressive results. Sporting a hat, plastic eyes, and fake eyebrows, and opening and closing its robotic gripper as it “talks,” Spot takes us on an entertaining tour of parts of Boston Dynamics’ facility in Massachusetts.

“We were interested in seeing how you could use technologies like these for robotics,” Matt Klingensmith, principal software engineer at Boston Dynamics, says in the video.

As part of preparations, the team gave Spot a brief script naming each room that it was to visit, along with a single sentence explaining the room’s purpose. Spot then combines that data with images from its built-in cameras before running it through what’s known as a “visual question answering model” to try to get more information about what it’s looking at so that it can offer a more elaborate spoken response.

The best part is how Spot behaves when instructed to adopt different personalities. Check out the British butler guide at the start of the video, for example, and the sarcastic guide a few minutes in. The Shakespearean actor is also very impressive.

“It would come up with these crazy personalities,” Klingensmith says. “It would incorporate its backstory into what it was seeing, reinterpret things that it was seeing. It was pretty incredible.”

The software engineer said he was also surprised by some of the responses. For example, when he asked Spot to show him its parents, the robot took him over to an early version of Spot among Boston Dynamics’ display of robots.

Klingensmith says AI might make it possible for robots “not just to follow our commands, but in some sense understand the actions that they can take in the context of the world around them,” adding that it could be useful for applications that “we haven’t imagined yet.”

Human tour guides needn’t worry just yet, though, as Klingensmith said that AI chatbots still have a tendency to make stuff up (known as “hallucinations”), which is definitely what you don’t want to happen inside somewhere like a museum.

It’s also susceptible to the internet connection going down, he added.

Trevor Mogg
Contributing Editor
Not so many moons ago, Trevor moved from one tea-loving island nation that drives on the left (Britain) to another (Japan)…
You can now try out Google’s Bard, the rival to ChatGPT
ChatGPT versus Google on smartphones.

Google has just announced the launch of its conversational AI, Bard. Bard is Google's response to the ever-popular ChatGPT, now in use by Microsoft in its own products.

The tech giant rushed to release Bard, and it is now ready for testing. Google is inviting users to test the AI, but as it notes, it might make mistakes.

Read more
The popularity of ChatGPT may give Nvidia an unexpected boost
Nvidia's A100 data center GPU.

The constant buzz around OpenAI's ChatGPT refuses to wane. With Microsoft now using the same technology to power its brand-new Bing Chat, it's safe to say that ChatGPT may continue this upward trend for quite some time. That's good news for OpenAI and Microsoft, but they're not the only two companies to benefit.

According to a new report, the sales of Nvidia's data center graphics cards may be about to skyrocket. With the commercialization of ChatGPT, OpenAI might need as many as 10,000 new GPUs to support the growing model -- and Nvidia appears to be the most likely supplier.

Read more
AMD is now more recognizable than Intel
AMD's CEO delivering the Computex 2024 presentation.

While many would assume otherwise, a recent report tells us that AMD is now a more recognizable brand than Intel -- and that's big news for the tech giant. Kantar's BrandZ Most Valuable Brands report ranks AMD at 41, followed by Intel at number 48. Beating its long-standing rival is just one part of the prize for AMD. It also ranked among the top 10 risers in the report, meaning that its brand value increased a lot over the last year.

According to the report, AMD saw massive brand growth since 2023, increasing by 53% year-over-year. Moreover, AMD's brand value reached $51.86 million in the Business Technology and Services Platforms category. It's easy to guess where that intense growth is coming from -- AMD is leaning into AI, just like its rivals Intel and Nvidia have done in recent years.

Read more