Skip to main content

Oops — Google Bard AI demo is disproven by the first search result

These are heady days if you’re following the world of artificial intelligence (AI). ChatGPT is taking over the world, Microsoft is adding its tech to Bing, and Google is working on its own AI called Bard.

Except, Bard might not quite be ready for prime time — and Google just proved it during its own tech demonstration. Oops.

A Google blog post discussing its LaMBDA artificial intelligence technology displayed on a smartphone screen.
Shutterstock

The error came during a slide explaining how Bard could help a person explain new discoveries from the James Webb Space Telescope (JWST) to their nine-year-old child. Seems simple enough, you might think.

However, Bard made the following three suggestions:

  • In 2023, the JWST spotted a number of galaxies nicknamed “green peas”
  • The telescope captured images of galaxies that are over 13 billion years old
  • JWST took the very first picture of a planet outside of our own solar system

It’s that last entry that has ruffled some feathers. That’s because the first photo of a planet outside our solar system (otherwise known as an exoplanet) was actually taken way back in 2004 by the Very Large Telescope (VLT).

Unfortunately a simple google search would tell us that JWST actually did not "take the very first picture of a planet outside of our own solar system" and this is literally in the ad for Bard so I wouldn't trust it yet https://t.co/OS8AMyLQRu

— Isabel Angelo (@IsabelNAngelo) February 7, 2023

As explained by NASA, that image shows exoplanet 2M1207b orbiting a brown dwarf star. That not only makes it the first image captured of an exoplanet, but also means that 2M1207b is the first exoplanet seen to orbit a brown dwarf. It’s a double whammy that unfortunately went unacknowledged by Bard.

As pointed out by astrophysics Ph.D. student Isabel Angelo on Twitter, the irony is that a quick Google search could have prevented this problem. Simply searching “first photo of an exoplanet” puts the NASA page at the top of the pile.

That said, Bard wasn’t too far off. September 2022 marked the first time that the JWST itself had snapped a photo of an exoplanet (in this case, it was exoplanet HIP 65426 b). But as any fluent speaker of English will know, there’s a world of difference between saying “the JWST took the very first picture of an exoplanet” and “the JWST took its first picture of an exoplanet.”

A bumpy road ahead

Screenshot of Google Bard responding to a question.
Google / Google

That lack of nuance aptly highlights some of the concerns surrounding the increasing role of AI in everyday life. If things like Bard and ChatGPT are integrated into search engines, they’re going to need to be not only fast but accurate too. Otherwise, a simple search could infect you with untrue information without any hint that it has happened.

After all, Google’s demonstration didn’t require you to visit a dodgy website making questionable claims, which might have raised red flags. Instead, the answers to the posed question are framed as if they’re coming directly from Google itself. Given Google’s global reach and name recognition, that could make the information it spits out much more believable — even if it’s totally incorrect.

Search AIs clearly need plenty of work before they can be treated with more than a tiny iota of trust. Google itself says it’s not going to release Bard until it has reached a “high bar for safety.” Clearly, it still has a long way to go.

Editors' Recommendations

Alex Blake
In ancient times, people like Alex would have been shunned for their nerdy ways and strange opinions on cheese. Today, he…
OpenAI and Microsoft sued by NY Times for copyright infringement
A phone with the OpenAI logo in front of a large Microsoft logo.

The New York Times has become the first major media organization to take on AI firms in the courts, accusing OpenAI and its backer, Microsoft, of infringing its copyright by using its content to train AI-powered products such as OpenAI's ChatGPT.

In a lawsuit filed in Federal District Court in Manhattan, the media giant claims that “millions” of its copyrighted articles were used to train its AI technologies, enabling it to compete with the New York Times as a content provider.

Read more
2023 was the year of AI. Here were the 9 moments that defined it
A person's hand holding a smartphone. The smartphone is showing the website for the ChatGPT generative AI.

ChatGPT may have launched in late 2022, but 2023 was undoubtedly the year that generative AI took hold of the public consciousness.

Not only did ChatGPT reach new highs (and lows), but a plethora of seismic changes shook the world, from incredible rival products to shocking scandals and everything in between. As the year draws to a close, we’ve taken a look back at the nine most important events in AI that took place over the last 12 months. It’s been a year like no other for AI -- here’s everything that made it memorable, starting at the beginning of 2023.
ChatGPT’s rivals rush to market

Read more
Google might finally have an answer to Chat GPT-4
ChatGPT versus Google on smartphones.

Google has announced the launch of its most extensive artificial intelligence model, Gemini, and it features three versions: Gemini Ultra, the largest and most capable; Gemini Pro, which is versatile across various tasks; and Gemini Nano, designed for specific tasks and mobile devices. The plan is to license Gemini to customers through Google Cloud for use in their applications, in a challenge to OpenAI's ChatGPT.

Gemini Ultra excels in massive multitask language understanding, outperforming human experts across subjects like math, physics, history, law, medicine, and ethics. It's expected to power Google products like Bard chatbot and Search Generative Experience. Google aims to monetize AI and plans to offer Gemini Pro through its cloud services.

Read more