Skip to main content

Oops — Google Bard AI demo is disproven by the first search result

These are heady days if you’re following the world of artificial intelligence (AI). ChatGPT is taking over the world, Microsoft is adding its tech to Bing, and Google is working on its own AI called Bard.

Except, Bard might not quite be ready for prime time — and Google just proved it during its own tech demonstration. Oops.

A Google blog post discussing its LaMBDA artificial intelligence technology displayed on a smartphone screen.
Shutterstock

The error came during a slide explaining how Bard could help a person explain new discoveries from the James Webb Space Telescope (JWST) to their nine-year-old child. Seems simple enough, you might think.

However, Bard made the following three suggestions:

  • In 2023, the JWST spotted a number of galaxies nicknamed “green peas”
  • The telescope captured images of galaxies that are over 13 billion years old
  • JWST took the very first picture of a planet outside of our own solar system

It’s that last entry that has ruffled some feathers. That’s because the first photo of a planet outside our solar system (otherwise known as an exoplanet) was actually taken way back in 2004 by the Very Large Telescope (VLT).

Unfortunately a simple google search would tell us that JWST actually did not "take the very first picture of a planet outside of our own solar system" and this is literally in the ad for Bard so I wouldn't trust it yet https://t.co/OS8AMyLQRu

— Isabel Angelo (@IsabelNAngelo) February 7, 2023

As explained by NASA, that image shows exoplanet 2M1207b orbiting a brown dwarf star. That not only makes it the first image captured of an exoplanet, but also means that 2M1207b is the first exoplanet seen to orbit a brown dwarf. It’s a double whammy that unfortunately went unacknowledged by Bard.

As pointed out by astrophysics Ph.D. student Isabel Angelo on Twitter, the irony is that a quick Google search could have prevented this problem. Simply searching “first photo of an exoplanet” puts the NASA page at the top of the pile.

That said, Bard wasn’t too far off. September 2022 marked the first time that the JWST itself had snapped a photo of an exoplanet (in this case, it was exoplanet HIP 65426 b). But as any fluent speaker of English will know, there’s a world of difference between saying “the JWST took the very first picture of an exoplanet” and “the JWST took its first picture of an exoplanet.”

A bumpy road ahead

Screenshot of Google Bard responding to a question.
Google

That lack of nuance aptly highlights some of the concerns surrounding the increasing role of AI in everyday life. If things like Bard and ChatGPT are integrated into search engines, they’re going to need to be not only fast but accurate too. Otherwise, a simple search could infect you with untrue information without any hint that it has happened.

After all, Google’s demonstration didn’t require you to visit a dodgy website making questionable claims, which might have raised red flags. Instead, the answers to the posed question are framed as if they’re coming directly from Google itself. Given Google’s global reach and name recognition, that could make the information it spits out much more believable — even if it’s totally incorrect.

Search AIs clearly need plenty of work before they can be treated with more than a tiny iota of trust. Google itself says it’s not going to release Bard until it has reached a “high bar for safety.” Clearly, it still has a long way to go.

Editors' Recommendations

Alex Blake
In ancient times, people like Alex would have been shunned for their nerdy ways and strange opinions on cheese. Today, he…
ChatGPT may soon moderate illegal content on sites like Facebook
A laptop screen shows the home page for ChatGPT, OpenAI's artificial intelligence chatbot.

GPT-4 -- the large language model (LLM) that powers ChatGPT Plus -- may soon take on a new role as an online moderator, policing forums and social networks for nefarious content that shouldn’t see the light of day. That’s according to a new blog post from ChatGPT developer OpenAI, which says this could offer “a more positive vision of the future of digital platforms.”

By enlisting artificial intelligence (AI) instead of human moderators, OpenAI says GPT-4 can enact “much faster iteration on policy changes, reducing the cycle from months to hours.” As well as that, “GPT-4 is also able to interpret rules and nuances in long content policy documentation and adapt instantly to policy updates, resulting in more consistent labeling,” OpenAI claims.

Read more
In the age of ChatGPT, Macs are under malware assault
A person using a laptop with a set of code seen on the display.

It's common knowledge -- Macs are less prone to malware than their Windows counterparts. That still holds true today, but the rise of ChatGPT and other AI tools is challenging the status quo, with even the FBI warning of its far-reaching implications for cybersecurity.

That may be why software developer Macpaw launched its own cybersecurity division -- dubbed Moonlock -- specifically to fight Mac malware. We spoke to Oleg Stukalenko, Lead Product Manager at Moonlock, to find out whether Mac malware is on the rise, and if ChatGPT could give hackers a massive advantage over everyday users.
State-sponsored attacks

Read more
Apple has been secretly working on a ChatGPT rival for years
An iPhone on a table with the Siri activation animation playing on the screen.

Apple CEO Tim Cook has just revealed that the company has been working on generative artificial intelligence (AI) tools “for years.” The surprise announcement suggests that Apple could launch a ChatGPT rival -- supposedly dubbed “Apple GPT” -- sooner than anyone expected.

The announcement was made in an interview with Reuters following Apple’s third-quarter earnings report. Cook explained that higher research and development (R&D) spending at the company had been driven in part by an increased focus on generative AI.

Read more