Captionbot is another AI from Microsoft, and it's not doing so hot either

By Lulu Chang Published April 17, 2016

You’d think that after its last AI chat bot fiasco, Microsoft would’ve learned its lesson — or at least waited a bit longer before introducing another monster to the world. Luckily for us, history has a tendency to repeat itself, and the company’s latest creation is a sometimes hilarious entity known as Captionbot. The premise is simple — recognize the contents of a photo, and come up with an appropriate caption. But alas, while the concept may be straightforward, the execution isn’t always so cut and dry. And social media has been quick to point out all of Captionbot’s faux pas.

In one case, the artificial intelligence system thought that Michelle Obama was a cellphone. And there’s also the time when the dress that launched a thousand debates (you know, the blue and black or white and gold dress) confuses the bot as much as it confused all of us. The system thought the dress was a cat wearing a tie (or in some cases, a suitcase).

Recommended Videos

The bot also looks to be attempting to rewrite history, absolutely refusing to identify Hitler as the infamous Nazi leader he was. When CNNMoney fed the AI photos of the dictator and swastika, more often than not, Captionbot responded, “I really can’t describe the picture” alongside a confused emoji. Strangely enough, it could identify other famous Nazis like Joseph Mengele and Joseph Goebbels.

Osama bin Laden is another infamous face Captionbot can’t recognize, although it is unclear whether this is due to restrictions Microsoft put in place to prevent Tay-esque disasters from taking place. “We have implemented some basic filtering in an effort to prevent some abuse scenarios,” a spokesperson noted of the limitations.

You can upload your own photos for Captionbot to analyze, but proceed at your own risk. Sometimes, this bot gets it very, very wrong. Just check out a couple of our favorite examples below.

#captionbot thinks Michelle Obama is a cell phone. pic.twitter.com/FtC6tP6Ben

— David Sim (@davidsim) April 14, 2016

Captionbot.ai 's view of my avatar: pic.twitter.com/OUctTxhx0p

— Richard Gadsden (@po8crg) April 14, 2016

https://twitter.com/ralphharrington/status/720544025649025024?ref_src=twsrc%5Etfw

Topics

Former Digital Trends Contributor

Fascinated by the effects of technology on human interaction, Lulu believes that if her parents can use your new app…

Computing

Microsoft just turned 50, can its dominance last another half a century?

Microsoft at 50.

Microsoft is officially half a century old and what a half a century it's been. It went from being a small scale software company to dominating the world of personal computers, to today where it's worth over $3 trillion -- or at least it was until some recent tariff shenanigans. It's not the only name in the game any more, with Google's Android platform the most popular operating system on devices, but Microsoft's Windows still forms the backbone of the professional and gaming worlds, and that's not the only pie it has its fingers in.

From trying to wrestle control of the AI hype train, to endeavours in Quantum computing, Microsoft is looking to form the zeitgeist of the next 50 years. Let's take a look at some of its big wins over the past few decades, and what it might do in to secure some more in the years to come.

Computing

Amazon’s AI shopper makes sure you don’t leave without spending

Amazon Buy for Me feature.

The future of online shopping on Amazon is going to be heavily dependent on AI. Early in 2025, the company pushed its Rufus AI agent to spill product information and help users find the right items. A few weeks later, another AI tool called Interests made its way to the shopping site.

The new Alexa+ AI assistant is also capable of placing orders semi-autonomously, handling everything from groceries to booking appointments. Now, the company has started to test yet another AI agent that will buy products from other websites if they’re not available on Amazon — without ever leaving the app.

Computing

Microsoft’s Bing adds a Copolit Search mode to rival Google AI Search

Copilot Search for Bing Search engine.

Barely a few weeks ago, Google introduced a new AI Search mode. The idea is to provide answers as a wall of text, just the way an AI chatbot answers your queries, instead of the usual Search Results with blue links to different sources.

Microsoft is now in the race, too. The company has quietly rolled out a new Copilot Search option for its Bing search engine. The feature was first spotted by Windows Latest, but Digital Trends can confirm that it is now accessible across all platforms.