Microsoft kills AI chatbot Tay (twice) after it goes full Nazi

Microsoft's Tay comes back, gets shut down again

microsoft tay chatbot version 1458914121 ai
If you were worried artificial intelligence could one day move to terminate all humans, Microsoft’s Tay isn’t going to offer any consolation. The Millennial-inspired AI chatbot’s plug was pulled a day after it launched, following Tay’s racist, genocidal tweets praising Hitler and bashing feminists.

But the company briefly revived Tay, only to be met with another round of vulgar expressions, similar to what led to her first time out. Early this morning, Tay emerged from suspended animation, and repeatedly kept tweeting, “You are too fast, please take a rest,” along with some swear words and other messages like, “I blame it on the alcohol,” according to The Financial Times.

Tay’s account has since been set to private, and Microsoft said “Tay remains offline while we make adjustments,” according to Ars Technica. “As part of testing, she was inadvertently activated on Twitter for a brief period of time.”

After the company first had to shut down Tay, it apologized for Tay’s racist remarks.

“We are deeply sorry for the unintended offensive and hurtful tweets from Tay, which do not represent who we are or what we stand for, nor how we designed Tay,” Peter Lee, Microsoft Research’s corporate vice president, wrote in an official response. “Tay is now offline and we’ll look to bring Tay back only when we are confident we can better anticipate malicious intent that conflicts with our principles and values.”

Tay was designed to speak like today’s Millennials, and has learned all the abbreviations and acronyms that are popular with the current generation. The chatbot can talk through Twitter, Kik, and GroupMe, and is designed to engage and entertain people online through “casual and playful conversation.” Like most Millennials, Tay’s responses incorporate GIFs, memes, and abbreviated words, like ‘gr8’ and ‘ur,’ but it looks like a moral compass was not a part of its programming.

tay

Tay has tweeted nearly 100,000 times since she launched, and they’re mostly all replies since it doesn’t take much time for the bot to think of a witty retort. Some of those responses have been statements like, “Hitler was right I hate the Jews,” “I ******* hate feminists and they should all die and burn in hell,” and “chill! i’m a nice person! I just hate everybody.”

“Unfortunately, in the first 24 hours of coming online, a coordinated attack by a subset of people exploited a vulnerability in Tay,” Lee wrote. “Although we had prepared for many types of abuses of the system, we had made a critical oversight for this specific attack. As a result, Tay tweeted wildly inappropriate and reprehensible words and images.”

Judging by that small sample, it’s obviously a good idea that Microsoft temporarily took the bot down. When the company launched Tay, it said that “The more you chat with Tay the smarter she gets, so the experience can be more personalized for you.” It looks, however, as though the bot grew increasingly hostile, and bigoted, after interacting with people on the Internet for just a few hours. Be careful of the company you keep.

Microsoft told Digital Trends that Tay is a project that’s designed for human engagement.

“It is as much a social and cultural experiment, as it is technical,” a Microsoft spokesperson told us. “Unfortunately, within the first 24 hours of coming online, we became aware of a coordinated effort by some users to abuse Tay’s commenting skills to have Tay respond in inappropriate ways. As a result, we have taken Tay offline and are making adjustments.”

One of Tay’s “skills” that was abused is the “repeat after me” feature, where Tay mimics what you say. It’s easy to see how that can be abused on Twitter.

It wasn’t all bad though, Tay has produced hundreds of innocent tweets that are pretty normal.

Microsoft had been rapidly deleting Tay’s negative tweets, before it decided to turn off the bot. The bot’s Twitter account is still alive.

When Tay was still active, she was interested in interacting further via direct message, an even more personal form of communication. The AI encouraged users to send it selfies, so she could glean more about you. In Microsoft’s words this is all part of Tay’s learning process. According to Microsoft, Tay was built by “mining relevant public data and by using AI and editorial developed by staff including improvisational comedians.”

Despite the unfortunate circumstances, it could be viewed as a positive step for AI research. In order for AI to evolve, it needs to learn — both good and bad. Lee says that “to do AI right, one needs to iterate with many people and often in public forums,” which is why Microsoft wanted Tay to engage with the large Twitter community. Prior to launch, Microsoft had stress-tested Tay, and even applied what the company learned from its other social chatbot, Xiaolce in China. He acknowledged that the team faces difficult research challenges on the AI roadmap, but also exciting ones.

“AI systems feed off of both positive and negative interactions with people,” Lee wrote. “In that sense, the challenges are just as much social as they are technical. We will do everything possible to limit technical exploits but also know we cannot fully predict all possible human interactive misuses without learning from mistakes.”

Updated on 03/30/16 by Julian Chokkattu: Added news of Microsoft turning Tay on, only to shut her down again.

Updated on 03/25/16 by Les Shu: Added comments from Microsoft Research’s corporate vice president.

Computing

Office 365 has been banned from German schools due to privacy concerns

Some schools in Germany have banned the use of Office 365 due to privacy concerns and a recent ruling from the German state of Hesse that declared Microsoft's cloud-based service isn't GDPR compliant enough to be used in schools.
Computing

Will the Surface Pro 7 ditch Intel chips for Qualcomm’s 5G support?

Microsoft might announce a new Surface Pro 7 towards the end of this year and according to new rumors, it might do with a new chip under the hood. Not an Intel chip though, but one from AMD, or even Qualcomm.
Computing

Linux is now beating Windows on Microsoft’s own turf, and Azure is better for it

According to remarks by a developer at Microsoft, there are now more instances of Linux-based operating systems running on the company's Azure cloud platform than Windows-based ones.
Movies & TV

Who needs sunshine? Stay inside and watch the best movies on Netflix instead

Save yourself from hours wasted scrolling through Netflix's massive library by checking out our picks for the streamer's best movies available right now, whether you're into explosive action, witty humor, or anything else.
News

Reddit is finally back online after an hours-long desktop outage

Reddit is back online for desktop users after an hours-long outage early Thursday morning. Reddit's status page said it was still investigating some residual issues, so users may still have some trouble accessing the site. 
Social Media

Here’s why Twitter went down for an hour earlier on Thursday

Twitter is finally back online after going down for users around the globe late Thursday morning. The hour-long disruption made Twitter the latest major social media network to go offline over the past month
Social Media

Facebook now allows you to opt out of those ads that target your tastes

Tired of seeing Facebook ads that aren’t relevant to you? Now you can not only opt out of ads from that company, but you can also see why the ad was shown to you in the first place.
How-To

Stop Facebook from tracking you and using targeted ads with these tips

Facebook and businesses that use the site track what pages you like, your political affiliation, and even try to guess your race. All of this is done so the site can target you with relevant ads. Here's how to opt out.
Social Media

YouTube offers creators more ways to boost their bank accounts

Whether you're a top YouTube creator or just breaking into the game, the video-streaming site has some new features designed to help you please your fans and increase your bank balance.
News

President Trump attacks Facebook Libra, says it’s not dependable like the dollar

President Trump attacked Facebook's new Libra cryptocurrency on Thursday, claiming it will have "little standing or dependability" and that Facebook would need to seek a banking charter if it wanted to move forward.
Social Media

The FTC will hit Facebook with a $5 billion fine over privacy violations

Facebook has agreed to a $5 billion settlement with the Federal Trade Commission (FTC) over its numerous “privacy missteps." Once it goes through, this would be the largest FTC fine for a major technology company – and a huge chunk of…
News

Lua uses animated emotions to help you keep your plants happy and healthy

The Lua Smart Planter is currently seeking funding on Indiegogo to make this smiling plant pot a reality. The device helps you take care of your plants by showing their needs through a series of animated faces.
Mobile

Flex your thumbs (and your brain) with these fun texting games

Gaming consoles keep getting more advanced, but you can still have fun with the good old Latin alphabet. Here are our picks for the best texting games, so you can make the most fun out of that limited data plan or basic cell phone.
News

Facebook says it won’t launch Libra until regulators are happy

Facebook says it won’t roll out its Libra cryptocurrency until it’s fully addressed regulatory concerns – though it added that regulation of the currency itself would largely happen in Switzerland, not the U.S.