Skip to main content

Facebook used a screenshot of a death threat to promote Instagram

1305060 autosave v1 2 37020033 m
Panithan Fakseemuang / 123RF
Score another point for human oversight — Facebook algorithms are once again being criticized for inadvertently promoting an inappropriate post. In an auto-generated Facebook post for Instagram, the algorithm promoted a screenshot of an email containing a death threat as part of the effort to encourage users to try out Instagram.

Instagram “notification posts,” as the company calls them, on Facebook are pretty common. An algorithm chooses a photo based on the number of interactions, then promotes the image on Facebook along with a list of all that user’s friends who are also on Instagram to help encourage Facebook users to join both platforms. When that same algorithm chose one of reporter Olivia Solon’s most popular posts, it was this one (be warned, the post contains graphic language):

Instagram is using one of my most "engaging" posts to advertise its service to others on Facebook ???? pic.twitter.com/lyEBHQXMfa

— Olivia Solon (@oliviasolon) September 21, 2017

Solon, a reporter for the Guardian, took the screenshot to demonstrate the type of hate mail she receives because of her job. The post resulted in several comments (though only a few likes), which was apparently enough for the algorithm to decide it was a good shot to use to promote Instagram to Solon’s Facebook friends.

Instagram apologized to Solon and said the post was not a paid promotion, but rather a notification post “designed to encourage engagement on Instagram.” According to Instagram, these types of notification posts are only viewed by a small percentage of a Facebook user’s friends.

The incident follows Facebook’s public apology after an organization discovered that promoted posts could be targeted to demographics like “Jew haters.” Facebook temporarily disabled the feature until the issue was corrected and said the company would be adding more human oversight to the process.

Like the automatically generated Instagram notification post, the demographic issue was a result of a lack of human oversight, allowing users to type whatever they want into the bio sections. More than 2,000 people typed “Jew hater” into one of the education fields, which meant the demographic was available for advertisers to choose from when creating a targeted post.

Facebook isn’t oblivious to the problem. Earlier in 2017, the company released a series of blog posts called “Hard Questions” that discusses how the social media platform handles topics such as hate speech and discrimination and what the company is doing to improve. Along with improving current algorithms, the company said at the time that they would be adding 3,000 employees before the end of the year to help catch what the computer misses.

Editors' Recommendations

Hillary K. Grigonis
Hillary never planned on becoming a photographer—and then she was handed a camera at her first writing job and she's been…
Meta’s new AI research may boost translations on Facebook, Instagram
Image with languages displaying in front of a man on his laptop for Meta's 200 languages within a single AI model video.

Facebook's parent company, Meta, announced a new AI model today that can translate hundreds of languages, and its research is expected to help improve language translations on its social media apps, specifically Facebook and Instagram.

On Wednesday, Meta unveiled its new AI model, NLLB-200. NLLB stands for No Language Left Behind, which is a Meta project that endeavors to "develop high-quality machine translation capabilities for most of the world’s languages." The AI model that came from that project, NLLB-200, can translate 200 languages.

Read more
The new ways Meta will pay you to make content for Facebook and Instagram
facebook hacked

Creators on Facebook and Instagram will soon have more ways to generate revenue from their content.

On Tuesday, Meta CEO Mark Zuckerberg shared via a Facebook post (and in a series of comments on that post), a few updates on monetization for creators on Facebook and Instagram. These updates included expansions to existing monetization options, as well as a few new ways to make money.

Read more
Instagram has new parental controls to help moderate use for teens
Closeup of the Instagram app icon.

Amid eight recently filed lawsuits that claim its platforms have been harmful to its teenage users, Meta has just announced the addition of more parental controls and digital well-being features for its popular photo and video sharing app, Instagram.

On Tuesday, Meta announced a series of "new tools and resources" for teens and their parents to help better regulate the former's consumption of content on Instagram. It's worth noting here that Instagram is one of the platforms included in the lawsuits against Meta.

Read more