Skip to main content

With AI, Instagram could become a new tool for anthropologists

1305060 autosave v1 2 37020033 m
Panithan Fakseemuang / 123RF
Instagram can serve as a valuable cultural analysis tool — if you have the time to go over a couple million photos. But Cornell University researchers recently trained an artificial intelligence program to analyze the images, uncovering how cultural clothing trends vary around the world with some photos, location data, and a computer.

The group worked directly with the social media platform and downloaded images in multiple time frames, between 2013 and 2016, from near 44 cities around the world. Those search parameters resulted in about 100 million Instagram photographs to analyze.

The group of researchers, led by Kevin Matzen, Kavita Bala, and Noah Snavely, decided to look specifically for fashion trends based on time and location. To eliminate all the photos that were not related, the group first used facial-recognition technology to exclude all the photos that did not include people in them. Then, the group further filtered the results to include photos that included the upper half of the body (sorry, #toesinthesand). That left the group with about 15 million photos.

With the narrower selection of photos, the team developed an object-recognition program that recognized items of clothing, for example, determining a jacket from a sweater and a scarf from a necktie. The program also learned a number of descriptors, like sleeve length, color, and popular patterns.

Once the images were tagged, the group put the data through another program, this one designed to recognize patterns not in the clothes but in the data, churring out information on what clothing items were being paired with what, which trends were popular to which areas and how the trends changed over the three-year time period.

The group discovered oddities like black and brown popping up more often during winter and white and blue favoring the summer season. While the system was designed to recognize fashion trends, the technology has implications for future studies analyzing anthropological data over large areas and wide time frames with just some photos and programming.

“Imagine a future anthropologist with access to trillions of photos of people — taken over centuries and across the world — and equipped with effective tools for analyzing these photos to derive insights,” the team wrote. “What kinds of new questions can be answered? This problem area of data-driven visual discovery is still new, but is beginning to gain attention in computer vision and graphics.”

Editors' Recommendations

Hillary K. Grigonis
Hillary never planned on becoming a photographer—and then she was handed a camera at her first writing job and she's been…
Meta’s new AI research may boost translations on Facebook, Instagram
Image with languages displaying in front of a man on his laptop for Meta's 200 languages within a single AI model video.

Facebook's parent company, Meta, announced a new AI model today that can translate hundreds of languages, and its research is expected to help improve language translations on its social media apps, specifically Facebook and Instagram.

On Wednesday, Meta unveiled its new AI model, NLLB-200. NLLB stands for No Language Left Behind, which is a Meta project that endeavors to "develop high-quality machine translation capabilities for most of the world’s languages." The AI model that came from that project, NLLB-200, can translate 200 languages.

Read more
Instagram is testing AI-powered video selfies to verify age
Turned on smartphone with Instagram app icon on its screen.

Continuing on with its push for age verification and the enforcement of its age requirement, Instagram announced that it would be testing new age-verification methods to help primarily younger users verify their ages with the popular photo and video sharing app.

These new methods include the AI-powered analysis of video selfies and the ability to ask your mutual followers to vouch for you and confirm your age.

Read more
The new ways Meta will pay you to make content for Facebook and Instagram
facebook hacked

Creators on Facebook and Instagram will soon have more ways to generate revenue from their content.

On Tuesday, Meta CEO Mark Zuckerberg shared via a Facebook post (and in a series of comments on that post), a few updates on monetization for creators on Facebook and Instagram. These updates included expansions to existing monetization options, as well as a few new ways to make money.

Read more