Skip to main content

Instagram may be more accurate at diagnosing depression than a doctor, study suggests

A new artificial intelligence program can pick up on the early signs of depression before humans (and even humans who are general practitioners) can — and just by using Instagram. A team of researchers from Harvard and the University of Vermont recently developed a machine learning program that correctly identified which Instagram users were clinically depressed with 70 percent accuracy.

In a study published on Aug. 10 from Andrew G. Reece and Christopher M. Danforth, the group applied the machine learning platform to 166 Instagram profiles containing 43,950 photos. The system uses markers to detect if Instagramers are depressed, analyzing aspects like color, metadata, and face detection.

“Using only photographic details, such as color and brightness,” the study says, “our statistical model was able to predict which study participants suffered from depression, and performed better than the rate at which unassisted general practitioners typically perform during in-person patient assessment.” Based on 118 earlier studies, the researchers found that general practitioners only correctly diagnosed depression 42 percent of the time.

While other studies have shown how written information from social media can be used to predict psychiatric disorders, the group says that earlier research failed to incorporate visual posts.

Using earlier studies, the group taught the computer system to identify markers for depression. For example, since earlier research showed that depressed individuals preferred darker, grayer colors, the program analyzed color as one factor, including the role that Instagram’s filters play on those colors.

The program also considered factors like how often users post, since depression often correlates with reduced social activity. In addition, the system also counted the number of people in the image using face detection and also factored in the number of likes and comments each photo received.

Photos posted from depressed Instagramers were more likely to get comments, but less likely to receive likes. The study participants with a depression diagnosis were more likely to use no filters at all, and when they did, often favored the Inkwell filter. And while depressed individuals were more likely to show faces in their posts, they often had fewer faces in each image compared to other users.

To see how well the average person is able to pick up on signs of depression using only Instagram photos, the researchers also had a group of people rate each photograph. The participants didn’t know they were looking at Instagram photos, and didn’t know that the study was being conducted on depression. The researchers asked each person to rate the image from 1-5 in four categories: happy, sad, likability and interestingness.  The ratings for happy and sad tended to correspond with the images shot by individuals diagnosed with depression, while the other ratings, including “likability” and “interestingness,” did not.

The researchers also took the same machine learning program and applied it to only the posts that were dated before the individual was diagnosed. Using earlier photos, the programs was still able to accurately predict which users were depressed more than half the time.

While the findings look promising, the study’s authors also noted that the program has some shortcomings, saying that the information shouldn’t be taken as “enduring facts” but as a “methodological foundation upon which to build and refine subsequent models.” For starters, 43 percent of the initial participants refused to give their Instagram information, due to privacy concerns. Another issue is that social media trends will change over time, and such a machine learning program would need to be continually updated, the researchers said.

Editors' Recommendations

Hillary K. Grigonis
Hillary never planned on becoming a photographer—and then she was handed a camera at her first writing job and she's been…
New microscope uses A.I. smarts to diagnose deadly blood infections
microscope blood infections ai gettyimages 543195947

As technology goes, microscopes are pretty smart, allowing us to examine samples blown up thousands of times their original size. But what if a microscope was able to identify what it was looking at? And what if this capability could be used to save people’s lives?

That’s the idea behind new work carried out by microbiologists at Beth Israel Deaconess Medical Center (BIDMC), a teaching hospital at Harvard Medical School. Researchers there have developed a microscope that’s enhanced by machine learning technology to help diagnose potentially deadly blood infections, greatly improving patients' odds of survival in the process.

Read more
AI being used to diagnose Alzheimer's disease early by reviewing brain scans
ai alzheimers italy diagnosis 42100086 l

A devastating chronic neurodegenerative disease, Alzheimer’s disease (AD) currently affects around 5.5 million people in the United States alone. Causing progressive mental deterioration, it ultimately advances to impact basic bodily functions such as walking and swallowing.

Looking for a way to help, researchers at the University of Bari and Istituto Nazionale di Fisica Nucleare in Italy have developed new machine learning AI technology that may help identify Alzheimer’s a decade before doctors usually can, by way of non-invasive MRI brain scans. An early diagnosis -- before any of the symptoms a doctor might recognize become apparent -- could give patients a chance to make changes to their lifestyle which may slow Alzheimer’s progression.

Read more
AI may beat humans at everything in 45 years, experts predict
oxford yale ai survey robot1

Predicting the future of AI isn’t easy. Every decade since artificial intelligence was first formed as its own discipline in 1956, there’s been a prediction that artificial general intelligence (AGI) is just a few years away -- and so far we can safely say that most of them have been shy of the mark.

A new survey, conducted by the University of Oxford and Yale University, draws on the expertise of 352 leading AI researchers. It suggests that there’s a 50-percent chance that machines will be bettering us at every task by the year 2062. However, plenty more milestones will be hit before then. These include machines that are better than us at translating foreign languages by 2024, better at writing high school essays than us by 2026, better at driving trucks by 2027, better at working retail jobs by 2031, capable of penning a best-selling book by 2049, and better at carrying out surgery by 2053. Asian respondents predicted these events will happen much sooner than did North American researchers.

Read more