The problems with your socially-sourced election predictions

social media and election predictions

Finally, November 6 is here. Election Day has come and that means the campaigns we’ve watched unfold over what feels like a lifetime are coming to an end. And this has been an election season the likes of which we’ve never seen: It’s infiltrated every last pore of our existence thanks to the deluge of social media outreach and coverage.

And it’s not over yet. While the votes have yet to be counted, we apparently already have an outcome: Obama will be our president for another four years.

How do we know this? Social media. Statistically, candidates who have more Facebook Likes and Twitter followers tend to win. Three recent gubernatorial races went to the candidate with largest Twitter follower counts.

But wait – there’s also an argument that @mentions indicate who our winner is going to be. The candidate everyone’s talking about will be the next president. In that case, Mitt Romney takes the lead.

topsy election

And if you think Web buzz in general is going to predict our next president, then once again it’s Romney for the win.

google trends election

Social network-sourced election predictions are everywhere, but whether they mean anything is unclear. There’s no shortage of infographics using eye-catching visuals to colorfully chart out how we’re using Facebook, Twitter, and Instagram to talk about our candidates, but not enough analysis about whether this content is signal or noise.

What we do know is this:

  • People increasingly use social networks; as of May, eight percent of online adults were using Twitter on a typical day.
  • People increasingly get their news from social media and digital outlets; according to a Pew Research Center Report, “the percentage of Americans saying they saw news or news headlines on a social networking site [from the day before] has doubled from nine percent to 19 percent – since 2010.”
  • 88 percent of social media users are registered voters.

election infographicsThe big picture take-away from this is that social media matters in an election; politicians should be creating content here, because constituents react to it. But the data raises more questions than it answers. What about sarcasm, mood, and sentiment? Or spam accounts? Or malicious posts meant to manipulate a social network? We just saw how completely faked information can take over a platform as well as the news cycle, so what’s to keep us safe from similar effects with election predictions?

For all the revealing bite-sized data we can squeeze out of Facebook posts and followers and Twitter mentions and hashtags, there are plenty of glaring inaccuracies as well. According to Twitter, Ron Paul should have been the Republican nominee, and the Iowa primary would have ended quite differently.

For every insightful social media analysis, there are 10 terribly shallow ones. Countless news outlets launch tools or republish infographics that count “buzz” – and if that’s all we we’re looking for, Herman Cain would probably be our next president.

What’s missing, of course, is context. So many of the endlessly-circulated infographics and charts we’ve seen this year are heavy on data and pie charts and graphs and lack anything to put those numbers into perspective.

As a rule, these prediction tools aren’t able to determine if tweets or Facebook posts are coming from people who are even eligible to vote. According to a recent study, 73.7 percent of Twitter users are between the ages of 15 and 25, so there’s plenty of opportunity here for users who can’t vote to be sharing their opinions. To further complicate things, only 0.45 percent of Twitter users disclose their ages. 46 percent of Facebook users are 45 or older, but given how large Facebook is, this number is sort of insignificant; it means that there are plenty of under-aged users on the site who could very well be endorsing candidates they can’t vote for.

Demographics in general are rather ignored – the most notable of them being that the people who use social networks to talk about politics are already politically motivated. This means that those who keep their political ideals to themselves or don’t have strong enough beliefs to broadcast them – but will still vote – aren’t being counted. In traditional prediction methods, pollsters specifically reached out to this subset in order to create more accurate views of the elections, but since the data being pulled from social networks is all self-motivated, this simply gets left out.

German researchers recently looked at Twitter’s predictive abilities, saying: “While we find evidence of a lively political debate on Twitter, this discussion is still dominated by a small number of users: Only four percent of all users accounted for more than 40 percent of the messages.” This was back in 2009, but surely the scale still speaks to a notable discrepancy.

“So long as you understand the data and the demographics of social users, you can measure sentiment in perspective and target relevant messages to those groups,” says 140Proof founder and CTO John Manoogian III. “The problem comes when pundits and analysts mistakenly assume that social media aggregates the tastes and preferences of all voters — it does not. Sites like Facebook and Twitter have political leanings. But social media does pretty strongly indicate what young, educated, and/or professional voters are saying.”

A much bigger factor is the failure of sentiment and mood analysis. The mechanisms we use to measure social media talk aren’t sophisticated enough to know if you’re slamming Obama or endorsing him. Some people can barely read sarcasm, so don’t expect applications pulling in tweets and posts to consistently do so. If you write “Oh sure, I totally believe Romney has women’s interests at heart,” in a Facebook post, it will likely be interpreted as a pro-Mitt statement.  

There’s also the fact that we want this to work; we want to be able to use social media to tell us how we all really feel. “This is the so-called file-drawer effect: researchers do not publish negative results, hence, only positive results are known and it seems that something is possible most of the time when it could be due to pure chance,” says researcher Daniel Gayo-Avello. “A paper [I wrote with] Eni Mustafaraj and Takis Metaxas showed that, in fact, results could be guessed roughly half of the time; that is not an impressive predictive ability, isn’t it?”

“Thus, by not knowing (because they are seldom published) about negative results, everybody assumes that simple methods simply work; and, indeed, they ‘work’ but half of the time, akin to a broken watch which ‘works’ twice a day.”

This doesn’t mean all this information isn’t valuable – it absolutely is, and interesting to boot. There’s no argument that politicians should be using social networks, and this type of outreach is only going to become more common and more sophisticated.

The big lesson is social networking can be used as an indicator of opinion, but not necessarily decision. There are just too many loose ends involved, and until they can be tied up, you’re just going to have to learn who will win our elections the old fashioned way: by waiting up all night for someone on TV to announce it. 

Cars

Tesla screens may support YouTube with next software update

Tesla CEO Elon Musk announced today at E3 that the infotainment screens will support YouTube video streaming very soon. This most likely lines up with the latest software update that is expected later this year.
Mobile

Get together with your buddies, talk, and play games with Snapchat's group chat

You can get your friends together for a good time, even if they are hundreds of miles away, by starting up a group chat on Snapchat. Here's how to make a group chat on Snapchat and get the party started.
Social Media

Instagram is back up after being offline. Here’s the latest on the outage

Instagram finally came back online Thursday afternoon after an outage that lasted just over an hour. The Instagram outage was one of several that hit at the same time, including a several-hour failure at the PlayStation Network.
Social Media

Facebook’s comment-ranking system aimed at taming the dumpster fire

Even by the standards of the internet, Facebook comments are famously awful. Now Facebook is introducing a new comment ranking system to attempt to tackle this problem by promoting quality comments and hiding low quality ones.
Photography

Adobe concocts an A.I. that can detect — and reverse — manipulated photos

The company behind the software that's often used to manipulate photographs may help make it easy to spot a fake photo. Researchers at Adobe recently created an artificially intelligent program that can recognize fake photos of faces.
Social Media

Kim Kardashian can get a deepfake taken off YouTube. It’s much harder for you

YouTube took down an incredibly realistic — and fake — video purporting to show Kim Kardashian West discussing a shadowy organization called “Spectre” and mocking her fans for violating copyright.
News

Brush up on your makeup skills with YouTube’s new augmented reality feature

YouTube will soon let users try on makeup while watching popular makeup tutorials through augmented reality. Viewers will be able to actually try on the makeup products the online tutorials are showcasing and promoting. 
Social Media

Maybe you missed something, so here's how to take another look at that Snap

The people you follow on Snapchat are important to you. If you get frustrated when you're trying to look at a friend's Snap or Story and it disappears, here's how to replay a Snapchat message or post.
How-To

You can delete Snapchat messages in a snap with these simple tips

If you've ever sent a message to someone and wish you could delete it, Snapchat has a feature you'll like. Yes, it lets you delete messages you've already sent. There are some limitations, though. Here's how to delete Snapchat messages.
News

Congress already wants to block rollout of Facebook’s cryptocurrency

It only took a few hours after Facebook provided details of its Libra cryptocurrency on Tuesday for lawmakers in Congress to tell the social media giant to pump the breaks. Facebook was asked to stop development until Congress weighs in.
Computing

What is Libra? Here’s what you need to know about Facebook’s new cryptocurrency

Facebook released a white paper announcing its new cryptocurrency, Libra, which it intends as a way to enable more people around the world to process online payments. Here's how the new blockchain technology works.
News

YouTube could make big changes to children’s content amid federal investigation

YouTube is considering major changes to its recommendation algorithm amid an investigation by the Federal Trade Commission into how it handles videos aimed at children. The investigation is in its late stages, and is in response to…
News

Facebook’s content moderators break their silence on terrifying work conditions

Content moderators for Facebook are overworked and overstressed to the point of unhealthy results. Last year, a moderator collapsed at his desk while on the clock and died of a heart attack. 
How-To

Keep up with the latest from your favorite Pinterest accounts with these tips

Your first step as a new Pinterest user is to follow your friends and favorite influencers so your feed is full of awesome, interesting stuff you love. Here's how to follow someone on Pinterest.