We’re closer to China’s disturbing ‘Social Credit System’ than you realize

Have you ever heard the saying that you are the average of the five people that you spend the most time with? It’s quite possible that someone in the Chinese government is intimately acquainted with the idea. Over the past several years, the country has been working to quantify the trustworthiness of every citizen in China. A bit like a financial credit score, only applying to how much stock we can put in a person’s character, the idea is that using big data and A.I. algorithms to analyze trustworthiness can lead to a new era in upstanding citizenry.

Or as the original proposal for the system, titled “Planning Outline for the Construction of a Social Credit System,” put it: “[Such an initiative] will forge a public opinion environment where keeping trust is glorious. It will strengthen sincerity in government affairs, commercial sincerity, social sincerity and the construction of judicial credibility.”

So where does businessman and motivational speaker Jim Rohn’s quote about a person being the sum total of five other people come into it? Because one element of the Social Credit System — which will become mandatory for citizens by 2020 — depends on who you associate with online.

It’s an idea straight out of the oft-invoked George Orwell dystopia Nineteen Eighty-Four.

In addition to more mundane areas like whether you pay your community charge on time, the system’s reputational algorithm will also factor in your choice of online friends. That person who complains about how the government is doing its job could suddenly cost you some serious social cred. Befriend too many wrongthinkers and you could quickly find yourself classed as a wrongthinker too.

It’s an idea straight out of the oft-invoked George Orwell dystopia Nineteen Eighty-Four. But it’s also not wholly unique to China. True, the U.S. government isn’t publicly instituting a Social Credit System, but the idea that digital reputation analysis isn’t something that affects us all in 2018 is patently untrue.

Your social standing, algorithmized

The recent ongoing Facebook saga involving potential user data abuse underlines once again the ways in which our online personas are curated, collected, monetized and sliced and diced in all sorts of ways. Increasingly they will be treated as next-generation credit scores, not only able to keep tabs on our financial respectability but also manner of other metrics by which we can be considered quality citizens.

Recently, I failed such a test. On Twitter, I try to follow a diverse range of thinkers, since it seems a good way to steer clear of the “filter bubble” effect. If there’s an issue that I feel strongly about, I like to follow “thought leaders” on the other side of the ideological divide so as to be exposed to their response to items in the news.

social credit system china twitter xxl
Westend61/Getty Images

Who knows: a well-argued case might even change your mind about something you thought was true. At the very least, it gives you a chance to know the most compelling arguments used against your position. All was going well until I discovered that I had been blocked by a certain user I’ll call “user X” with whom I had had no previous interaction.

Based on a bit of further digging I discovered the explanation: another person I followed had been added to an automated blocklist by user X, so that anyone who followed them was then barred from viewing the tweets of user X. Somewhere in the ephemeral world of the interwebs I felt my personal social credit noticeably slide in a way that it hadn’t since my middle school classmates discovered I still watched Power Rangers.

On the internet, everyone knows you’re a dog

We’re still getting to grips with the way that our digital identities are changing. Twenty-five years ago, we didn’t worry about online reputation because the entire galvanizing idea of the internet was built around anonymity. A famous 1993 New Yorker cartoon depicted two computer-savvy canines using a computer. “On the Internet, nobody knows you’re a dog,” the tagline read. Today, not only do companies online know that you’re a dog; they know which brand of dog food you enjoy, what collar you wear, where you stretch your legs and — for better or worse — where you do your messes.

Here in 2018, we take it for granted that the internet knows who we are. It’s considered an insult if it doesn’t. If websites don’t know who we are then we don’t get personalized news recommendations, social media friend updates, or suggested videos. Heck, on Twitter, the idea of being “verified” as yourself is just about the ultimate reward you can have: an idea that would have struck early web-users as bizarre.

Studies have suggested that social media profiles can also be used to accurately predict our employment success.

While we may have multiple personas online, just as we do in the real world, these identities aren’t neatly self contained. They can spill over into other areas of our lives; the line increasingly blurred between public and private personas, or social and professional ones. For instance, multiple studies have suggested that social media profiles (designed for, you know, our social lives) can also be used to accurately predict our employment success. One 2016 research project carried out by researchers at Belgium’s Ghent University came to the conclusion that Facebook profile pictures can increase or decrease your chances of being offered an interview for a job by up to 40 percent.

“I think the CV of now and the future moves from a paper one we send out to how we look when Googled,” Simon Wadsworth, a managing partner Igniyte, an online reputation management company, told Digital Trends. “We know that’s the first port of call for employers. Looking your best online will be a major factor when anyone is looking to go into higher education, get a job, or even buy a house.”

A game you have to play

social credit system fico vertical blue 4
Chris DeGraw/Digital Trends

Don’t think you can get away without playing, either. “I think also there is an issue if a person can’t be found online in any way – so a happy medium is required,” he continued. Not being discoverable online could mean that a person has something to hide. More mundanely, but crucially, it might also simply leave a person out in the digital cold. “For the generation going to college and getting jobs, it suggests not being very digitally savvy if they have no presence online,” Wadsworth said.

If a good Facebook profile makes your more likely to get an interview, what does no Facebook profile at all mean?

The problematic nature of digital identities will only become more complex as we continue to live increasingly online. Credit scores measure one aspect of our reputation: our ability to pay back money. They take into account things like whether payments are made on time, how much of our line of credit we’ve used, the length of our credit history, types of credit we use, and our past credit applications. From there, a FICO score is created and used by banks and retailers.

The idea behind the FICO score dates back to the 1950s, before it was ultimately introduced in 1989. Today, there is a wealth of information that can be gathered about users that could not possibly be known about in the 1980s. What a person “likes” online, what they buy, where they buy it, who they socialize with, what they do in their homes, all of it can increasingly be gathered and combed through using smart machine learning tools.

As more and more of ourselves are virtualized, what is possible to “know” expands. Fitness data, health records, online dating profiles and preferences, our emotional states, how we learn in the classroom, how quickly we read e-books on our vacation and much more can build up an astonishingly accurate picture of who we are. True, much of this data is anonymized, but the ability to draw on this information and cross-reference it in all sorts of new ways is an unavoidable reality.

The return of social credit

The system that credit scores replaced was based on reputation and qualitative judgements. A person could be denied a line of credit because a banker didn’t like their demeanor. In addition to payment history, this meant that judgements were the result of things like home visits, a person’s perceived standing in the community and more. Credit scores were intended to take the subjectivity and, just as importantly, opacity out of this process.

Today, social credit is once again a reality.

Today, social credit is once again a reality. Everything from the information that we are shown to the prices and opportunities we’re offered are wrapped up in the byzantine way the digital world curates identity. We have easy access to our credit scores, and know the way to improve them. When it comes to the online world, this isn’t nearly so straightforward. Who is gathering data about us, how is it used and what does this mean for the way that we perceive the digital world around us; all of these questions are far from clear.

Projects like China’s Social Credit System should worry people for a number of reasons. But just like the sci-fi dystopias it’s being likened to, it scares us because we innately understand that it’s a world we’re familiar with — only with the volume cranked up to eleven. Don’t for a second think that the impetus driving it isn’t the same one finding its way into every interaction that we have online.

Product Review

'Hitman 2' goes in for the kill with more of everything you love

IO Interactive and Warner Bros introduce us to ‘Hitman 2’, a sequel that embraces what made the series so unique and exceeds at delivering a more polished and complex experience.
Movies & TV

One popular character won't be returning for 'John Wick 3: Parabellum'

The third installment of the wildly successful action series that stars Keanu Reeves as a deadly assassin forced out of retirement, John Wick 3: Parabellum, hits theaters in May 2019. Here's everything we know about the movie so far.
Movies & TV

Winter coming in spring? HBO reveals 'Game of Thrones' season 8 premiere date

With the eighth and final season looming, Game of Thrones fever has officially become a pandemic. Our list of all the relevant news and rumors will help make the wait more bearable, if you don't mind spoilers.
Smart Home

Amazon Alexa added a skill for Butterball’s annual Turkey Talk-Line

Just in time for Thanksgiving Day meal planning, now you can say "Alexa, ask Butterball" for access to Butterball's Turkey Talk-Line. Alexa will connect you to Butterball experts who can answer any cooking questions.
Emerging Tech

Alibaba’s Singles’ Day sale smashes online shopping records

The annual online shopping frenzy that is Singles' Day this year raked in $30.8 billion, up from $25 billion last time around. The Alibaba-organized event generates more in sales than Black Friday and Cyber Monday combined.
Emerging Tech

Watch this lab-grown heart tissue beat just like the real thing

A team of researchers in Germany have used stem cells to create a lab-grown human heart tissue which actually beats, as well as responding to drugs in the same way as the real thing.
Emerging Tech

Michigan’s former transportation chief has some advice for wannabe smart cities

After 31 years as Michigan’s transportation director, Kirk Steudle has seen it all, particularly with smart city projects. He spoke with Digital Trends recently about what makes smart cities work, and offers advice along the way.
Emerging Tech

Shipping crate filled with 3D-printing robots may be the future of construction

Autodesk has created a robot-filled shipping container which may represent the future of construction work. The crate contains two robots able to 3D print custom components for building sites.
Emerging Tech

Sticking these tiny needles in your eye may help fight blindness

An eye patch covered in tiny needles sounds like a torture device. In fact, it's a potential new medical treatment for eye diseases like glaucoma and macular degeneration. Here's how it works.
Emerging Tech

Bottle-flipping robots may be the most millennial thing we’ve ever seen

Until drones start vaping, you're unlikely to see anything more millennial than a recent contest in Japan in which robots competed to pull off some seriously impressive bottle-flipping feats.
Emerging Tech

New simulation shows how Elon Musk’s internet satellite network might work

Elon Musk has the dream of building a network for conveying internet traffic via thousands of satellites. A new simulation created by a computer scientist looks at how feasible the idea is.
Cars

Car parts maker ZF is using drones to deliver components to its factories

ZF recently became the first entity in Germany to receive approval to use drones to deliver spare parts, and the company now uses them to deliver parts from its central warehouses to its workshops.
Emerging Tech

Meet the 4K selfie drone that folds like a book, follows you like a paparrazzo

Having a drone that could follow you everywhere while taking high-quality images without crashing has been a flight of fantasy. With ZeroZero's Hover 2, not only can you have a fully autonomous 4K selfie drone, you can have it for $400.
Emerging Tech

These Alexa-stuffed retro phones don’t listen until you take them off the hook

Looking for an Amazon Echo with a cool vintage touch? Los Angeles-based Grain Design is taking old, non-working antique phones and transforming them into amazing Alexa smart speakers.