Skip to main content

The birth of big data: How Simulmatics predicted the future 60 years ago

Technicians evaluate the UNIVAC computer system in 1951, which took up 352 square feet of floor space and ran at a then-astronomical rate of 2.25 megahertz. Getty

In the 1957 film Desk Set, Katherine Hepburn plays a reference librarian whose job is seemingly threatened by a “mechanical brain,” a room-sized computer named EMERAC. Though she assures her fellow researchers that no machine can do their jobs, her co-worker replies, “that’s what they said in payroll,” before half the workers were fired.

Two years after that movie premiered, a new company was founded, amid the uneasiness around automation. The Simulmatics Corporation, as it was called, was a consulting firm that promised with enough data, it could sway voters’ opinions and predict the outcome of elections. It also claimed it could apply the same methods to advertising, getting more people to buy a certain brand of soap or breakfast cereal.

If you’ve never heard of Simulmatics, it’s because it didn’t really succeed in its grand plans. But according to historian Jill Lepore, author of If Then: How the Simulmatics Corporation Invented the Future, its legacy lives on: “By the early twenty-first century, the mission of Simulmatics had become the mission of many corporations, from manufacturers to banks to predictive policing consultants. Collect data. Write code. Detect patterns. Target ads.”

A crack team

Simulmatics was up and running in early 1959 and bankrupt by August 1970. In the interim, it supplied reports to John F. Kennedy’s election campaign, tried to predict an election for The New York Times, attempted to stop communism in Vietnam, and claimed to be able to predict when race riots would occur.

Lepore compares hiring for the company to assembling a team for a bank heist. There was social scientist Bill McPhee, computer scientist Alex Bernstein, and Ithiel de Sola Pool, a political scientist. Bringing them all together was Ed Greenfield, “the huckster,” according to Lepore. He’d become enthralled with the idea of marrying computers and politics ever since 1952, when CBS employed a UNIVAC (Universal Automatic Computer) — and a prop version for the TV studio — to predict the election’s winner.

Two men work at different components of a large Univac computer in an office. Photo by Hulton Archive / Getty Images

Using a variety of poll data — of mixed quality, according to one skeptic — Simulmatics created simulations of voting behavior to test out different campaign strategies. McPhee, Pool, and the rest of the team took data from thousands of Gallup and Roper surveys to create 480 voter types, like “Midwestern, rural, Protestant, lower income, female.” They also cataloged the groups’ views on issues like McCarthyism and the hydrogen bomb. It took ages to create all the punch cards with the information from the polls and surveys, but afterward, the Simulmatics group could mine the data for answers to any of their queries and receive the results in about 40 minutes, simulating how these types would respond to the candidate taking different stances.

If Kennedy wanted to win, he needed to push a strong civil rights platform and actively bring up his Catholicism. Any anti-Catholic backlash would sway those concerned about prejudice — like Jewish voters — toward Kennedy, according to Simulmatics. To explain what they were doing to potential clients, employees would compare it to weather forecasting: “One can predict tomorrow’s weather best if one has not only current information but also historical information about patterns into which current reports can be fitted.”

The pitch worked. The New York Times briefly contracted with Simulmatics to interpret the 1964 election results in “real time,” a fairly new concept that meant there wasn’t a huge lag between results coming in and the computer’s analysis.

Greenfield figured the secret sauce didn’t need to just apply to elections. He also courted brands, saying Simulmatics could make consumer profiles similar to voter types. The U.S. Department of Defense’s Advanced Research Projects Agency requested a proposal on Simulmatics’ methods for “dealing with the problems of counter-insurgency.”

The flimflam machine

Despite Greenfield’s expertise in selling Simulmatics, the results didn’t always deliver. How or if anyone used its reports is murky. It’s a bit like how most people probably viewed UNIVAC at the time: Feed in the punch cards, get a result. What happens in between is alchemy. The New York Times canceled its contract with the company after some buggy trials leading up to the election. Instead of partnering with the corporation and giving up their precious data — which Simulmatics needed to make its models work — advertising agencies like BBDO decided to build their own.

In the mid-1960s, Simulmatics went to Vietnam to, in Pool’s view, predict and stop insurgency before it happened. To accomplish this, the company bought over an American team and hired Vietnamese interpreters to administer lengthy questionnaires, written in English, to villagers. The Vietnamese workers found that the questionnaire didn’t make much sense when translated, and Simulmatics didn’t explain the main goal of the research, which was to “assess what changes in information, attitudes, and behavior result from placing TV sets in Vietnamese villages.” An assessment of the research pointed out that the question was possible to ascertain unless the company researched every facet of Vietnamese life. “So far from being a way to study all things about all Vietnamese, Simulmatics’ research appeared to some people at ARPA as a way to study nothing at all,” writes Lepore.

“The fantasy of computer-aided riot prediction endured; that ongoing civil unrest and racial inequality and police brutality can be addressed by more cameras, more data, and more computers, and, above all, by predictive, what-if algorithms.”

Even Simulmatics’ seeming successes were a bit dubious. “It is not known what, if any, influence the Simulmatics simulation had in the development of Kennedy’s approach to the religious issue after August 25,” Thomas Morgan wrote in a 1961 Harper’s Magazine article about the company, adding, “It seems that, at most, the simulation may have lent some psychological support to those Kennedy strategists who favored its conclusions anyway.”

“It is true that Simulmatics did contribute some reports to the campaign, but it’s worth emphasizing that, even without the company’s advice, Kennedy’s team was savvy enough to adopt tactics that increased his appeal to Black voters and openly confronted the issue of his Catholicism,” Stephen Schlesinger wrote in a letter to The New Yorker after an expert from If Then was published. He’s the son of the son of historian Arthur Schlesinger, Jr., who wrote A Thousand Days: John F. Kennedy in the White House.

The future is then?

There’s a scene in Desk Set where Katherine Hepburn’s character describes seeing a demonstration of IBM’s computer, with its ability to translate Russian into Chinese. “Gave me the feeling that maybe, just maybe, people were a little bit outmoded,” she says. “Wouldn’t surprise me a bit if they stopped making them,” Spencer Tracey responds.

“When a machine takes the job of 10 men, where do those 10 men go?” Kennedy asked in 1960. The fears of automation were already present. As Lepore points out, many of the early jobs that computers replaced belonged to women — secretarial tasks like typing and filing.

Morgan’s story in Harper’s Magazine caused a bit of a stir, as it was meant to do. He was actually Simulmatics’ PR person, in addition to being a freelance writer. But in the piece he raised all kinds of questions that people are still asking today: “As we seek more and more data for the machines, can we maintain our traditions of privacy?” he wrote.

Image used with permission by copyright holder

Lepore describes the men of Simulmatics as “midcentury white liberals” who raised money for causes like civil rights. They started out well-intentioned, but those intentions looked very different in the villages of Vietnam and the streets of Rochester, New York, where they wanted to quell riots.

In a letter to his son, Pool wrote, “I’m privy to all kinds of information that you can’t possibly know. So there’s no point in arguing because your opinion is uninformed; we’re not coming from positions of equal knowledge.” Pool would go on to predict social networks, information bubbles, and the transition to storing everything from tax returns to school transcripts on computers. “Pool predicted so accurately because he knew so much,” writes Lepore.

But Pool’s attitude toward his son — that because he had a different experience, his point of view didn’t matter — endured, too. The problem is that Simulmatics, in trying to smother revolutions and riots, wanted to halt a chemical reaction instead of looking at the elements that caused it.

After a series of riots in the mid-1960s, President Lyndon B. Johnson appointed the Kerner Commission to investigate their causes. Simulmatics provided information on the media’s response to these riots. But the panel’s main finding was that housing discrimination, voter suppression, and education and employment inequalities were creating “two societies, one black, one white — separate and unequal.” The report establishing programs that would require  “unprecedented levels of funding and performance, but they neither probe deeper nor demand more than the problems which called them forth. There can be no higher priority for national action and no higher claim on the nation’s conscience.”

But Johnson didn’t provide that funding, and, as Lepore writes, “the fantasy of computer-aided riot prediction endured” in the belief “that ongoing civil unrest and racial inequality and police brutality can be addressed by more cameras, more data, and more computers, and, above all, by predictive, what-if algorithms.”

Editors' Recommendations

Topics
Jenny McGrath
Former Digital Trends Contributor
Jenny McGrath is a senior writer at Digital Trends covering the intersection of tech and the arts and the environment. Before…
Best deal ever? Get 80% off PureVPN and an Uber Eats voucher
A close-up of a computer monitor displaying a generic VPN.

Everyone should sign up to a virtual private network, so if you're looking for VPN deals, here's one that you wouldn't want to miss -- two years plus three extra months of PureVPN's Max Plan at 80% off for just $4 per month, for a total of $108 for 27 months. That's $16 in savings per month for dependable online protection, and to top it off, you'll be getting an Uber Eats voucher worth up to $30. We're not sure how much time is remaining on this offer though, so if you're interested, you're going to have to sign up for the subscription immediately.

Why you should sign up for PureVPN Max Plan
A VPN is a necessity in this digital age because it will protect your data from being accessed by cybercriminals. It will also help you get around any geoblocking restrictions as you can have your device appear as if it's located in another part of the world. PureVPN is one of the best VPNs for these purposes, as it uses a global network of more than 6,500 servers that are located across dozens of countries.

Read more
Razer’s most boring product is also one of its best
The Razer Iskur V2 gaming chair in an office.

Razer isn't exactly known for subtlety. This is the company that released a Bane-like RGB face mask, a headset with haptic feedback, and most recently, a mouse pad that has RGB lighting from corner to corner. The Iskur V2 chair is an exercise in subtlety, however, and a change of pace that pays off for Razer in a big way.

There's nothing special about the Iskur V2 at first glance. It's a gaming chair fit with the usual racer-style back and some green trim to let you know it's a Razer product. But there are no motors promising immersive haptic feedback, and no RGB leaving you tethered to a wall outlet (yes, Razer has done both in a chair before). The Iskur V2 is just a well-designed, comfortable chair, and that's exactly why it's so impressive.
Out of the box

Read more
Best OLED monitor deals: Get an OLED screen from just $450
Marvel's Spider-Man running on the Samsung Odyssey OLED G8.

Up to a couple of years ago, OLED technology only really existed in OLED TVs and very-high-end monitors that cost thousands and thousands of dollars. Luckily, the prices have come down quite substantially, even on the best OLED monitors, especially as the market gets more saturated with options. That means that if you tend to use a monitor for the majority of your content consumption, such as gaming, then you can grab an OLED monitor for a great price and experience amazing visual fidelity and reproduction.

To that end, we've gone out and scoured all the major retailers and brands to find our favorite OLED monitor deals out there and compiled them below. That said, if you haven't quite found what you're looking for, or feel you aren't ready for an OLED monitor, be sure to check out some of these other great monitor deals.
LG UltraGear 27-inch gaming monitor -- $660, was $1,000

Read more