Skip to main content

AI is almost as smart as the average high schooler, at least when it comes to the SAT

Despite all the warnings of woe that accompany discussions of artificial intelligence and its potential for destroying humanity, we really don’t have anything to worry about … yet. Unless, of course, the mental capacity of an average high schooler is frightening to you. As per the latest collaboration between the Allen Institute for Artificial Intelligence (AI2) and the University of Washington, an AI system managed to score a 500 out of 800 on the math section of the SAT, slightly lower than the average score of 513 achieved by high school seniors. So while it’s impressive that AI can make it through the test at all, when it comes to outsmarting us, it’s probably not quite there yet.

A score of 500, which indicates around 49 percent accuracy, may not sound like much, especially considering computers are supposed to be wildly good at subjects like math — after all, it’s just computation, right? Wrong. What puts the AI system (named GeoS) head and shoulders above your standard computer is its ability to read the questions straight off the page, taking the test in the same way a human would. Whereas most computers are fed information in their own language, GeoS had to adapt not only to English, but also interpret the charts, graphs, and other data that one would find on the math section of the SAT. That 500 isn’t looking so shabby anymore, is it?

“Our biggest challenge was converting the question to a computer-understandable language,” Ali Farhadi, an assistant professor of computer science and engineering at the University of Washington and research manager at AI2, said in a statement. “One needs to go beyond standard pattern-matching approaches for problems like solving geometry questions that require in-depth understanding of text, diagram and reasoning.” But thanks to their hard work, the GeoS team has successfully created “the first automated system to solve unaltered SAT geometry questions by combining text understanding and diagram interpretation.”

In their paper detailing the results of their achievements, researchers explain, “Our method consists of two steps: interpreting a geometry question by deriving a logical expression that represents the meaning of the text and the diagram, and solving the geometry question by checking the satisfiablity of the derived logical expression.” While humans can complete these tasks (with varying levels of success) naturally, computers must be taught how to, well, think like a human.

“Much of what we understand from text and graphics is not explicitly stated, and requires far more knowledge than we appreciate,” AI2 CEO Oren Etzioni said in a press release. “Creating a system to be able to successfully take these tests is challenging, and we are proud to achieve these unprecedented results.” So sure, AI isn’t “intelligent” by standard definitions — not quite yet. But boy, is it getting close.

Editors' Recommendations

Lulu Chang
Former Digital Trends Contributor
Fascinated by the effects of technology on human interaction, Lulu believes that if her parents can use your new app…
Using smart sensors to monitor a hive reveals when bee colonies are in trouble

“What is this? A center for ants?” rages Derek Zoolander in one of the funniest and most quotable scenes of the original 2001 comedy Zoolander. Over at Canada’s Simon Fraser University, graduate student Oldooz Pooyanfar hasn’t exactly built a center for ants, but rather a smart home for bees -- which we reckon is every bit as cool. What Pooyanfar has built is a smart hive real-time monitoring system, intended to keep tabs on what thousands of bees in a series of hives are “saying” to one another.

This high-tech monitoring platform is placed along the wall of the hive she wants to analyze. It is fitted with a number of tiny sensors that are equipped with microphones (and, in the future, accelerometers, too) to monitor sound and vibration. The monitoring platform also keeps tabs on temperature and humidity using heat sensors. The smart system collects all of this data and then analyzes it looking for abnormalities, such as possible sickness or the death of the queen. If abnormalities are found, beekeepers are alerted so that they can instantly respond.

Read more
What do you get when you combine AI and a laser pointer? The best cat toy ever
ai powered laser cat toy device stand 2

If you’ve got a pet dog or cat at home, you almost certainly had the experience of having to leave it alone at some point when you go out to work.

That is what the folks behind a new Kickstarter campaign called Felik want to help with. They developed a smart device they describe as being a bit like a “Kinect for pets.” It combines a camera, computer vision algorithms, motion tracking, and artificial intelligence to keep your beloved cat or dog entertained (and therefore mentally active) with a laser pointer in your absence.

Read more
Duo smart mirror has ambitious plans for AI, its own app store, and more
duo mirror ai

Your mirror may not tell you who's the fairest of them all, but it soon might be able to tell you a few other things -- if your mirror is the Duo, that is. The AI-enabled, 27-inch smart mirror reportedly comes with built-in apps, its own app store, and natural language recognition. That's not to mention multitouch capabilities, connectivity to smart devices, and multi-user support. So if you need a friend in the morning, you don't have to talk to yourself in the mirror -- just talk to your mirror.
Duo, which is already available for pre-order, has ambitious plans for its smart home device, including native apps that will tell you all about the day's headlines, as well as play music (by way of the Spotify API). The company is also creating its own HomeOS platform, which is said to include lighting and temperature control for your whole house. There's also talk of an independent app store that will host apps made specifically for the connected mirror, as well as voice-controlled apps for popular platforms like Instagram, YouTube, and Giphy, so you can stay entertained while checking out your reflection.
While some of this may sound too good to be true, the company's co-founder and CEO Jack Kim reached out to assuage some of our fears. For one thing, although Duo doesn't appear on Lightspeed Venture Partners' portfolio, the VC giant is in fact helping to fund the project. As Kim told Digital Trends, "We're going through betaworks' voicecamp program, which co-invests with Lightspeed and Launch Capital. It's a relatively small investment so they don't list it in their portfolio."
Kim also cleared up another discrepancy in terms of the mirror's capability -- a video suggests that the Duo has 10-point multitouch, while its website suggests five-point multitouch. Kim explained, "HomeOS as an operating system is capable of up to 10-point multi-touch input. Our own hardware device provides five."
If you're interested in checking out the Duo, you may want to wait until October, when the product is supposed to go into production, to determine whether or not it's worth the $399 price tag.
Article updated on 4-14-2017 by Lulu Chang: Added responses to concerns from Duo CEO and co-founder Jack Kim.

Read more