AI is almost as smart as the average high schooler, at least when it comes to the SAT

ai
Pixabay
Despite all the warnings of woe that accompany discussions of artificial intelligence and its potential for destroying humanity, we really don’t have anything to worry about … yet. Unless, of course, the mental capacity of an average high schooler is frightening to you. As per the latest collaboration between the Allen Institute for Artificial Intelligence (AI2) and the University of Washington, an AI system managed to score a 500 out of 800 on the math section of the SAT, slightly lower than the average score of 513 achieved by high school seniors. So while it’s impressive that AI can make it through the test at all, when it comes to outsmarting us, it’s probably not quite there yet.

A score of 500, which indicates around 49 percent accuracy, may not sound like much, especially considering computers are supposed to be wildly good at subjects like math — after all, it’s just computation, right? Wrong. What puts the AI system (named GeoS) head and shoulders above your standard computer is its ability to read the questions straight off the page, taking the test in the same way a human would. Whereas most computers are fed information in their own language, GeoS had to adapt not only to English, but also interpret the charts, graphs, and other data that one would find on the math section of the SAT. That 500 isn’t looking so shabby anymore, is it?

“Our biggest challenge was converting the question to a computer-understandable language,” Ali Farhadi, an assistant professor of computer science and engineering at the University of Washington and research manager at AI2, said in a statement. “One needs to go beyond standard pattern-matching approaches for problems like solving geometry questions that require in-depth understanding of text, diagram and reasoning.” But thanks to their hard work, the GeoS team has successfully created “the first automated system to solve unaltered SAT geometry questions by combining text understanding and diagram interpretation.”

In their paper detailing the results of their achievements, researchers explain, “Our method consists of two steps: interpreting a geometry question by deriving a logical expression that represents the meaning of the text and the diagram, and solving the geometry question by checking the satisfiablity of the derived logical expression.” While humans can complete these tasks (with varying levels of success) naturally, computers must be taught how to, well, think like a human.

“Much of what we understand from text and graphics is not explicitly stated, and requires far more knowledge than we appreciate,” AI2 CEO Oren Etzioni said in a press release. “Creating a system to be able to successfully take these tests is challenging, and we are proud to achieve these unprecedented results.” So sure, AI isn’t “intelligent” by standard definitions — not quite yet. But boy, is it getting close.

Product Review

There’s almost nothing bad to say about the Mi Mix 3, but you still shouldn’t buy it

The Xiaomi Mi Mix 3 is good-looking, really well made, packed with features, and is a powerful, modern, desirable smartphone. But you probably shouldn’t buy it. Why? Nothing wrong with the device itself, but Xiaomi itself is mostly to…
Deals

Looking for a Chromebook? The Google PixelBook just got a $200 price cut

Once relatively obscure, Chromebooks have come into their own in a big way in recent years. One of our favorites is the super-sleek Google Pixelbook, and it's on sale right now from Amazon for $200 off, letting you score this premium laptop…
Deals

The best Nintendo Switch deals and bundles for March 2019

Looking to score Nintendo's latest console? We've smoked out the best Nintendo Switch deals right here, including discounts on bundles that feature must-have games like Super Mario Odyssey, Super Smash Bros. Ultimate, and Zelda: Breath of…
Computing

Edit, sign, append, and save with six of the best PDF editors

Though there are plenty of PDF editors to be had online, finding a solution with the tools you need can be tough. Here are the best PDF editors for your editing needs, no matter your budget or operating system.
Emerging Tech

Scientists use drone to map Icelandic cave in preparation for Mars exploration

Researchers from the SETI Institute and Astrobotic Technology have demonstrated a way that astronauts may be able to map Martian caves using a Lidar-equipped drone that can travel autonomously without GPS.
Emerging Tech

A 3D printer the size of a small barn will produce entire homes in Saudi Arabia

If you’re looking for a 3D printer that can comfortably fit on the side of your desk… well, Danish company Cobod International’s enormous new 3D house printer probably isn’t for you.
Deals

Need a ride? Amazon is slashing prices on popular electric scooters

If you’re not much of a cyclist or if you’re looking for a lazier way to zip about town, an electric scooter should be right up your alley. Two of our favorites, the foldable Glion Dolly and the eco-friendly Razor scooter, are on sale…
Emerging Tech

Unexpected particle plumes discovered jetting out of asteroid Bennu

The OSIRIS-REx craft traveled to asteroid Bennu last year and won't return until 2023. But the mission is already throwing up unexpected findings, like plumes of particles which are being ejected from the surface of the asteroid.
Emerging Tech

Trip to Neptune’s moon, Triton, could inform search for extraterrestrial life

NASA has proposed sending a craft to Neptune to study its largest moon, Triton. Studying Triton could offer clues to how liquid water is maintained on planets, which may indicate what to look for when searching for life beyond our planet.
Emerging Tech

NASA’s Mars 2020 rover passes its tests with flying colors

The Mars 2020 rover team has been undertaking a series of tests to see if the craft will be able to launch, navigate, and land on the Red Planet. Called Systems Test 1, or ST1, these tests represent the first test drive of the new rover.
Outdoors

Light up the night! Here are the five best headlamps money can buy

Headlamps make all the difference when camping or walking the dog at night, especially when you're in need of both hands. From Petzl to Tikkid, here are some of the best headlamps on the market.
Emerging Tech

A hive of activity: Using honeybees to measure urban pollution

According to a new study from Vancouver, bees could help us understand urban pollution. Scientists have found an innovative way to measure the level of source of pollution in urban environments: by analyzing honey.
Emerging Tech

Spacewalk a success as astronauts upgrade batteries on the ISS

The International Space Station was treated to some new batteries on Friday, thanks to two NASA astronauts who took a spacewalk for nearly seven hours in order to complete the upgrades.
Emerging Tech

Awesome Tech You Can’t Buy Yet: Robotic companions and computer-aided karaoke

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it's fun to gawk!