Eye-tracking could help readers by noticing when they struggle with a word

eye tracking reader help human
Marcos Osorio Cecilia/123rf
Eye-tracking technology could be used to help readers struggling with certain words, claims new research from the University of Copenhagen.

With so-called “gaze data” now recordable using everyday PCs, tablets, and smartphones, the research offers a new way of using technology to help people who may be trying to learn a new language, or who are seeking to improve their reading skills in some other way.

“It’s easy to imagine a program in the classroom that, instead of waiting for a teacher to intervene, could learn when to pop up suggested translations or synonyms if a student struggles with a particular word,” Ph.D. researcher Sigrid Klerke told Digital Trends.

Klerke’s work uses computer vision and machine learning technology to recognize people’s eyes as they move across a piece of text. Impressively, it can determine from this movement which words a person is likely reading on a document.

“What the eye-tracking does is to use a recording of your eyes to make a geometrical calculation about which point on the screen your eyes are fixating on at a particular moment,” Klerle said. “For reading, we can pretty accurately work out where your eyes are going to have to be in order to make sense of a certain piece of text. That’s because you can only see 1-2 degrees of the central visual field in sharp detail. As a result, people have to continuously move their eyes along a line of text in order to be able to read all the words.”

Klerke’s work builds on the observation that eyes fixate repeatedly on words or sentences that are difficult. Her research eschews building a general model to fit all readers in favor of one that is customized to each individual reader: thereby absorbing all of the personal quirks we might exhibit when we read.

Based on just a few short seconds of recorded gaze data, the model can then accurately predict whether a word is one that a person is having trouble with. As she said, “I’ve taught a machine to look at someone’s gaze and to be able to recognize stumbling behavior.”

It’s not just reading apps where this could have application, either. Klerke said that her research could also be used by services like Google Translate to suggest whether particular translations may be faulty. If a large number of French speakers struggle with a particular word or phrase when Google translates another language into French, it may suggest the translation needs to be improved.

“Our eyes can tell us a lot,” Klerke concluded. “People don’t always know if a particular word is taking more energy for them to process. There are some easy cases where it’s obvious, but others where it is much harder. In some of these cases, our eyes will reveal this without a person having to be aware of it consciously.”

Movies & TV

Out of movies to binge? Our staff picks the best flicks on Hulu right now

From classics to blockbusters, Hulu offers some great films to its subscribers. Check out the best movies on Hulu, whether you're into charming adventure tales or gruesome horror stories.
Home Theater

The best movies on Netflix in December, from 'Buster Scruggs’ to endangered cats

Save yourself from hours wasted scrolling through Netflix's massive library by checking out our picks for the streamer's best movies available right now, whether you're into explosive action, witty humor, or anything else.

This list of PlayStation 4 exclusives puts its competitors to shame

The PlayStation 4's game library and incredible selection of exclusive games could make anyone with an Xbox One or Nintendo Switch think twice. Here's our list of the latest and greatest PS4 exclusives.
Emerging Tech

Feast your eyes on the wildest, most elaborate Rube Goldberg machines ever built

Want to see something totally mesmerizing? Check out several of the best Rube Goldberg machines from across the internet, including one that serves cake and other that do ... nothing particularly useful.
Emerging Tech

The 20 best tech toys for kids will make you wish you were 10 again

Looking for the perfect toy or gadget for your child? Thankfully, we've rounded up some of our personal favorite tech toys, including microscopes, computer kits, and a spherical droid from a galaxy far, far away.
Emerging Tech

Scoot your commute! Here are the 9 best electric scooters on the market

Electric scooters are an affordable, convenient way to minimize your carbon footprint and zip around town. Check out 8 of our current favorites, whether you're working with a budget or have some cash to spare.

Has Columbus, Ohio raised its IQ yet? A progress report from the mayor

Two years ago, the city of Columbus in Ohio received $40 million to pursue smart city initiatives. So, what’s happened since then? We spoke with its mayor, Andrew Ginther, to discuss progress and what’s ahead.
Emerging Tech

Sick of walking everywhere? Here are the best electric skateboards you can buy

Thanks for Kickstarter and Indiegogo, electric skateboards are carving a bigger niche than you might think. Whether you're into speed, mileage, or something a bit more stylish, here are the best electric skateboards on the market.
Emerging Tech

Hear the sounds of wind on Mars from InSight’s latest audio recording

NASA's InSight craft has captured the sound of the wind blowing on the surface of Mars. The audio file was picked up by the air pressure sensor and the seismometer which detected vibrations from the 10 to 15 mph winds in the area.
Emerging Tech

Awesome Tech You Can’t Buy Yet: Folding canoes and ultra-fast water filters

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!
Emerging Tech

New experiment casts doubt on claims to have identified dark matter

A South Korean experiment called COSINE-100 has attempted to replicate the claims of dark matter observed by the Italian DAMA/LIBRA experiment, but has failed to replicate the observations.
Emerging Tech

White dwarf star unexpectedly emitting bright ‘supersoft’ X-rays

NASA's Chandra Observatory has discovered a white dwarf star which is emitting supersoft X-rays, calling into question the conventional wisdom about how X-rays are produced by dying stars.

Amazon scouted airport locations for its cashier-free Amazon Go stores

Representatives of Amazon Go checkout-free retail stores connected with officials at Los Angeles and San Jose airports in June to discuss the possibility of cashier-free grab-and-go locations in busy terminals.
Emerging Tech

Full-fledged drone delivery service set to land in remote Canadian community

Some drone delivery operations seem rather crude in their execution, but Drone Delivery Canada is building a comprehensive platform that's aiming to take drone delivery to the next level.