Eye-tracking glasses reveal what master pianists look at while they play

Ever wanted to experience what it is like to be a master pianist tickling the ivories? A new video gives a sense of what that might feel like, while also demonstrating a few fundamental differences between a true master and a very good student.

The video is an experiment using a pair of wearable eye-tracking glasses made by Tobii Pro, the global leader in eye-tracking research. Entitled “What Does a Pianist See?” it’s the first episode in a new online video series designed to show how the technology — that is able to show exactly where people are looking when they perform actions — can be used as a training (or learning) tool.

“The big difference we found with the expert pianist is that they stay looking in the center,” Patrick Adelman, co-founder of the video maker Fractal Media, told Digital Trends. “They don’t need to look at where their fingers are moving all the time. On the other hand, the student’s eyes constantly go all over the keyboard to find where her fingers needed to go. The same is true when you look at how they read sheet music and whether or not they need to keep looking at the music, then down at the keyboard.”

Breaking that down in terms of figures, the expert pianist spent approximately 83 percent of the time looking at sheet music, compared to the “novice” who spent 58 percent of the time looking at the music. The expert also scanned ahead vertically and horizontally, meaning that they were able to mentally stay a few steps ahead.

Piano playing is not the only use-case made possible by Tobii Pro’s eye-tracking wearable, of course.

eye tracking video piano player 1195 tobiipro glasses2 tech specs 3 2

“This product is really the first time that it’s been possible to take eye-tracking technology out of the lab and into real contexts,” Mike Bartels, U.S. Research Director for Tobii Pro, told Digital Trends. “Because of that, we’re seeing a lot of interest in fields like sports research. You can’t tell much about how a basketball player shoots free throws if they’re sitting in a laboratory; you have to have them actually on the court. Other applications include media research, where traditionally you’d have to bring people to a research facility to study how they pay attention to adverts, for example. Now we can send this technology home with people, so they can wear it while they’re going about their daily lives. If you want to capture natural behavior, you have to allow people to be in natural contexts, rather than being tested in a lab.”

Whether eye-tracking glasses eventually become mainstream technology remains to be seen, but it’s certainly a fascinating demonstration of how tech can reveal valuable insights about a range of disciplines.

Now if you will excuse us, we have some piano practice to get back to!

Cars

How General Motors is preparing for an electric, autonomous, connected future

How does an established automaker like General Motors adapt to new tech trends? By looking for people and solutions outside the mainstream, says Ken Kelzer, GM VP of global vehicle components and subsystems.
Movies & TV

The best shows on Netflix in October, from 'Mindhunter’ to ‘The Good Place’

Looking for a new show to binge? Lucky for you, we've curated a list of the best shows on Netflix, whether you're a fan of outlandish anime, dramatic period pieces, or shows that leave you questioning what lies beyond.
Home Theater

Need more contrast in your life? Here’s what you need to know about HDR TVs

So what is HDR TV? In a nutshell, it’s the best thing to happen to TV since the arrival of 4K. Here's everything you need to know about the technology, what it can do, and why it’s a must-have.
Computing

The sequel to the Pixelbook is coming. Here's what we know about it

What will the Pixelbook 2 be like? Google hasn't even announced it but thanks to rumors and leaks, we think we have a pretty good idea of what the potential new flagship Chromebook will be like.
Emerging Tech

Leafy greens are grown by machines at new, automated Silicon Valley farm

Farming hasn't changed too much for hundreds of years. Now a new startup called Iron Ox has opened its first automated hydroponics farm, producing a variety of leafy greens tended by machines.
Emerging Tech

Awesome Tech You Can’t Buy Yet: DIY smartphones and zip-on bike tires

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!
Gaming

As deaf gamers speak up, game studios are finally listening to those who can’t

Using social media, personal blogs and Twitch, a small group of deaf and hard-of-hearing players have been working to make their voices heard and improve accessibility in the gaming industry.
Emerging Tech

From flying for fun to pro filmmaking, these are the best drones you can buy

In just the past few years, drones have transformed from a geeky hobbyist affair to a full-on cultural phenomenon. Here's a no-nonsense rundown of the best drones you can buy right now, no matter what kind of flying you plan to do.
Emerging Tech

Get your head in the clouds with the best vaporizers for flower and concentrates

Why combust dead plant matter when you could vaporize the good stuff and leave the leaves behind? Here's a rundown of the best vaporizers money can buy, no matter what your style is.
Emerging Tech

Here’s all the best gear and gadgetry you can snag for $100 or less

A $100 bill can get you further than you might think -- so long as you know where to look. Check out our picks for the best tech under $100, whether you're in the market for headphones or a virtual-reality headset.
Emerging Tech

What the heck is machine learning, and why is it everywhere these days?

Machine learning has been responsible for some of the biggest advances in artificial intelligence over the past decade. But what exactly is it? Check out our handy beginner's guide.
Emerging Tech

Here are the best (and least likely to explode) hoverboards you can buy

With widespread reports of cheap, knock-off Chinese hoverboards exploding, these self-balancing scooters may be getting a rough reputation. They're not all bad, though. Ride in style with our picks for the best -- and safest -- hoverboards
Emerging Tech

Boston Dynamics is trying to make fetch happen with its new working robot dog

Boston Dynamics wants to see Spot in the workplace, but not as part of take-your-dog-to-work days. Quite the opposite, in fact, as the technology company believes its extraordinary robo-dog is now ready to start work.
Emerging Tech

With cameras that know dogs from Dodges, Honda is making intersections safer

Honda and the city of Marysville, Ohio are working on creating a smart intersection. The goal would not only help better direct the flow of traffic, it could also help save the lives of pedestrians and cyclists.