Skip to main content

Eye-tracking glasses reveal what master pianists look at while they play

What Does a Pianist See? | Eye Tracking - Episode 1
Ever wanted to experience what it is like to be a master pianist tickling the ivories? A new video gives a sense of what that might feel like, while also demonstrating a few fundamental differences between a true master and a very good student.

The video is an experiment using a pair of wearable eye-tracking glasses made by Tobii Pro, the global leader in eye-tracking research. Entitled “What Does a Pianist See?” it’s the first episode in a new online video series designed to show how the technology — that is able to show exactly where people are looking when they perform actions — can be used as a training (or learning) tool.

“The big difference we found with the expert pianist is that they stay looking in the center,” Patrick Adelman, co-founder of the video maker Fractal Media, told Digital Trends. “They don’t need to look at where their fingers are moving all the time. On the other hand, the student’s eyes constantly go all over the keyboard to find where her fingers needed to go. The same is true when you look at how they read sheet music and whether or not they need to keep looking at the music, then down at the keyboard.”

Breaking that down in terms of figures, the expert pianist spent approximately 83 percent of the time looking at sheet music, compared to the “novice” who spent 58 percent of the time looking at the music. The expert also scanned ahead vertically and horizontally, meaning that they were able to mentally stay a few steps ahead.

Piano playing is not the only use-case made possible by Tobii Pro’s eye-tracking wearable, of course.

Image used with permission by copyright holder

“This product is really the first time that it’s been possible to take eye-tracking technology out of the lab and into real contexts,” Mike Bartels, U.S. Research Director for Tobii Pro, told Digital Trends. “Because of that, we’re seeing a lot of interest in fields like sports research. You can’t tell much about how a basketball player shoots free throws if they’re sitting in a laboratory; you have to have them actually on the court. Other applications include media research, where traditionally you’d have to bring people to a research facility to study how they pay attention to adverts, for example. Now we can send this technology home with people, so they can wear it while they’re going about their daily lives. If you want to capture natural behavior, you have to allow people to be in natural contexts, rather than being tested in a lab.”

Whether eye-tracking glasses eventually become mainstream technology remains to be seen, but it’s certainly a fascinating demonstration of how tech can reveal valuable insights about a range of disciplines.

Now if you will excuse us, we have some piano practice to get back to!

Luke Dormehl
Former Digital Trends Contributor
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
The 11 best Father’s Day deals that you can get for Sunday
Data from a workout showing on the screen of the Apple Watch Series 8.

Father's Day is fast approaching and there's still time to buy your beloved Dad a sweet new device to show him how much you love him. That's why we've rounded up the ten best Father's Day tech deals going on right now. There's something for most budgets here, including if you're able to spend a lot on your loved one. Read on while we take you through the highlights and remember to order fast so you don't miss out on the big day.
Samsung Galaxy Tab A8 -- $200, was $230

While it's the Plus version of the Samsung Galaxy Tab A8 that features in our look at the best tablets, the standard variety is still worth checking out. Saving your Dad the need to dig out their laptop or squint at a small phone screen, the Samsung Galaxy Tab A8 offers a large 10.5-inch LCD display and all the useful features you would expect. 128GB of storage means plenty of room for all your Dad's favorite apps as well as games too. A long-lasting battery and fast charging save him the need for a power source too often too.

Read more
The Apollo wearable is proven to help you sleep better (and it’s on sale)
Apollo wearable worn during sleep in bed.

This content was produced in partnership with Apollo Neuro.
Stress, anxiety, and insomnia are all concerning things that just about everyone struggles with at one time or another. Maybe you can sleep, fending off insomnia, but you lack quality sleep and don’t feel rested in the morning. Or, maybe when it’s time to kick back and relax, you just can’t find a way to do so. There are many solutions for these issues, some work, and others don’t, but one unlikely area of support can be found in a modern, smart wearable.

Medicine is the obvious choice, but not everyone prefers to go that route. There is an answer in modern technology or rather a modern wearable device. One such device is the Apollo wearable, which improves sleep and stress relief via touch therapy. According to Apollo Neuro, the company behind the device, which is worn on your ankle, wrist or clipped to your clothing, it sends out waves of vibrations to help your body relax and reduce feelings of stress. It's an interesting new approach to a common problem that has typically been resolved via medicine, therapy, or other more invasive and time-consuming techniques. The way it utilizes those vibrations, uniquely placed and administered, to create a sense of peace, makes us ask, can it really cure what ails us? We’ll dig a little deeper into how it achieves what it does and what methods it’s using to make you feel better.

Read more
What comes after Webb? NASA’s next-generation planet-hunting telescope
An illustration shows how NASA's Habitable Worlds Observatory would measure the atmosphere of distant planets.

When it comes to building enormous, complex space telescopes, agencies like NASA have to plan far in advance. Even though the James Webb Space Telescope only launched recently, astronomers are already busy thinking about what will come after Webb — and they've got ambitious plans.

The big plan for the next decades of astronomy research is to find habitable planets, and maybe even to search for signs of life beyond Earth. That's the lofty goal of the Habitable Worlds Observatory, a space telescope currently in the planning phase that is aimed at discovering 25 Earth-like planets around sun-like stars.

Read more