Skip to main content

I turned my face into a game controller, and you can too

At Google I/O, AI was a theme throughout the event, but another game-changing assistive technology was announced that lets your face control a computer instead of using a mouse. Google’s Project GameFace literally turns your face into a game controller. If even the best mouse or trackball is prving difficult or impossible, this free app can significantly improve your computing experience.

Alan Truly tries Project Gameface while watching Lance Carr.
Alan Truly tries Project GameFace while watching Lance Carr. Image used with permission by copyright holder

Google’s blog post describes how Project GameFace was inspired by the plight of video game streamer Lance Carr, who has muscular dystrophy. A fire led to the loss of Carr’s expensive head-tracking mouse, which had allowed him to keep gaming.

Google worked with Carr to develop Project GameFace, a solution that uses a standard webcam and works on any Windows PC. You can download the app from the GitHub project or fork, and customize it for your own particular needs if you know Python.

I installed and tried it. My built-in webcam worked for pointer control, but was too blown out by a nearby window to detect my eyebrows and mouth well. I hooked up an Insta360 Link, which includes face-tracking technology to pan and tilt as I move around. The two technologies blended seamlessly and everything worked great after some fine-tuning.

The cursor speed was much too fast, so I dropped from the default setting of 40 to 15 vertically and 20 horizontally. With these adjustments, I could move my mouse pointer to any point on my screen simply by turning and tilting my head. This isn’t eye-tracking. It seems to follow my nose.

Google's Project Gameface has adjustments for cursor speed.
Google’s Project GameFace has adjustments for cursor speed. Image used with permission by copyright holder

The app recognizes six face gestures: open mouth, mouth left and right, raise left and right eyebrow, and lower right eyebrow. It’s unclear why Lower left eyebrow isn’t an option. These gesture settings, combined with head movement for directional control, make it relatively easy to bind keys and mouse clicks, allowing you to play a game or control a computer with only your face.

There’s plenty of room for improvement here. Ideally, groups of gesture bindings and cursor speeds should be saved for each app so you don’t have to find a single configuration that works for everything. It would also be more convenient to require a confirmation click, with a countdown to revert, after adjusting cursor speed. It took me a few minutes to tame my wild mouse pointer when I first switched on face tracking.

Overall, Project GameFace is a wonderful adaptation that should make life much easier for many people who could otherwise struggle to navigate a computer or play a game. More tech companies should be taking advantage of gesture control enabled by a webcam.

Editors' Recommendations

Alan Truly
Computing Writer
Alan is a Computing Writer living in Nova Scotia, Canada. A tech-enthusiast since his youth, Alan stays current on what is…
What is an RSS feed? Here’s why you should still use one
A person using a HP ENVY x360 2-in-1 15.6-inch Touch-Screen Laptop sitting on a bed.

With so much new content on the web added daily, it can be tough to keep up with what's happening online. People try several different ways, including visiting specific websites every day, doing Google searches, or relying on social media to keep them informed. One solution that sometimes gets overlooked is an old-school one: The RSS feed.

What is an RSS feed? It's a technology that has influenced many modern internet tools you're familiar with, and its streamlined, algorithm-free format could make it your next great tool for reading what you want online.
What is RSS?

Read more
Best laptop deals: Save on HP, Lenovo, Dell and Apple
Asus ROG Zephyrus M16 playing Cyberpunk 2077.

Buying a new laptop can be very daunting, especially with how saturated the market is with dozens of options from nearly a dozen brands and various configurations of each of those laptops. Even worse is trying to navigate the maze of available laptop deals across various retailers, and for those who don't want to do all that legwork, you're in luck! We've used our experience to collect the best deals in various categories to ensure you get the best bang for your buck. All you need to do is have a general sense of what specs or brand you want, and we'll likely have a deal for it listed below.

Best Laptop Deals

Read more
M2 MacBook Air vs. M1 MacBook Air: things have changed
A man holds the new Macbook Air (2022) in his hands.

The Apple MacBook Air M1 has been among our favorite MacBooks for some time now, and it's even held a place on our list of the best laptops overall. The new MacBook Air M2 is a significant redesign, bringing with it a new chassis and Apple's latest M2 processor.

Sometimes, it's easy to recommend the new model over the old one, especially when the new model brings significant improvements. The M2 MacBook Air qualifies, as it feels a lot more like a completely new model than a simple replacement of the old one. While Apple continues to sell the original M1 MacBook Air at a lower price, the M2 MacBook Air can often be had for only a little more money. That makes the choice between them a lot easier.
Specs
 

Read more