Skip to main content

3D motion technology lets wheelchair users move with the wink of an eye

brazil brain control wheelchair facial
Controlling a wheelchair is hard enough when you have full operation of your hands. It is next to impossible if you have a condition such as cerebral palsy, which makes it difficult to move your hands with precision. Researchers from Brazil may have a solution that allows for this precision movement — an interface that controls the wheelchair using facial, head, or iris movements.

The team began its work on the wheelchair in 2011 by exploring the feasibility of using brain-computer-interface technology to bridge the gap between the brain and the wheelchair. After studying the problem on paper, the team decided to work first on controlling the wheelchair using external cues instead of the more complicated brain-control interface. Researchers built their first prototype using a standard motorized wheelchair that was modified using sensors and cameras. The team first removed the joystick typically used to control the movement of the chair and replaced it with a suite of sensors that could both detect variations in floor surface and measure the distance of objects and walls surrounding the wheelchair.

Related Videos

Once the chair hardware modifications were complete, the researchers designed a control interface that used a 3D camera with RealSense technology. Similar to Microsoft Kinect for the Xbox, RealSense receives input from a depth-sensing camera that monitors facial and body expressions. These expressions are then translated by the system into commands to control the wheelchair.

“The camera can identify more than 70 facial points around the mouth, nose and eyes. By moving these points, it is possible to get simple commands, such as forward, backward, left or right and, most importantly, stop,” says researcher Eleri Cardozo.

As an added benefit, the wheelchair also is equipped with Wi-Fi and a remote control feature that allows a caregiver to control the wheelchair over an internet connection. When the wheelchair user gets tired, the caregiver can take over control of the chair and guide the occupant to a safe spot. After successfully receiving additional funding, the team now is working on adding BCI technology to the wheelchair setup. The team plans to eventually sell its wheelchair commercially in Brazil for less than R$14,000, or $4,000 U.S.

Editors' Recommendations

NASA’s ‘Refabricator’ lets astronauts recycle 3D-printed tools to make new ones
refabricator 3d printing recycling iss etu photo 3 04 27 17

Christmas has come and gone, but that hasn’t stopped the International Space Station from gifting itself a pretty awesome new gadget to usher in 2019 in style. Called the Refabricator, it’s an integrated recycler and 3D printer that was just installed onboard the ISS. It is designed to turn recyclable plastics into 3D printable material.

“The Refabricator is key in demonstrating a sustainable model to fabricate, recycle, and reuse parts and waste materials on extended space exploration missions,” said Niki Werkheiser, manager of in-space manufacturing at NASA's Marshall Space Flight Center in Huntsville, Alabama.

Read more
Nintendo eye-tracking patent hints at 3D gaming on the Switch
Nintendo Switch review

Nintendo may have abandoned true 3D gaming with the 2DS and the Switch, but it appears the company isn't finished with the technology entirely. A patent application just published in January points to Nintendo's potential plans to turn your television into the ultimate 3D gaming display.

Published by the United States Patent and Trademark Office on January 24, a patent application for "Eye Tracking Enabled 3D Viewing" was filed by Nintendo back in September 2018, with the goal of providing a device that can see where users are looking in order to deliver the optimal 3D viewing angle.

Read more
Sony’s new 3D tech push isn’t for TVs — it’s for our phones
Honor View 20 review

Sony's IMX586 camera and a 3D sensor on the back of the Honor View 20 smartphone. Andy Boxall/Digital Trends

Sony is hyping up 3D technology. We know what you’re thinking -- the last time we were told 3D would change our lives, the powers that be were mistaken. However, this time things could be different, as the 3D itself is not on our televisions, but in our phones. Sony has started to push new, improved 3D sensors for better-than-ever face unlocking, plus more depth and new features to make the growing world of mobile augmented reality way more compelling.

Read more